Nov 10 17:40:07 user nova-compute[75100]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75100) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75100) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75100) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 10 17:40:07 user nova-compute[75100]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:40:07 user nova-compute[75100]: INFO nova.virt.driver [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 10 17:40:07 user nova-compute[75100]: INFO nova.compute.provider_config [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] Acquiring lock "singleton_lock" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] Acquired lock "singleton_lock" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] Releasing lock "singleton_lock" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] Full set of CONF: {{(pid=75100) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] ******************************************************************************** {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] Configuration options gathered from: {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] ================================================================================ {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] allow_resize_to_same_host      = True {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] arq_binding_timeout            = 300 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] backdoor_port                  = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] backdoor_socket                = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] block_device_allocate_retries  = 300 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] block_device_allocate_retries_interval = 5 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] cert                           = self.pem {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] compute_monitors               = [] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] config_dir                     = [] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] config_drive_format            = iso9660 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] config_source                  = [] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] console_host                   = user {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] control_exchange               = nova {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] cpu_allocation_ratio           = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] daemon                         = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] debug                          = True {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] default_access_ip_network_name = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] default_availability_zone      = nova {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] default_ephemeral_format       = ext4 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] default_green_pool_size        = 1000 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] default_schedule_zone          = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] disk_allocation_ratio          = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] enable_new_services            = True {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] enabled_apis                   = ['osapi_compute'] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] enabled_ssl_apis               = [] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] flat_injected                  = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] force_config_drive             = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] force_raw_images               = True {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] graceful_shutdown_timeout      = 5 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] heal_instance_info_cache_interval = 60 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] host                           = user {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] instance_build_timeout         = 0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] instance_delete_interval       = 300 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] instance_name_template         = instance-%08x {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] instance_usage_audit           = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] instance_usage_audit_period    = month {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] internal_service_availability_zone = internal {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] key                            = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] live_migration_retry_count     = 30 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] log_config_append              = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] log_dir                        = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] log_file                       = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] log_options                    = True {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] log_rotate_interval            = 1 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] log_rotate_interval_type       = days {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] log_rotation_type              = none {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] long_rpc_timeout               = 1800 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] max_concurrent_builds          = 10 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] max_concurrent_live_migrations = 1 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] max_concurrent_snapshots       = 5 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] max_local_block_devices        = 3 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] max_logfile_count              = 30 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] max_logfile_size_mb            = 200 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] maximum_instance_delete_attempts = 5 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] metadata_listen                = 0.0.0.0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] metadata_listen_port           = 8775 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] metadata_workers               = 3 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] migrate_max_retries            = -1 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] mkisofs_cmd                    = genisoimage {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] my_ip                          = 10.0.0.210 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] network_allocate_retries       = 0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] osapi_compute_listen_port      = 8774 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] osapi_compute_unique_server_name_scope =  {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] osapi_compute_workers          = 3 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] password_length                = 12 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] periodic_enable                = True {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] periodic_fuzzy_delay           = 60 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] pointer_model                  = ps2mouse {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] preallocate_images             = none {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] publish_errors                 = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] pybasedir                      = /opt/stack/nova {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] ram_allocation_ratio           = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] rate_limit_burst               = 0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] rate_limit_except_level        = CRITICAL {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] rate_limit_interval            = 0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] reboot_timeout                 = 0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] reclaim_instance_interval      = 0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] record                         = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] reimage_timeout_per_gb         = 60 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] report_interval                = 120 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] rescue_timeout                 = 0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] reserved_host_cpus             = 0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] reserved_host_disk_mb          = 0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] reserved_host_memory_mb        = 512 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] reserved_huge_pages            = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] resize_confirm_window          = 0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] resize_fs_using_block_device   = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] resume_guests_state_on_host_boot = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] rpc_response_timeout           = 60 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] run_external_periodic_tasks    = True {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] running_deleted_instance_action = reap {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] running_deleted_instance_poll_interval = 1800 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] running_deleted_instance_timeout = 0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] scheduler_instance_sync_interval = 120 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] service_down_time              = 720 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] servicegroup_driver            = db {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] shelved_offload_time           = 0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] shelved_poll_interval          = 3600 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] shutdown_timeout               = 0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] source_is_ipv6                 = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] ssl_only                       = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] state_path                     = /opt/stack/data/nova {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] sync_power_state_interval      = 600 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] sync_power_state_pool_size     = 1000 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] syslog_log_facility            = LOG_USER {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] tempdir                        = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] timeout_nbd                    = 10 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] transport_url                  = **** {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] update_resources_interval      = 0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] use_cow_images                 = True {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] use_eventlog                   = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] use_journal                    = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] use_json                       = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] use_rootwrap_daemon            = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] use_stderr                     = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] use_syslog                     = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vcpu_pin_set                   = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vif_plugging_is_fatal          = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vif_plugging_timeout           = 0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] virt_mkfs                      = [] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] volume_usage_poll_interval     = 0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] watch_log_file                 = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] web                            = /usr/share/spice-html5 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_concurrency.disable_process_locking = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] api.auth_strategy              = keystone {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] api.compute_link_prefix        = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] api.dhcp_domain                = novalocal {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] api.enable_instance_password   = True {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] api.glance_link_prefix         = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] api.instance_list_per_project_cells = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] api.list_records_by_skipping_down_cells = True {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] api.local_metadata_per_cell    = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] api.max_limit                  = 1000 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] api.metadata_cache_expiration  = 15 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] api.neutron_default_tenant_id  = default {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] api.use_forwarded_for          = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] api.use_neutron_default_nets   = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] api.vendordata_dynamic_targets = [] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] api.vendordata_jsonfile_path   = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] cache.backend                  = dogpile.cache.memcached {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] cache.backend_argument         = **** {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] cache.config_prefix            = cache.oslo {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] cache.dead_timeout             = 60.0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] cache.debug_cache_backend      = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] cache.enable_retry_client      = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] cache.enable_socket_keepalive  = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] cache.enabled                  = True {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] cache.expiration_time          = 600 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] cache.hashclient_retry_attempts = 2 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] cache.memcache_dead_retry      = 300 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] cache.memcache_password        =  {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] cache.memcache_sasl_enabled    = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] cache.memcache_username        =  {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] cache.proxies                  = [] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] cache.retry_attempts           = 2 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] cache.retry_delay              = 0.0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] cache.socket_keepalive_count   = 1 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] cache.socket_keepalive_idle    = 1 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] cache.socket_keepalive_interval = 1 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] cache.tls_allowed_ciphers      = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] cache.tls_cafile               = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] cache.tls_certfile             = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] cache.tls_enabled              = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] cache.tls_keyfile              = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] cinder.auth_section            = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] cinder.auth_type               = password {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] cinder.cafile                  = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] cinder.certfile                = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] cinder.collect_timing          = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] cinder.cross_az_attach         = True {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] cinder.debug                   = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] cinder.endpoint_template       = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] cinder.http_retries            = 3 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] cinder.insecure                = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] cinder.keyfile                 = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] cinder.os_region_name          = RegionOne {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] cinder.split_loggers           = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] cinder.timeout                 = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] compute.cpu_dedicated_set      = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] compute.cpu_shared_set         = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] compute.image_type_exclude_list = [] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] compute.max_concurrent_disk_ops = 0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] compute.max_disk_devices_to_attach = -1 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] compute.resource_provider_association_refresh = 300 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] compute.shutdown_retry_interval = 10 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] conductor.workers              = 3 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] console.allowed_origins        = [] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] console.ssl_ciphers            = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] console.ssl_minimum_version    = default {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] consoleauth.token_ttl          = 600 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] cyborg.cafile                  = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] cyborg.certfile                = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] cyborg.collect_timing          = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] cyborg.connect_retries         = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] cyborg.connect_retry_delay     = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] cyborg.endpoint_override       = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] cyborg.insecure                = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] cyborg.keyfile                 = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] cyborg.max_version             = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] cyborg.min_version             = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] cyborg.region_name             = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] cyborg.service_name            = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] cyborg.service_type            = accelerator {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] cyborg.split_loggers           = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] cyborg.status_code_retries     = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] cyborg.status_code_retry_delay = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] cyborg.timeout                 = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] cyborg.version                 = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] database.backend               = sqlalchemy {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] database.connection            = **** {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] database.connection_debug      = 0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] database.connection_parameters =  {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] database.connection_recycle_time = 3600 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] database.connection_trace      = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] database.db_inc_retry_interval = True {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] database.db_max_retries        = 20 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] database.db_max_retry_interval = 10 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] database.db_retry_interval     = 1 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] database.max_overflow          = 50 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] database.max_pool_size         = 5 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] database.max_retries           = 10 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] database.mysql_wsrep_sync_wait = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] database.pool_timeout          = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] database.retry_interval        = 10 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] database.slave_connection      = **** {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] database.sqlite_synchronous    = True {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] api_database.backend           = sqlalchemy {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] api_database.connection        = **** {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] api_database.connection_debug  = 0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] api_database.connection_parameters =  {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] api_database.connection_recycle_time = 3600 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] api_database.connection_trace  = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] api_database.db_inc_retry_interval = True {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] api_database.db_max_retries    = 20 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] api_database.db_max_retry_interval = 10 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] api_database.db_retry_interval = 1 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] api_database.max_overflow      = 50 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] api_database.max_pool_size     = 5 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] api_database.max_retries       = 10 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] api_database.pool_timeout      = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] api_database.retry_interval    = 10 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] api_database.slave_connection  = **** {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] api_database.sqlite_synchronous = True {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] devices.enabled_mdev_types     = [] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] ephemeral_storage_encryption.enabled = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] glance.api_servers             = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] glance.cafile                  = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] glance.certfile                = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] glance.collect_timing          = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] glance.connect_retries         = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] glance.connect_retry_delay     = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] glance.debug                   = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] glance.default_trusted_certificate_ids = [] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] glance.enable_certificate_validation = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] glance.enable_rbd_download     = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] glance.endpoint_override       = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] glance.insecure                = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] glance.keyfile                 = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] glance.max_version             = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] glance.min_version             = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] glance.num_retries             = 3 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] glance.rbd_ceph_conf           =  {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] glance.rbd_connect_timeout     = 5 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] glance.rbd_pool                =  {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] glance.rbd_user                =  {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] glance.region_name             = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] glance.service_name            = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] glance.service_type            = image {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] glance.split_loggers           = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] glance.status_code_retries     = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] glance.status_code_retry_delay = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] glance.timeout                 = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] glance.verify_glance_signatures = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] glance.version                 = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] guestfs.debug                  = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] hyperv.config_drive_cdrom      = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] hyperv.config_drive_inject_password = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] hyperv.enable_instance_metrics_collection = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] hyperv.enable_remotefx         = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] hyperv.instances_path_share    =  {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] hyperv.iscsi_initiator_list    = [] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] hyperv.limit_cpu_features      = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] hyperv.power_state_check_timeframe = 60 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] hyperv.use_multipath_io        = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] hyperv.volume_attach_retry_count = 10 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] hyperv.vswitch_name            = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] mks.enabled                    = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] image_cache.manager_interval   = 2400 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] image_cache.precache_concurrency = 1 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] image_cache.remove_unused_base_images = True {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] image_cache.subdirectory_name  = _base {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] ironic.api_max_retries         = 60 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] ironic.api_retry_interval      = 2 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] ironic.auth_section            = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] ironic.auth_type               = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] ironic.cafile                  = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] ironic.certfile                = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] ironic.collect_timing          = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] ironic.conductor_group         = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] ironic.connect_retries         = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] ironic.connect_retry_delay     = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] ironic.endpoint_override       = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] ironic.insecure                = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] ironic.keyfile                 = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] ironic.max_version             = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] ironic.min_version             = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] ironic.peer_list               = [] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] ironic.region_name             = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] ironic.serial_console_state_timeout = 10 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] ironic.service_name            = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] ironic.service_type            = baremetal {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] ironic.split_loggers           = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] ironic.status_code_retries     = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] ironic.status_code_retry_delay = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] ironic.timeout                 = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] ironic.version                 = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] key_manager.fixed_key          = **** {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] barbican.barbican_api_version  = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] barbican.barbican_endpoint     = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] barbican.barbican_endpoint_type = public {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] barbican.barbican_region_name  = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] barbican.cafile                = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] barbican.certfile              = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] barbican.collect_timing        = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] barbican.insecure              = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] barbican.keyfile               = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] barbican.number_of_retries     = 60 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] barbican.retry_delay           = 1 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] barbican.send_service_user_token = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] barbican.split_loggers         = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] barbican.timeout               = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] barbican.verify_ssl            = True {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] barbican.verify_ssl_path       = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] barbican_service_user.auth_section = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] barbican_service_user.auth_type = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] barbican_service_user.cafile   = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] barbican_service_user.certfile = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] barbican_service_user.collect_timing = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] barbican_service_user.insecure = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] barbican_service_user.keyfile  = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] barbican_service_user.split_loggers = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] barbican_service_user.timeout  = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vault.approle_role_id          = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vault.approle_secret_id        = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vault.cafile                   = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vault.certfile                 = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vault.collect_timing           = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vault.insecure                 = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vault.keyfile                  = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vault.kv_mountpoint            = secret {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vault.kv_path                  = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vault.kv_version               = 2 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vault.namespace                = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vault.root_token_id            = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vault.split_loggers            = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vault.ssl_ca_crt_file          = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vault.timeout                  = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vault.use_ssl                  = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] keystone.auth_section          = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] keystone.auth_type             = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] keystone.cafile                = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] keystone.certfile              = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] keystone.collect_timing        = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] keystone.connect_retries       = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] keystone.connect_retry_delay   = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] keystone.endpoint_override     = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] keystone.insecure              = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] keystone.keyfile               = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] keystone.max_version           = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] keystone.min_version           = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] keystone.region_name           = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] keystone.service_name          = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] keystone.service_type          = identity {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] keystone.split_loggers         = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] keystone.status_code_retries   = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] keystone.status_code_retry_delay = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] keystone.timeout               = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] keystone.version               = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.connection_uri         =  {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.cpu_mode               = custom {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: WARNING oslo_config.cfg [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.cpu_power_governor_high = performance {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.cpu_power_governor_low = powersave {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.cpu_power_management   = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.device_detach_attempts = 8 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.device_detach_timeout  = 20 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.disk_cachemodes        = [] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.disk_prefix            = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.enabled_perf_events    = [] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.file_backed_memory     = 0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.gid_maps               = [] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.hw_disk_discard        = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.hw_machine_type        = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.images_rbd_glance_store_name =  {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.images_rbd_pool        = rbd {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.images_type            = default {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.images_volume_group    = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.inject_key             = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.inject_partition       = -2 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.inject_password        = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.iscsi_iface            = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.iser_use_multipath     = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.live_migration_bandwidth = 0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.live_migration_downtime = 500 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.live_migration_inbound_addr = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.live_migration_permit_post_copy = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.live_migration_scheme  = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.live_migration_timeout_action = abort {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.live_migration_tunnelled = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: WARNING oslo_config.cfg [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 10 17:40:07 user nova-compute[75100]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 10 17:40:07 user nova-compute[75100]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 10 17:40:07 user nova-compute[75100]: and ``live_migration_inbound_addr`` respectively.
Nov 10 17:40:07 user nova-compute[75100]: ).  Its value may be silently ignored in the future.
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.live_migration_with_native_tls = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.max_queues             = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.nfs_mount_options      = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.num_memory_encrypted_guests = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.num_pcie_ports         = 0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.pmem_namespaces        = [] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.quobyte_client_cfg     = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.rbd_secret_uuid        = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.rbd_user               = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.remote_filesystem_transport = ssh {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.rescue_image_id        = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.rescue_kernel_id       = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.rescue_ramdisk_id      = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.rx_queue_size          = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.smbfs_mount_options    =  {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.snapshot_compression   = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.snapshot_image_format  = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.sparse_logical_volumes = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.swtpm_enabled          = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.swtpm_group            = tss {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.swtpm_user             = tss {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.sysinfo_serial         = unique {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.tb_cache_size          = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.tx_queue_size          = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.uid_maps               = [] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.use_virtio_for_bridges = True {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.virt_type              = kvm {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.volume_clear           = zero {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.volume_clear_size      = 0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.volume_use_multipath   = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.vzstorage_cache_path   = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.vzstorage_mount_user   = stack {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] neutron.auth_section           = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] neutron.auth_type              = password {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] neutron.cafile                 = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] neutron.certfile               = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] neutron.collect_timing         = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] neutron.connect_retries        = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] neutron.connect_retry_delay    = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] neutron.default_floating_pool  = public {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] neutron.endpoint_override      = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] neutron.extension_sync_interval = 600 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] neutron.http_retries           = 3 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] neutron.insecure               = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] neutron.keyfile                = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] neutron.max_version            = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] neutron.min_version            = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] neutron.ovs_bridge             = br-int {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] neutron.physnets               = [] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] neutron.region_name            = RegionOne {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] neutron.service_metadata_proxy = True {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] neutron.service_name           = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] neutron.service_type           = network {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] neutron.split_loggers          = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] neutron.status_code_retries    = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] neutron.status_code_retry_delay = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] neutron.timeout                = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] neutron.version                = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] notifications.bdms_in_notifications = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] notifications.default_level    = INFO {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] notifications.notification_format = unversioned {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] notifications.notify_on_state_change = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] pci.alias                      = [] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] pci.device_spec                = [] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] pci.report_in_placement        = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] placement.auth_section         = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] placement.auth_type            = password {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] placement.cafile               = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] placement.certfile             = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] placement.collect_timing       = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] placement.connect_retries      = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] placement.connect_retry_delay  = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] placement.default_domain_id    = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] placement.default_domain_name  = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] placement.domain_id            = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] placement.domain_name          = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] placement.endpoint_override    = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] placement.insecure             = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] placement.keyfile              = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] placement.max_version          = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] placement.min_version          = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] placement.password             = **** {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] placement.project_domain_id    = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] placement.project_domain_name  = Default {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] placement.project_id           = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] placement.project_name         = service {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] placement.region_name          = RegionOne {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] placement.service_name         = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] placement.service_type         = placement {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] placement.split_loggers        = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] placement.status_code_retries  = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] placement.status_code_retry_delay = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] placement.system_scope         = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] placement.timeout              = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] placement.trust_id             = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] placement.user_domain_id       = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] placement.user_domain_name     = Default {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] placement.user_id              = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] placement.username             = placement {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] placement.version              = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] quota.cores                    = 20 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] quota.count_usage_from_placement = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] quota.injected_file_content_bytes = 10240 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] quota.injected_file_path_length = 255 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] quota.injected_files           = 5 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] quota.instances                = 10 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] quota.key_pairs                = 100 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] quota.metadata_items           = 128 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] quota.ram                      = 51200 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] quota.recheck_quota            = True {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] quota.server_group_members     = 10 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] quota.server_groups            = 10 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] rdp.enabled                    = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] scheduler.image_metadata_prefilter = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] scheduler.max_attempts         = 3 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] scheduler.max_placement_results = 1000 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] scheduler.query_placement_for_image_type_support = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] scheduler.workers              = 3 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] filter_scheduler.host_subset_size = 1 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] filter_scheduler.isolated_hosts = [] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] filter_scheduler.isolated_images = [] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] filter_scheduler.pci_in_placement = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] filter_scheduler.track_instance_changes = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] metrics.required               = True {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] metrics.weight_multiplier      = 1.0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] metrics.weight_setting         = [] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] serial_console.enabled         = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] serial_console.port_range      = 10000:20000 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] serial_console.serialproxy_port = 6083 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] service_user.auth_section      = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] service_user.auth_type         = password {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] service_user.cafile            = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] service_user.certfile          = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] service_user.collect_timing    = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] service_user.insecure          = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] service_user.keyfile           = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] service_user.send_service_user_token = True {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] service_user.split_loggers     = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] service_user.timeout           = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] spice.agent_enabled            = True {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] spice.enabled                  = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] spice.html5proxy_port          = 6082 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] spice.image_compression        = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] spice.jpeg_compression         = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] spice.playback_compression     = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] spice.server_listen            = 127.0.0.1 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] spice.streaming_mode           = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] spice.zlib_compression         = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] upgrade_levels.baseapi         = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] upgrade_levels.cert            = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] upgrade_levels.compute         = auto {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] upgrade_levels.conductor       = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] upgrade_levels.scheduler       = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vendordata_dynamic_auth.auth_section = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vendordata_dynamic_auth.auth_type = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vendordata_dynamic_auth.cafile = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vendordata_dynamic_auth.certfile = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vendordata_dynamic_auth.insecure = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vendordata_dynamic_auth.keyfile = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vendordata_dynamic_auth.timeout = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vmware.api_retry_count         = 10 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vmware.ca_file                 = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vmware.cache_prefix            = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vmware.cluster_name            = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vmware.connection_pool_size    = 10 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vmware.console_delay_seconds   = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vmware.datastore_regex         = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vmware.host_ip                 = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vmware.host_password           = **** {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vmware.host_port               = 443 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vmware.host_username           = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vmware.insecure                = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vmware.integration_bridge      = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vmware.maximum_objects         = 100 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vmware.pbm_default_policy      = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vmware.pbm_enabled             = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vmware.pbm_wsdl_location       = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vmware.serial_port_proxy_uri   = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vmware.serial_port_service_uri = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vmware.task_poll_interval      = 0.5 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vmware.use_linked_clone        = True {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vmware.vnc_keymap              = en-us {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vmware.vnc_port                = 5900 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vmware.vnc_port_total          = 10000 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vnc.auth_schemes               = ['none'] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vnc.enabled                    = True {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vnc.novncproxy_port            = 6080 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vnc.server_listen              = 0.0.0.0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vnc.vencrypt_ca_certs          = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vnc.vencrypt_client_cert       = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vnc.vencrypt_client_key        = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] workarounds.disable_rootwrap   = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] workarounds.enable_numa_live_migration = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] workarounds.libvirt_disable_apic = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] wsgi.client_socket_timeout     = 900 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] wsgi.default_pool_size         = 1000 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] wsgi.keep_alive                = True {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] wsgi.max_header_line           = 16384 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] wsgi.ssl_ca_file               = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] wsgi.ssl_cert_file             = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] wsgi.ssl_key_file              = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] wsgi.tcp_keepidle              = 600 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] zvm.ca_file                    = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] zvm.cloud_connector_url        = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] zvm.reachable_timeout          = 300 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_policy.enforce_new_defaults = True {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_policy.enforce_scope      = True {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_policy.policy_default_rule = default {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] profiler.connection_string     = messaging:// {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] profiler.enabled               = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] profiler.es_doc_type           = notification {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] profiler.es_scroll_size        = 10000 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] profiler.es_scroll_time        = 2m {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] profiler.filter_error_trace    = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] profiler.hmac_keys             = **** {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] profiler.sentinel_service_name = mymaster {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] profiler.socket_timeout        = 0.1 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] profiler.trace_requests        = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] profiler.trace_sqlalchemy      = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] profiler_jaeger.process_tags   = {} {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] profiler_jaeger.service_name_prefix = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] profiler_otlp.service_name_prefix = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] remote_debug.host              = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] remote_debug.port              = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_messaging_notifications.retry = -1 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_limit.auth_section        = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_limit.auth_type           = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_limit.cafile              = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_limit.certfile            = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_limit.collect_timing      = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_limit.connect_retries     = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_limit.connect_retry_delay = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_limit.endpoint_id         = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_limit.endpoint_override   = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_limit.insecure            = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_limit.keyfile             = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_limit.max_version         = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_limit.min_version         = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_limit.region_name         = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_limit.service_name        = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_limit.service_type        = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_limit.split_loggers       = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_limit.status_code_retries = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_limit.status_code_retry_delay = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_limit.timeout             = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_limit.valid_interfaces    = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_limit.version             = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_reports.file_event_handler = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] oslo_reports.log_dir           = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vif_plug_ovs_privileged.group  = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] vif_plug_ovs_privileged.user   = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] os_vif_linux_bridge.flat_interface = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] os_vif_ovs.isolate_vif         = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] os_vif_ovs.per_port_bridge     = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] os_brick.lock_path             = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] privsep_osbrick.capabilities   = [21] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] privsep_osbrick.group          = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] privsep_osbrick.helper_command = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] privsep_osbrick.user           = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] nova_sys_admin.group           = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] nova_sys_admin.helper_command  = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] nova_sys_admin.user            = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG oslo_service.service [None req-7e0a86c8-dbd6-40eb-b7b0-cf3d2d647675 None None] ******************************************************************************** {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 10 17:40:07 user nova-compute[75100]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 10 17:40:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Connecting to libvirt: qemu:///system {{(pid=75100) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fa3dd443010> {{(pid=75100) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 10 17:40:07 user nova-compute[75100]: libvirt:  error : internal error: could not initialize domain event timer
Nov 10 17:40:07 user nova-compute[75100]: WARNING nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 10 17:40:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fa3dd443010> {{(pid=75100) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Starting native event thread {{(pid=75100) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Starting green dispatch thread {{(pid=75100) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 10 17:40:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Starting connection event dispatch thread {{(pid=75100) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 10 17:40:07 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Connection event '1' reason 'None'
Nov 10 17:40:07 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 10 17:40:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.mount [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Initialising _HostMountState generation 0 {{(pid=75100) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 10 17:40:15 user nova-compute[75100]: INFO nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Libvirt host capabilities <capabilities>
Nov 10 17:40:15 user nova-compute[75100]:   <host>
Nov 10 17:40:15 user nova-compute[75100]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 10 17:40:15 user nova-compute[75100]:     <cpu>
Nov 10 17:40:15 user nova-compute[75100]:       <arch>x86_64</arch>
Nov 10 17:40:15 user nova-compute[75100]:       <model>IvyBridge-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <vendor>Intel</vendor>
Nov 10 17:40:15 user nova-compute[75100]:       <microcode version='1070'/>
Nov 10 17:40:15 user nova-compute[75100]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 10 17:40:15 user nova-compute[75100]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature name='ss'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature name='vmx'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature name='pcid'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature name='osxsave'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature name='hypervisor'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature name='arat'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature name='tsc_adjust'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature name='md-clear'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature name='stibp'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature name='arch-capabilities'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature name='ssbd'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature name='invtsc'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature name='rsba'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature name='skip-l1dfl-vmentry'/>
Nov 10 17:40:15 user nova-compute[75100]:       <pages unit='KiB' size='4'/>
Nov 10 17:40:15 user nova-compute[75100]:       <pages unit='KiB' size='2048'/>
Nov 10 17:40:15 user nova-compute[75100]:     </cpu>
Nov 10 17:40:15 user nova-compute[75100]:     <power_management>
Nov 10 17:40:15 user nova-compute[75100]:       <suspend_mem/>
Nov 10 17:40:15 user nova-compute[75100]:       <suspend_disk/>
Nov 10 17:40:15 user nova-compute[75100]:       <suspend_hybrid/>
Nov 10 17:40:15 user nova-compute[75100]:     </power_management>
Nov 10 17:40:15 user nova-compute[75100]:     <iommu support='no'/>
Nov 10 17:40:15 user nova-compute[75100]:     <migration_features>
Nov 10 17:40:15 user nova-compute[75100]:       <live/>
Nov 10 17:40:15 user nova-compute[75100]:       <uri_transports>
Nov 10 17:40:15 user nova-compute[75100]:         <uri_transport>tcp</uri_transport>
Nov 10 17:40:15 user nova-compute[75100]:         <uri_transport>rdma</uri_transport>
Nov 10 17:40:15 user nova-compute[75100]:       </uri_transports>
Nov 10 17:40:15 user nova-compute[75100]:     </migration_features>
Nov 10 17:40:15 user nova-compute[75100]:     <topology>
Nov 10 17:40:15 user nova-compute[75100]:       <cells num='2'>
Nov 10 17:40:15 user nova-compute[75100]:         <cell id='0'>
Nov 10 17:40:15 user nova-compute[75100]:           <memory unit='KiB'>8140672</memory>
Nov 10 17:40:15 user nova-compute[75100]:           <pages unit='KiB' size='4'>2035168</pages>
Nov 10 17:40:15 user nova-compute[75100]:           <pages unit='KiB' size='2048'>0</pages>
Nov 10 17:40:15 user nova-compute[75100]:           <distances>
Nov 10 17:40:15 user nova-compute[75100]:             <sibling id='0' value='10'/>
Nov 10 17:40:15 user nova-compute[75100]:             <sibling id='1' value='20'/>
Nov 10 17:40:15 user nova-compute[75100]:           </distances>
Nov 10 17:40:15 user nova-compute[75100]:           <cpus num='6'>
Nov 10 17:40:15 user nova-compute[75100]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 10 17:40:15 user nova-compute[75100]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 10 17:40:15 user nova-compute[75100]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 10 17:40:15 user nova-compute[75100]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 10 17:40:15 user nova-compute[75100]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 10 17:40:15 user nova-compute[75100]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 10 17:40:15 user nova-compute[75100]:           </cpus>
Nov 10 17:40:15 user nova-compute[75100]:         </cell>
Nov 10 17:40:15 user nova-compute[75100]:         <cell id='1'>
Nov 10 17:40:15 user nova-compute[75100]:           <memory unit='KiB'>8254952</memory>
Nov 10 17:40:15 user nova-compute[75100]:           <pages unit='KiB' size='4'>2063738</pages>
Nov 10 17:40:15 user nova-compute[75100]:           <pages unit='KiB' size='2048'>0</pages>
Nov 10 17:40:15 user nova-compute[75100]:           <distances>
Nov 10 17:40:15 user nova-compute[75100]:             <sibling id='0' value='20'/>
Nov 10 17:40:15 user nova-compute[75100]:             <sibling id='1' value='10'/>
Nov 10 17:40:15 user nova-compute[75100]:           </distances>
Nov 10 17:40:15 user nova-compute[75100]:           <cpus num='6'>
Nov 10 17:40:15 user nova-compute[75100]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 10 17:40:15 user nova-compute[75100]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 10 17:40:15 user nova-compute[75100]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 10 17:40:15 user nova-compute[75100]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 10 17:40:15 user nova-compute[75100]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 10 17:40:15 user nova-compute[75100]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 10 17:40:15 user nova-compute[75100]:           </cpus>
Nov 10 17:40:15 user nova-compute[75100]:         </cell>
Nov 10 17:40:15 user nova-compute[75100]:       </cells>
Nov 10 17:40:15 user nova-compute[75100]:     </topology>
Nov 10 17:40:15 user nova-compute[75100]:     <cache>
Nov 10 17:40:15 user nova-compute[75100]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 10 17:40:15 user nova-compute[75100]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 10 17:40:15 user nova-compute[75100]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 10 17:40:15 user nova-compute[75100]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 10 17:40:15 user nova-compute[75100]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 10 17:40:15 user nova-compute[75100]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 10 17:40:15 user nova-compute[75100]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 10 17:40:15 user nova-compute[75100]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 10 17:40:15 user nova-compute[75100]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 10 17:40:15 user nova-compute[75100]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 10 17:40:15 user nova-compute[75100]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 10 17:40:15 user nova-compute[75100]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 10 17:40:15 user nova-compute[75100]:     </cache>
Nov 10 17:40:15 user nova-compute[75100]:     <secmodel>
Nov 10 17:40:15 user nova-compute[75100]:       <model>apparmor</model>
Nov 10 17:40:15 user nova-compute[75100]:       <doi>0</doi>
Nov 10 17:40:15 user nova-compute[75100]:     </secmodel>
Nov 10 17:40:15 user nova-compute[75100]:     <secmodel>
Nov 10 17:40:15 user nova-compute[75100]:       <model>dac</model>
Nov 10 17:40:15 user nova-compute[75100]:       <doi>0</doi>
Nov 10 17:40:15 user nova-compute[75100]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 10 17:40:15 user nova-compute[75100]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 10 17:40:15 user nova-compute[75100]:     </secmodel>
Nov 10 17:40:15 user nova-compute[75100]:   </host>
Nov 10 17:40:15 user nova-compute[75100]:   <guest>
Nov 10 17:40:15 user nova-compute[75100]:     <os_type>hvm</os_type>
Nov 10 17:40:15 user nova-compute[75100]:     <arch name='alpha'>
Nov 10 17:40:15 user nova-compute[75100]:       <wordsize>64</wordsize>
Nov 10 17:40:15 user nova-compute[75100]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='4'>clipper</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <domain type='qemu'/>
Nov 10 17:40:15 user nova-compute[75100]:     </arch>
Nov 10 17:40:15 user nova-compute[75100]:     <features>
Nov 10 17:40:15 user nova-compute[75100]:       <cpuselection/>
Nov 10 17:40:15 user nova-compute[75100]:       <deviceboot/>
Nov 10 17:40:15 user nova-compute[75100]:       <disksnapshot default='on' toggle='no'/>
Nov 10 17:40:15 user nova-compute[75100]:     </features>
Nov 10 17:40:15 user nova-compute[75100]:   </guest>
Nov 10 17:40:15 user nova-compute[75100]:   <guest>
Nov 10 17:40:15 user nova-compute[75100]:     <os_type>hvm</os_type>
Nov 10 17:40:15 user nova-compute[75100]:     <arch name='armv6l'>
Nov 10 17:40:15 user nova-compute[75100]:       <wordsize>32</wordsize>
Nov 10 17:40:15 user nova-compute[75100]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>integratorcp</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>borzoi</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>spitz</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2'>nuri</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2'>musca-b1</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>versatileab</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>kzm</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2'>musca-a</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2'>smdkc210</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>sx1</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>z2</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>tosa</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='4'>sabrelite</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>realview-eb</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>n810</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>n800</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>versatilepb</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>terrier</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>mainstone</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='4'>midway</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>musicpal</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>microbit</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>cubieboard</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>verdex</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>netduino2</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='4'>raspi2b</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>cheetah</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='4'>highbank</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>akita</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>connex</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>collie</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>raspi0</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <domain type='qemu'/>
Nov 10 17:40:15 user nova-compute[75100]:     </arch>
Nov 10 17:40:15 user nova-compute[75100]:     <features>
Nov 10 17:40:15 user nova-compute[75100]:       <cpuselection/>
Nov 10 17:40:15 user nova-compute[75100]:       <deviceboot/>
Nov 10 17:40:15 user nova-compute[75100]:       <disksnapshot default='on' toggle='no'/>
Nov 10 17:40:15 user nova-compute[75100]:     </features>
Nov 10 17:40:15 user nova-compute[75100]:   </guest>
Nov 10 17:40:15 user nova-compute[75100]:   <guest>
Nov 10 17:40:15 user nova-compute[75100]:     <os_type>hvm</os_type>
Nov 10 17:40:15 user nova-compute[75100]:     <arch name='armv7l'>
Nov 10 17:40:15 user nova-compute[75100]:       <wordsize>32</wordsize>
Nov 10 17:40:15 user nova-compute[75100]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>integratorcp</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>borzoi</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>spitz</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2'>nuri</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2'>musca-b1</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>versatileab</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>kzm</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2'>musca-a</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2'>smdkc210</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>sx1</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>z2</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>tosa</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='4'>sabrelite</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>realview-eb</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>n810</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>n800</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>versatilepb</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>terrier</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>mainstone</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='4'>midway</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>musicpal</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>microbit</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>cubieboard</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>verdex</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>netduino2</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='4'>raspi2b</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>cheetah</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='4'>highbank</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>akita</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>connex</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>collie</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>raspi0</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <domain type='qemu'/>
Nov 10 17:40:15 user nova-compute[75100]:     </arch>
Nov 10 17:40:15 user nova-compute[75100]:     <features>
Nov 10 17:40:15 user nova-compute[75100]:       <cpuselection/>
Nov 10 17:40:15 user nova-compute[75100]:       <deviceboot/>
Nov 10 17:40:15 user nova-compute[75100]:       <disksnapshot default='on' toggle='no'/>
Nov 10 17:40:15 user nova-compute[75100]:     </features>
Nov 10 17:40:15 user nova-compute[75100]:   </guest>
Nov 10 17:40:15 user nova-compute[75100]:   <guest>
Nov 10 17:40:15 user nova-compute[75100]:     <os_type>hvm</os_type>
Nov 10 17:40:15 user nova-compute[75100]:     <arch name='aarch64'>
Nov 10 17:40:15 user nova-compute[75100]:       <wordsize>64</wordsize>
Nov 10 17:40:15 user nova-compute[75100]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>integratorcp</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>borzoi</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>spitz</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2'>nuri</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2'>musca-b1</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>versatileab</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>kzm</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2'>musca-a</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2'>smdkc210</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>sx1</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>z2</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>tosa</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='4'>sabrelite</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>realview-eb</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>n810</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>n800</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>versatilepb</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>terrier</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>mainstone</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='4'>midway</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>musicpal</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>microbit</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>cubieboard</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>verdex</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>netduino2</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='4'>raspi3b</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='4'>raspi2b</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>cheetah</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='4'>highbank</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>akita</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>connex</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>collie</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>raspi0</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <domain type='qemu'/>
Nov 10 17:40:15 user nova-compute[75100]:     </arch>
Nov 10 17:40:15 user nova-compute[75100]:     <features>
Nov 10 17:40:15 user nova-compute[75100]:       <acpi default='on' toggle='yes'/>
Nov 10 17:40:15 user nova-compute[75100]:       <cpuselection/>
Nov 10 17:40:15 user nova-compute[75100]:       <deviceboot/>
Nov 10 17:40:15 user nova-compute[75100]:       <disksnapshot default='on' toggle='no'/>
Nov 10 17:40:15 user nova-compute[75100]:     </features>
Nov 10 17:40:15 user nova-compute[75100]:   </guest>
Nov 10 17:40:15 user nova-compute[75100]:   <guest>
Nov 10 17:40:15 user nova-compute[75100]:     <os_type>hvm</os_type>
Nov 10 17:40:15 user nova-compute[75100]:     <arch name='cris'>
Nov 10 17:40:15 user nova-compute[75100]:       <wordsize>32</wordsize>
Nov 10 17:40:15 user nova-compute[75100]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <domain type='qemu'/>
Nov 10 17:40:15 user nova-compute[75100]:     </arch>
Nov 10 17:40:15 user nova-compute[75100]:     <features>
Nov 10 17:40:15 user nova-compute[75100]:       <cpuselection/>
Nov 10 17:40:15 user nova-compute[75100]:       <deviceboot/>
Nov 10 17:40:15 user nova-compute[75100]:       <disksnapshot default='on' toggle='no'/>
Nov 10 17:40:15 user nova-compute[75100]:     </features>
Nov 10 17:40:15 user nova-compute[75100]:   </guest>
Nov 10 17:40:15 user nova-compute[75100]:   <guest>
Nov 10 17:40:15 user nova-compute[75100]:     <os_type>hvm</os_type>
Nov 10 17:40:15 user nova-compute[75100]:     <arch name='i686'>
Nov 10 17:40:15 user nova-compute[75100]:       <wordsize>32</wordsize>
Nov 10 17:40:15 user nova-compute[75100]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>x-remote</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>isapc</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>microvm</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <domain type='qemu'/>
Nov 10 17:40:15 user nova-compute[75100]:       <domain type='kvm'/>
Nov 10 17:40:15 user nova-compute[75100]:     </arch>
Nov 10 17:40:15 user nova-compute[75100]:     <features>
Nov 10 17:40:15 user nova-compute[75100]:       <pae/>
Nov 10 17:40:15 user nova-compute[75100]:       <nonpae/>
Nov 10 17:40:15 user nova-compute[75100]:       <acpi default='on' toggle='yes'/>
Nov 10 17:40:15 user nova-compute[75100]:       <apic default='on' toggle='no'/>
Nov 10 17:40:15 user nova-compute[75100]:       <cpuselection/>
Nov 10 17:40:15 user nova-compute[75100]:       <deviceboot/>
Nov 10 17:40:15 user nova-compute[75100]:       <disksnapshot default='on' toggle='no'/>
Nov 10 17:40:15 user nova-compute[75100]:     </features>
Nov 10 17:40:15 user nova-compute[75100]:   </guest>
Nov 10 17:40:15 user nova-compute[75100]:   <guest>
Nov 10 17:40:15 user nova-compute[75100]:     <os_type>hvm</os_type>
Nov 10 17:40:15 user nova-compute[75100]:     <arch name='m68k'>
Nov 10 17:40:15 user nova-compute[75100]:       <wordsize>32</wordsize>
Nov 10 17:40:15 user nova-compute[75100]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>an5206</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>q800</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>next-cube</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <domain type='qemu'/>
Nov 10 17:40:15 user nova-compute[75100]:     </arch>
Nov 10 17:40:15 user nova-compute[75100]:     <features>
Nov 10 17:40:15 user nova-compute[75100]:       <cpuselection/>
Nov 10 17:40:15 user nova-compute[75100]:       <deviceboot/>
Nov 10 17:40:15 user nova-compute[75100]:       <disksnapshot default='on' toggle='no'/>
Nov 10 17:40:15 user nova-compute[75100]:     </features>
Nov 10 17:40:15 user nova-compute[75100]:   </guest>
Nov 10 17:40:15 user nova-compute[75100]:   <guest>
Nov 10 17:40:15 user nova-compute[75100]:     <os_type>hvm</os_type>
Nov 10 17:40:15 user nova-compute[75100]:     <arch name='microblaze'>
Nov 10 17:40:15 user nova-compute[75100]:       <wordsize>32</wordsize>
Nov 10 17:40:15 user nova-compute[75100]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <domain type='qemu'/>
Nov 10 17:40:15 user nova-compute[75100]:     </arch>
Nov 10 17:40:15 user nova-compute[75100]:     <features>
Nov 10 17:40:15 user nova-compute[75100]:       <cpuselection/>
Nov 10 17:40:15 user nova-compute[75100]:       <deviceboot/>
Nov 10 17:40:15 user nova-compute[75100]:       <disksnapshot default='on' toggle='no'/>
Nov 10 17:40:15 user nova-compute[75100]:     </features>
Nov 10 17:40:15 user nova-compute[75100]:   </guest>
Nov 10 17:40:15 user nova-compute[75100]:   <guest>
Nov 10 17:40:15 user nova-compute[75100]:     <os_type>hvm</os_type>
Nov 10 17:40:15 user nova-compute[75100]:     <arch name='microblazeel'>
Nov 10 17:40:15 user nova-compute[75100]:       <wordsize>32</wordsize>
Nov 10 17:40:15 user nova-compute[75100]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <domain type='qemu'/>
Nov 10 17:40:15 user nova-compute[75100]:     </arch>
Nov 10 17:40:15 user nova-compute[75100]:     <features>
Nov 10 17:40:15 user nova-compute[75100]:       <cpuselection/>
Nov 10 17:40:15 user nova-compute[75100]:       <deviceboot/>
Nov 10 17:40:15 user nova-compute[75100]:       <disksnapshot default='on' toggle='no'/>
Nov 10 17:40:15 user nova-compute[75100]:     </features>
Nov 10 17:40:15 user nova-compute[75100]:   </guest>
Nov 10 17:40:15 user nova-compute[75100]:   <guest>
Nov 10 17:40:15 user nova-compute[75100]:     <os_type>hvm</os_type>
Nov 10 17:40:15 user nova-compute[75100]:     <arch name='mips'>
Nov 10 17:40:15 user nova-compute[75100]:       <wordsize>32</wordsize>
Nov 10 17:40:15 user nova-compute[75100]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='16'>malta</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>mipssim</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <domain type='qemu'/>
Nov 10 17:40:15 user nova-compute[75100]:     </arch>
Nov 10 17:40:15 user nova-compute[75100]:     <features>
Nov 10 17:40:15 user nova-compute[75100]:       <cpuselection/>
Nov 10 17:40:15 user nova-compute[75100]:       <deviceboot/>
Nov 10 17:40:15 user nova-compute[75100]:       <disksnapshot default='on' toggle='no'/>
Nov 10 17:40:15 user nova-compute[75100]:     </features>
Nov 10 17:40:15 user nova-compute[75100]:   </guest>
Nov 10 17:40:15 user nova-compute[75100]:   <guest>
Nov 10 17:40:15 user nova-compute[75100]:     <os_type>hvm</os_type>
Nov 10 17:40:15 user nova-compute[75100]:     <arch name='mipsel'>
Nov 10 17:40:15 user nova-compute[75100]:       <wordsize>32</wordsize>
Nov 10 17:40:15 user nova-compute[75100]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='16'>malta</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>mipssim</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <domain type='qemu'/>
Nov 10 17:40:15 user nova-compute[75100]:     </arch>
Nov 10 17:40:15 user nova-compute[75100]:     <features>
Nov 10 17:40:15 user nova-compute[75100]:       <cpuselection/>
Nov 10 17:40:15 user nova-compute[75100]:       <deviceboot/>
Nov 10 17:40:15 user nova-compute[75100]:       <disksnapshot default='on' toggle='no'/>
Nov 10 17:40:15 user nova-compute[75100]:     </features>
Nov 10 17:40:15 user nova-compute[75100]:   </guest>
Nov 10 17:40:15 user nova-compute[75100]:   <guest>
Nov 10 17:40:15 user nova-compute[75100]:     <os_type>hvm</os_type>
Nov 10 17:40:15 user nova-compute[75100]:     <arch name='mips64'>
Nov 10 17:40:15 user nova-compute[75100]:       <wordsize>64</wordsize>
Nov 10 17:40:15 user nova-compute[75100]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='16'>malta</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>mipssim</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>pica61</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>magnum</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <domain type='qemu'/>
Nov 10 17:40:15 user nova-compute[75100]:     </arch>
Nov 10 17:40:15 user nova-compute[75100]:     <features>
Nov 10 17:40:15 user nova-compute[75100]:       <cpuselection/>
Nov 10 17:40:15 user nova-compute[75100]:       <deviceboot/>
Nov 10 17:40:15 user nova-compute[75100]:       <disksnapshot default='on' toggle='no'/>
Nov 10 17:40:15 user nova-compute[75100]:     </features>
Nov 10 17:40:15 user nova-compute[75100]:   </guest>
Nov 10 17:40:15 user nova-compute[75100]:   <guest>
Nov 10 17:40:15 user nova-compute[75100]:     <os_type>hvm</os_type>
Nov 10 17:40:15 user nova-compute[75100]:     <arch name='mips64el'>
Nov 10 17:40:15 user nova-compute[75100]:       <wordsize>64</wordsize>
Nov 10 17:40:15 user nova-compute[75100]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='16'>malta</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>mipssim</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>pica61</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>magnum</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='16'>boston</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <domain type='qemu'/>
Nov 10 17:40:15 user nova-compute[75100]:     </arch>
Nov 10 17:40:15 user nova-compute[75100]:     <features>
Nov 10 17:40:15 user nova-compute[75100]:       <cpuselection/>
Nov 10 17:40:15 user nova-compute[75100]:       <deviceboot/>
Nov 10 17:40:15 user nova-compute[75100]:       <disksnapshot default='on' toggle='no'/>
Nov 10 17:40:15 user nova-compute[75100]:     </features>
Nov 10 17:40:15 user nova-compute[75100]:   </guest>
Nov 10 17:40:15 user nova-compute[75100]:   <guest>
Nov 10 17:40:15 user nova-compute[75100]:     <os_type>hvm</os_type>
Nov 10 17:40:15 user nova-compute[75100]:     <arch name='ppc'>
Nov 10 17:40:15 user nova-compute[75100]:       <wordsize>32</wordsize>
Nov 10 17:40:15 user nova-compute[75100]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>g3beige</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>mac99</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='32'>ppce500</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>pegasos2</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>sam460ex</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>bamboo</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>40p</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>ref405ep</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>taihu</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <domain type='qemu'/>
Nov 10 17:40:15 user nova-compute[75100]:     </arch>
Nov 10 17:40:15 user nova-compute[75100]:     <features>
Nov 10 17:40:15 user nova-compute[75100]:       <cpuselection/>
Nov 10 17:40:15 user nova-compute[75100]:       <deviceboot/>
Nov 10 17:40:15 user nova-compute[75100]:       <disksnapshot default='on' toggle='no'/>
Nov 10 17:40:15 user nova-compute[75100]:     </features>
Nov 10 17:40:15 user nova-compute[75100]:   </guest>
Nov 10 17:40:15 user nova-compute[75100]:   <guest>
Nov 10 17:40:15 user nova-compute[75100]:     <os_type>hvm</os_type>
Nov 10 17:40:15 user nova-compute[75100]:     <arch name='ppc64'>
Nov 10 17:40:15 user nova-compute[75100]:       <wordsize>64</wordsize>
Nov 10 17:40:15 user nova-compute[75100]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2048'>powernv9</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>taihu</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2048'>powernv10</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='32'>ppce500</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>40p</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>pegasos2</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>bamboo</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>g3beige</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>mac99</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>sam460ex</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>ref405ep</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2048'>powernv8</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <domain type='qemu'/>
Nov 10 17:40:15 user nova-compute[75100]:     </arch>
Nov 10 17:40:15 user nova-compute[75100]:     <features>
Nov 10 17:40:15 user nova-compute[75100]:       <cpuselection/>
Nov 10 17:40:15 user nova-compute[75100]:       <deviceboot/>
Nov 10 17:40:15 user nova-compute[75100]:       <disksnapshot default='on' toggle='no'/>
Nov 10 17:40:15 user nova-compute[75100]:     </features>
Nov 10 17:40:15 user nova-compute[75100]:   </guest>
Nov 10 17:40:15 user nova-compute[75100]:   <guest>
Nov 10 17:40:15 user nova-compute[75100]:     <os_type>hvm</os_type>
Nov 10 17:40:15 user nova-compute[75100]:     <arch name='ppc64le'>
Nov 10 17:40:15 user nova-compute[75100]:       <wordsize>64</wordsize>
Nov 10 17:40:15 user nova-compute[75100]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2048'>powernv9</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>taihu</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2048'>powernv10</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='32'>ppce500</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>40p</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>pegasos2</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>bamboo</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>g3beige</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>mac99</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>sam460ex</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>ref405ep</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2048'>powernv8</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <domain type='qemu'/>
Nov 10 17:40:15 user nova-compute[75100]:     </arch>
Nov 10 17:40:15 user nova-compute[75100]:     <features>
Nov 10 17:40:15 user nova-compute[75100]:       <cpuselection/>
Nov 10 17:40:15 user nova-compute[75100]:       <deviceboot/>
Nov 10 17:40:15 user nova-compute[75100]:       <disksnapshot default='on' toggle='no'/>
Nov 10 17:40:15 user nova-compute[75100]:     </features>
Nov 10 17:40:15 user nova-compute[75100]:   </guest>
Nov 10 17:40:15 user nova-compute[75100]:   <guest>
Nov 10 17:40:15 user nova-compute[75100]:     <os_type>hvm</os_type>
Nov 10 17:40:15 user nova-compute[75100]:     <arch name='riscv32'>
Nov 10 17:40:15 user nova-compute[75100]:       <wordsize>32</wordsize>
Nov 10 17:40:15 user nova-compute[75100]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='8'>spike</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>opentitan</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='5'>sifive_u</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>sifive_e</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='8'>virt</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <domain type='qemu'/>
Nov 10 17:40:15 user nova-compute[75100]:     </arch>
Nov 10 17:40:15 user nova-compute[75100]:     <features>
Nov 10 17:40:15 user nova-compute[75100]:       <cpuselection/>
Nov 10 17:40:15 user nova-compute[75100]:       <deviceboot/>
Nov 10 17:40:15 user nova-compute[75100]:       <disksnapshot default='on' toggle='no'/>
Nov 10 17:40:15 user nova-compute[75100]:     </features>
Nov 10 17:40:15 user nova-compute[75100]:   </guest>
Nov 10 17:40:15 user nova-compute[75100]:   <guest>
Nov 10 17:40:15 user nova-compute[75100]:     <os_type>hvm</os_type>
Nov 10 17:40:15 user nova-compute[75100]:     <arch name='riscv64'>
Nov 10 17:40:15 user nova-compute[75100]:       <wordsize>64</wordsize>
Nov 10 17:40:15 user nova-compute[75100]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='8'>spike</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='5'>sifive_u</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>shakti_c</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>sifive_e</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='8'>virt</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <domain type='qemu'/>
Nov 10 17:40:15 user nova-compute[75100]:     </arch>
Nov 10 17:40:15 user nova-compute[75100]:     <features>
Nov 10 17:40:15 user nova-compute[75100]:       <cpuselection/>
Nov 10 17:40:15 user nova-compute[75100]:       <deviceboot/>
Nov 10 17:40:15 user nova-compute[75100]:       <disksnapshot default='on' toggle='no'/>
Nov 10 17:40:15 user nova-compute[75100]:     </features>
Nov 10 17:40:15 user nova-compute[75100]:   </guest>
Nov 10 17:40:15 user nova-compute[75100]:   <guest>
Nov 10 17:40:15 user nova-compute[75100]:     <os_type>hvm</os_type>
Nov 10 17:40:15 user nova-compute[75100]:     <arch name='s390x'>
Nov 10 17:40:15 user nova-compute[75100]:       <wordsize>64</wordsize>
Nov 10 17:40:15 user nova-compute[75100]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <domain type='qemu'/>
Nov 10 17:40:15 user nova-compute[75100]:     </arch>
Nov 10 17:40:15 user nova-compute[75100]:     <features>
Nov 10 17:40:15 user nova-compute[75100]:       <cpuselection/>
Nov 10 17:40:15 user nova-compute[75100]:       <deviceboot/>
Nov 10 17:40:15 user nova-compute[75100]:       <disksnapshot default='on' toggle='no'/>
Nov 10 17:40:15 user nova-compute[75100]:     </features>
Nov 10 17:40:15 user nova-compute[75100]:   </guest>
Nov 10 17:40:15 user nova-compute[75100]:   <guest>
Nov 10 17:40:15 user nova-compute[75100]:     <os_type>hvm</os_type>
Nov 10 17:40:15 user nova-compute[75100]:     <arch name='sh4'>
Nov 10 17:40:15 user nova-compute[75100]:       <wordsize>32</wordsize>
Nov 10 17:40:15 user nova-compute[75100]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>shix</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>r2d</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <domain type='qemu'/>
Nov 10 17:40:15 user nova-compute[75100]:     </arch>
Nov 10 17:40:15 user nova-compute[75100]:     <features>
Nov 10 17:40:15 user nova-compute[75100]:       <cpuselection/>
Nov 10 17:40:15 user nova-compute[75100]:       <deviceboot/>
Nov 10 17:40:15 user nova-compute[75100]:       <disksnapshot default='on' toggle='no'/>
Nov 10 17:40:15 user nova-compute[75100]:     </features>
Nov 10 17:40:15 user nova-compute[75100]:   </guest>
Nov 10 17:40:15 user nova-compute[75100]:   <guest>
Nov 10 17:40:15 user nova-compute[75100]:     <os_type>hvm</os_type>
Nov 10 17:40:15 user nova-compute[75100]:     <arch name='sh4eb'>
Nov 10 17:40:15 user nova-compute[75100]:       <wordsize>64</wordsize>
Nov 10 17:40:15 user nova-compute[75100]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>shix</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>r2d</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <domain type='qemu'/>
Nov 10 17:40:15 user nova-compute[75100]:     </arch>
Nov 10 17:40:15 user nova-compute[75100]:     <features>
Nov 10 17:40:15 user nova-compute[75100]:       <cpuselection/>
Nov 10 17:40:15 user nova-compute[75100]:       <deviceboot/>
Nov 10 17:40:15 user nova-compute[75100]:       <disksnapshot default='on' toggle='no'/>
Nov 10 17:40:15 user nova-compute[75100]:     </features>
Nov 10 17:40:15 user nova-compute[75100]:   </guest>
Nov 10 17:40:15 user nova-compute[75100]:   <guest>
Nov 10 17:40:15 user nova-compute[75100]:     <os_type>hvm</os_type>
Nov 10 17:40:15 user nova-compute[75100]:     <arch name='sparc'>
Nov 10 17:40:15 user nova-compute[75100]:       <wordsize>32</wordsize>
Nov 10 17:40:15 user nova-compute[75100]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>SS-5</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='4'>SS-20</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>LX</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>SS-4</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='4'>SS-10</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>Voyager</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <domain type='qemu'/>
Nov 10 17:40:15 user nova-compute[75100]:     </arch>
Nov 10 17:40:15 user nova-compute[75100]:     <features>
Nov 10 17:40:15 user nova-compute[75100]:       <cpuselection/>
Nov 10 17:40:15 user nova-compute[75100]:       <deviceboot/>
Nov 10 17:40:15 user nova-compute[75100]:       <disksnapshot default='on' toggle='no'/>
Nov 10 17:40:15 user nova-compute[75100]:     </features>
Nov 10 17:40:15 user nova-compute[75100]:   </guest>
Nov 10 17:40:15 user nova-compute[75100]:   <guest>
Nov 10 17:40:15 user nova-compute[75100]:     <os_type>hvm</os_type>
Nov 10 17:40:15 user nova-compute[75100]:     <arch name='sparc64'>
Nov 10 17:40:15 user nova-compute[75100]:       <wordsize>64</wordsize>
Nov 10 17:40:15 user nova-compute[75100]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>sun4u</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>niagara</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>sun4v</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <domain type='qemu'/>
Nov 10 17:40:15 user nova-compute[75100]:     </arch>
Nov 10 17:40:15 user nova-compute[75100]:     <features>
Nov 10 17:40:15 user nova-compute[75100]:       <cpuselection/>
Nov 10 17:40:15 user nova-compute[75100]:       <deviceboot/>
Nov 10 17:40:15 user nova-compute[75100]:       <disksnapshot default='on' toggle='no'/>
Nov 10 17:40:15 user nova-compute[75100]:     </features>
Nov 10 17:40:15 user nova-compute[75100]:   </guest>
Nov 10 17:40:15 user nova-compute[75100]:   <guest>
Nov 10 17:40:15 user nova-compute[75100]:     <os_type>hvm</os_type>
Nov 10 17:40:15 user nova-compute[75100]:     <arch name='x86_64'>
Nov 10 17:40:15 user nova-compute[75100]:       <wordsize>64</wordsize>
Nov 10 17:40:15 user nova-compute[75100]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>x-remote</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='1'>isapc</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>microvm</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <domain type='qemu'/>
Nov 10 17:40:15 user nova-compute[75100]:       <domain type='kvm'/>
Nov 10 17:40:15 user nova-compute[75100]:     </arch>
Nov 10 17:40:15 user nova-compute[75100]:     <features>
Nov 10 17:40:15 user nova-compute[75100]:       <acpi default='on' toggle='yes'/>
Nov 10 17:40:15 user nova-compute[75100]:       <apic default='on' toggle='no'/>
Nov 10 17:40:15 user nova-compute[75100]:       <cpuselection/>
Nov 10 17:40:15 user nova-compute[75100]:       <deviceboot/>
Nov 10 17:40:15 user nova-compute[75100]:       <disksnapshot default='on' toggle='no'/>
Nov 10 17:40:15 user nova-compute[75100]:     </features>
Nov 10 17:40:15 user nova-compute[75100]:   </guest>
Nov 10 17:40:15 user nova-compute[75100]:   <guest>
Nov 10 17:40:15 user nova-compute[75100]:     <os_type>hvm</os_type>
Nov 10 17:40:15 user nova-compute[75100]:     <arch name='xtensa'>
Nov 10 17:40:15 user nova-compute[75100]:       <wordsize>32</wordsize>
Nov 10 17:40:15 user nova-compute[75100]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='4'>sim</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='32'>kc705</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='32'>ml605</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='32'>virt</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='32'>lx200</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='32'>lx60</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <domain type='qemu'/>
Nov 10 17:40:15 user nova-compute[75100]:     </arch>
Nov 10 17:40:15 user nova-compute[75100]:     <features>
Nov 10 17:40:15 user nova-compute[75100]:       <cpuselection/>
Nov 10 17:40:15 user nova-compute[75100]:       <deviceboot/>
Nov 10 17:40:15 user nova-compute[75100]:       <disksnapshot default='on' toggle='no'/>
Nov 10 17:40:15 user nova-compute[75100]:     </features>
Nov 10 17:40:15 user nova-compute[75100]:   </guest>
Nov 10 17:40:15 user nova-compute[75100]:   <guest>
Nov 10 17:40:15 user nova-compute[75100]:     <os_type>hvm</os_type>
Nov 10 17:40:15 user nova-compute[75100]:     <arch name='xtensaeb'>
Nov 10 17:40:15 user nova-compute[75100]:       <wordsize>32</wordsize>
Nov 10 17:40:15 user nova-compute[75100]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='4'>sim</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='32'>kc705</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='32'>ml605</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='32'>virt</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='32'>lx200</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='32'>lx60</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 10 17:40:15 user nova-compute[75100]:       <domain type='qemu'/>
Nov 10 17:40:15 user nova-compute[75100]:     </arch>
Nov 10 17:40:15 user nova-compute[75100]:     <features>
Nov 10 17:40:15 user nova-compute[75100]:       <cpuselection/>
Nov 10 17:40:15 user nova-compute[75100]:       <deviceboot/>
Nov 10 17:40:15 user nova-compute[75100]:       <disksnapshot default='on' toggle='no'/>
Nov 10 17:40:15 user nova-compute[75100]:     </features>
Nov 10 17:40:15 user nova-compute[75100]:   </guest>
Nov 10 17:40:15 user nova-compute[75100]: </capabilities>
Nov 10 17:40:15 user nova-compute[75100]: 
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75100) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75100) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=75100) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75100) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75100) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75100) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75100) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75100) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75100) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75100) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75100) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'ubuntu-q35', 'q35', 'pc'} {{(pid=75100) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 10 17:40:15 user nova-compute[75100]: <domainCapabilities>
Nov 10 17:40:15 user nova-compute[75100]:   <path>/usr/bin/qemu-system-i386</path>
Nov 10 17:40:15 user nova-compute[75100]:   <domain>kvm</domain>
Nov 10 17:40:15 user nova-compute[75100]:   <machine>pc-i440fx-jammy</machine>
Nov 10 17:40:15 user nova-compute[75100]:   <arch>i686</arch>
Nov 10 17:40:15 user nova-compute[75100]:   <vcpu max='255'/>
Nov 10 17:40:15 user nova-compute[75100]:   <iothreads supported='yes'/>
Nov 10 17:40:15 user nova-compute[75100]:   <os supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:     <enum name='firmware'/>
Nov 10 17:40:15 user nova-compute[75100]:     <loader supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 10 17:40:15 user nova-compute[75100]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 10 17:40:15 user nova-compute[75100]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 10 17:40:15 user nova-compute[75100]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 10 17:40:15 user nova-compute[75100]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='type'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>rom</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>pflash</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='readonly'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>yes</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>no</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='secure'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>no</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </loader>
Nov 10 17:40:15 user nova-compute[75100]:   </os>
Nov 10 17:40:15 user nova-compute[75100]:   <cpu>
Nov 10 17:40:15 user nova-compute[75100]:     <mode name='host-passthrough' supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='hostPassthroughMigratable'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>off</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </mode>
Nov 10 17:40:15 user nova-compute[75100]:     <mode name='maximum' supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='maximumMigratable'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>on</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>off</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </mode>
Nov 10 17:40:15 user nova-compute[75100]:     <mode name='host-model' supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <vendor>Intel</vendor>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='ss'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='vmx'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='pcid'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='hypervisor'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='arat'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='tsc_adjust'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='umip'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='md-clear'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='stibp'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='arch-capabilities'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='ssbd'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='ibpb'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='ibrs'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='amd-stibp'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='amd-ssbd'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='disable' name='erms'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='disable' name='xsaveopt'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='disable' name='lm'/>
Nov 10 17:40:15 user nova-compute[75100]:     </mode>
Nov 10 17:40:15 user nova-compute[75100]:     <mode name='custom' supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>qemu64</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>qemu32</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>phenom</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>pentium3</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>pentium2</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>pentium</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>n270</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>kvm64</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>kvm32</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>coreduo</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>core2duo</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>athlon</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Westmere-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Westmere</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Snowridge</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Skylake-Server</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Skylake-Client</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>SandyBridge</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Penryn</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Opteron_G5</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Opteron_G4</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Opteron_G3</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Opteron_G2</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Opteron_G1</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Nehalem-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Nehalem</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>IvyBridge</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Icelake-Server</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Haswell-noTSX</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Haswell-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Haswell</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>EPYC-Rome</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>EPYC-Milan</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>EPYC-IBPB</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>EPYC</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Dhyana</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Cooperlake</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Conroe</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Cascadelake-Server</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Broadwell-noTSX</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Broadwell-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Broadwell</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>486</model>
Nov 10 17:40:15 user nova-compute[75100]:     </mode>
Nov 10 17:40:15 user nova-compute[75100]:   </cpu>
Nov 10 17:40:15 user nova-compute[75100]:   <memoryBacking supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:     <enum name='sourceType'>
Nov 10 17:40:15 user nova-compute[75100]:       <value>file</value>
Nov 10 17:40:15 user nova-compute[75100]:       <value>anonymous</value>
Nov 10 17:40:15 user nova-compute[75100]:       <value>memfd</value>
Nov 10 17:40:15 user nova-compute[75100]:     </enum>
Nov 10 17:40:15 user nova-compute[75100]:   </memoryBacking>
Nov 10 17:40:15 user nova-compute[75100]:   <devices>
Nov 10 17:40:15 user nova-compute[75100]:     <disk supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='diskDevice'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>disk</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>cdrom</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>floppy</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>lun</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='bus'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>ide</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>fdc</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>scsi</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtio</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>usb</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>sata</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='model'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtio</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtio-transitional</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtio-non-transitional</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </disk>
Nov 10 17:40:15 user nova-compute[75100]:     <graphics supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='type'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>sdl</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>vnc</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>spice</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>egl-headless</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </graphics>
Nov 10 17:40:15 user nova-compute[75100]:     <video supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='modelType'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>vga</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>cirrus</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>vmvga</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>qxl</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtio</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>none</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>bochs</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>ramfb</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </video>
Nov 10 17:40:15 user nova-compute[75100]:     <hostdev supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='mode'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>subsystem</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='startupPolicy'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>default</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>mandatory</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>requisite</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>optional</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='subsysType'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>usb</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>pci</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>scsi</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='capsType'/>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='pciBackend'/>
Nov 10 17:40:15 user nova-compute[75100]:     </hostdev>
Nov 10 17:40:15 user nova-compute[75100]:     <rng supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='model'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtio</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtio-transitional</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtio-non-transitional</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='backendModel'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>random</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>egd</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>builtin</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </rng>
Nov 10 17:40:15 user nova-compute[75100]:     <filesystem supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='driverType'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>path</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>handle</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtiofs</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </filesystem>
Nov 10 17:40:15 user nova-compute[75100]:     <tpm supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='model'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>tpm-tis</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>tpm-crb</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='backendModel'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>passthrough</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>emulator</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </tpm>
Nov 10 17:40:15 user nova-compute[75100]:   </devices>
Nov 10 17:40:15 user nova-compute[75100]:   <features>
Nov 10 17:40:15 user nova-compute[75100]:     <gic supported='no'/>
Nov 10 17:40:15 user nova-compute[75100]:     <vmcoreinfo supported='yes'/>
Nov 10 17:40:15 user nova-compute[75100]:     <genid supported='yes'/>
Nov 10 17:40:15 user nova-compute[75100]:     <backingStoreInput supported='yes'/>
Nov 10 17:40:15 user nova-compute[75100]:     <backup supported='yes'/>
Nov 10 17:40:15 user nova-compute[75100]:     <sev supported='no'/>
Nov 10 17:40:15 user nova-compute[75100]:   </features>
Nov 10 17:40:15 user nova-compute[75100]: </domainCapabilities>
Nov 10 17:40:15 user nova-compute[75100]:  {{(pid=75100) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 10 17:40:15 user nova-compute[75100]: <domainCapabilities>
Nov 10 17:40:15 user nova-compute[75100]:   <path>/usr/bin/qemu-system-i386</path>
Nov 10 17:40:15 user nova-compute[75100]:   <domain>kvm</domain>
Nov 10 17:40:15 user nova-compute[75100]:   <machine>pc-q35-jammy</machine>
Nov 10 17:40:15 user nova-compute[75100]:   <arch>i686</arch>
Nov 10 17:40:15 user nova-compute[75100]:   <vcpu max='288'/>
Nov 10 17:40:15 user nova-compute[75100]:   <iothreads supported='yes'/>
Nov 10 17:40:15 user nova-compute[75100]:   <os supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:     <enum name='firmware'/>
Nov 10 17:40:15 user nova-compute[75100]:     <loader supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 10 17:40:15 user nova-compute[75100]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 10 17:40:15 user nova-compute[75100]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 10 17:40:15 user nova-compute[75100]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 10 17:40:15 user nova-compute[75100]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='type'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>rom</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>pflash</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='readonly'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>yes</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>no</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='secure'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>no</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </loader>
Nov 10 17:40:15 user nova-compute[75100]:   </os>
Nov 10 17:40:15 user nova-compute[75100]:   <cpu>
Nov 10 17:40:15 user nova-compute[75100]:     <mode name='host-passthrough' supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='hostPassthroughMigratable'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>off</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </mode>
Nov 10 17:40:15 user nova-compute[75100]:     <mode name='maximum' supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='maximumMigratable'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>on</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>off</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </mode>
Nov 10 17:40:15 user nova-compute[75100]:     <mode name='host-model' supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <vendor>Intel</vendor>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='ss'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='vmx'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='pcid'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='hypervisor'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='arat'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='tsc_adjust'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='umip'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='md-clear'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='stibp'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='arch-capabilities'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='ssbd'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='ibpb'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='ibrs'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='amd-stibp'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='amd-ssbd'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='disable' name='erms'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='disable' name='xsaveopt'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='disable' name='lm'/>
Nov 10 17:40:15 user nova-compute[75100]:     </mode>
Nov 10 17:40:15 user nova-compute[75100]:     <mode name='custom' supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>qemu64</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>qemu32</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>phenom</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>pentium3</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>pentium2</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>pentium</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>n270</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>kvm64</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>kvm32</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>coreduo</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>core2duo</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>athlon</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Westmere-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Westmere</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Snowridge</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Skylake-Server</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Skylake-Client</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>SandyBridge</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Penryn</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Opteron_G5</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Opteron_G4</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Opteron_G3</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Opteron_G2</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Opteron_G1</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Nehalem-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Nehalem</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>IvyBridge</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Icelake-Server</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Haswell-noTSX</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Haswell-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Haswell</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>EPYC-Rome</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>EPYC-Milan</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>EPYC-IBPB</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>EPYC</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Dhyana</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Cooperlake</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Conroe</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Cascadelake-Server</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Broadwell-noTSX</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Broadwell-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Broadwell</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>486</model>
Nov 10 17:40:15 user nova-compute[75100]:     </mode>
Nov 10 17:40:15 user nova-compute[75100]:   </cpu>
Nov 10 17:40:15 user nova-compute[75100]:   <memoryBacking supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:     <enum name='sourceType'>
Nov 10 17:40:15 user nova-compute[75100]:       <value>file</value>
Nov 10 17:40:15 user nova-compute[75100]:       <value>anonymous</value>
Nov 10 17:40:15 user nova-compute[75100]:       <value>memfd</value>
Nov 10 17:40:15 user nova-compute[75100]:     </enum>
Nov 10 17:40:15 user nova-compute[75100]:   </memoryBacking>
Nov 10 17:40:15 user nova-compute[75100]:   <devices>
Nov 10 17:40:15 user nova-compute[75100]:     <disk supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='diskDevice'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>disk</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>cdrom</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>floppy</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>lun</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='bus'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>fdc</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>scsi</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtio</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>usb</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>sata</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='model'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtio</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtio-transitional</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtio-non-transitional</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </disk>
Nov 10 17:40:15 user nova-compute[75100]:     <graphics supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='type'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>sdl</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>vnc</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>spice</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>egl-headless</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </graphics>
Nov 10 17:40:15 user nova-compute[75100]:     <video supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='modelType'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>vga</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>cirrus</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>vmvga</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>qxl</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtio</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>none</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>bochs</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>ramfb</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </video>
Nov 10 17:40:15 user nova-compute[75100]:     <hostdev supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='mode'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>subsystem</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='startupPolicy'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>default</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>mandatory</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>requisite</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>optional</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='subsysType'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>usb</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>pci</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>scsi</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='capsType'/>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='pciBackend'/>
Nov 10 17:40:15 user nova-compute[75100]:     </hostdev>
Nov 10 17:40:15 user nova-compute[75100]:     <rng supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='model'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtio</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtio-transitional</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtio-non-transitional</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='backendModel'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>random</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>egd</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>builtin</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </rng>
Nov 10 17:40:15 user nova-compute[75100]:     <filesystem supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='driverType'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>path</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>handle</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtiofs</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </filesystem>
Nov 10 17:40:15 user nova-compute[75100]:     <tpm supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='model'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>tpm-tis</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>tpm-crb</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='backendModel'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>passthrough</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>emulator</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </tpm>
Nov 10 17:40:15 user nova-compute[75100]:   </devices>
Nov 10 17:40:15 user nova-compute[75100]:   <features>
Nov 10 17:40:15 user nova-compute[75100]:     <gic supported='no'/>
Nov 10 17:40:15 user nova-compute[75100]:     <vmcoreinfo supported='yes'/>
Nov 10 17:40:15 user nova-compute[75100]:     <genid supported='yes'/>
Nov 10 17:40:15 user nova-compute[75100]:     <backingStoreInput supported='yes'/>
Nov 10 17:40:15 user nova-compute[75100]:     <backup supported='yes'/>
Nov 10 17:40:15 user nova-compute[75100]:     <sev supported='no'/>
Nov 10 17:40:15 user nova-compute[75100]:   </features>
Nov 10 17:40:15 user nova-compute[75100]: </domainCapabilities>
Nov 10 17:40:15 user nova-compute[75100]:  {{(pid=75100) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 10 17:40:15 user nova-compute[75100]: <domainCapabilities>
Nov 10 17:40:15 user nova-compute[75100]:   <path>/usr/bin/qemu-system-i386</path>
Nov 10 17:40:15 user nova-compute[75100]:   <domain>kvm</domain>
Nov 10 17:40:15 user nova-compute[75100]:   <machine>pc-q35-6.2</machine>
Nov 10 17:40:15 user nova-compute[75100]:   <arch>i686</arch>
Nov 10 17:40:15 user nova-compute[75100]:   <vcpu max='288'/>
Nov 10 17:40:15 user nova-compute[75100]:   <iothreads supported='yes'/>
Nov 10 17:40:15 user nova-compute[75100]:   <os supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:     <enum name='firmware'/>
Nov 10 17:40:15 user nova-compute[75100]:     <loader supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 10 17:40:15 user nova-compute[75100]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 10 17:40:15 user nova-compute[75100]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 10 17:40:15 user nova-compute[75100]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 10 17:40:15 user nova-compute[75100]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='type'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>rom</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>pflash</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='readonly'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>yes</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>no</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='secure'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>no</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </loader>
Nov 10 17:40:15 user nova-compute[75100]:   </os>
Nov 10 17:40:15 user nova-compute[75100]:   <cpu>
Nov 10 17:40:15 user nova-compute[75100]:     <mode name='host-passthrough' supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='hostPassthroughMigratable'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>off</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </mode>
Nov 10 17:40:15 user nova-compute[75100]:     <mode name='maximum' supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='maximumMigratable'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>on</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>off</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </mode>
Nov 10 17:40:15 user nova-compute[75100]:     <mode name='host-model' supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <vendor>Intel</vendor>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='ss'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='vmx'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='pcid'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='hypervisor'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='arat'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='tsc_adjust'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='umip'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='md-clear'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='stibp'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='arch-capabilities'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='ssbd'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='ibpb'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='ibrs'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='amd-stibp'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='amd-ssbd'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='disable' name='erms'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='disable' name='xsaveopt'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='disable' name='lm'/>
Nov 10 17:40:15 user nova-compute[75100]:     </mode>
Nov 10 17:40:15 user nova-compute[75100]:     <mode name='custom' supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>qemu64</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>qemu32</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>phenom</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>pentium3</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>pentium2</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>pentium</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>n270</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>kvm64</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>kvm32</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>coreduo</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>core2duo</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>athlon</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Westmere-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Westmere</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Snowridge</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Skylake-Server</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Skylake-Client</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>SandyBridge</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Penryn</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Opteron_G5</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Opteron_G4</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Opteron_G3</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Opteron_G2</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Opteron_G1</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Nehalem-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Nehalem</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>IvyBridge</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Icelake-Server</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Haswell-noTSX</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Haswell-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Haswell</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>EPYC-Rome</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>EPYC-Milan</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>EPYC-IBPB</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>EPYC</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Dhyana</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Cooperlake</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Conroe</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Cascadelake-Server</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Broadwell-noTSX</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Broadwell-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Broadwell</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>486</model>
Nov 10 17:40:15 user nova-compute[75100]:     </mode>
Nov 10 17:40:15 user nova-compute[75100]:   </cpu>
Nov 10 17:40:15 user nova-compute[75100]:   <memoryBacking supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:     <enum name='sourceType'>
Nov 10 17:40:15 user nova-compute[75100]:       <value>file</value>
Nov 10 17:40:15 user nova-compute[75100]:       <value>anonymous</value>
Nov 10 17:40:15 user nova-compute[75100]:       <value>memfd</value>
Nov 10 17:40:15 user nova-compute[75100]:     </enum>
Nov 10 17:40:15 user nova-compute[75100]:   </memoryBacking>
Nov 10 17:40:15 user nova-compute[75100]:   <devices>
Nov 10 17:40:15 user nova-compute[75100]:     <disk supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='diskDevice'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>disk</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>cdrom</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>floppy</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>lun</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='bus'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>fdc</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>scsi</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtio</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>usb</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>sata</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='model'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtio</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtio-transitional</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtio-non-transitional</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </disk>
Nov 10 17:40:15 user nova-compute[75100]:     <graphics supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='type'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>sdl</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>vnc</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>spice</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>egl-headless</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </graphics>
Nov 10 17:40:15 user nova-compute[75100]:     <video supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='modelType'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>vga</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>cirrus</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>vmvga</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>qxl</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtio</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>none</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>bochs</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>ramfb</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </video>
Nov 10 17:40:15 user nova-compute[75100]:     <hostdev supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='mode'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>subsystem</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='startupPolicy'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>default</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>mandatory</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>requisite</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>optional</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='subsysType'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>usb</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>pci</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>scsi</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='capsType'/>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='pciBackend'/>
Nov 10 17:40:15 user nova-compute[75100]:     </hostdev>
Nov 10 17:40:15 user nova-compute[75100]:     <rng supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='model'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtio</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtio-transitional</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtio-non-transitional</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='backendModel'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>random</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>egd</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>builtin</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </rng>
Nov 10 17:40:15 user nova-compute[75100]:     <filesystem supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='driverType'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>path</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>handle</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtiofs</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </filesystem>
Nov 10 17:40:15 user nova-compute[75100]:     <tpm supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='model'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>tpm-tis</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>tpm-crb</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='backendModel'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>passthrough</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>emulator</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </tpm>
Nov 10 17:40:15 user nova-compute[75100]:   </devices>
Nov 10 17:40:15 user nova-compute[75100]:   <features>
Nov 10 17:40:15 user nova-compute[75100]:     <gic supported='no'/>
Nov 10 17:40:15 user nova-compute[75100]:     <vmcoreinfo supported='yes'/>
Nov 10 17:40:15 user nova-compute[75100]:     <genid supported='yes'/>
Nov 10 17:40:15 user nova-compute[75100]:     <backingStoreInput supported='yes'/>
Nov 10 17:40:15 user nova-compute[75100]:     <backup supported='yes'/>
Nov 10 17:40:15 user nova-compute[75100]:     <sev supported='no'/>
Nov 10 17:40:15 user nova-compute[75100]:   </features>
Nov 10 17:40:15 user nova-compute[75100]: </domainCapabilities>
Nov 10 17:40:15 user nova-compute[75100]:  {{(pid=75100) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 10 17:40:15 user nova-compute[75100]: <domainCapabilities>
Nov 10 17:40:15 user nova-compute[75100]:   <path>/usr/bin/qemu-system-i386</path>
Nov 10 17:40:15 user nova-compute[75100]:   <domain>kvm</domain>
Nov 10 17:40:15 user nova-compute[75100]:   <machine>pc-i440fx-6.2</machine>
Nov 10 17:40:15 user nova-compute[75100]:   <arch>i686</arch>
Nov 10 17:40:15 user nova-compute[75100]:   <vcpu max='255'/>
Nov 10 17:40:15 user nova-compute[75100]:   <iothreads supported='yes'/>
Nov 10 17:40:15 user nova-compute[75100]:   <os supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:     <enum name='firmware'/>
Nov 10 17:40:15 user nova-compute[75100]:     <loader supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 10 17:40:15 user nova-compute[75100]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 10 17:40:15 user nova-compute[75100]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 10 17:40:15 user nova-compute[75100]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 10 17:40:15 user nova-compute[75100]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='type'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>rom</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>pflash</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='readonly'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>yes</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>no</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='secure'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>no</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </loader>
Nov 10 17:40:15 user nova-compute[75100]:   </os>
Nov 10 17:40:15 user nova-compute[75100]:   <cpu>
Nov 10 17:40:15 user nova-compute[75100]:     <mode name='host-passthrough' supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='hostPassthroughMigratable'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>off</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </mode>
Nov 10 17:40:15 user nova-compute[75100]:     <mode name='maximum' supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='maximumMigratable'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>on</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>off</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </mode>
Nov 10 17:40:15 user nova-compute[75100]:     <mode name='host-model' supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <vendor>Intel</vendor>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='ss'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='vmx'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='pcid'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='hypervisor'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='arat'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='tsc_adjust'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='umip'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='md-clear'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='stibp'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='arch-capabilities'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='ssbd'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='ibpb'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='ibrs'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='amd-stibp'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='amd-ssbd'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='disable' name='erms'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='disable' name='xsaveopt'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='disable' name='lm'/>
Nov 10 17:40:15 user nova-compute[75100]:     </mode>
Nov 10 17:40:15 user nova-compute[75100]:     <mode name='custom' supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>qemu64</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>qemu32</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>phenom</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>pentium3</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>pentium2</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>pentium</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>n270</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>kvm64</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>kvm32</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>coreduo</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>core2duo</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>athlon</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Westmere-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Westmere</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Snowridge</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Skylake-Server</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Skylake-Client</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>SandyBridge</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Penryn</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Opteron_G5</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Opteron_G4</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Opteron_G3</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Opteron_G2</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Opteron_G1</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Nehalem-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Nehalem</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>IvyBridge</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Icelake-Server</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Haswell-noTSX</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Haswell-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Haswell</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>EPYC-Rome</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>EPYC-Milan</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>EPYC-IBPB</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>EPYC</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Dhyana</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Cooperlake</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Conroe</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Cascadelake-Server</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Broadwell-noTSX</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Broadwell-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Broadwell</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>486</model>
Nov 10 17:40:15 user nova-compute[75100]:     </mode>
Nov 10 17:40:15 user nova-compute[75100]:   </cpu>
Nov 10 17:40:15 user nova-compute[75100]:   <memoryBacking supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:     <enum name='sourceType'>
Nov 10 17:40:15 user nova-compute[75100]:       <value>file</value>
Nov 10 17:40:15 user nova-compute[75100]:       <value>anonymous</value>
Nov 10 17:40:15 user nova-compute[75100]:       <value>memfd</value>
Nov 10 17:40:15 user nova-compute[75100]:     </enum>
Nov 10 17:40:15 user nova-compute[75100]:   </memoryBacking>
Nov 10 17:40:15 user nova-compute[75100]:   <devices>
Nov 10 17:40:15 user nova-compute[75100]:     <disk supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='diskDevice'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>disk</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>cdrom</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>floppy</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>lun</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='bus'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>ide</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>fdc</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>scsi</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtio</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>usb</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>sata</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='model'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtio</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtio-transitional</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtio-non-transitional</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </disk>
Nov 10 17:40:15 user nova-compute[75100]:     <graphics supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='type'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>sdl</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>vnc</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>spice</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>egl-headless</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </graphics>
Nov 10 17:40:15 user nova-compute[75100]:     <video supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='modelType'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>vga</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>cirrus</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>vmvga</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>qxl</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtio</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>none</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>bochs</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>ramfb</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </video>
Nov 10 17:40:15 user nova-compute[75100]:     <hostdev supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='mode'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>subsystem</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='startupPolicy'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>default</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>mandatory</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>requisite</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>optional</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='subsysType'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>usb</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>pci</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>scsi</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='capsType'/>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='pciBackend'/>
Nov 10 17:40:15 user nova-compute[75100]:     </hostdev>
Nov 10 17:40:15 user nova-compute[75100]:     <rng supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='model'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtio</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtio-transitional</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtio-non-transitional</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='backendModel'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>random</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>egd</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>builtin</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </rng>
Nov 10 17:40:15 user nova-compute[75100]:     <filesystem supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='driverType'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>path</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>handle</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtiofs</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </filesystem>
Nov 10 17:40:15 user nova-compute[75100]:     <tpm supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='model'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>tpm-tis</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>tpm-crb</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='backendModel'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>passthrough</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>emulator</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </tpm>
Nov 10 17:40:15 user nova-compute[75100]:   </devices>
Nov 10 17:40:15 user nova-compute[75100]:   <features>
Nov 10 17:40:15 user nova-compute[75100]:     <gic supported='no'/>
Nov 10 17:40:15 user nova-compute[75100]:     <vmcoreinfo supported='yes'/>
Nov 10 17:40:15 user nova-compute[75100]:     <genid supported='yes'/>
Nov 10 17:40:15 user nova-compute[75100]:     <backingStoreInput supported='yes'/>
Nov 10 17:40:15 user nova-compute[75100]:     <backup supported='yes'/>
Nov 10 17:40:15 user nova-compute[75100]:     <sev supported='no'/>
Nov 10 17:40:15 user nova-compute[75100]:   </features>
Nov 10 17:40:15 user nova-compute[75100]: </domainCapabilities>
Nov 10 17:40:15 user nova-compute[75100]:  {{(pid=75100) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=75100) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75100) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75100) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75100) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75100) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75100) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75100) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75100) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75100) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75100) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75100) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75100) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75100) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75100) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75100) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75100) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75100) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Getting domain capabilities for ppc64 via machine types: {'pseries', None, 'powernv'} {{(pid=75100) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75100) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75100) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75100) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=75100) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75100) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75100) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75100) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75100) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75100) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75100) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75100) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75100) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75100) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75100) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75100) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75100) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75100) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75100) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75100) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75100) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'ubuntu-q35', 'q35', 'pc'} {{(pid=75100) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 10 17:40:15 user nova-compute[75100]: <domainCapabilities>
Nov 10 17:40:15 user nova-compute[75100]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 10 17:40:15 user nova-compute[75100]:   <domain>kvm</domain>
Nov 10 17:40:15 user nova-compute[75100]:   <machine>pc-i440fx-jammy</machine>
Nov 10 17:40:15 user nova-compute[75100]:   <arch>x86_64</arch>
Nov 10 17:40:15 user nova-compute[75100]:   <vcpu max='255'/>
Nov 10 17:40:15 user nova-compute[75100]:   <iothreads supported='yes'/>
Nov 10 17:40:15 user nova-compute[75100]:   <os supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:     <enum name='firmware'>
Nov 10 17:40:15 user nova-compute[75100]:       <value>efi</value>
Nov 10 17:40:15 user nova-compute[75100]:     </enum>
Nov 10 17:40:15 user nova-compute[75100]:     <loader supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='type'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>rom</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>pflash</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='readonly'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>yes</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>no</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='secure'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>no</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </loader>
Nov 10 17:40:15 user nova-compute[75100]:   </os>
Nov 10 17:40:15 user nova-compute[75100]:   <cpu>
Nov 10 17:40:15 user nova-compute[75100]:     <mode name='host-passthrough' supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='hostPassthroughMigratable'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>on</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>off</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </mode>
Nov 10 17:40:15 user nova-compute[75100]:     <mode name='maximum' supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='maximumMigratable'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>on</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>off</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </mode>
Nov 10 17:40:15 user nova-compute[75100]:     <mode name='host-model' supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <vendor>Intel</vendor>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='ss'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='vmx'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='pcid'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='hypervisor'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='arat'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='tsc_adjust'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='umip'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='md-clear'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='stibp'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='arch-capabilities'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='ssbd'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='invtsc'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='ibpb'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='ibrs'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='amd-stibp'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='amd-ssbd'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='rsba'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='pschange-mc-no'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='disable' name='erms'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='disable' name='xsaveopt'/>
Nov 10 17:40:15 user nova-compute[75100]:     </mode>
Nov 10 17:40:15 user nova-compute[75100]:     <mode name='custom' supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>qemu64</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>qemu32</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>phenom</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>pentium3</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>pentium2</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>pentium</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>n270</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>kvm64</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>kvm32</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>coreduo</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>core2duo</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>athlon</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>Westmere-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>Westmere</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Snowridge</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Skylake-Server</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Skylake-Client</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>SandyBridge</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>Penryn</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Opteron_G5</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Opteron_G4</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Opteron_G3</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Opteron_G2</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>Opteron_G1</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>Nehalem</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>IvyBridge</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Icelake-Server</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Haswell-noTSX</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Haswell-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Haswell</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>EPYC-Rome</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>EPYC-Milan</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>EPYC-IBPB</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>EPYC</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Dhyana</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Cooperlake</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>Conroe</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Cascadelake-Server</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Broadwell-noTSX</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Broadwell-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Broadwell</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>486</model>
Nov 10 17:40:15 user nova-compute[75100]:     </mode>
Nov 10 17:40:15 user nova-compute[75100]:   </cpu>
Nov 10 17:40:15 user nova-compute[75100]:   <memoryBacking supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:     <enum name='sourceType'>
Nov 10 17:40:15 user nova-compute[75100]:       <value>file</value>
Nov 10 17:40:15 user nova-compute[75100]:       <value>anonymous</value>
Nov 10 17:40:15 user nova-compute[75100]:       <value>memfd</value>
Nov 10 17:40:15 user nova-compute[75100]:     </enum>
Nov 10 17:40:15 user nova-compute[75100]:   </memoryBacking>
Nov 10 17:40:15 user nova-compute[75100]:   <devices>
Nov 10 17:40:15 user nova-compute[75100]:     <disk supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='diskDevice'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>disk</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>cdrom</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>floppy</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>lun</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='bus'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>ide</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>fdc</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>scsi</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtio</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>usb</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>sata</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='model'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtio</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtio-transitional</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtio-non-transitional</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </disk>
Nov 10 17:40:15 user nova-compute[75100]:     <graphics supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='type'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>sdl</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>vnc</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>spice</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>egl-headless</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </graphics>
Nov 10 17:40:15 user nova-compute[75100]:     <video supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='modelType'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>vga</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>cirrus</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>vmvga</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>qxl</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtio</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>none</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>bochs</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>ramfb</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </video>
Nov 10 17:40:15 user nova-compute[75100]:     <hostdev supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='mode'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>subsystem</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='startupPolicy'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>default</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>mandatory</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>requisite</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>optional</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='subsysType'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>usb</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>pci</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>scsi</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='capsType'/>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='pciBackend'/>
Nov 10 17:40:15 user nova-compute[75100]:     </hostdev>
Nov 10 17:40:15 user nova-compute[75100]:     <rng supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='model'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtio</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtio-transitional</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtio-non-transitional</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='backendModel'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>random</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>egd</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>builtin</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </rng>
Nov 10 17:40:15 user nova-compute[75100]:     <filesystem supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='driverType'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>path</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>handle</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtiofs</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </filesystem>
Nov 10 17:40:15 user nova-compute[75100]:     <tpm supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='model'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>tpm-tis</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>tpm-crb</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='backendModel'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>passthrough</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>emulator</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </tpm>
Nov 10 17:40:15 user nova-compute[75100]:   </devices>
Nov 10 17:40:15 user nova-compute[75100]:   <features>
Nov 10 17:40:15 user nova-compute[75100]:     <gic supported='no'/>
Nov 10 17:40:15 user nova-compute[75100]:     <vmcoreinfo supported='yes'/>
Nov 10 17:40:15 user nova-compute[75100]:     <genid supported='yes'/>
Nov 10 17:40:15 user nova-compute[75100]:     <backingStoreInput supported='yes'/>
Nov 10 17:40:15 user nova-compute[75100]:     <backup supported='yes'/>
Nov 10 17:40:15 user nova-compute[75100]:     <sev supported='no'/>
Nov 10 17:40:15 user nova-compute[75100]:   </features>
Nov 10 17:40:15 user nova-compute[75100]: </domainCapabilities>
Nov 10 17:40:15 user nova-compute[75100]:  {{(pid=75100) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 10 17:40:15 user nova-compute[75100]: <domainCapabilities>
Nov 10 17:40:15 user nova-compute[75100]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 10 17:40:15 user nova-compute[75100]:   <domain>kvm</domain>
Nov 10 17:40:15 user nova-compute[75100]:   <machine>pc-q35-jammy</machine>
Nov 10 17:40:15 user nova-compute[75100]:   <arch>x86_64</arch>
Nov 10 17:40:15 user nova-compute[75100]:   <vcpu max='288'/>
Nov 10 17:40:15 user nova-compute[75100]:   <iothreads supported='yes'/>
Nov 10 17:40:15 user nova-compute[75100]:   <os supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:     <enum name='firmware'>
Nov 10 17:40:15 user nova-compute[75100]:       <value>efi</value>
Nov 10 17:40:15 user nova-compute[75100]:     </enum>
Nov 10 17:40:15 user nova-compute[75100]:     <loader supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 10 17:40:15 user nova-compute[75100]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 10 17:40:15 user nova-compute[75100]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='type'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>rom</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>pflash</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='readonly'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>yes</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>no</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='secure'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>yes</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>no</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </loader>
Nov 10 17:40:15 user nova-compute[75100]:   </os>
Nov 10 17:40:15 user nova-compute[75100]:   <cpu>
Nov 10 17:40:15 user nova-compute[75100]:     <mode name='host-passthrough' supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='hostPassthroughMigratable'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>on</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>off</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </mode>
Nov 10 17:40:15 user nova-compute[75100]:     <mode name='maximum' supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='maximumMigratable'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>on</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>off</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </mode>
Nov 10 17:40:15 user nova-compute[75100]:     <mode name='host-model' supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <vendor>Intel</vendor>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='ss'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='vmx'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='pcid'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='hypervisor'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='arat'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='tsc_adjust'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='umip'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='md-clear'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='stibp'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='arch-capabilities'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='ssbd'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='invtsc'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='ibpb'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='ibrs'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='amd-stibp'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='amd-ssbd'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='rsba'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='pschange-mc-no'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='disable' name='erms'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='disable' name='xsaveopt'/>
Nov 10 17:40:15 user nova-compute[75100]:     </mode>
Nov 10 17:40:15 user nova-compute[75100]:     <mode name='custom' supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>qemu64</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>qemu32</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>phenom</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>pentium3</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>pentium2</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>pentium</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>n270</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>kvm64</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>kvm32</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>coreduo</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>core2duo</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>athlon</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>Westmere-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>Westmere</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Snowridge</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Skylake-Server</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Skylake-Client</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>SandyBridge</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>Penryn</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Opteron_G5</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Opteron_G4</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Opteron_G3</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Opteron_G2</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>Opteron_G1</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>Nehalem</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>IvyBridge</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Icelake-Server</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Haswell-noTSX</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Haswell-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Haswell</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>EPYC-Rome</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>EPYC-Milan</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>EPYC-IBPB</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>EPYC</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Dhyana</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Cooperlake</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>Conroe</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Cascadelake-Server</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Broadwell-noTSX</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Broadwell-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Broadwell</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>486</model>
Nov 10 17:40:15 user nova-compute[75100]:     </mode>
Nov 10 17:40:15 user nova-compute[75100]:   </cpu>
Nov 10 17:40:15 user nova-compute[75100]:   <memoryBacking supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:     <enum name='sourceType'>
Nov 10 17:40:15 user nova-compute[75100]:       <value>file</value>
Nov 10 17:40:15 user nova-compute[75100]:       <value>anonymous</value>
Nov 10 17:40:15 user nova-compute[75100]:       <value>memfd</value>
Nov 10 17:40:15 user nova-compute[75100]:     </enum>
Nov 10 17:40:15 user nova-compute[75100]:   </memoryBacking>
Nov 10 17:40:15 user nova-compute[75100]:   <devices>
Nov 10 17:40:15 user nova-compute[75100]:     <disk supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='diskDevice'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>disk</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>cdrom</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>floppy</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>lun</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='bus'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>fdc</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>scsi</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtio</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>usb</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>sata</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='model'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtio</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtio-transitional</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtio-non-transitional</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </disk>
Nov 10 17:40:15 user nova-compute[75100]:     <graphics supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='type'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>sdl</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>vnc</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>spice</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>egl-headless</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </graphics>
Nov 10 17:40:15 user nova-compute[75100]:     <video supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='modelType'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>vga</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>cirrus</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>vmvga</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>qxl</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtio</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>none</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>bochs</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>ramfb</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </video>
Nov 10 17:40:15 user nova-compute[75100]:     <hostdev supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='mode'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>subsystem</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='startupPolicy'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>default</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>mandatory</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>requisite</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>optional</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='subsysType'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>usb</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>pci</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>scsi</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='capsType'/>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='pciBackend'/>
Nov 10 17:40:15 user nova-compute[75100]:     </hostdev>
Nov 10 17:40:15 user nova-compute[75100]:     <rng supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='model'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtio</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtio-transitional</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtio-non-transitional</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='backendModel'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>random</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>egd</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>builtin</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </rng>
Nov 10 17:40:15 user nova-compute[75100]:     <filesystem supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='driverType'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>path</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>handle</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtiofs</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </filesystem>
Nov 10 17:40:15 user nova-compute[75100]:     <tpm supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='model'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>tpm-tis</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>tpm-crb</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='backendModel'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>passthrough</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>emulator</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </tpm>
Nov 10 17:40:15 user nova-compute[75100]:   </devices>
Nov 10 17:40:15 user nova-compute[75100]:   <features>
Nov 10 17:40:15 user nova-compute[75100]:     <gic supported='no'/>
Nov 10 17:40:15 user nova-compute[75100]:     <vmcoreinfo supported='yes'/>
Nov 10 17:40:15 user nova-compute[75100]:     <genid supported='yes'/>
Nov 10 17:40:15 user nova-compute[75100]:     <backingStoreInput supported='yes'/>
Nov 10 17:40:15 user nova-compute[75100]:     <backup supported='yes'/>
Nov 10 17:40:15 user nova-compute[75100]:     <sev supported='no'/>
Nov 10 17:40:15 user nova-compute[75100]:   </features>
Nov 10 17:40:15 user nova-compute[75100]: </domainCapabilities>
Nov 10 17:40:15 user nova-compute[75100]:  {{(pid=75100) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 10 17:40:15 user nova-compute[75100]: <domainCapabilities>
Nov 10 17:40:15 user nova-compute[75100]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 10 17:40:15 user nova-compute[75100]:   <domain>kvm</domain>
Nov 10 17:40:15 user nova-compute[75100]:   <machine>pc-q35-6.2</machine>
Nov 10 17:40:15 user nova-compute[75100]:   <arch>x86_64</arch>
Nov 10 17:40:15 user nova-compute[75100]:   <vcpu max='288'/>
Nov 10 17:40:15 user nova-compute[75100]:   <iothreads supported='yes'/>
Nov 10 17:40:15 user nova-compute[75100]:   <os supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:     <enum name='firmware'>
Nov 10 17:40:15 user nova-compute[75100]:       <value>efi</value>
Nov 10 17:40:15 user nova-compute[75100]:     </enum>
Nov 10 17:40:15 user nova-compute[75100]:     <loader supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 10 17:40:15 user nova-compute[75100]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 10 17:40:15 user nova-compute[75100]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='type'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>rom</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>pflash</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='readonly'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>yes</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>no</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='secure'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>yes</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>no</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </loader>
Nov 10 17:40:15 user nova-compute[75100]:   </os>
Nov 10 17:40:15 user nova-compute[75100]:   <cpu>
Nov 10 17:40:15 user nova-compute[75100]:     <mode name='host-passthrough' supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='hostPassthroughMigratable'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>on</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>off</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </mode>
Nov 10 17:40:15 user nova-compute[75100]:     <mode name='maximum' supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='maximumMigratable'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>on</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>off</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </mode>
Nov 10 17:40:15 user nova-compute[75100]:     <mode name='host-model' supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <vendor>Intel</vendor>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='ss'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='vmx'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='pcid'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='hypervisor'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='arat'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='tsc_adjust'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='umip'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='md-clear'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='stibp'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='arch-capabilities'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='ssbd'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='invtsc'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='ibpb'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='ibrs'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='amd-stibp'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='amd-ssbd'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='rsba'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='pschange-mc-no'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='disable' name='erms'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='disable' name='xsaveopt'/>
Nov 10 17:40:15 user nova-compute[75100]:     </mode>
Nov 10 17:40:15 user nova-compute[75100]:     <mode name='custom' supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>qemu64</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>qemu32</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>phenom</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>pentium3</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>pentium2</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>pentium</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>n270</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>kvm64</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>kvm32</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>coreduo</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>core2duo</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>athlon</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>Westmere-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>Westmere</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Snowridge</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Skylake-Server</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Skylake-Client</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>SandyBridge</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>Penryn</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Opteron_G5</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Opteron_G4</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Opteron_G3</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Opteron_G2</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>Opteron_G1</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>Nehalem</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>IvyBridge</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Icelake-Server</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Haswell-noTSX</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Haswell-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Haswell</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>EPYC-Rome</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>EPYC-Milan</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>EPYC-IBPB</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>EPYC</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Dhyana</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Cooperlake</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>Conroe</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Cascadelake-Server</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Broadwell-noTSX</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Broadwell-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Broadwell</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>486</model>
Nov 10 17:40:15 user nova-compute[75100]:     </mode>
Nov 10 17:40:15 user nova-compute[75100]:   </cpu>
Nov 10 17:40:15 user nova-compute[75100]:   <memoryBacking supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:     <enum name='sourceType'>
Nov 10 17:40:15 user nova-compute[75100]:       <value>file</value>
Nov 10 17:40:15 user nova-compute[75100]:       <value>anonymous</value>
Nov 10 17:40:15 user nova-compute[75100]:       <value>memfd</value>
Nov 10 17:40:15 user nova-compute[75100]:     </enum>
Nov 10 17:40:15 user nova-compute[75100]:   </memoryBacking>
Nov 10 17:40:15 user nova-compute[75100]:   <devices>
Nov 10 17:40:15 user nova-compute[75100]:     <disk supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='diskDevice'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>disk</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>cdrom</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>floppy</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>lun</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='bus'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>fdc</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>scsi</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtio</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>usb</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>sata</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='model'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtio</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtio-transitional</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtio-non-transitional</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </disk>
Nov 10 17:40:15 user nova-compute[75100]:     <graphics supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='type'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>sdl</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>vnc</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>spice</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>egl-headless</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </graphics>
Nov 10 17:40:15 user nova-compute[75100]:     <video supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='modelType'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>vga</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>cirrus</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>vmvga</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>qxl</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtio</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>none</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>bochs</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>ramfb</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </video>
Nov 10 17:40:15 user nova-compute[75100]:     <hostdev supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='mode'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>subsystem</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='startupPolicy'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>default</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>mandatory</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>requisite</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>optional</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='subsysType'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>usb</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>pci</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>scsi</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='capsType'/>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='pciBackend'/>
Nov 10 17:40:15 user nova-compute[75100]:     </hostdev>
Nov 10 17:40:15 user nova-compute[75100]:     <rng supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='model'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtio</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtio-transitional</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtio-non-transitional</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='backendModel'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>random</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>egd</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>builtin</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </rng>
Nov 10 17:40:15 user nova-compute[75100]:     <filesystem supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='driverType'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>path</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>handle</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtiofs</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </filesystem>
Nov 10 17:40:15 user nova-compute[75100]:     <tpm supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='model'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>tpm-tis</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>tpm-crb</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='backendModel'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>passthrough</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>emulator</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </tpm>
Nov 10 17:40:15 user nova-compute[75100]:   </devices>
Nov 10 17:40:15 user nova-compute[75100]:   <features>
Nov 10 17:40:15 user nova-compute[75100]:     <gic supported='no'/>
Nov 10 17:40:15 user nova-compute[75100]:     <vmcoreinfo supported='yes'/>
Nov 10 17:40:15 user nova-compute[75100]:     <genid supported='yes'/>
Nov 10 17:40:15 user nova-compute[75100]:     <backingStoreInput supported='yes'/>
Nov 10 17:40:15 user nova-compute[75100]:     <backup supported='yes'/>
Nov 10 17:40:15 user nova-compute[75100]:     <sev supported='no'/>
Nov 10 17:40:15 user nova-compute[75100]:   </features>
Nov 10 17:40:15 user nova-compute[75100]: </domainCapabilities>
Nov 10 17:40:15 user nova-compute[75100]:  {{(pid=75100) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 10 17:40:15 user nova-compute[75100]: <domainCapabilities>
Nov 10 17:40:15 user nova-compute[75100]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 10 17:40:15 user nova-compute[75100]:   <domain>kvm</domain>
Nov 10 17:40:15 user nova-compute[75100]:   <machine>pc-i440fx-6.2</machine>
Nov 10 17:40:15 user nova-compute[75100]:   <arch>x86_64</arch>
Nov 10 17:40:15 user nova-compute[75100]:   <vcpu max='255'/>
Nov 10 17:40:15 user nova-compute[75100]:   <iothreads supported='yes'/>
Nov 10 17:40:15 user nova-compute[75100]:   <os supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:     <enum name='firmware'>
Nov 10 17:40:15 user nova-compute[75100]:       <value>efi</value>
Nov 10 17:40:15 user nova-compute[75100]:     </enum>
Nov 10 17:40:15 user nova-compute[75100]:     <loader supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='type'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>rom</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>pflash</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='readonly'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>yes</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>no</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='secure'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>no</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </loader>
Nov 10 17:40:15 user nova-compute[75100]:   </os>
Nov 10 17:40:15 user nova-compute[75100]:   <cpu>
Nov 10 17:40:15 user nova-compute[75100]:     <mode name='host-passthrough' supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='hostPassthroughMigratable'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>on</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>off</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </mode>
Nov 10 17:40:15 user nova-compute[75100]:     <mode name='maximum' supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='maximumMigratable'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>on</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>off</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </mode>
Nov 10 17:40:15 user nova-compute[75100]:     <mode name='host-model' supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <vendor>Intel</vendor>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='ss'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='vmx'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='pcid'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='hypervisor'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='arat'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='tsc_adjust'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='umip'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='md-clear'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='stibp'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='arch-capabilities'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='ssbd'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='invtsc'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='ibpb'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='ibrs'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='amd-stibp'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='amd-ssbd'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='rsba'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='require' name='pschange-mc-no'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='disable' name='erms'/>
Nov 10 17:40:15 user nova-compute[75100]:       <feature policy='disable' name='xsaveopt'/>
Nov 10 17:40:15 user nova-compute[75100]:     </mode>
Nov 10 17:40:15 user nova-compute[75100]:     <mode name='custom' supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>qemu64</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>qemu32</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>phenom</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>pentium3</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>pentium2</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>pentium</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>n270</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>kvm64</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>kvm32</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>coreduo</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>core2duo</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>athlon</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>Westmere-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>Westmere</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Snowridge</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Skylake-Server</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Skylake-Client</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>SandyBridge</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>Penryn</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Opteron_G5</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Opteron_G4</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Opteron_G3</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Opteron_G2</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>Opteron_G1</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>Nehalem</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>IvyBridge</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Icelake-Server</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Haswell-noTSX</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Haswell-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Haswell</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>EPYC-Rome</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>EPYC-Milan</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>EPYC-IBPB</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>EPYC</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Dhyana</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Cooperlake</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>Conroe</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Cascadelake-Server</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Broadwell-noTSX</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Broadwell-IBRS</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='no'>Broadwell</model>
Nov 10 17:40:15 user nova-compute[75100]:       <model usable='yes'>486</model>
Nov 10 17:40:15 user nova-compute[75100]:     </mode>
Nov 10 17:40:15 user nova-compute[75100]:   </cpu>
Nov 10 17:40:15 user nova-compute[75100]:   <memoryBacking supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:     <enum name='sourceType'>
Nov 10 17:40:15 user nova-compute[75100]:       <value>file</value>
Nov 10 17:40:15 user nova-compute[75100]:       <value>anonymous</value>
Nov 10 17:40:15 user nova-compute[75100]:       <value>memfd</value>
Nov 10 17:40:15 user nova-compute[75100]:     </enum>
Nov 10 17:40:15 user nova-compute[75100]:   </memoryBacking>
Nov 10 17:40:15 user nova-compute[75100]:   <devices>
Nov 10 17:40:15 user nova-compute[75100]:     <disk supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='diskDevice'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>disk</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>cdrom</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>floppy</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>lun</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='bus'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>ide</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>fdc</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>scsi</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtio</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>usb</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>sata</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='model'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtio</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtio-transitional</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtio-non-transitional</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </disk>
Nov 10 17:40:15 user nova-compute[75100]:     <graphics supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='type'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>sdl</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>vnc</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>spice</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>egl-headless</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </graphics>
Nov 10 17:40:15 user nova-compute[75100]:     <video supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='modelType'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>vga</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>cirrus</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>vmvga</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>qxl</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtio</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>none</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>bochs</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>ramfb</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </video>
Nov 10 17:40:15 user nova-compute[75100]:     <hostdev supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='mode'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>subsystem</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='startupPolicy'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>default</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>mandatory</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>requisite</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>optional</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='subsysType'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>usb</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>pci</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>scsi</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='capsType'/>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='pciBackend'/>
Nov 10 17:40:15 user nova-compute[75100]:     </hostdev>
Nov 10 17:40:15 user nova-compute[75100]:     <rng supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='model'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtio</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtio-transitional</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtio-non-transitional</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='backendModel'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>random</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>egd</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>builtin</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </rng>
Nov 10 17:40:15 user nova-compute[75100]:     <filesystem supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='driverType'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>path</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>handle</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>virtiofs</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </filesystem>
Nov 10 17:40:15 user nova-compute[75100]:     <tpm supported='yes'>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='model'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>tpm-tis</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>tpm-crb</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:       <enum name='backendModel'>
Nov 10 17:40:15 user nova-compute[75100]:         <value>passthrough</value>
Nov 10 17:40:15 user nova-compute[75100]:         <value>emulator</value>
Nov 10 17:40:15 user nova-compute[75100]:       </enum>
Nov 10 17:40:15 user nova-compute[75100]:     </tpm>
Nov 10 17:40:15 user nova-compute[75100]:   </devices>
Nov 10 17:40:15 user nova-compute[75100]:   <features>
Nov 10 17:40:15 user nova-compute[75100]:     <gic supported='no'/>
Nov 10 17:40:15 user nova-compute[75100]:     <vmcoreinfo supported='yes'/>
Nov 10 17:40:15 user nova-compute[75100]:     <genid supported='yes'/>
Nov 10 17:40:15 user nova-compute[75100]:     <backingStoreInput supported='yes'/>
Nov 10 17:40:15 user nova-compute[75100]:     <backup supported='yes'/>
Nov 10 17:40:15 user nova-compute[75100]:     <sev supported='no'/>
Nov 10 17:40:15 user nova-compute[75100]:   </features>
Nov 10 17:40:15 user nova-compute[75100]: </domainCapabilities>
Nov 10 17:40:15 user nova-compute[75100]:  {{(pid=75100) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75100) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75100) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75100) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75100) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Checking secure boot support for host arch (x86_64) {{(pid=75100) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Checking secure boot support for host arch (x86_64) {{(pid=75100) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Checking secure boot support for host arch (x86_64) {{(pid=75100) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 10 17:40:15 user nova-compute[75100]: INFO nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Secure Boot support detected
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] cpu compare xml: <cpu match="exact">
Nov 10 17:40:15 user nova-compute[75100]:   <model>Nehalem</model>
Nov 10 17:40:15 user nova-compute[75100]: </cpu>
Nov 10 17:40:15 user nova-compute[75100]:  {{(pid=75100) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 10 17:40:15 user nova-compute[75100]: INFO nova.virt.node [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Generated node identity 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64
Nov 10 17:40:15 user nova-compute[75100]: INFO nova.virt.node [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Wrote node identity 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 to /opt/stack/data/nova/compute_id
Nov 10 17:40:15 user nova-compute[75100]: WARNING nova.compute.manager [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Compute nodes ['54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 10 17:40:15 user nova-compute[75100]: INFO nova.compute.manager [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 10 17:40:15 user nova-compute[75100]: WARNING nova.compute.manager [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 10 17:40:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 17:40:15 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:40:15 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:40:15 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Hypervisor/Node resource view: name=user free_ram=10956MB free_disk=25.47774887084961GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:40:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:40:15 user nova-compute[75100]: WARNING nova.compute.resource_tracker [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] No compute node record for user:54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 could not be found.
Nov 10 17:40:15 user nova-compute[75100]: INFO nova.compute.resource_tracker [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Compute node record created for user:user with uuid: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64
Nov 10 17:40:16 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 17:40:16 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 17:40:16 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] [req-61113ced-59c1-4af5-b9eb-541b53144be7] Created resource provider record via placement API for resource provider with UUID 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 and name user.
Nov 10 17:40:16 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75100) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 10 17:40:16 user nova-compute[75100]: INFO nova.virt.libvirt.host [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] kernel doesn't support AMD SEV
Nov 10 17:40:16 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Updating inventory in ProviderTree for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 17:40:16 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 17:40:16 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Libvirt baseline CPU <cpu>
Nov 10 17:40:16 user nova-compute[75100]:   <arch>x86_64</arch>
Nov 10 17:40:16 user nova-compute[75100]:   <model>Nehalem</model>
Nov 10 17:40:16 user nova-compute[75100]:   <vendor>Intel</vendor>
Nov 10 17:40:16 user nova-compute[75100]:   <topology sockets="6" cores="1" threads="1"/>
Nov 10 17:40:16 user nova-compute[75100]: </cpu>
Nov 10 17:40:16 user nova-compute[75100]:  {{(pid=75100) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 10 17:40:16 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Updated inventory for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 10 17:40:16 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Updating resource provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 generation from 0 to 1 during operation: update_inventory {{(pid=75100) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 10 17:40:16 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Updating inventory in ProviderTree for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 17:40:16 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Updating resource provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 generation from 1 to 2 during operation: update_traits {{(pid=75100) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 10 17:40:16 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 17:40:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.588s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:40:16 user nova-compute[75100]: DEBUG nova.service [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Creating RPC server for service compute {{(pid=75100) start /opt/stack/nova/nova/service.py:182}}
Nov 10 17:40:16 user nova-compute[75100]: DEBUG nova.service [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] Join ServiceGroup membership for this service compute {{(pid=75100) start /opt/stack/nova/nova/service.py:199}}
Nov 10 17:40:16 user nova-compute[75100]: DEBUG nova.servicegroup.drivers.db [None req-319a732e-39eb-4c74-910e-b0fc696cb32a None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75100) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 10 17:40:28 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:40:28 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:41:07 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:41:07 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:41:07 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 17:41:07 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Rebuilding the list of instances to heal {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 17:41:07 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Didn't find any instances for network info cache update. {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 17:41:07 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:41:07 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:41:07 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:41:07 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:41:07 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:41:07 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:41:07 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 17:41:07 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:41:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:41:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:41:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:41:07 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 17:41:07 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:41:07 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:41:07 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Hypervisor/Node resource view: name=user free_ram=10395MB free_disk=25.381603240966797GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 17:41:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:41:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:41:07 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 17:41:07 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 17:41:07 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:41:07 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:41:07 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 17:41:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.207s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:42:07 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:42:07 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:42:07 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:42:08 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:42:08 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:42:08 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 17:42:08 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Rebuilding the list of instances to heal {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 17:42:08 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Didn't find any instances for network info cache update. {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 17:42:08 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:42:09 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:42:09 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:42:09 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:42:09 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 17:42:09 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:42:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:42:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:42:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:42:09 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 17:42:09 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:42:09 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:42:09 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Hypervisor/Node resource view: name=user free_ram=10297MB free_disk=25.445934295654297GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 17:42:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:42:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:42:09 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 17:42:09 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 17:42:09 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:42:09 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:42:09 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 17:42:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.105s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:43:07 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:43:08 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:43:08 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:43:08 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:43:09 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:43:09 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:43:09 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 17:43:10 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:43:10 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 17:43:10 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Rebuilding the list of instances to heal {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 17:43:10 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Didn't find any instances for network info cache update. {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 17:43:10 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:43:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:43:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:43:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:43:10 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 17:43:10 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:43:10 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:43:10 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Hypervisor/Node resource view: name=user free_ram=10304MB free_disk=25.199817657470703GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 17:43:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:43:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:43:10 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 17:43:10 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 17:43:10 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:43:10 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:43:10 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 17:43:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.117s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:43:11 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:44:08 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:44:08 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:44:09 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:44:09 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 17:44:10 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:44:10 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:44:10 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:44:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:44:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:44:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:44:10 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 17:44:10 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:44:10 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:44:10 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Hypervisor/Node resource view: name=user free_ram=9626MB free_disk=25.226974487304688GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 17:44:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:44:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:44:10 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 17:44:10 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 17:44:10 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:44:10 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:44:10 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 17:44:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.107s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:44:11 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:44:12 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:44:12 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:44:12 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 17:44:12 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Rebuilding the list of instances to heal {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 17:44:12 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Didn't find any instances for network info cache update. {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 17:44:12 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:44:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Acquiring lock "c19fc271-a248-4631-a11f-89b7ed73bf85" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:44:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lock "c19fc271-a248-4631-a11f-89b7ed73bf85" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:44:19 user nova-compute[75100]: DEBUG nova.compute.manager [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 17:44:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:44:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:44:20 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 17:44:20 user nova-compute[75100]: INFO nova.compute.claims [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Claim successful on node user
Nov 10 17:44:20 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:44:20 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:44:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.823s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:44:20 user nova-compute[75100]: DEBUG nova.compute.manager [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 17:44:21 user nova-compute[75100]: DEBUG nova.compute.manager [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 17:44:21 user nova-compute[75100]: DEBUG nova.network.neutron [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 17:44:21 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 17:44:21 user nova-compute[75100]: DEBUG nova.compute.manager [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 17:44:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Acquiring lock "b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:44:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:44:21 user nova-compute[75100]: DEBUG nova.compute.manager [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 17:44:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 17:44:21 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Creating image(s)
Nov 10 17:44:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Acquiring lock "/opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:44:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lock "/opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:44:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lock "/opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:44:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Acquiring lock "818b9e28e061d41a38d903968b229be2ed9ba520" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:44:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:44:21 user nova-compute[75100]: DEBUG nova.compute.manager [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 17:44:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:44:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:44:21 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 17:44:21 user nova-compute[75100]: INFO nova.compute.claims [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Claim successful on node user
Nov 10 17:44:21 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:44:21 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:44:21 user nova-compute[75100]: DEBUG nova.policy [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b79cb22ab5774ce8991f237bd2204555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c970a503d74d32a1e2b71f086649fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 17:44:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.297s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:44:21 user nova-compute[75100]: DEBUG nova.compute.manager [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 17:44:21 user nova-compute[75100]: DEBUG nova.compute.manager [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 17:44:21 user nova-compute[75100]: DEBUG nova.network.neutron [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 17:44:21 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 17:44:21 user nova-compute[75100]: DEBUG nova.compute.manager [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 17:44:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520.part --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:44:22 user nova-compute[75100]: DEBUG nova.policy [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8cdb9250e6c7459587e429a0aea577c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19755f3e634fdfbd562c33fbfa2a88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 17:44:22 user nova-compute[75100]: DEBUG nova.compute.manager [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 17:44:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 17:44:22 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Creating image(s)
Nov 10 17:44:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Acquiring lock "/opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:44:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "/opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:44:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "/opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:44:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Acquiring lock "818b9e28e061d41a38d903968b229be2ed9ba520" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:44:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520.part --force-share --output=json" returned: 0 in 0.183s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:44:22 user nova-compute[75100]: DEBUG nova.virt.images [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] e3cc5321-4d40-49ee-885c-700e14741732 was qcow2, converting to raw {{(pid=75100) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 10 17:44:22 user nova-compute[75100]: DEBUG nova.privsep.utils [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75100) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 17:44:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520.part /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520.converted {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:44:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520.part /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520.converted" returned: 0 in 0.165s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:44:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520.converted --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:44:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520.converted --force-share --output=json" returned: 0 in 0.197s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:44:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.591s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:44:22 user nova-compute[75100]: INFO oslo.privsep.daemon [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp17kh9g64/privsep.sock']
Nov 10 17:44:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.418s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:44:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:44:22 user sudo[84354]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp17kh9g64/privsep.sock
Nov 10 17:44:22 user sudo[84354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 10 17:44:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Acquiring lock "3e14de19-540d-4dc2-a058-6874d8d14478" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:44:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "3e14de19-540d-4dc2-a058-6874d8d14478" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:44:23 user nova-compute[75100]: DEBUG nova.compute.manager [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 17:44:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:44:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:44:23 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 17:44:23 user nova-compute[75100]: INFO nova.compute.claims [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Claim successful on node user
Nov 10 17:44:24 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:44:24 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:44:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.480s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:44:24 user nova-compute[75100]: DEBUG nova.compute.manager [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 17:44:24 user nova-compute[75100]: DEBUG nova.network.neutron [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Successfully created port: eedb3d8e-5619-4df9-aef9-bbc44db1dba9 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 17:44:24 user nova-compute[75100]: DEBUG nova.compute.manager [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 17:44:24 user nova-compute[75100]: DEBUG nova.network.neutron [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 17:44:24 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 17:44:24 user sudo[84354]: pam_unix(sudo:session): session closed for user root
Nov 10 17:44:24 user nova-compute[75100]: INFO oslo.privsep.daemon [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Spawned new privsep daemon via rootwrap
Nov 10 17:44:24 user nova-compute[75100]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 10 17:44:24 user nova-compute[75100]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 10 17:44:24 user nova-compute[75100]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 10 17:44:24 user nova-compute[75100]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84362
Nov 10 17:44:24 user nova-compute[75100]: WARNING oslo_privsep.priv_context [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] privsep daemon already running
Nov 10 17:44:24 user nova-compute[75100]: DEBUG nova.compute.manager [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 17:44:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Acquiring lock "45efac9f-8de9-43aa-b361-b5e4cf78795f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:44:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Lock "45efac9f-8de9-43aa-b361-b5e4cf78795f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:44:24 user nova-compute[75100]: DEBUG nova.compute.manager [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 17:44:24 user nova-compute[75100]: DEBUG nova.compute.manager [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 17:44:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 17:44:24 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Creating image(s)
Nov 10 17:44:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Acquiring lock "/opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:44:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "/opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:44:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "/opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:44:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:44:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:44:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:44:24 user nova-compute[75100]: DEBUG nova.policy [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8cdb9250e6c7459587e429a0aea577c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19755f3e634fdfbd562c33fbfa2a88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 17:44:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:44:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:44:24 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 17:44:24 user nova-compute[75100]: INFO nova.compute.claims [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] Claim successful on node user
Nov 10 17:44:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.186s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:44:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Acquiring lock "818b9e28e061d41a38d903968b229be2ed9ba520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:44:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:44:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:44:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.188s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:44:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Acquiring lock "818b9e28e061d41a38d903968b229be2ed9ba520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:44:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.222s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:44:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Acquiring lock "818b9e28e061d41a38d903968b229be2ed9ba520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:44:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.202s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:44:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:44:25 user nova-compute[75100]: DEBUG nova.network.neutron [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Successfully created port: be620d2e-a2ea-49fe-9205-68101009027b {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 17:44:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk 1073741824" returned: 0 in 0.058s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:44:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:44:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:44:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.258s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:44:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:44:25 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:44:25 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:44:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.187s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:44:25 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 17:44:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:44:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.182s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:44:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:44:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.570s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:44:25 user nova-compute[75100]: DEBUG nova.compute.manager [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 17:44:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk 1073741824" returned: 0 in 0.056s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:44:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:44:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:44:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.475s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:44:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:44:25 user nova-compute[75100]: DEBUG nova.compute.manager [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 17:44:25 user nova-compute[75100]: DEBUG nova.network.neutron [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 17:44:25 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 17:44:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:44:25 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Cannot resize image /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 17:44:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 17:44:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Ensure instance console log exists: /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 17:44:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:44:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:44:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:44:25 user nova-compute[75100]: DEBUG nova.compute.manager [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 17:44:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.200s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:44:25 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 17:44:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:44:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.218s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:44:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:44:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk 1073741824" returned: 0 in 0.048s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:44:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:44:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:44:25 user nova-compute[75100]: DEBUG nova.compute.manager [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 17:44:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 17:44:25 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] Creating image(s)
Nov 10 17:44:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Acquiring lock "/opt/stack/data/nova/instances/45efac9f-8de9-43aa-b361-b5e4cf78795f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:44:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Lock "/opt/stack/data/nova/instances/45efac9f-8de9-43aa-b361-b5e4cf78795f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:44:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Lock "/opt/stack/data/nova/instances/45efac9f-8de9-43aa-b361-b5e4cf78795f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:44:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:44:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:44:25 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Cannot resize image /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 17:44:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 17:44:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Ensure instance console log exists: /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 17:44:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:44:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:44:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:44:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.189s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:44:25 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 17:44:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:44:25 user nova-compute[75100]: DEBUG nova.policy [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b6f778e7dbee479a92186100c7ffb9b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2bbe56892041fc909c5664f9668d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 17:44:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.201s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:44:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Acquiring lock "818b9e28e061d41a38d903968b229be2ed9ba520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:44:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:44:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:44:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:44:26 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Cannot resize image /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 17:44:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 17:44:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Ensure instance console log exists: /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 17:44:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:44:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:44:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:44:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.164s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:44:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/45efac9f-8de9-43aa-b361-b5e4cf78795f/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:44:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/45efac9f-8de9-43aa-b361-b5e4cf78795f/disk 1073741824" returned: 0 in 0.046s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:44:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.214s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:44:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:44:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.178s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:44:26 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Checking if we can resize image /opt/stack/data/nova/instances/45efac9f-8de9-43aa-b361-b5e4cf78795f/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 17:44:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45efac9f-8de9-43aa-b361-b5e4cf78795f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:44:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45efac9f-8de9-43aa-b361-b5e4cf78795f/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:44:26 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Cannot resize image /opt/stack/data/nova/instances/45efac9f-8de9-43aa-b361-b5e4cf78795f/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 17:44:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 17:44:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] Ensure instance console log exists: /opt/stack/data/nova/instances/45efac9f-8de9-43aa-b361-b5e4cf78795f/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 17:44:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:44:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:44:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:44:27 user nova-compute[75100]: DEBUG nova.network.neutron [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Successfully created port: d3f47ac6-ad90-4589-b41e-798c6fe6d5cf {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 17:44:27 user nova-compute[75100]: DEBUG nova.network.neutron [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Successfully updated port: be620d2e-a2ea-49fe-9205-68101009027b {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 17:44:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Acquiring lock "refresh_cache-b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:44:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Acquired lock "refresh_cache-b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:44:27 user nova-compute[75100]: DEBUG nova.network.neutron [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 17:44:27 user nova-compute[75100]: DEBUG nova.network.neutron [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Successfully updated port: eedb3d8e-5619-4df9-aef9-bbc44db1dba9 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 17:44:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Acquiring lock "refresh_cache-c19fc271-a248-4631-a11f-89b7ed73bf85" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:44:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Acquired lock "refresh_cache-c19fc271-a248-4631-a11f-89b7ed73bf85" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:44:27 user nova-compute[75100]: DEBUG nova.network.neutron [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 17:44:27 user nova-compute[75100]: DEBUG nova.network.neutron [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 17:44:27 user nova-compute[75100]: DEBUG nova.compute.manager [req-6ad236af-5fa1-48b0-b7c3-c1f2f5a26c82 req-4eba98a7-e0cc-4aeb-9e0b-4c1172c3b63e service nova] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Received event network-changed-be620d2e-a2ea-49fe-9205-68101009027b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:44:27 user nova-compute[75100]: DEBUG nova.compute.manager [req-6ad236af-5fa1-48b0-b7c3-c1f2f5a26c82 req-4eba98a7-e0cc-4aeb-9e0b-4c1172c3b63e service nova] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Refreshing instance network info cache due to event network-changed-be620d2e-a2ea-49fe-9205-68101009027b. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 17:44:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6ad236af-5fa1-48b0-b7c3-c1f2f5a26c82 req-4eba98a7-e0cc-4aeb-9e0b-4c1172c3b63e service nova] Acquiring lock "refresh_cache-b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:44:27 user nova-compute[75100]: DEBUG nova.network.neutron [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 17:44:28 user nova-compute[75100]: DEBUG nova.compute.manager [req-b1a4dd2b-41a3-483b-9e89-8786f3c41132 req-bb61971e-8563-46e4-8309-d818986e7be2 service nova] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Received event network-changed-eedb3d8e-5619-4df9-aef9-bbc44db1dba9 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:44:28 user nova-compute[75100]: DEBUG nova.compute.manager [req-b1a4dd2b-41a3-483b-9e89-8786f3c41132 req-bb61971e-8563-46e4-8309-d818986e7be2 service nova] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Refreshing instance network info cache due to event network-changed-eedb3d8e-5619-4df9-aef9-bbc44db1dba9. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 17:44:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b1a4dd2b-41a3-483b-9e89-8786f3c41132 req-bb61971e-8563-46e4-8309-d818986e7be2 service nova] Acquiring lock "refresh_cache-c19fc271-a248-4631-a11f-89b7ed73bf85" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:44:28 user nova-compute[75100]: DEBUG nova.network.neutron [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Updating instance_info_cache with network_info: [{"id": "be620d2e-a2ea-49fe-9205-68101009027b", "address": "fa:16:3e:2d:37:4e", "network": {"id": "26a554fe-9a5e-40c0-9981-5ac084c9ea73", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-269663495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19755f3e634fdfbd562c33fbfa2a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe620d2e-a2", "ovs_interfaceid": "be620d2e-a2ea-49fe-9205-68101009027b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:44:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Releasing lock "refresh_cache-b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:44:28 user nova-compute[75100]: DEBUG nova.compute.manager [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Instance network_info: |[{"id": "be620d2e-a2ea-49fe-9205-68101009027b", "address": "fa:16:3e:2d:37:4e", "network": {"id": "26a554fe-9a5e-40c0-9981-5ac084c9ea73", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-269663495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19755f3e634fdfbd562c33fbfa2a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe620d2e-a2", "ovs_interfaceid": "be620d2e-a2ea-49fe-9205-68101009027b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 17:44:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6ad236af-5fa1-48b0-b7c3-c1f2f5a26c82 req-4eba98a7-e0cc-4aeb-9e0b-4c1172c3b63e service nova] Acquired lock "refresh_cache-b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:44:28 user nova-compute[75100]: DEBUG nova.network.neutron [req-6ad236af-5fa1-48b0-b7c3-c1f2f5a26c82 req-4eba98a7-e0cc-4aeb-9e0b-4c1172c3b63e service nova] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Refreshing network info cache for port be620d2e-a2ea-49fe-9205-68101009027b {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 17:44:28 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Start _get_guest_xml network_info=[{"id": "be620d2e-a2ea-49fe-9205-68101009027b", "address": "fa:16:3e:2d:37:4e", "network": {"id": "26a554fe-9a5e-40c0-9981-5ac084c9ea73", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-269663495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19755f3e634fdfbd562c33fbfa2a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe620d2e-a2", "ovs_interfaceid": "be620d2e-a2ea-49fe-9205-68101009027b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'e3cc5321-4d40-49ee-885c-700e14741732'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 17:44:28 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:44:28 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:44:28 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 17:44:28 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 17:44:28 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 17:44:28 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 17:44:28 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 17:44:28 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T17:40:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 17:44:28 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 17:44:28 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 17:44:28 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 17:44:28 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 17:44:28 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 17:44:28 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 17:44:28 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 17:44:28 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 17:44:28 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 17:44:28 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 17:44:28 user nova-compute[75100]: DEBUG nova.privsep.utils [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75100) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 17:44:28 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:44:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-81379937',display_name='tempest-ServerRescueNegativeTestJSON-server-81379937',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-81379937',id=2,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b19755f3e634fdfbd562c33fbfa2a88',ramdisk_id='',reservation_id='r-sqwzcrjg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-783763036',owner_user_name='tempest-ServerRescueNegativeTestJSON-783763036-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:44:22Z,user_data=None,user_id='8cdb9250e6c7459587e429a0aea577c6',uuid=b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be620d2e-a2ea-49fe-9205-68101009027b", "address": "fa:16:3e:2d:37:4e", "network": {"id": "26a554fe-9a5e-40c0-9981-5ac084c9ea73", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-269663495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19755f3e634fdfbd562c33fbfa2a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe620d2e-a2", "ovs_interfaceid": "be620d2e-a2ea-49fe-9205-68101009027b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 17:44:28 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Converting VIF {"id": "be620d2e-a2ea-49fe-9205-68101009027b", "address": "fa:16:3e:2d:37:4e", "network": {"id": "26a554fe-9a5e-40c0-9981-5ac084c9ea73", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-269663495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19755f3e634fdfbd562c33fbfa2a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe620d2e-a2", "ovs_interfaceid": "be620d2e-a2ea-49fe-9205-68101009027b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:44:28 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:37:4e,bridge_name='br-int',has_traffic_filtering=True,id=be620d2e-a2ea-49fe-9205-68101009027b,network=Network(26a554fe-9a5e-40c0-9981-5ac084c9ea73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe620d2e-a2') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:44:28 user nova-compute[75100]: DEBUG nova.objects.instance [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lazy-loading 'pci_devices' on Instance uuid b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:44:28 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] End _get_guest_xml xml=<domain type="kvm">
Nov 10 17:44:28 user nova-compute[75100]:   <uuid>b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b</uuid>
Nov 10 17:44:28 user nova-compute[75100]:   <name>instance-00000002</name>
Nov 10 17:44:28 user nova-compute[75100]:   <memory>524288</memory>
Nov 10 17:44:28 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 10 17:44:28 user nova-compute[75100]:   <metadata>
Nov 10 17:44:28 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 17:44:28 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 10 17:44:28 user nova-compute[75100]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-81379937</nova:name>
Nov 10 17:44:28 user nova-compute[75100]:       <nova:creationTime>2023-11-10 17:44:28</nova:creationTime>
Nov 10 17:44:28 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 10 17:44:28 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 10 17:44:28 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 10 17:44:28 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 10 17:44:28 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 17:44:28 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 10 17:44:28 user nova-compute[75100]:       </nova:flavor>
Nov 10 17:44:28 user nova-compute[75100]:       <nova:owner>
Nov 10 17:44:28 user nova-compute[75100]:         <nova:user uuid="8cdb9250e6c7459587e429a0aea577c6">tempest-ServerRescueNegativeTestJSON-783763036-project-member</nova:user>
Nov 10 17:44:28 user nova-compute[75100]:         <nova:project uuid="6b19755f3e634fdfbd562c33fbfa2a88">tempest-ServerRescueNegativeTestJSON-783763036</nova:project>
Nov 10 17:44:28 user nova-compute[75100]:       </nova:owner>
Nov 10 17:44:28 user nova-compute[75100]:       <nova:root type="image" uuid="e3cc5321-4d40-49ee-885c-700e14741732"/>
Nov 10 17:44:28 user nova-compute[75100]:       <nova:ports>
Nov 10 17:44:28 user nova-compute[75100]:         <nova:port uuid="be620d2e-a2ea-49fe-9205-68101009027b">
Nov 10 17:44:28 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 10 17:44:28 user nova-compute[75100]:         </nova:port>
Nov 10 17:44:28 user nova-compute[75100]:       </nova:ports>
Nov 10 17:44:28 user nova-compute[75100]:     </nova:instance>
Nov 10 17:44:28 user nova-compute[75100]:   </metadata>
Nov 10 17:44:28 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 10 17:44:28 user nova-compute[75100]:     <system>
Nov 10 17:44:28 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 17:44:28 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 10 17:44:28 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 10 17:44:28 user nova-compute[75100]:       <entry name="serial">b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b</entry>
Nov 10 17:44:28 user nova-compute[75100]:       <entry name="uuid">b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b</entry>
Nov 10 17:44:28 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 10 17:44:28 user nova-compute[75100]:     </system>
Nov 10 17:44:28 user nova-compute[75100]:   </sysinfo>
Nov 10 17:44:28 user nova-compute[75100]:   <os>
Nov 10 17:44:28 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 17:44:28 user nova-compute[75100]:     <boot dev="hd"/>
Nov 10 17:44:28 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 10 17:44:28 user nova-compute[75100]:   </os>
Nov 10 17:44:28 user nova-compute[75100]:   <features>
Nov 10 17:44:28 user nova-compute[75100]:     <acpi/>
Nov 10 17:44:28 user nova-compute[75100]:     <apic/>
Nov 10 17:44:28 user nova-compute[75100]:     <vmcoreinfo/>
Nov 10 17:44:28 user nova-compute[75100]:   </features>
Nov 10 17:44:28 user nova-compute[75100]:   <clock offset="utc">
Nov 10 17:44:28 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 17:44:28 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 17:44:28 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 10 17:44:28 user nova-compute[75100]:   </clock>
Nov 10 17:44:28 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 10 17:44:28 user nova-compute[75100]:     <model>Nehalem</model>
Nov 10 17:44:28 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 17:44:28 user nova-compute[75100]:   </cpu>
Nov 10 17:44:28 user nova-compute[75100]:   <devices>
Nov 10 17:44:28 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 10 17:44:28 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 17:44:28 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk"/>
Nov 10 17:44:28 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 10 17:44:28 user nova-compute[75100]:     </disk>
Nov 10 17:44:28 user nova-compute[75100]:     <interface type="ethernet">
Nov 10 17:44:28 user nova-compute[75100]:       <mac address="fa:16:3e:2d:37:4e"/>
Nov 10 17:44:28 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:44:28 user nova-compute[75100]:       <mtu size="1442"/>
Nov 10 17:44:28 user nova-compute[75100]:       <target dev="tapbe620d2e-a2"/>
Nov 10 17:44:28 user nova-compute[75100]:     </interface>
Nov 10 17:44:28 user nova-compute[75100]:     <serial type="pty">
Nov 10 17:44:28 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/console.log" append="off"/>
Nov 10 17:44:28 user nova-compute[75100]:     </serial>
Nov 10 17:44:28 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 17:44:28 user nova-compute[75100]:     <video>
Nov 10 17:44:28 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:44:28 user nova-compute[75100]:     </video>
Nov 10 17:44:28 user nova-compute[75100]:     <rng model="virtio">
Nov 10 17:44:28 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 10 17:44:28 user nova-compute[75100]:     </rng>
Nov 10 17:44:28 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 10 17:44:28 user nova-compute[75100]:     <memballoon model="virtio">
Nov 10 17:44:28 user nova-compute[75100]:       <stats period="10"/>
Nov 10 17:44:28 user nova-compute[75100]:     </memballoon>
Nov 10 17:44:28 user nova-compute[75100]:   </devices>
Nov 10 17:44:28 user nova-compute[75100]: </domain>
Nov 10 17:44:28 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 17:44:28 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:44:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-81379937',display_name='tempest-ServerRescueNegativeTestJSON-server-81379937',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-81379937',id=2,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b19755f3e634fdfbd562c33fbfa2a88',ramdisk_id='',reservation_id='r-sqwzcrjg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-783763036',owner_user_name='tempest-ServerRescueNegativeTestJSON-783763036-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:44:22Z,user_data=None,user_id='8cdb9250e6c7459587e429a0aea577c6',uuid=b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be620d2e-a2ea-49fe-9205-68101009027b", "address": "fa:16:3e:2d:37:4e", "network": {"id": "26a554fe-9a5e-40c0-9981-5ac084c9ea73", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-269663495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19755f3e634fdfbd562c33fbfa2a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe620d2e-a2", "ovs_interfaceid": "be620d2e-a2ea-49fe-9205-68101009027b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 17:44:28 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Converting VIF {"id": "be620d2e-a2ea-49fe-9205-68101009027b", "address": "fa:16:3e:2d:37:4e", "network": {"id": "26a554fe-9a5e-40c0-9981-5ac084c9ea73", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-269663495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19755f3e634fdfbd562c33fbfa2a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe620d2e-a2", "ovs_interfaceid": "be620d2e-a2ea-49fe-9205-68101009027b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:44:28 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:37:4e,bridge_name='br-int',has_traffic_filtering=True,id=be620d2e-a2ea-49fe-9205-68101009027b,network=Network(26a554fe-9a5e-40c0-9981-5ac084c9ea73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe620d2e-a2') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:44:28 user nova-compute[75100]: DEBUG os_vif [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:37:4e,bridge_name='br-int',has_traffic_filtering=True,id=be620d2e-a2ea-49fe-9205-68101009027b,network=Network(26a554fe-9a5e-40c0-9981-5ac084c9ea73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe620d2e-a2') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 17:44:28 user nova-compute[75100]: DEBUG nova.network.neutron [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] Successfully created port: c676ea25-33da-405a-84ac-9f0ad0308c08 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 17:44:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Created schema index Interface.name {{(pid=75100) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 10 17:44:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Created schema index Port.name {{(pid=75100) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 10 17:44:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Created schema index Bridge.name {{(pid=75100) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 10 17:44:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:44:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [POLLOUT] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:44:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:44:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 17:44:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bd494fd7-4c9c-5e68-a074-a226bdab6b8a', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:44:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:44:28 user nova-compute[75100]: INFO oslo.privsep.daemon [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp34qdqgu8/privsep.sock']
Nov 10 17:44:28 user sudo[84458]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp34qdqgu8/privsep.sock
Nov 10 17:44:28 user sudo[84458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 10 17:44:29 user nova-compute[75100]: DEBUG nova.network.neutron [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Updating instance_info_cache with network_info: [{"id": "eedb3d8e-5619-4df9-aef9-bbc44db1dba9", "address": "fa:16:3e:ee:f9:3d", "network": {"id": "f240fae3-3d7b-4b6e-b04f-18550ab4d0a3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1007355777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c970a503d74d32a1e2b71f086649fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeedb3d8e-56", "ovs_interfaceid": "eedb3d8e-5619-4df9-aef9-bbc44db1dba9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:44:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Releasing lock "refresh_cache-c19fc271-a248-4631-a11f-89b7ed73bf85" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:44:29 user nova-compute[75100]: DEBUG nova.compute.manager [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Instance network_info: |[{"id": "eedb3d8e-5619-4df9-aef9-bbc44db1dba9", "address": "fa:16:3e:ee:f9:3d", "network": {"id": "f240fae3-3d7b-4b6e-b04f-18550ab4d0a3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1007355777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c970a503d74d32a1e2b71f086649fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeedb3d8e-56", "ovs_interfaceid": "eedb3d8e-5619-4df9-aef9-bbc44db1dba9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 17:44:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b1a4dd2b-41a3-483b-9e89-8786f3c41132 req-bb61971e-8563-46e4-8309-d818986e7be2 service nova] Acquired lock "refresh_cache-c19fc271-a248-4631-a11f-89b7ed73bf85" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:44:29 user nova-compute[75100]: DEBUG nova.network.neutron [req-b1a4dd2b-41a3-483b-9e89-8786f3c41132 req-bb61971e-8563-46e4-8309-d818986e7be2 service nova] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Refreshing network info cache for port eedb3d8e-5619-4df9-aef9-bbc44db1dba9 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 17:44:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Start _get_guest_xml network_info=[{"id": "eedb3d8e-5619-4df9-aef9-bbc44db1dba9", "address": "fa:16:3e:ee:f9:3d", "network": {"id": "f240fae3-3d7b-4b6e-b04f-18550ab4d0a3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1007355777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c970a503d74d32a1e2b71f086649fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeedb3d8e-56", "ovs_interfaceid": "eedb3d8e-5619-4df9-aef9-bbc44db1dba9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'e3cc5321-4d40-49ee-885c-700e14741732'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 17:44:29 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:44:29 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:44:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 17:44:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 17:44:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 17:44:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 17:44:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 17:44:29 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T17:40:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 17:44:29 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 17:44:29 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 17:44:29 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 17:44:29 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 17:44:29 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 17:44:29 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 17:44:29 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 17:44:29 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 17:44:29 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 17:44:29 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 17:44:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:44:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-871447999',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-871447999',id=1,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72c970a503d74d32a1e2b71f086649fd',ramdisk_id='',reservation_id='r-m29zcg2f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2001759307',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:44:21Z,user_data=None,user_id='b79cb22ab5774ce8991f237bd2204555',uuid=c19fc271-a248-4631-a11f-89b7ed73bf85,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eedb3d8e-5619-4df9-aef9-bbc44db1dba9", "address": "fa:16:3e:ee:f9:3d", "network": {"id": "f240fae3-3d7b-4b6e-b04f-18550ab4d0a3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1007355777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c970a503d74d32a1e2b71f086649fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeedb3d8e-56", "ovs_interfaceid": "eedb3d8e-5619-4df9-aef9-bbc44db1dba9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 17:44:29 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Converting VIF {"id": "eedb3d8e-5619-4df9-aef9-bbc44db1dba9", "address": "fa:16:3e:ee:f9:3d", "network": {"id": "f240fae3-3d7b-4b6e-b04f-18550ab4d0a3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1007355777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c970a503d74d32a1e2b71f086649fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeedb3d8e-56", "ovs_interfaceid": "eedb3d8e-5619-4df9-aef9-bbc44db1dba9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:44:29 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:f9:3d,bridge_name='br-int',has_traffic_filtering=True,id=eedb3d8e-5619-4df9-aef9-bbc44db1dba9,network=Network(f240fae3-3d7b-4b6e-b04f-18550ab4d0a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeedb3d8e-56') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:44:29 user nova-compute[75100]: DEBUG nova.objects.instance [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lazy-loading 'pci_devices' on Instance uuid c19fc271-a248-4631-a11f-89b7ed73bf85 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:44:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] End _get_guest_xml xml=<domain type="kvm">
Nov 10 17:44:29 user nova-compute[75100]:   <uuid>c19fc271-a248-4631-a11f-89b7ed73bf85</uuid>
Nov 10 17:44:29 user nova-compute[75100]:   <name>instance-00000001</name>
Nov 10 17:44:29 user nova-compute[75100]:   <memory>524288</memory>
Nov 10 17:44:29 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 10 17:44:29 user nova-compute[75100]:   <metadata>
Nov 10 17:44:29 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 17:44:29 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 10 17:44:29 user nova-compute[75100]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-871447999</nova:name>
Nov 10 17:44:29 user nova-compute[75100]:       <nova:creationTime>2023-11-10 17:44:29</nova:creationTime>
Nov 10 17:44:29 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 10 17:44:29 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 10 17:44:29 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 10 17:44:29 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 10 17:44:29 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 17:44:29 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 10 17:44:29 user nova-compute[75100]:       </nova:flavor>
Nov 10 17:44:29 user nova-compute[75100]:       <nova:owner>
Nov 10 17:44:29 user nova-compute[75100]:         <nova:user uuid="b79cb22ab5774ce8991f237bd2204555">tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member</nova:user>
Nov 10 17:44:29 user nova-compute[75100]:         <nova:project uuid="72c970a503d74d32a1e2b71f086649fd">tempest-ServerBootFromVolumeStableRescueTest-2001759307</nova:project>
Nov 10 17:44:29 user nova-compute[75100]:       </nova:owner>
Nov 10 17:44:29 user nova-compute[75100]:       <nova:root type="image" uuid="e3cc5321-4d40-49ee-885c-700e14741732"/>
Nov 10 17:44:29 user nova-compute[75100]:       <nova:ports>
Nov 10 17:44:29 user nova-compute[75100]:         <nova:port uuid="eedb3d8e-5619-4df9-aef9-bbc44db1dba9">
Nov 10 17:44:29 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 10 17:44:29 user nova-compute[75100]:         </nova:port>
Nov 10 17:44:29 user nova-compute[75100]:       </nova:ports>
Nov 10 17:44:29 user nova-compute[75100]:     </nova:instance>
Nov 10 17:44:29 user nova-compute[75100]:   </metadata>
Nov 10 17:44:29 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 10 17:44:29 user nova-compute[75100]:     <system>
Nov 10 17:44:29 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 17:44:29 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 10 17:44:29 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 10 17:44:29 user nova-compute[75100]:       <entry name="serial">c19fc271-a248-4631-a11f-89b7ed73bf85</entry>
Nov 10 17:44:29 user nova-compute[75100]:       <entry name="uuid">c19fc271-a248-4631-a11f-89b7ed73bf85</entry>
Nov 10 17:44:29 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 10 17:44:29 user nova-compute[75100]:     </system>
Nov 10 17:44:29 user nova-compute[75100]:   </sysinfo>
Nov 10 17:44:29 user nova-compute[75100]:   <os>
Nov 10 17:44:29 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 17:44:29 user nova-compute[75100]:     <boot dev="hd"/>
Nov 10 17:44:29 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 10 17:44:29 user nova-compute[75100]:   </os>
Nov 10 17:44:29 user nova-compute[75100]:   <features>
Nov 10 17:44:29 user nova-compute[75100]:     <acpi/>
Nov 10 17:44:29 user nova-compute[75100]:     <apic/>
Nov 10 17:44:29 user nova-compute[75100]:     <vmcoreinfo/>
Nov 10 17:44:29 user nova-compute[75100]:   </features>
Nov 10 17:44:29 user nova-compute[75100]:   <clock offset="utc">
Nov 10 17:44:29 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 17:44:29 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 17:44:29 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 10 17:44:29 user nova-compute[75100]:   </clock>
Nov 10 17:44:29 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 10 17:44:29 user nova-compute[75100]:     <model>Nehalem</model>
Nov 10 17:44:29 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 17:44:29 user nova-compute[75100]:   </cpu>
Nov 10 17:44:29 user nova-compute[75100]:   <devices>
Nov 10 17:44:29 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 10 17:44:29 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 17:44:29 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk"/>
Nov 10 17:44:29 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 10 17:44:29 user nova-compute[75100]:     </disk>
Nov 10 17:44:29 user nova-compute[75100]:     <interface type="ethernet">
Nov 10 17:44:29 user nova-compute[75100]:       <mac address="fa:16:3e:ee:f9:3d"/>
Nov 10 17:44:29 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:44:29 user nova-compute[75100]:       <mtu size="1442"/>
Nov 10 17:44:29 user nova-compute[75100]:       <target dev="tapeedb3d8e-56"/>
Nov 10 17:44:29 user nova-compute[75100]:     </interface>
Nov 10 17:44:29 user nova-compute[75100]:     <serial type="pty">
Nov 10 17:44:29 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/console.log" append="off"/>
Nov 10 17:44:29 user nova-compute[75100]:     </serial>
Nov 10 17:44:29 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 17:44:29 user nova-compute[75100]:     <video>
Nov 10 17:44:29 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:44:29 user nova-compute[75100]:     </video>
Nov 10 17:44:29 user nova-compute[75100]:     <rng model="virtio">
Nov 10 17:44:29 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 10 17:44:29 user nova-compute[75100]:     </rng>
Nov 10 17:44:29 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 10 17:44:29 user nova-compute[75100]:     <memballoon model="virtio">
Nov 10 17:44:29 user nova-compute[75100]:       <stats period="10"/>
Nov 10 17:44:29 user nova-compute[75100]:     </memballoon>
Nov 10 17:44:29 user nova-compute[75100]:   </devices>
Nov 10 17:44:29 user nova-compute[75100]: </domain>
Nov 10 17:44:29 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 17:44:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:44:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-871447999',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-871447999',id=1,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72c970a503d74d32a1e2b71f086649fd',ramdisk_id='',reservation_id='r-m29zcg2f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2001759307',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:44:21Z,user_data=None,user_id='b79cb22ab5774ce8991f237bd2204555',uuid=c19fc271-a248-4631-a11f-89b7ed73bf85,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eedb3d8e-5619-4df9-aef9-bbc44db1dba9", "address": "fa:16:3e:ee:f9:3d", "network": {"id": "f240fae3-3d7b-4b6e-b04f-18550ab4d0a3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1007355777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c970a503d74d32a1e2b71f086649fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeedb3d8e-56", "ovs_interfaceid": "eedb3d8e-5619-4df9-aef9-bbc44db1dba9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 17:44:29 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Converting VIF {"id": "eedb3d8e-5619-4df9-aef9-bbc44db1dba9", "address": "fa:16:3e:ee:f9:3d", "network": {"id": "f240fae3-3d7b-4b6e-b04f-18550ab4d0a3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1007355777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c970a503d74d32a1e2b71f086649fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeedb3d8e-56", "ovs_interfaceid": "eedb3d8e-5619-4df9-aef9-bbc44db1dba9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:44:29 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:f9:3d,bridge_name='br-int',has_traffic_filtering=True,id=eedb3d8e-5619-4df9-aef9-bbc44db1dba9,network=Network(f240fae3-3d7b-4b6e-b04f-18550ab4d0a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeedb3d8e-56') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:44:29 user nova-compute[75100]: DEBUG os_vif [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:f9:3d,bridge_name='br-int',has_traffic_filtering=True,id=eedb3d8e-5619-4df9-aef9-bbc44db1dba9,network=Network(f240fae3-3d7b-4b6e-b04f-18550ab4d0a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeedb3d8e-56') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 17:44:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:44:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 17:44:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b1fd60ed-c490-5cc6-a5d7-ce515113a29e', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:44:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:44:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:29 user nova-compute[75100]: DEBUG nova.network.neutron [req-6ad236af-5fa1-48b0-b7c3-c1f2f5a26c82 req-4eba98a7-e0cc-4aeb-9e0b-4c1172c3b63e service nova] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Updated VIF entry in instance network info cache for port be620d2e-a2ea-49fe-9205-68101009027b. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 17:44:29 user nova-compute[75100]: DEBUG nova.network.neutron [req-6ad236af-5fa1-48b0-b7c3-c1f2f5a26c82 req-4eba98a7-e0cc-4aeb-9e0b-4c1172c3b63e service nova] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Updating instance_info_cache with network_info: [{"id": "be620d2e-a2ea-49fe-9205-68101009027b", "address": "fa:16:3e:2d:37:4e", "network": {"id": "26a554fe-9a5e-40c0-9981-5ac084c9ea73", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-269663495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19755f3e634fdfbd562c33fbfa2a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe620d2e-a2", "ovs_interfaceid": "be620d2e-a2ea-49fe-9205-68101009027b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:44:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6ad236af-5fa1-48b0-b7c3-c1f2f5a26c82 req-4eba98a7-e0cc-4aeb-9e0b-4c1172c3b63e service nova] Releasing lock "refresh_cache-b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:44:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:30 user sudo[84458]: pam_unix(sudo:session): session closed for user root
Nov 10 17:44:30 user nova-compute[75100]: INFO oslo.privsep.daemon [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Spawned new privsep daemon via rootwrap
Nov 10 17:44:30 user nova-compute[75100]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 10 17:44:30 user nova-compute[75100]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 10 17:44:30 user nova-compute[75100]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 10 17:44:30 user nova-compute[75100]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84511
Nov 10 17:44:30 user nova-compute[75100]: WARNING oslo_privsep.priv_context [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] privsep daemon already running
Nov 10 17:44:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:30 user nova-compute[75100]: DEBUG nova.network.neutron [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Successfully updated port: d3f47ac6-ad90-4589-b41e-798c6fe6d5cf {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 17:44:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Acquiring lock "refresh_cache-3e14de19-540d-4dc2-a058-6874d8d14478" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:44:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Acquired lock "refresh_cache-3e14de19-540d-4dc2-a058-6874d8d14478" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:44:30 user nova-compute[75100]: DEBUG nova.network.neutron [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 17:44:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeedb3d8e-56, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:44:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeedb3d8e-56, col_values=(('qos', UUID('0b3a976a-7130-4d99-8099-a924d8780f9f')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:44:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeedb3d8e-56, col_values=(('external_ids', {'iface-id': 'eedb3d8e-5619-4df9-aef9-bbc44db1dba9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:f9:3d', 'vm-uuid': 'c19fc271-a248-4631-a11f-89b7ed73bf85'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:44:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:44:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:31 user nova-compute[75100]: INFO os_vif [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:f9:3d,bridge_name='br-int',has_traffic_filtering=True,id=eedb3d8e-5619-4df9-aef9-bbc44db1dba9,network=Network(f240fae3-3d7b-4b6e-b04f-18550ab4d0a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeedb3d8e-56')
Nov 10 17:44:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbe620d2e-a2, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:44:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbe620d2e-a2, col_values=(('qos', UUID('7209b566-ca69-4d11-bb5c-61289f25e45e')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:44:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbe620d2e-a2, col_values=(('external_ids', {'iface-id': 'be620d2e-a2ea-49fe-9205-68101009027b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:37:4e', 'vm-uuid': 'b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:44:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:31 user nova-compute[75100]: DEBUG nova.network.neutron [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 17:44:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:31 user nova-compute[75100]: INFO os_vif [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:37:4e,bridge_name='br-int',has_traffic_filtering=True,id=be620d2e-a2ea-49fe-9205-68101009027b,network=Network(26a554fe-9a5e-40c0-9981-5ac084c9ea73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe620d2e-a2')
Nov 10 17:44:31 user nova-compute[75100]: DEBUG nova.compute.manager [req-6b4d8e8c-449f-4a67-ba01-9a7c04dba91c req-bf8ba8bb-b236-4707-87a6-aca055cbb5a0 service nova] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Received event network-changed-d3f47ac6-ad90-4589-b41e-798c6fe6d5cf {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:44:31 user nova-compute[75100]: DEBUG nova.compute.manager [req-6b4d8e8c-449f-4a67-ba01-9a7c04dba91c req-bf8ba8bb-b236-4707-87a6-aca055cbb5a0 service nova] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Refreshing instance network info cache due to event network-changed-d3f47ac6-ad90-4589-b41e-798c6fe6d5cf. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 17:44:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6b4d8e8c-449f-4a67-ba01-9a7c04dba91c req-bf8ba8bb-b236-4707-87a6-aca055cbb5a0 service nova] Acquiring lock "refresh_cache-3e14de19-540d-4dc2-a058-6874d8d14478" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:44:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 17:44:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] No VIF found with MAC fa:16:3e:ee:f9:3d, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 17:44:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 17:44:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] No VIF found with MAC fa:16:3e:2d:37:4e, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 17:44:31 user nova-compute[75100]: DEBUG nova.network.neutron [req-b1a4dd2b-41a3-483b-9e89-8786f3c41132 req-bb61971e-8563-46e4-8309-d818986e7be2 service nova] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Updated VIF entry in instance network info cache for port eedb3d8e-5619-4df9-aef9-bbc44db1dba9. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 17:44:31 user nova-compute[75100]: DEBUG nova.network.neutron [req-b1a4dd2b-41a3-483b-9e89-8786f3c41132 req-bb61971e-8563-46e4-8309-d818986e7be2 service nova] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Updating instance_info_cache with network_info: [{"id": "eedb3d8e-5619-4df9-aef9-bbc44db1dba9", "address": "fa:16:3e:ee:f9:3d", "network": {"id": "f240fae3-3d7b-4b6e-b04f-18550ab4d0a3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1007355777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c970a503d74d32a1e2b71f086649fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeedb3d8e-56", "ovs_interfaceid": "eedb3d8e-5619-4df9-aef9-bbc44db1dba9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:44:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b1a4dd2b-41a3-483b-9e89-8786f3c41132 req-bb61971e-8563-46e4-8309-d818986e7be2 service nova] Releasing lock "refresh_cache-c19fc271-a248-4631-a11f-89b7ed73bf85" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:44:32 user nova-compute[75100]: DEBUG nova.network.neutron [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Updating instance_info_cache with network_info: [{"id": "d3f47ac6-ad90-4589-b41e-798c6fe6d5cf", "address": "fa:16:3e:b3:84:ec", "network": {"id": "26a554fe-9a5e-40c0-9981-5ac084c9ea73", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-269663495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19755f3e634fdfbd562c33fbfa2a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3f47ac6-ad", "ovs_interfaceid": "d3f47ac6-ad90-4589-b41e-798c6fe6d5cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:44:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Releasing lock "refresh_cache-3e14de19-540d-4dc2-a058-6874d8d14478" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:44:32 user nova-compute[75100]: DEBUG nova.compute.manager [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Instance network_info: |[{"id": "d3f47ac6-ad90-4589-b41e-798c6fe6d5cf", "address": "fa:16:3e:b3:84:ec", "network": {"id": "26a554fe-9a5e-40c0-9981-5ac084c9ea73", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-269663495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19755f3e634fdfbd562c33fbfa2a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3f47ac6-ad", "ovs_interfaceid": "d3f47ac6-ad90-4589-b41e-798c6fe6d5cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 17:44:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6b4d8e8c-449f-4a67-ba01-9a7c04dba91c req-bf8ba8bb-b236-4707-87a6-aca055cbb5a0 service nova] Acquired lock "refresh_cache-3e14de19-540d-4dc2-a058-6874d8d14478" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:44:32 user nova-compute[75100]: DEBUG nova.network.neutron [req-6b4d8e8c-449f-4a67-ba01-9a7c04dba91c req-bf8ba8bb-b236-4707-87a6-aca055cbb5a0 service nova] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Refreshing network info cache for port d3f47ac6-ad90-4589-b41e-798c6fe6d5cf {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 17:44:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Start _get_guest_xml network_info=[{"id": "d3f47ac6-ad90-4589-b41e-798c6fe6d5cf", "address": "fa:16:3e:b3:84:ec", "network": {"id": "26a554fe-9a5e-40c0-9981-5ac084c9ea73", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-269663495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19755f3e634fdfbd562c33fbfa2a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3f47ac6-ad", "ovs_interfaceid": "d3f47ac6-ad90-4589-b41e-798c6fe6d5cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'e3cc5321-4d40-49ee-885c-700e14741732'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 17:44:32 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:44:32 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:44:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 17:44:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 17:44:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 17:44:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 17:44:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 17:44:32 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T17:40:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 17:44:32 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 17:44:32 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 17:44:32 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 17:44:32 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 17:44:32 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 17:44:32 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 17:44:32 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 17:44:32 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 17:44:32 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 17:44:32 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 17:44:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:44:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1959011287',display_name='tempest-ServerRescueNegativeTestJSON-server-1959011287',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1959011287',id=3,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b19755f3e634fdfbd562c33fbfa2a88',ramdisk_id='',reservation_id='r-6vqr8vu5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-783763036',owner_user_name='tempest-ServerRescueNegativeTestJSON-783763036-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:44:25Z,user_data=None,user_id='8cdb9250e6c7459587e429a0aea577c6',uuid=3e14de19-540d-4dc2-a058-6874d8d14478,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3f47ac6-ad90-4589-b41e-798c6fe6d5cf", "address": "fa:16:3e:b3:84:ec", "network": {"id": "26a554fe-9a5e-40c0-9981-5ac084c9ea73", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-269663495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19755f3e634fdfbd562c33fbfa2a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3f47ac6-ad", "ovs_interfaceid": "d3f47ac6-ad90-4589-b41e-798c6fe6d5cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 17:44:32 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Converting VIF {"id": "d3f47ac6-ad90-4589-b41e-798c6fe6d5cf", "address": "fa:16:3e:b3:84:ec", "network": {"id": "26a554fe-9a5e-40c0-9981-5ac084c9ea73", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-269663495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19755f3e634fdfbd562c33fbfa2a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3f47ac6-ad", "ovs_interfaceid": "d3f47ac6-ad90-4589-b41e-798c6fe6d5cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:44:32 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:84:ec,bridge_name='br-int',has_traffic_filtering=True,id=d3f47ac6-ad90-4589-b41e-798c6fe6d5cf,network=Network(26a554fe-9a5e-40c0-9981-5ac084c9ea73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3f47ac6-ad') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:44:32 user nova-compute[75100]: DEBUG nova.objects.instance [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lazy-loading 'pci_devices' on Instance uuid 3e14de19-540d-4dc2-a058-6874d8d14478 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:44:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] End _get_guest_xml xml=<domain type="kvm">
Nov 10 17:44:32 user nova-compute[75100]:   <uuid>3e14de19-540d-4dc2-a058-6874d8d14478</uuid>
Nov 10 17:44:32 user nova-compute[75100]:   <name>instance-00000003</name>
Nov 10 17:44:32 user nova-compute[75100]:   <memory>524288</memory>
Nov 10 17:44:32 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 10 17:44:32 user nova-compute[75100]:   <metadata>
Nov 10 17:44:32 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 17:44:32 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 10 17:44:32 user nova-compute[75100]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1959011287</nova:name>
Nov 10 17:44:32 user nova-compute[75100]:       <nova:creationTime>2023-11-10 17:44:32</nova:creationTime>
Nov 10 17:44:32 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 10 17:44:32 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 10 17:44:32 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 10 17:44:32 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 10 17:44:32 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 17:44:32 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 10 17:44:32 user nova-compute[75100]:       </nova:flavor>
Nov 10 17:44:32 user nova-compute[75100]:       <nova:owner>
Nov 10 17:44:32 user nova-compute[75100]:         <nova:user uuid="8cdb9250e6c7459587e429a0aea577c6">tempest-ServerRescueNegativeTestJSON-783763036-project-member</nova:user>
Nov 10 17:44:32 user nova-compute[75100]:         <nova:project uuid="6b19755f3e634fdfbd562c33fbfa2a88">tempest-ServerRescueNegativeTestJSON-783763036</nova:project>
Nov 10 17:44:32 user nova-compute[75100]:       </nova:owner>
Nov 10 17:44:32 user nova-compute[75100]:       <nova:root type="image" uuid="e3cc5321-4d40-49ee-885c-700e14741732"/>
Nov 10 17:44:32 user nova-compute[75100]:       <nova:ports>
Nov 10 17:44:32 user nova-compute[75100]:         <nova:port uuid="d3f47ac6-ad90-4589-b41e-798c6fe6d5cf">
Nov 10 17:44:32 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 10 17:44:32 user nova-compute[75100]:         </nova:port>
Nov 10 17:44:32 user nova-compute[75100]:       </nova:ports>
Nov 10 17:44:32 user nova-compute[75100]:     </nova:instance>
Nov 10 17:44:32 user nova-compute[75100]:   </metadata>
Nov 10 17:44:32 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 10 17:44:32 user nova-compute[75100]:     <system>
Nov 10 17:44:32 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 17:44:32 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 10 17:44:32 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 10 17:44:32 user nova-compute[75100]:       <entry name="serial">3e14de19-540d-4dc2-a058-6874d8d14478</entry>
Nov 10 17:44:32 user nova-compute[75100]:       <entry name="uuid">3e14de19-540d-4dc2-a058-6874d8d14478</entry>
Nov 10 17:44:32 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 10 17:44:32 user nova-compute[75100]:     </system>
Nov 10 17:44:32 user nova-compute[75100]:   </sysinfo>
Nov 10 17:44:32 user nova-compute[75100]:   <os>
Nov 10 17:44:32 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 17:44:32 user nova-compute[75100]:     <boot dev="hd"/>
Nov 10 17:44:32 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 10 17:44:32 user nova-compute[75100]:   </os>
Nov 10 17:44:32 user nova-compute[75100]:   <features>
Nov 10 17:44:32 user nova-compute[75100]:     <acpi/>
Nov 10 17:44:32 user nova-compute[75100]:     <apic/>
Nov 10 17:44:32 user nova-compute[75100]:     <vmcoreinfo/>
Nov 10 17:44:32 user nova-compute[75100]:   </features>
Nov 10 17:44:32 user nova-compute[75100]:   <clock offset="utc">
Nov 10 17:44:32 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 17:44:32 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 17:44:32 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 10 17:44:32 user nova-compute[75100]:   </clock>
Nov 10 17:44:32 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 10 17:44:32 user nova-compute[75100]:     <model>Nehalem</model>
Nov 10 17:44:32 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 17:44:32 user nova-compute[75100]:   </cpu>
Nov 10 17:44:32 user nova-compute[75100]:   <devices>
Nov 10 17:44:32 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 10 17:44:32 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 17:44:32 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk"/>
Nov 10 17:44:32 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 10 17:44:32 user nova-compute[75100]:     </disk>
Nov 10 17:44:32 user nova-compute[75100]:     <interface type="ethernet">
Nov 10 17:44:32 user nova-compute[75100]:       <mac address="fa:16:3e:b3:84:ec"/>
Nov 10 17:44:32 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:44:32 user nova-compute[75100]:       <mtu size="1442"/>
Nov 10 17:44:32 user nova-compute[75100]:       <target dev="tapd3f47ac6-ad"/>
Nov 10 17:44:32 user nova-compute[75100]:     </interface>
Nov 10 17:44:32 user nova-compute[75100]:     <serial type="pty">
Nov 10 17:44:32 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/console.log" append="off"/>
Nov 10 17:44:32 user nova-compute[75100]:     </serial>
Nov 10 17:44:32 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 17:44:32 user nova-compute[75100]:     <video>
Nov 10 17:44:32 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:44:32 user nova-compute[75100]:     </video>
Nov 10 17:44:32 user nova-compute[75100]:     <rng model="virtio">
Nov 10 17:44:32 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 10 17:44:32 user nova-compute[75100]:     </rng>
Nov 10 17:44:32 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 10 17:44:32 user nova-compute[75100]:     <memballoon model="virtio">
Nov 10 17:44:32 user nova-compute[75100]:       <stats period="10"/>
Nov 10 17:44:32 user nova-compute[75100]:     </memballoon>
Nov 10 17:44:32 user nova-compute[75100]:   </devices>
Nov 10 17:44:32 user nova-compute[75100]: </domain>
Nov 10 17:44:32 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 17:44:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:44:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1959011287',display_name='tempest-ServerRescueNegativeTestJSON-server-1959011287',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1959011287',id=3,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b19755f3e634fdfbd562c33fbfa2a88',ramdisk_id='',reservation_id='r-6vqr8vu5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-783763036',owner_user_name='tempest-ServerRescueNegativeTestJSON-783763036-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:44:25Z,user_data=None,user_id='8cdb9250e6c7459587e429a0aea577c6',uuid=3e14de19-540d-4dc2-a058-6874d8d14478,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3f47ac6-ad90-4589-b41e-798c6fe6d5cf", "address": "fa:16:3e:b3:84:ec", "network": {"id": "26a554fe-9a5e-40c0-9981-5ac084c9ea73", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-269663495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19755f3e634fdfbd562c33fbfa2a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3f47ac6-ad", "ovs_interfaceid": "d3f47ac6-ad90-4589-b41e-798c6fe6d5cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 17:44:32 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Converting VIF {"id": "d3f47ac6-ad90-4589-b41e-798c6fe6d5cf", "address": "fa:16:3e:b3:84:ec", "network": {"id": "26a554fe-9a5e-40c0-9981-5ac084c9ea73", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-269663495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19755f3e634fdfbd562c33fbfa2a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3f47ac6-ad", "ovs_interfaceid": "d3f47ac6-ad90-4589-b41e-798c6fe6d5cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:44:32 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:84:ec,bridge_name='br-int',has_traffic_filtering=True,id=d3f47ac6-ad90-4589-b41e-798c6fe6d5cf,network=Network(26a554fe-9a5e-40c0-9981-5ac084c9ea73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3f47ac6-ad') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:44:32 user nova-compute[75100]: DEBUG os_vif [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:84:ec,bridge_name='br-int',has_traffic_filtering=True,id=d3f47ac6-ad90-4589-b41e-798c6fe6d5cf,network=Network(26a554fe-9a5e-40c0-9981-5ac084c9ea73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3f47ac6-ad') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 17:44:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:44:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 17:44:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '14089e25-1c98-509e-9f71-29f309f0ead7', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:44:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:44:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd3f47ac6-ad, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:44:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd3f47ac6-ad, col_values=(('qos', UUID('336ea0fd-506d-422e-94a4-b5f84e4b9da6')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:44:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd3f47ac6-ad, col_values=(('external_ids', {'iface-id': 'd3f47ac6-ad90-4589-b41e-798c6fe6d5cf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:84:ec', 'vm-uuid': '3e14de19-540d-4dc2-a058-6874d8d14478'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:44:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:44:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:32 user nova-compute[75100]: INFO os_vif [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:84:ec,bridge_name='br-int',has_traffic_filtering=True,id=d3f47ac6-ad90-4589-b41e-798c6fe6d5cf,network=Network(26a554fe-9a5e-40c0-9981-5ac084c9ea73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3f47ac6-ad')
Nov 10 17:44:32 user nova-compute[75100]: DEBUG nova.network.neutron [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] Successfully updated port: c676ea25-33da-405a-84ac-9f0ad0308c08 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 17:44:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 17:44:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] No VIF found with MAC fa:16:3e:b3:84:ec, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 17:44:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Acquiring lock "refresh_cache-45efac9f-8de9-43aa-b361-b5e4cf78795f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:44:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Acquired lock "refresh_cache-45efac9f-8de9-43aa-b361-b5e4cf78795f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:44:32 user nova-compute[75100]: DEBUG nova.network.neutron [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 17:44:32 user nova-compute[75100]: DEBUG nova.compute.manager [req-1211afbf-c7eb-4915-86a7-9490f50b8a7a req-d57cf2f8-600c-491e-9883-5c75cf4c137b service nova] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] Received event network-changed-c676ea25-33da-405a-84ac-9f0ad0308c08 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:44:32 user nova-compute[75100]: DEBUG nova.compute.manager [req-1211afbf-c7eb-4915-86a7-9490f50b8a7a req-d57cf2f8-600c-491e-9883-5c75cf4c137b service nova] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] Refreshing instance network info cache due to event network-changed-c676ea25-33da-405a-84ac-9f0ad0308c08. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 17:44:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-1211afbf-c7eb-4915-86a7-9490f50b8a7a req-d57cf2f8-600c-491e-9883-5c75cf4c137b service nova] Acquiring lock "refresh_cache-45efac9f-8de9-43aa-b361-b5e4cf78795f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:44:33 user nova-compute[75100]: DEBUG nova.network.neutron [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 17:44:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:33 user nova-compute[75100]: DEBUG nova.network.neutron [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] Updating instance_info_cache with network_info: [{"id": "c676ea25-33da-405a-84ac-9f0ad0308c08", "address": "fa:16:3e:ed:fe:82", "network": {"id": "92e0841d-9eee-49ac-8e59-0ddd4fc67c7d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2119900864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a2bbe56892041fc909c5664f9668d17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc676ea25-33", "ovs_interfaceid": "c676ea25-33da-405a-84ac-9f0ad0308c08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:44:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Releasing lock "refresh_cache-45efac9f-8de9-43aa-b361-b5e4cf78795f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:44:33 user nova-compute[75100]: DEBUG nova.compute.manager [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] Instance network_info: |[{"id": "c676ea25-33da-405a-84ac-9f0ad0308c08", "address": "fa:16:3e:ed:fe:82", "network": {"id": "92e0841d-9eee-49ac-8e59-0ddd4fc67c7d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2119900864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a2bbe56892041fc909c5664f9668d17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc676ea25-33", "ovs_interfaceid": "c676ea25-33da-405a-84ac-9f0ad0308c08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 17:44:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-1211afbf-c7eb-4915-86a7-9490f50b8a7a req-d57cf2f8-600c-491e-9883-5c75cf4c137b service nova] Acquired lock "refresh_cache-45efac9f-8de9-43aa-b361-b5e4cf78795f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:44:33 user nova-compute[75100]: DEBUG nova.network.neutron [req-1211afbf-c7eb-4915-86a7-9490f50b8a7a req-d57cf2f8-600c-491e-9883-5c75cf4c137b service nova] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] Refreshing network info cache for port c676ea25-33da-405a-84ac-9f0ad0308c08 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 17:44:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] Start _get_guest_xml network_info=[{"id": "c676ea25-33da-405a-84ac-9f0ad0308c08", "address": "fa:16:3e:ed:fe:82", "network": {"id": "92e0841d-9eee-49ac-8e59-0ddd4fc67c7d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2119900864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a2bbe56892041fc909c5664f9668d17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc676ea25-33", "ovs_interfaceid": "c676ea25-33da-405a-84ac-9f0ad0308c08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'e3cc5321-4d40-49ee-885c-700e14741732'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 17:44:33 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:44:33 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:44:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 17:44:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 17:44:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 17:44:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 17:44:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 17:44:33 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T17:40:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 17:44:33 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 17:44:33 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 17:44:33 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 17:44:33 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 17:44:33 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 17:44:33 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 17:44:33 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 17:44:33 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 17:44:33 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 17:44:33 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 17:44:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:44:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-765158909',display_name='tempest-DeleteServersTestJSON-server-765158909',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-765158909',id=4,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a2bbe56892041fc909c5664f9668d17',ramdisk_id='',reservation_id='r-ofawh396',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1805291581',owner_user_name='tempest-DeleteServersTestJSON-1805291581-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:44:26Z,user_data=None,user_id='b6f778e7dbee479a92186100c7ffb9b5',uuid=45efac9f-8de9-43aa-b361-b5e4cf78795f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c676ea25-33da-405a-84ac-9f0ad0308c08", "address": "fa:16:3e:ed:fe:82", "network": {"id": "92e0841d-9eee-49ac-8e59-0ddd4fc67c7d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2119900864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a2bbe56892041fc909c5664f9668d17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc676ea25-33", "ovs_interfaceid": "c676ea25-33da-405a-84ac-9f0ad0308c08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 17:44:33 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Converting VIF {"id": "c676ea25-33da-405a-84ac-9f0ad0308c08", "address": "fa:16:3e:ed:fe:82", "network": {"id": "92e0841d-9eee-49ac-8e59-0ddd4fc67c7d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2119900864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a2bbe56892041fc909c5664f9668d17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc676ea25-33", "ovs_interfaceid": "c676ea25-33da-405a-84ac-9f0ad0308c08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:44:33 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:fe:82,bridge_name='br-int',has_traffic_filtering=True,id=c676ea25-33da-405a-84ac-9f0ad0308c08,network=Network(92e0841d-9eee-49ac-8e59-0ddd4fc67c7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc676ea25-33') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:44:33 user nova-compute[75100]: DEBUG nova.objects.instance [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Lazy-loading 'pci_devices' on Instance uuid 45efac9f-8de9-43aa-b361-b5e4cf78795f {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:44:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] End _get_guest_xml xml=<domain type="kvm">
Nov 10 17:44:33 user nova-compute[75100]:   <uuid>45efac9f-8de9-43aa-b361-b5e4cf78795f</uuid>
Nov 10 17:44:33 user nova-compute[75100]:   <name>instance-00000004</name>
Nov 10 17:44:33 user nova-compute[75100]:   <memory>524288</memory>
Nov 10 17:44:33 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 10 17:44:33 user nova-compute[75100]:   <metadata>
Nov 10 17:44:33 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 17:44:33 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 10 17:44:33 user nova-compute[75100]:       <nova:name>tempest-DeleteServersTestJSON-server-765158909</nova:name>
Nov 10 17:44:33 user nova-compute[75100]:       <nova:creationTime>2023-11-10 17:44:33</nova:creationTime>
Nov 10 17:44:33 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 10 17:44:33 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 10 17:44:33 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 10 17:44:33 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 10 17:44:33 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 17:44:33 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 10 17:44:33 user nova-compute[75100]:       </nova:flavor>
Nov 10 17:44:33 user nova-compute[75100]:       <nova:owner>
Nov 10 17:44:33 user nova-compute[75100]:         <nova:user uuid="b6f778e7dbee479a92186100c7ffb9b5">tempest-DeleteServersTestJSON-1805291581-project-member</nova:user>
Nov 10 17:44:33 user nova-compute[75100]:         <nova:project uuid="5a2bbe56892041fc909c5664f9668d17">tempest-DeleteServersTestJSON-1805291581</nova:project>
Nov 10 17:44:33 user nova-compute[75100]:       </nova:owner>
Nov 10 17:44:33 user nova-compute[75100]:       <nova:root type="image" uuid="e3cc5321-4d40-49ee-885c-700e14741732"/>
Nov 10 17:44:33 user nova-compute[75100]:       <nova:ports>
Nov 10 17:44:33 user nova-compute[75100]:         <nova:port uuid="c676ea25-33da-405a-84ac-9f0ad0308c08">
Nov 10 17:44:33 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 10 17:44:33 user nova-compute[75100]:         </nova:port>
Nov 10 17:44:33 user nova-compute[75100]:       </nova:ports>
Nov 10 17:44:33 user nova-compute[75100]:     </nova:instance>
Nov 10 17:44:33 user nova-compute[75100]:   </metadata>
Nov 10 17:44:33 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 10 17:44:33 user nova-compute[75100]:     <system>
Nov 10 17:44:33 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 17:44:33 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 10 17:44:33 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 10 17:44:33 user nova-compute[75100]:       <entry name="serial">45efac9f-8de9-43aa-b361-b5e4cf78795f</entry>
Nov 10 17:44:33 user nova-compute[75100]:       <entry name="uuid">45efac9f-8de9-43aa-b361-b5e4cf78795f</entry>
Nov 10 17:44:33 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 10 17:44:33 user nova-compute[75100]:     </system>
Nov 10 17:44:33 user nova-compute[75100]:   </sysinfo>
Nov 10 17:44:33 user nova-compute[75100]:   <os>
Nov 10 17:44:33 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 17:44:33 user nova-compute[75100]:     <boot dev="hd"/>
Nov 10 17:44:33 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 10 17:44:33 user nova-compute[75100]:   </os>
Nov 10 17:44:33 user nova-compute[75100]:   <features>
Nov 10 17:44:33 user nova-compute[75100]:     <acpi/>
Nov 10 17:44:33 user nova-compute[75100]:     <apic/>
Nov 10 17:44:33 user nova-compute[75100]:     <vmcoreinfo/>
Nov 10 17:44:33 user nova-compute[75100]:   </features>
Nov 10 17:44:33 user nova-compute[75100]:   <clock offset="utc">
Nov 10 17:44:33 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 17:44:33 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 17:44:33 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 10 17:44:33 user nova-compute[75100]:   </clock>
Nov 10 17:44:33 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 10 17:44:33 user nova-compute[75100]:     <model>Nehalem</model>
Nov 10 17:44:33 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 17:44:33 user nova-compute[75100]:   </cpu>
Nov 10 17:44:33 user nova-compute[75100]:   <devices>
Nov 10 17:44:33 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 10 17:44:33 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 17:44:33 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/45efac9f-8de9-43aa-b361-b5e4cf78795f/disk"/>
Nov 10 17:44:33 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 10 17:44:33 user nova-compute[75100]:     </disk>
Nov 10 17:44:33 user nova-compute[75100]:     <interface type="ethernet">
Nov 10 17:44:33 user nova-compute[75100]:       <mac address="fa:16:3e:ed:fe:82"/>
Nov 10 17:44:33 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:44:33 user nova-compute[75100]:       <mtu size="1442"/>
Nov 10 17:44:33 user nova-compute[75100]:       <target dev="tapc676ea25-33"/>
Nov 10 17:44:33 user nova-compute[75100]:     </interface>
Nov 10 17:44:33 user nova-compute[75100]:     <serial type="pty">
Nov 10 17:44:33 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/45efac9f-8de9-43aa-b361-b5e4cf78795f/console.log" append="off"/>
Nov 10 17:44:33 user nova-compute[75100]:     </serial>
Nov 10 17:44:33 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 17:44:33 user nova-compute[75100]:     <video>
Nov 10 17:44:33 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:44:33 user nova-compute[75100]:     </video>
Nov 10 17:44:33 user nova-compute[75100]:     <rng model="virtio">
Nov 10 17:44:33 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 10 17:44:33 user nova-compute[75100]:     </rng>
Nov 10 17:44:33 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 10 17:44:33 user nova-compute[75100]:     <memballoon model="virtio">
Nov 10 17:44:33 user nova-compute[75100]:       <stats period="10"/>
Nov 10 17:44:33 user nova-compute[75100]:     </memballoon>
Nov 10 17:44:33 user nova-compute[75100]:   </devices>
Nov 10 17:44:33 user nova-compute[75100]: </domain>
Nov 10 17:44:33 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 17:44:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:44:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-765158909',display_name='tempest-DeleteServersTestJSON-server-765158909',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-765158909',id=4,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a2bbe56892041fc909c5664f9668d17',ramdisk_id='',reservation_id='r-ofawh396',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1805291581',owner_user_name='tempest-DeleteServersTestJSON-1805291581-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:44:26Z,user_data=None,user_id='b6f778e7dbee479a92186100c7ffb9b5',uuid=45efac9f-8de9-43aa-b361-b5e4cf78795f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c676ea25-33da-405a-84ac-9f0ad0308c08", "address": "fa:16:3e:ed:fe:82", "network": {"id": "92e0841d-9eee-49ac-8e59-0ddd4fc67c7d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2119900864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a2bbe56892041fc909c5664f9668d17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc676ea25-33", "ovs_interfaceid": "c676ea25-33da-405a-84ac-9f0ad0308c08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 17:44:33 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Converting VIF {"id": "c676ea25-33da-405a-84ac-9f0ad0308c08", "address": "fa:16:3e:ed:fe:82", "network": {"id": "92e0841d-9eee-49ac-8e59-0ddd4fc67c7d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2119900864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a2bbe56892041fc909c5664f9668d17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc676ea25-33", "ovs_interfaceid": "c676ea25-33da-405a-84ac-9f0ad0308c08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:44:33 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:fe:82,bridge_name='br-int',has_traffic_filtering=True,id=c676ea25-33da-405a-84ac-9f0ad0308c08,network=Network(92e0841d-9eee-49ac-8e59-0ddd4fc67c7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc676ea25-33') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:44:33 user nova-compute[75100]: DEBUG os_vif [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:fe:82,bridge_name='br-int',has_traffic_filtering=True,id=c676ea25-33da-405a-84ac-9f0ad0308c08,network=Network(92e0841d-9eee-49ac-8e59-0ddd4fc67c7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc676ea25-33') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 17:44:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:44:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 17:44:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd24803e6-b3cc-5103-9027-11c3964e380e', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:44:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:44:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc676ea25-33, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:44:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc676ea25-33, col_values=(('qos', UUID('b8650ea5-2eae-4aea-951c-09151fec2d4c')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:44:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc676ea25-33, col_values=(('external_ids', {'iface-id': 'c676ea25-33da-405a-84ac-9f0ad0308c08', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:fe:82', 'vm-uuid': '45efac9f-8de9-43aa-b361-b5e4cf78795f'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:44:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:44:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:33 user nova-compute[75100]: INFO os_vif [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:fe:82,bridge_name='br-int',has_traffic_filtering=True,id=c676ea25-33da-405a-84ac-9f0ad0308c08,network=Network(92e0841d-9eee-49ac-8e59-0ddd4fc67c7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc676ea25-33')
Nov 10 17:44:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 17:44:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] No VIF found with MAC fa:16:3e:ed:fe:82, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 17:44:34 user nova-compute[75100]: DEBUG nova.network.neutron [req-6b4d8e8c-449f-4a67-ba01-9a7c04dba91c req-bf8ba8bb-b236-4707-87a6-aca055cbb5a0 service nova] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Updated VIF entry in instance network info cache for port d3f47ac6-ad90-4589-b41e-798c6fe6d5cf. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 17:44:34 user nova-compute[75100]: DEBUG nova.network.neutron [req-6b4d8e8c-449f-4a67-ba01-9a7c04dba91c req-bf8ba8bb-b236-4707-87a6-aca055cbb5a0 service nova] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Updating instance_info_cache with network_info: [{"id": "d3f47ac6-ad90-4589-b41e-798c6fe6d5cf", "address": "fa:16:3e:b3:84:ec", "network": {"id": "26a554fe-9a5e-40c0-9981-5ac084c9ea73", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-269663495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19755f3e634fdfbd562c33fbfa2a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3f47ac6-ad", "ovs_interfaceid": "d3f47ac6-ad90-4589-b41e-798c6fe6d5cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:44:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6b4d8e8c-449f-4a67-ba01-9a7c04dba91c req-bf8ba8bb-b236-4707-87a6-aca055cbb5a0 service nova] Releasing lock "refresh_cache-3e14de19-540d-4dc2-a058-6874d8d14478" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:44:34 user nova-compute[75100]: DEBUG nova.network.neutron [req-1211afbf-c7eb-4915-86a7-9490f50b8a7a req-d57cf2f8-600c-491e-9883-5c75cf4c137b service nova] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] Updated VIF entry in instance network info cache for port c676ea25-33da-405a-84ac-9f0ad0308c08. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 17:44:34 user nova-compute[75100]: DEBUG nova.network.neutron [req-1211afbf-c7eb-4915-86a7-9490f50b8a7a req-d57cf2f8-600c-491e-9883-5c75cf4c137b service nova] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] Updating instance_info_cache with network_info: [{"id": "c676ea25-33da-405a-84ac-9f0ad0308c08", "address": "fa:16:3e:ed:fe:82", "network": {"id": "92e0841d-9eee-49ac-8e59-0ddd4fc67c7d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2119900864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a2bbe56892041fc909c5664f9668d17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc676ea25-33", "ovs_interfaceid": "c676ea25-33da-405a-84ac-9f0ad0308c08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:44:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-1211afbf-c7eb-4915-86a7-9490f50b8a7a req-d57cf2f8-600c-491e-9883-5c75cf4c137b service nova] Releasing lock "refresh_cache-45efac9f-8de9-43aa-b361-b5e4cf78795f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:44:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:39 user nova-compute[75100]: DEBUG nova.compute.manager [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 17:44:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 17:44:39 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Instance spawned successfully.
Nov 10 17:44:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 17:44:39 user nova-compute[75100]: DEBUG nova.compute.manager [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 17:44:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 17:44:39 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Instance spawned successfully.
Nov 10 17:44:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 17:44:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:44:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:44:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:44:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:44:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:44:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:44:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:44:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:44:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:44:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:44:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:44:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:44:39 user nova-compute[75100]: INFO nova.compute.manager [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Took 17.95 seconds to spawn the instance on the hypervisor.
Nov 10 17:44:39 user nova-compute[75100]: DEBUG nova.compute.manager [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 17:44:39 user nova-compute[75100]: INFO nova.compute.manager [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Took 16.93 seconds to spawn the instance on the hypervisor.
Nov 10 17:44:39 user nova-compute[75100]: DEBUG nova.compute.manager [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 17:44:39 user nova-compute[75100]: INFO nova.compute.manager [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Took 19.42 seconds to build instance.
Nov 10 17:44:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-51bf4239-d99a-4d3c-8a1c-c8348212712c tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lock "c19fc271-a248-4631-a11f-89b7ed73bf85" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.662s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:44:39 user nova-compute[75100]: INFO nova.compute.manager [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Took 18.17 seconds to build instance.
Nov 10 17:44:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-577fe7ba-1668-4862-ab0c-a4eb8452eb03 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.345s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:44:39 user nova-compute[75100]: DEBUG nova.compute.manager [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 17:44:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 17:44:39 user nova-compute[75100]: DEBUG nova.compute.manager [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 17:44:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 17:44:39 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] Instance spawned successfully.
Nov 10 17:44:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 17:44:39 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Instance spawned successfully.
Nov 10 17:44:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 17:44:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:44:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:44:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:44:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:44:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:44:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:44:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:44:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:44:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:44:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:44:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:44:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:44:39 user nova-compute[75100]: INFO nova.compute.manager [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Took 15.18 seconds to spawn the instance on the hypervisor.
Nov 10 17:44:39 user nova-compute[75100]: DEBUG nova.compute.manager [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 17:44:39 user nova-compute[75100]: INFO nova.compute.manager [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] Took 14.14 seconds to spawn the instance on the hypervisor.
Nov 10 17:44:39 user nova-compute[75100]: DEBUG nova.compute.manager [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 17:44:40 user nova-compute[75100]: INFO nova.compute.manager [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Took 16.38 seconds to build instance.
Nov 10 17:44:40 user nova-compute[75100]: INFO nova.compute.manager [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] Took 15.50 seconds to build instance.
Nov 10 17:44:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-de594ec5-3298-4dea-8dec-3806973f999a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "3e14de19-540d-4dc2-a058-6874d8d14478" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.511s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:44:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e60c50ac-a6e1-461c-87ef-4f39cb141061 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Lock "45efac9f-8de9-43aa-b361-b5e4cf78795f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.697s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:44:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Acquiring lock "ead532eb-c8be-45fa-a8b7-0b4c4f884a90" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:44:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Lock "ead532eb-c8be-45fa-a8b7-0b4c4f884a90" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:44:46 user nova-compute[75100]: DEBUG nova.compute.manager [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 17:44:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:44:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:44:47 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 17:44:47 user nova-compute[75100]: INFO nova.compute.claims [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Claim successful on node user
Nov 10 17:44:47 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:44:47 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:44:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.729s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:44:47 user nova-compute[75100]: DEBUG nova.compute.manager [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 17:44:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Acquiring lock "5b5ec5d3-fa6f-43de-b786-8c423064fe7a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:44:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Lock "5b5ec5d3-fa6f-43de-b786-8c423064fe7a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:44:47 user nova-compute[75100]: DEBUG nova.compute.manager [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 17:44:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:44:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:44:48 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 17:44:48 user nova-compute[75100]: INFO nova.compute.claims [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Claim successful on node user
Nov 10 17:44:48 user nova-compute[75100]: DEBUG nova.compute.manager [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 17:44:48 user nova-compute[75100]: DEBUG nova.network.neutron [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 17:44:48 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 17:44:48 user nova-compute[75100]: DEBUG nova.compute.manager [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 17:44:48 user nova-compute[75100]: DEBUG nova.policy [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7994564d536446e38002847db1668157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8460c83146a64640ba7e549d159275c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 17:44:48 user nova-compute[75100]: DEBUG nova.compute.manager [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 17:44:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 17:44:48 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Creating image(s)
Nov 10 17:44:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Acquiring lock "/opt/stack/data/nova/instances/ead532eb-c8be-45fa-a8b7-0b4c4f884a90/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:44:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Lock "/opt/stack/data/nova/instances/ead532eb-c8be-45fa-a8b7-0b4c4f884a90/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:44:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Lock "/opt/stack/data/nova/instances/ead532eb-c8be-45fa-a8b7-0b4c4f884a90/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:44:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:44:48 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:44:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:48 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:44:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.758s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:44:48 user nova-compute[75100]: DEBUG nova.compute.manager [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 17:44:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.219s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:44:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Acquiring lock "818b9e28e061d41a38d903968b229be2ed9ba520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:44:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:44:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:44:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:48 user nova-compute[75100]: DEBUG nova.compute.manager [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 17:44:48 user nova-compute[75100]: DEBUG nova.network.neutron [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 17:44:49 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 10 17:44:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.238s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:44:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/ead532eb-c8be-45fa-a8b7-0b4c4f884a90/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:44:49 user nova-compute[75100]: DEBUG nova.policy [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dafadcfe7db24ff285a0622e6d1ced58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7974315cb54b07a47f3d59fc12ae02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 17:44:49 user nova-compute[75100]: DEBUG nova.compute.manager [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 17:44:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/ead532eb-c8be-45fa-a8b7-0b4c4f884a90/disk 1073741824" returned: 0 in 0.105s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:44:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.349s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:44:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:44:49 user nova-compute[75100]: DEBUG nova.compute.manager [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 17:44:49 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 17:44:49 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Creating image(s)
Nov 10 17:44:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Acquiring lock "/opt/stack/data/nova/instances/5b5ec5d3-fa6f-43de-b786-8c423064fe7a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:44:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Lock "/opt/stack/data/nova/instances/5b5ec5d3-fa6f-43de-b786-8c423064fe7a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:44:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Lock "/opt/stack/data/nova/instances/5b5ec5d3-fa6f-43de-b786-8c423064fe7a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.012s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:44:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Acquiring lock "63e098e260c9cbc17986e4db78afe5b7a428c299" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:44:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Lock "63e098e260c9cbc17986e4db78afe5b7a428c299" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:44:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.248s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:44:49 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ead532eb-c8be-45fa-a8b7-0b4c4f884a90/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 17:44:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ead532eb-c8be-45fa-a8b7-0b4c4f884a90/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:44:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/63e098e260c9cbc17986e4db78afe5b7a428c299.part --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:44:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ead532eb-c8be-45fa-a8b7-0b4c4f884a90/disk --force-share --output=json" returned: 0 in 0.632s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:44:50 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Cannot resize image /opt/stack/data/nova/instances/ead532eb-c8be-45fa-a8b7-0b4c4f884a90/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 17:44:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 17:44:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Ensure instance console log exists: /opt/stack/data/nova/instances/ead532eb-c8be-45fa-a8b7-0b4c4f884a90/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 17:44:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:44:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.004s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:44:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:44:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/63e098e260c9cbc17986e4db78afe5b7a428c299.part --force-share --output=json" returned: 0 in 0.215s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:44:50 user nova-compute[75100]: DEBUG nova.virt.images [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] 62afa448-a474-4519-a8f3-297ecbc104bf was qcow2, converting to raw {{(pid=75100) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 10 17:44:50 user nova-compute[75100]: DEBUG nova.privsep.utils [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75100) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 17:44:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/63e098e260c9cbc17986e4db78afe5b7a428c299.part /opt/stack/data/nova/instances/_base/63e098e260c9cbc17986e4db78afe5b7a428c299.converted {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:44:50 user nova-compute[75100]: DEBUG nova.network.neutron [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Successfully created port: 2b2adca0-0004-4df3-b8c8-03febbdc56ed {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 17:44:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/63e098e260c9cbc17986e4db78afe5b7a428c299.part /opt/stack/data/nova/instances/_base/63e098e260c9cbc17986e4db78afe5b7a428c299.converted" returned: 0 in 0.258s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:44:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/63e098e260c9cbc17986e4db78afe5b7a428c299.converted --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:44:50 user nova-compute[75100]: DEBUG nova.network.neutron [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Successfully created port: bdf312ed-cce0-4d35-9257-f6a5a80cc0d2 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 17:44:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/63e098e260c9cbc17986e4db78afe5b7a428c299.converted --force-share --output=json" returned: 0 in 0.239s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:44:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Lock "63e098e260c9cbc17986e4db78afe5b7a428c299" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.395s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:44:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/63e098e260c9cbc17986e4db78afe5b7a428c299 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:44:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/63e098e260c9cbc17986e4db78afe5b7a428c299 --force-share --output=json" returned: 0 in 0.187s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:44:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Acquiring lock "63e098e260c9cbc17986e4db78afe5b7a428c299" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:44:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Lock "63e098e260c9cbc17986e4db78afe5b7a428c299" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:44:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/63e098e260c9cbc17986e4db78afe5b7a428c299 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:44:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/63e098e260c9cbc17986e4db78afe5b7a428c299 --force-share --output=json" returned: 0 in 0.222s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:44:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/63e098e260c9cbc17986e4db78afe5b7a428c299,backing_fmt=raw /opt/stack/data/nova/instances/5b5ec5d3-fa6f-43de-b786-8c423064fe7a/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:44:51 user nova-compute[75100]: DEBUG nova.network.neutron [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Successfully updated port: 2b2adca0-0004-4df3-b8c8-03febbdc56ed {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 17:44:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/63e098e260c9cbc17986e4db78afe5b7a428c299,backing_fmt=raw /opt/stack/data/nova/instances/5b5ec5d3-fa6f-43de-b786-8c423064fe7a/disk 1073741824" returned: 0 in 0.060s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:44:51 user nova-compute[75100]: DEBUG nova.compute.manager [req-feefb2b2-19f8-4a00-b19e-6054322acc3b req-1fe27d3b-7f38-426d-8658-804a57cb823a service nova] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Received event network-changed-2b2adca0-0004-4df3-b8c8-03febbdc56ed {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:44:51 user nova-compute[75100]: DEBUG nova.compute.manager [req-feefb2b2-19f8-4a00-b19e-6054322acc3b req-1fe27d3b-7f38-426d-8658-804a57cb823a service nova] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Refreshing instance network info cache due to event network-changed-2b2adca0-0004-4df3-b8c8-03febbdc56ed. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 17:44:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-feefb2b2-19f8-4a00-b19e-6054322acc3b req-1fe27d3b-7f38-426d-8658-804a57cb823a service nova] Acquiring lock "refresh_cache-5b5ec5d3-fa6f-43de-b786-8c423064fe7a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:44:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-feefb2b2-19f8-4a00-b19e-6054322acc3b req-1fe27d3b-7f38-426d-8658-804a57cb823a service nova] Acquired lock "refresh_cache-5b5ec5d3-fa6f-43de-b786-8c423064fe7a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:44:51 user nova-compute[75100]: DEBUG nova.network.neutron [req-feefb2b2-19f8-4a00-b19e-6054322acc3b req-1fe27d3b-7f38-426d-8658-804a57cb823a service nova] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Refreshing network info cache for port 2b2adca0-0004-4df3-b8c8-03febbdc56ed {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 17:44:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Lock "63e098e260c9cbc17986e4db78afe5b7a428c299" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.295s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:44:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/63e098e260c9cbc17986e4db78afe5b7a428c299 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:44:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Acquiring lock "refresh_cache-5b5ec5d3-fa6f-43de-b786-8c423064fe7a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:44:51 user nova-compute[75100]: DEBUG nova.network.neutron [req-feefb2b2-19f8-4a00-b19e-6054322acc3b req-1fe27d3b-7f38-426d-8658-804a57cb823a service nova] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 17:44:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/63e098e260c9cbc17986e4db78afe5b7a428c299 --force-share --output=json" returned: 0 in 0.216s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:44:51 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5b5ec5d3-fa6f-43de-b786-8c423064fe7a/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 17:44:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5ec5d3-fa6f-43de-b786-8c423064fe7a/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:44:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5ec5d3-fa6f-43de-b786-8c423064fe7a/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:44:51 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Cannot resize image /opt/stack/data/nova/instances/5b5ec5d3-fa6f-43de-b786-8c423064fe7a/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 17:44:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 17:44:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Ensure instance console log exists: /opt/stack/data/nova/instances/5b5ec5d3-fa6f-43de-b786-8c423064fe7a/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 17:44:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:44:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:44:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:44:51 user nova-compute[75100]: DEBUG nova.network.neutron [req-feefb2b2-19f8-4a00-b19e-6054322acc3b req-1fe27d3b-7f38-426d-8658-804a57cb823a service nova] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:44:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-feefb2b2-19f8-4a00-b19e-6054322acc3b req-1fe27d3b-7f38-426d-8658-804a57cb823a service nova] Releasing lock "refresh_cache-5b5ec5d3-fa6f-43de-b786-8c423064fe7a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:44:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Acquired lock "refresh_cache-5b5ec5d3-fa6f-43de-b786-8c423064fe7a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:44:52 user nova-compute[75100]: DEBUG nova.network.neutron [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 17:44:52 user nova-compute[75100]: DEBUG nova.network.neutron [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 17:44:52 user nova-compute[75100]: DEBUG nova.network.neutron [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Updating instance_info_cache with network_info: [{"id": "2b2adca0-0004-4df3-b8c8-03febbdc56ed", "address": "fa:16:3e:4d:09:82", "network": {"id": "80d66f5d-7270-4848-992f-d7d1dd0f9d3d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1394179581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e7974315cb54b07a47f3d59fc12ae02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b2adca0-00", "ovs_interfaceid": "2b2adca0-0004-4df3-b8c8-03febbdc56ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:44:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Releasing lock "refresh_cache-5b5ec5d3-fa6f-43de-b786-8c423064fe7a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:44:52 user nova-compute[75100]: DEBUG nova.compute.manager [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Instance network_info: |[{"id": "2b2adca0-0004-4df3-b8c8-03febbdc56ed", "address": "fa:16:3e:4d:09:82", "network": {"id": "80d66f5d-7270-4848-992f-d7d1dd0f9d3d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1394179581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e7974315cb54b07a47f3d59fc12ae02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b2adca0-00", "ovs_interfaceid": "2b2adca0-0004-4df3-b8c8-03febbdc56ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 17:44:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Start _get_guest_xml network_info=[{"id": "2b2adca0-0004-4df3-b8c8-03febbdc56ed", "address": "fa:16:3e:4d:09:82", "network": {"id": "80d66f5d-7270-4848-992f-d7d1dd0f9d3d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1394179581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e7974315cb54b07a47f3d59fc12ae02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b2adca0-00", "ovs_interfaceid": "2b2adca0-0004-4df3-b8c8-03febbdc56ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:44:38Z,direct_url=<?>,disk_format='qcow2',id=62afa448-a474-4519-a8f3-297ecbc104bf,min_disk=0,min_ram=0,name='',owner='79b67edfa51446cf809c0c24dd67e97f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:44:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'device_name': '/dev/sda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'scsi', 'image_id': '62afa448-a474-4519-a8f3-297ecbc104bf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 17:44:52 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:44:52 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:44:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 17:44:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 17:44:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 17:44:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 17:44:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 17:44:52 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T17:40:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:44:38Z,direct_url=<?>,disk_format='qcow2',id=62afa448-a474-4519-a8f3-297ecbc104bf,min_disk=0,min_ram=0,name='',owner='79b67edfa51446cf809c0c24dd67e97f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:44:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 17:44:52 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 17:44:52 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 17:44:52 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 17:44:52 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 17:44:52 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 17:44:52 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 17:44:52 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 17:44:52 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 17:44:52 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 17:44:52 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 17:44:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T17:44:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-2092187117',display_name='tempest-AttachSCSIVolumeTestJSON-server-2092187117',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-2092187117',id=6,image_ref='62afa448-a474-4519-a8f3-297ecbc104bf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOP54VPtzNvqZrc+sFdJF7Njv1b4DMYzwD5qdJXA6wpAKXbe3gnYZYV1ZcxW2TsdvxcfzvIpf7Z2qwbIdNI6fduBbgK5hh89KHYygNnM4d9bJfAcpUIdHp1RvNgxYO7taQ==',key_name='tempest-keypair-881731324',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7e7974315cb54b07a47f3d59fc12ae02',ramdisk_id='',reservation_id='r-9xnnu22n',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='62afa448-a474-4519-a8f3-297ecbc104bf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-2125795715',owner_user_name='tempest-AttachSCSIVolumeTestJSON-2125795715-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:44:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dafadcfe7db24ff285a0622e6d1ced58',uuid=5b5ec5d3-fa6f-43de-b786-8c423064fe7a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b2adca0-0004-4df3-b8c8-03febbdc56ed", "address": "fa:16:3e:4d:09:82", "network": {"id": "80d66f5d-7270-4848-992f-d7d1dd0f9d3d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1394179581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e7974315cb54b07a47f3d59fc12ae02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b2adca0-00", "ovs_interfaceid": "2b2adca0-0004-4df3-b8c8-03febbdc56ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 17:44:52 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Converting VIF {"id": "2b2adca0-0004-4df3-b8c8-03febbdc56ed", "address": "fa:16:3e:4d:09:82", "network": {"id": "80d66f5d-7270-4848-992f-d7d1dd0f9d3d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1394179581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e7974315cb54b07a47f3d59fc12ae02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b2adca0-00", "ovs_interfaceid": "2b2adca0-0004-4df3-b8c8-03febbdc56ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:44:52 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:09:82,bridge_name='br-int',has_traffic_filtering=True,id=2b2adca0-0004-4df3-b8c8-03febbdc56ed,network=Network(80d66f5d-7270-4848-992f-d7d1dd0f9d3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b2adca0-00') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:44:52 user nova-compute[75100]: DEBUG nova.objects.instance [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Lazy-loading 'pci_devices' on Instance uuid 5b5ec5d3-fa6f-43de-b786-8c423064fe7a {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:44:52 user nova-compute[75100]: DEBUG nova.network.neutron [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Successfully updated port: bdf312ed-cce0-4d35-9257-f6a5a80cc0d2 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 17:44:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Acquiring lock "refresh_cache-ead532eb-c8be-45fa-a8b7-0b4c4f884a90" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:44:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Acquired lock "refresh_cache-ead532eb-c8be-45fa-a8b7-0b4c4f884a90" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:44:52 user nova-compute[75100]: DEBUG nova.network.neutron [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 17:44:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] End _get_guest_xml xml=<domain type="kvm">
Nov 10 17:44:52 user nova-compute[75100]:   <uuid>5b5ec5d3-fa6f-43de-b786-8c423064fe7a</uuid>
Nov 10 17:44:52 user nova-compute[75100]:   <name>instance-00000006</name>
Nov 10 17:44:52 user nova-compute[75100]:   <memory>524288</memory>
Nov 10 17:44:52 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 10 17:44:52 user nova-compute[75100]:   <metadata>
Nov 10 17:44:52 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 17:44:52 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 10 17:44:52 user nova-compute[75100]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-2092187117</nova:name>
Nov 10 17:44:52 user nova-compute[75100]:       <nova:creationTime>2023-11-10 17:44:52</nova:creationTime>
Nov 10 17:44:52 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 10 17:44:52 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 10 17:44:52 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 10 17:44:52 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 10 17:44:52 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 17:44:52 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 10 17:44:52 user nova-compute[75100]:       </nova:flavor>
Nov 10 17:44:52 user nova-compute[75100]:       <nova:owner>
Nov 10 17:44:52 user nova-compute[75100]:         <nova:user uuid="dafadcfe7db24ff285a0622e6d1ced58">tempest-AttachSCSIVolumeTestJSON-2125795715-project-member</nova:user>
Nov 10 17:44:52 user nova-compute[75100]:         <nova:project uuid="7e7974315cb54b07a47f3d59fc12ae02">tempest-AttachSCSIVolumeTestJSON-2125795715</nova:project>
Nov 10 17:44:52 user nova-compute[75100]:       </nova:owner>
Nov 10 17:44:52 user nova-compute[75100]:       <nova:root type="image" uuid="62afa448-a474-4519-a8f3-297ecbc104bf"/>
Nov 10 17:44:52 user nova-compute[75100]:       <nova:ports>
Nov 10 17:44:52 user nova-compute[75100]:         <nova:port uuid="2b2adca0-0004-4df3-b8c8-03febbdc56ed">
Nov 10 17:44:52 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 10 17:44:52 user nova-compute[75100]:         </nova:port>
Nov 10 17:44:52 user nova-compute[75100]:       </nova:ports>
Nov 10 17:44:52 user nova-compute[75100]:     </nova:instance>
Nov 10 17:44:52 user nova-compute[75100]:   </metadata>
Nov 10 17:44:52 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 10 17:44:52 user nova-compute[75100]:     <system>
Nov 10 17:44:52 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 17:44:52 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 10 17:44:52 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 10 17:44:52 user nova-compute[75100]:       <entry name="serial">5b5ec5d3-fa6f-43de-b786-8c423064fe7a</entry>
Nov 10 17:44:52 user nova-compute[75100]:       <entry name="uuid">5b5ec5d3-fa6f-43de-b786-8c423064fe7a</entry>
Nov 10 17:44:52 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 10 17:44:52 user nova-compute[75100]:     </system>
Nov 10 17:44:52 user nova-compute[75100]:   </sysinfo>
Nov 10 17:44:52 user nova-compute[75100]:   <os>
Nov 10 17:44:52 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 17:44:52 user nova-compute[75100]:     <boot dev="hd"/>
Nov 10 17:44:52 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 10 17:44:52 user nova-compute[75100]:   </os>
Nov 10 17:44:52 user nova-compute[75100]:   <features>
Nov 10 17:44:52 user nova-compute[75100]:     <acpi/>
Nov 10 17:44:52 user nova-compute[75100]:     <apic/>
Nov 10 17:44:52 user nova-compute[75100]:     <vmcoreinfo/>
Nov 10 17:44:52 user nova-compute[75100]:   </features>
Nov 10 17:44:52 user nova-compute[75100]:   <clock offset="utc">
Nov 10 17:44:52 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 17:44:52 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 17:44:52 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 10 17:44:52 user nova-compute[75100]:   </clock>
Nov 10 17:44:52 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 10 17:44:52 user nova-compute[75100]:     <model>Nehalem</model>
Nov 10 17:44:52 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 17:44:52 user nova-compute[75100]:   </cpu>
Nov 10 17:44:52 user nova-compute[75100]:   <devices>
Nov 10 17:44:52 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 10 17:44:52 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 17:44:52 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/5b5ec5d3-fa6f-43de-b786-8c423064fe7a/disk"/>
Nov 10 17:44:52 user nova-compute[75100]:       <target dev="sda" bus="scsi"/>
Nov 10 17:44:52 user nova-compute[75100]:       <address type="drive" controller="0" unit="0"/>
Nov 10 17:44:52 user nova-compute[75100]:     </disk>
Nov 10 17:44:52 user nova-compute[75100]:     <disk type="file" device="cdrom">
Nov 10 17:44:52 user nova-compute[75100]:       <driver name="qemu" type="raw" cache="none"/>
Nov 10 17:44:52 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/5b5ec5d3-fa6f-43de-b786-8c423064fe7a/disk.config"/>
Nov 10 17:44:52 user nova-compute[75100]:       <target dev="sdb" bus="scsi"/>
Nov 10 17:44:52 user nova-compute[75100]:       <address type="drive" controller="0" unit="1"/>
Nov 10 17:44:52 user nova-compute[75100]:     </disk>
Nov 10 17:44:52 user nova-compute[75100]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 10 17:44:52 user nova-compute[75100]:     <interface type="ethernet">
Nov 10 17:44:52 user nova-compute[75100]:       <mac address="fa:16:3e:4d:09:82"/>
Nov 10 17:44:52 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:44:52 user nova-compute[75100]:       <mtu size="1442"/>
Nov 10 17:44:52 user nova-compute[75100]:       <target dev="tap2b2adca0-00"/>
Nov 10 17:44:52 user nova-compute[75100]:     </interface>
Nov 10 17:44:52 user nova-compute[75100]:     <serial type="pty">
Nov 10 17:44:52 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/5b5ec5d3-fa6f-43de-b786-8c423064fe7a/console.log" append="off"/>
Nov 10 17:44:52 user nova-compute[75100]:     </serial>
Nov 10 17:44:52 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 17:44:52 user nova-compute[75100]:     <video>
Nov 10 17:44:52 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:44:52 user nova-compute[75100]:     </video>
Nov 10 17:44:52 user nova-compute[75100]:     <rng model="virtio">
Nov 10 17:44:52 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 10 17:44:52 user nova-compute[75100]:     </rng>
Nov 10 17:44:52 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 10 17:44:52 user nova-compute[75100]:     <memballoon model="virtio">
Nov 10 17:44:52 user nova-compute[75100]:       <stats period="10"/>
Nov 10 17:44:52 user nova-compute[75100]:     </memballoon>
Nov 10 17:44:52 user nova-compute[75100]:   </devices>
Nov 10 17:44:52 user nova-compute[75100]: </domain>
Nov 10 17:44:52 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 17:44:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T17:44:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-2092187117',display_name='tempest-AttachSCSIVolumeTestJSON-server-2092187117',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-2092187117',id=6,image_ref='62afa448-a474-4519-a8f3-297ecbc104bf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOP54VPtzNvqZrc+sFdJF7Njv1b4DMYzwD5qdJXA6wpAKXbe3gnYZYV1ZcxW2TsdvxcfzvIpf7Z2qwbIdNI6fduBbgK5hh89KHYygNnM4d9bJfAcpUIdHp1RvNgxYO7taQ==',key_name='tempest-keypair-881731324',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7e7974315cb54b07a47f3d59fc12ae02',ramdisk_id='',reservation_id='r-9xnnu22n',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='62afa448-a474-4519-a8f3-297ecbc104bf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-2125795715',owner_user_name='tempest-AttachSCSIVolumeTestJSON-2125795715-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:44:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dafadcfe7db24ff285a0622e6d1ced58',uuid=5b5ec5d3-fa6f-43de-b786-8c423064fe7a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b2adca0-0004-4df3-b8c8-03febbdc56ed", "address": "fa:16:3e:4d:09:82", "network": {"id": "80d66f5d-7270-4848-992f-d7d1dd0f9d3d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1394179581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e7974315cb54b07a47f3d59fc12ae02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b2adca0-00", "ovs_interfaceid": "2b2adca0-0004-4df3-b8c8-03febbdc56ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 17:44:52 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Converting VIF {"id": "2b2adca0-0004-4df3-b8c8-03febbdc56ed", "address": "fa:16:3e:4d:09:82", "network": {"id": "80d66f5d-7270-4848-992f-d7d1dd0f9d3d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1394179581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e7974315cb54b07a47f3d59fc12ae02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b2adca0-00", "ovs_interfaceid": "2b2adca0-0004-4df3-b8c8-03febbdc56ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:44:52 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:09:82,bridge_name='br-int',has_traffic_filtering=True,id=2b2adca0-0004-4df3-b8c8-03febbdc56ed,network=Network(80d66f5d-7270-4848-992f-d7d1dd0f9d3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b2adca0-00') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:44:52 user nova-compute[75100]: DEBUG os_vif [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:09:82,bridge_name='br-int',has_traffic_filtering=True,id=2b2adca0-0004-4df3-b8c8-03febbdc56ed,network=Network(80d66f5d-7270-4848-992f-d7d1dd0f9d3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b2adca0-00') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 17:44:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:44:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 17:44:52 user nova-compute[75100]: DEBUG nova.compute.manager [req-cd72753d-6455-44a1-b298-216a666614ae req-f5054722-6d70-4a02-8bbd-1d1ad963af73 service nova] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Received event network-changed-bdf312ed-cce0-4d35-9257-f6a5a80cc0d2 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:44:52 user nova-compute[75100]: DEBUG nova.compute.manager [req-cd72753d-6455-44a1-b298-216a666614ae req-f5054722-6d70-4a02-8bbd-1d1ad963af73 service nova] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Refreshing instance network info cache due to event network-changed-bdf312ed-cce0-4d35-9257-f6a5a80cc0d2. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 17:44:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cd72753d-6455-44a1-b298-216a666614ae req-f5054722-6d70-4a02-8bbd-1d1ad963af73 service nova] Acquiring lock "refresh_cache-ead532eb-c8be-45fa-a8b7-0b4c4f884a90" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:44:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '14f7e3f1-ad98-5d3c-9896-2263c5714138', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:44:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:44:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2b2adca0-00, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:44:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2b2adca0-00, col_values=(('qos', UUID('2d5bcc9f-d39b-4e0d-82d1-754cc0553528')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:44:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2b2adca0-00, col_values=(('external_ids', {'iface-id': '2b2adca0-0004-4df3-b8c8-03febbdc56ed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:09:82', 'vm-uuid': '5b5ec5d3-fa6f-43de-b786-8c423064fe7a'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:44:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:44:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:52 user nova-compute[75100]: INFO os_vif [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:09:82,bridge_name='br-int',has_traffic_filtering=True,id=2b2adca0-0004-4df3-b8c8-03febbdc56ed,network=Network(80d66f5d-7270-4848-992f-d7d1dd0f9d3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b2adca0-00')
Nov 10 17:44:52 user nova-compute[75100]: DEBUG nova.network.neutron [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 17:44:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] No BDM found with device name sda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 17:44:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 17:44:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] No VIF found with MAC fa:16:3e:4d:09:82, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 17:44:52 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Using config drive
Nov 10 17:44:53 user nova-compute[75100]: DEBUG nova.network.neutron [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Updating instance_info_cache with network_info: [{"id": "bdf312ed-cce0-4d35-9257-f6a5a80cc0d2", "address": "fa:16:3e:55:c2:62", "network": {"id": "7b0728f9-3997-4fbd-9583-81a235e0b690", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1553690854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8460c83146a64640ba7e549d159275c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdf312ed-cc", "ovs_interfaceid": "bdf312ed-cce0-4d35-9257-f6a5a80cc0d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:44:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Releasing lock "refresh_cache-ead532eb-c8be-45fa-a8b7-0b4c4f884a90" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:44:53 user nova-compute[75100]: DEBUG nova.compute.manager [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Instance network_info: |[{"id": "bdf312ed-cce0-4d35-9257-f6a5a80cc0d2", "address": "fa:16:3e:55:c2:62", "network": {"id": "7b0728f9-3997-4fbd-9583-81a235e0b690", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1553690854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8460c83146a64640ba7e549d159275c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdf312ed-cc", "ovs_interfaceid": "bdf312ed-cce0-4d35-9257-f6a5a80cc0d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 17:44:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cd72753d-6455-44a1-b298-216a666614ae req-f5054722-6d70-4a02-8bbd-1d1ad963af73 service nova] Acquired lock "refresh_cache-ead532eb-c8be-45fa-a8b7-0b4c4f884a90" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:44:53 user nova-compute[75100]: DEBUG nova.network.neutron [req-cd72753d-6455-44a1-b298-216a666614ae req-f5054722-6d70-4a02-8bbd-1d1ad963af73 service nova] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Refreshing network info cache for port bdf312ed-cce0-4d35-9257-f6a5a80cc0d2 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 17:44:53 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Start _get_guest_xml network_info=[{"id": "bdf312ed-cce0-4d35-9257-f6a5a80cc0d2", "address": "fa:16:3e:55:c2:62", "network": {"id": "7b0728f9-3997-4fbd-9583-81a235e0b690", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1553690854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8460c83146a64640ba7e549d159275c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdf312ed-cc", "ovs_interfaceid": "bdf312ed-cce0-4d35-9257-f6a5a80cc0d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'e3cc5321-4d40-49ee-885c-700e14741732'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 17:44:53 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:44:53 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:44:53 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 17:44:53 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 17:44:53 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 17:44:53 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 17:44:53 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 17:44:53 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T17:40:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 17:44:53 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 17:44:53 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 17:44:53 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 17:44:53 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 17:44:53 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 17:44:53 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 17:44:53 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 17:44:53 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 17:44:53 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 17:44:53 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 17:44:53 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:44:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1569402446',display_name='tempest-VolumesAdminNegativeTest-server-1569402446',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1569402446',id=5,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM8Mgwh9Oz9c33+lKVITcrw1u2yFY/zSZSn/46TDmummyopuD69BLBhczKDnulz5SNCJw0coB6gJCRJRGmQ7wHrJM2Psl2mrUGpc+wqcJ8RyTMsYtYnIfcVB6fpVlHgaMg==',key_name='tempest-keypair-1129073438',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8460c83146a64640ba7e549d159275c2',ramdisk_id='',reservation_id='r-k2gc1wz8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1957922837',owner_user_name='tempest-VolumesAdminNegativeTest-1957922837-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:44:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7994564d536446e38002847db1668157',uuid=ead532eb-c8be-45fa-a8b7-0b4c4f884a90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bdf312ed-cce0-4d35-9257-f6a5a80cc0d2", "address": "fa:16:3e:55:c2:62", "network": {"id": "7b0728f9-3997-4fbd-9583-81a235e0b690", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1553690854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8460c83146a64640ba7e549d159275c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdf312ed-cc", "ovs_interfaceid": "bdf312ed-cce0-4d35-9257-f6a5a80cc0d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 17:44:53 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Converting VIF {"id": "bdf312ed-cce0-4d35-9257-f6a5a80cc0d2", "address": "fa:16:3e:55:c2:62", "network": {"id": "7b0728f9-3997-4fbd-9583-81a235e0b690", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1553690854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8460c83146a64640ba7e549d159275c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdf312ed-cc", "ovs_interfaceid": "bdf312ed-cce0-4d35-9257-f6a5a80cc0d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:44:53 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:c2:62,bridge_name='br-int',has_traffic_filtering=True,id=bdf312ed-cce0-4d35-9257-f6a5a80cc0d2,network=Network(7b0728f9-3997-4fbd-9583-81a235e0b690),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdf312ed-cc') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:44:53 user nova-compute[75100]: DEBUG nova.objects.instance [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Lazy-loading 'pci_devices' on Instance uuid ead532eb-c8be-45fa-a8b7-0b4c4f884a90 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:44:53 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Creating config drive at /opt/stack/data/nova/instances/5b5ec5d3-fa6f-43de-b786-8c423064fe7a/disk.config
Nov 10 17:44:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5b5ec5d3-fa6f-43de-b786-8c423064fe7a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpkwuuj2d4 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:44:53 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] End _get_guest_xml xml=<domain type="kvm">
Nov 10 17:44:53 user nova-compute[75100]:   <uuid>ead532eb-c8be-45fa-a8b7-0b4c4f884a90</uuid>
Nov 10 17:44:53 user nova-compute[75100]:   <name>instance-00000005</name>
Nov 10 17:44:53 user nova-compute[75100]:   <memory>524288</memory>
Nov 10 17:44:53 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 10 17:44:53 user nova-compute[75100]:   <metadata>
Nov 10 17:44:53 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 17:44:53 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 10 17:44:53 user nova-compute[75100]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1569402446</nova:name>
Nov 10 17:44:53 user nova-compute[75100]:       <nova:creationTime>2023-11-10 17:44:53</nova:creationTime>
Nov 10 17:44:53 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 10 17:44:53 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 10 17:44:53 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 10 17:44:53 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 10 17:44:53 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 17:44:53 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 10 17:44:53 user nova-compute[75100]:       </nova:flavor>
Nov 10 17:44:53 user nova-compute[75100]:       <nova:owner>
Nov 10 17:44:53 user nova-compute[75100]:         <nova:user uuid="7994564d536446e38002847db1668157">tempest-VolumesAdminNegativeTest-1957922837-project-member</nova:user>
Nov 10 17:44:53 user nova-compute[75100]:         <nova:project uuid="8460c83146a64640ba7e549d159275c2">tempest-VolumesAdminNegativeTest-1957922837</nova:project>
Nov 10 17:44:53 user nova-compute[75100]:       </nova:owner>
Nov 10 17:44:53 user nova-compute[75100]:       <nova:root type="image" uuid="e3cc5321-4d40-49ee-885c-700e14741732"/>
Nov 10 17:44:53 user nova-compute[75100]:       <nova:ports>
Nov 10 17:44:53 user nova-compute[75100]:         <nova:port uuid="bdf312ed-cce0-4d35-9257-f6a5a80cc0d2">
Nov 10 17:44:53 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 10 17:44:53 user nova-compute[75100]:         </nova:port>
Nov 10 17:44:53 user nova-compute[75100]:       </nova:ports>
Nov 10 17:44:53 user nova-compute[75100]:     </nova:instance>
Nov 10 17:44:53 user nova-compute[75100]:   </metadata>
Nov 10 17:44:53 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 10 17:44:53 user nova-compute[75100]:     <system>
Nov 10 17:44:53 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 17:44:53 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 10 17:44:53 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 10 17:44:53 user nova-compute[75100]:       <entry name="serial">ead532eb-c8be-45fa-a8b7-0b4c4f884a90</entry>
Nov 10 17:44:53 user nova-compute[75100]:       <entry name="uuid">ead532eb-c8be-45fa-a8b7-0b4c4f884a90</entry>
Nov 10 17:44:53 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 10 17:44:53 user nova-compute[75100]:     </system>
Nov 10 17:44:53 user nova-compute[75100]:   </sysinfo>
Nov 10 17:44:53 user nova-compute[75100]:   <os>
Nov 10 17:44:53 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 17:44:53 user nova-compute[75100]:     <boot dev="hd"/>
Nov 10 17:44:53 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 10 17:44:53 user nova-compute[75100]:   </os>
Nov 10 17:44:53 user nova-compute[75100]:   <features>
Nov 10 17:44:53 user nova-compute[75100]:     <acpi/>
Nov 10 17:44:53 user nova-compute[75100]:     <apic/>
Nov 10 17:44:53 user nova-compute[75100]:     <vmcoreinfo/>
Nov 10 17:44:53 user nova-compute[75100]:   </features>
Nov 10 17:44:53 user nova-compute[75100]:   <clock offset="utc">
Nov 10 17:44:53 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 17:44:53 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 17:44:53 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 10 17:44:53 user nova-compute[75100]:   </clock>
Nov 10 17:44:53 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 10 17:44:53 user nova-compute[75100]:     <model>Nehalem</model>
Nov 10 17:44:53 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 17:44:53 user nova-compute[75100]:   </cpu>
Nov 10 17:44:53 user nova-compute[75100]:   <devices>
Nov 10 17:44:53 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 10 17:44:53 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 17:44:53 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/ead532eb-c8be-45fa-a8b7-0b4c4f884a90/disk"/>
Nov 10 17:44:53 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 10 17:44:53 user nova-compute[75100]:     </disk>
Nov 10 17:44:53 user nova-compute[75100]:     <interface type="ethernet">
Nov 10 17:44:53 user nova-compute[75100]:       <mac address="fa:16:3e:55:c2:62"/>
Nov 10 17:44:53 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:44:53 user nova-compute[75100]:       <mtu size="1442"/>
Nov 10 17:44:53 user nova-compute[75100]:       <target dev="tapbdf312ed-cc"/>
Nov 10 17:44:53 user nova-compute[75100]:     </interface>
Nov 10 17:44:53 user nova-compute[75100]:     <serial type="pty">
Nov 10 17:44:53 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/ead532eb-c8be-45fa-a8b7-0b4c4f884a90/console.log" append="off"/>
Nov 10 17:44:53 user nova-compute[75100]:     </serial>
Nov 10 17:44:53 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 17:44:53 user nova-compute[75100]:     <video>
Nov 10 17:44:53 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:44:53 user nova-compute[75100]:     </video>
Nov 10 17:44:53 user nova-compute[75100]:     <rng model="virtio">
Nov 10 17:44:53 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 10 17:44:53 user nova-compute[75100]:     </rng>
Nov 10 17:44:53 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 10 17:44:53 user nova-compute[75100]:     <memballoon model="virtio">
Nov 10 17:44:53 user nova-compute[75100]:       <stats period="10"/>
Nov 10 17:44:53 user nova-compute[75100]:     </memballoon>
Nov 10 17:44:53 user nova-compute[75100]:   </devices>
Nov 10 17:44:53 user nova-compute[75100]: </domain>
Nov 10 17:44:53 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 17:44:53 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:44:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1569402446',display_name='tempest-VolumesAdminNegativeTest-server-1569402446',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1569402446',id=5,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM8Mgwh9Oz9c33+lKVITcrw1u2yFY/zSZSn/46TDmummyopuD69BLBhczKDnulz5SNCJw0coB6gJCRJRGmQ7wHrJM2Psl2mrUGpc+wqcJ8RyTMsYtYnIfcVB6fpVlHgaMg==',key_name='tempest-keypair-1129073438',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8460c83146a64640ba7e549d159275c2',ramdisk_id='',reservation_id='r-k2gc1wz8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1957922837',owner_user_name='tempest-VolumesAdminNegativeTest-1957922837-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:44:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7994564d536446e38002847db1668157',uuid=ead532eb-c8be-45fa-a8b7-0b4c4f884a90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bdf312ed-cce0-4d35-9257-f6a5a80cc0d2", "address": "fa:16:3e:55:c2:62", "network": {"id": "7b0728f9-3997-4fbd-9583-81a235e0b690", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1553690854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8460c83146a64640ba7e549d159275c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdf312ed-cc", "ovs_interfaceid": "bdf312ed-cce0-4d35-9257-f6a5a80cc0d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 17:44:53 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Converting VIF {"id": "bdf312ed-cce0-4d35-9257-f6a5a80cc0d2", "address": "fa:16:3e:55:c2:62", "network": {"id": "7b0728f9-3997-4fbd-9583-81a235e0b690", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1553690854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8460c83146a64640ba7e549d159275c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdf312ed-cc", "ovs_interfaceid": "bdf312ed-cce0-4d35-9257-f6a5a80cc0d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:44:53 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:c2:62,bridge_name='br-int',has_traffic_filtering=True,id=bdf312ed-cce0-4d35-9257-f6a5a80cc0d2,network=Network(7b0728f9-3997-4fbd-9583-81a235e0b690),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdf312ed-cc') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:44:53 user nova-compute[75100]: DEBUG os_vif [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:c2:62,bridge_name='br-int',has_traffic_filtering=True,id=bdf312ed-cce0-4d35-9257-f6a5a80cc0d2,network=Network(7b0728f9-3997-4fbd-9583-81a235e0b690),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdf312ed-cc') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 17:44:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:44:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 17:44:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5b5ec5d3-fa6f-43de-b786-8c423064fe7a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpkwuuj2d4" returned: 0 in 0.059s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:44:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c476f128-568c-59b7-8476-9cf46607517c', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:44:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:44:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbdf312ed-cc, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:44:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbdf312ed-cc, col_values=(('qos', UUID('4d27d4f6-b799-4520-b5a9-0ec1f246e1d8')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:44:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbdf312ed-cc, col_values=(('external_ids', {'iface-id': 'bdf312ed-cce0-4d35-9257-f6a5a80cc0d2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:55:c2:62', 'vm-uuid': 'ead532eb-c8be-45fa-a8b7-0b4c4f884a90'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:44:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:44:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:53 user nova-compute[75100]: INFO os_vif [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:c2:62,bridge_name='br-int',has_traffic_filtering=True,id=bdf312ed-cce0-4d35-9257-f6a5a80cc0d2,network=Network(7b0728f9-3997-4fbd-9583-81a235e0b690),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdf312ed-cc')
Nov 10 17:44:53 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 17:44:53 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] No VIF found with MAC fa:16:3e:55:c2:62, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 17:44:53 user nova-compute[75100]: DEBUG nova.network.neutron [req-cd72753d-6455-44a1-b298-216a666614ae req-f5054722-6d70-4a02-8bbd-1d1ad963af73 service nova] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Updated VIF entry in instance network info cache for port bdf312ed-cce0-4d35-9257-f6a5a80cc0d2. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 17:44:53 user nova-compute[75100]: DEBUG nova.network.neutron [req-cd72753d-6455-44a1-b298-216a666614ae req-f5054722-6d70-4a02-8bbd-1d1ad963af73 service nova] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Updating instance_info_cache with network_info: [{"id": "bdf312ed-cce0-4d35-9257-f6a5a80cc0d2", "address": "fa:16:3e:55:c2:62", "network": {"id": "7b0728f9-3997-4fbd-9583-81a235e0b690", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1553690854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8460c83146a64640ba7e549d159275c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdf312ed-cc", "ovs_interfaceid": "bdf312ed-cce0-4d35-9257-f6a5a80cc0d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:44:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cd72753d-6455-44a1-b298-216a666614ae req-f5054722-6d70-4a02-8bbd-1d1ad963af73 service nova] Releasing lock "refresh_cache-ead532eb-c8be-45fa-a8b7-0b4c4f884a90" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:44:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Acquiring lock "91238923-a64c-4f41-a046-be243eff880d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:44:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Lock "91238923-a64c-4f41-a046-be243eff880d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:44:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:56 user nova-compute[75100]: DEBUG nova.compute.manager [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] [instance: 91238923-a64c-4f41-a046-be243eff880d] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 17:44:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:44:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:44:56 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 17:44:56 user nova-compute[75100]: INFO nova.compute.claims [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] [instance: 91238923-a64c-4f41-a046-be243eff880d] Claim successful on node user
Nov 10 17:44:56 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:44:56 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:44:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.405s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:44:56 user nova-compute[75100]: DEBUG nova.compute.manager [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] [instance: 91238923-a64c-4f41-a046-be243eff880d] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 17:44:56 user nova-compute[75100]: DEBUG nova.compute.manager [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] [instance: 91238923-a64c-4f41-a046-be243eff880d] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 17:44:56 user nova-compute[75100]: DEBUG nova.network.neutron [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] [instance: 91238923-a64c-4f41-a046-be243eff880d] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 17:44:56 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] [instance: 91238923-a64c-4f41-a046-be243eff880d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 17:44:56 user nova-compute[75100]: DEBUG nova.compute.manager [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] [instance: 91238923-a64c-4f41-a046-be243eff880d] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 17:44:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:56 user nova-compute[75100]: DEBUG nova.policy [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '83545cded878478a8c823e5614376f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38f5a70dae74e3cb19dd6ddade72581', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 17:44:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:57 user nova-compute[75100]: DEBUG nova.compute.manager [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] [instance: 91238923-a64c-4f41-a046-be243eff880d] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 17:44:57 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] [instance: 91238923-a64c-4f41-a046-be243eff880d] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 17:44:57 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] [instance: 91238923-a64c-4f41-a046-be243eff880d] Creating image(s)
Nov 10 17:44:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Acquiring lock "/opt/stack/data/nova/instances/91238923-a64c-4f41-a046-be243eff880d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:44:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Lock "/opt/stack/data/nova/instances/91238923-a64c-4f41-a046-be243eff880d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:44:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Lock "/opt/stack/data/nova/instances/91238923-a64c-4f41-a046-be243eff880d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:44:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:44:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.176s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:44:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Acquiring lock "818b9e28e061d41a38d903968b229be2ed9ba520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:44:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:44:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:44:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.162s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:44:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/91238923-a64c-4f41-a046-be243eff880d/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:44:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/91238923-a64c-4f41-a046-be243eff880d/disk 1073741824" returned: 0 in 0.057s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:44:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:44:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:44:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.164s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:44:57 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Checking if we can resize image /opt/stack/data/nova/instances/91238923-a64c-4f41-a046-be243eff880d/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 17:44:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91238923-a64c-4f41-a046-be243eff880d/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:44:57 user nova-compute[75100]: DEBUG nova.network.neutron [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] [instance: 91238923-a64c-4f41-a046-be243eff880d] Successfully created port: 4d2871cf-d6d9-4edb-9a0d-bc275ee11e13 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 17:44:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91238923-a64c-4f41-a046-be243eff880d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:44:57 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Cannot resize image /opt/stack/data/nova/instances/91238923-a64c-4f41-a046-be243eff880d/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 17:44:57 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] [instance: 91238923-a64c-4f41-a046-be243eff880d] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 17:44:57 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] [instance: 91238923-a64c-4f41-a046-be243eff880d] Ensure instance console log exists: /opt/stack/data/nova/instances/91238923-a64c-4f41-a046-be243eff880d/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 17:44:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:44:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:44:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:44:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:58 user nova-compute[75100]: DEBUG nova.network.neutron [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] [instance: 91238923-a64c-4f41-a046-be243eff880d] Successfully updated port: 4d2871cf-d6d9-4edb-9a0d-bc275ee11e13 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 17:44:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Acquiring lock "refresh_cache-91238923-a64c-4f41-a046-be243eff880d" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:44:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Acquired lock "refresh_cache-91238923-a64c-4f41-a046-be243eff880d" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:44:58 user nova-compute[75100]: DEBUG nova.network.neutron [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] [instance: 91238923-a64c-4f41-a046-be243eff880d] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 17:44:58 user nova-compute[75100]: DEBUG nova.compute.manager [req-3e1fe2d5-2d3d-41a2-a6c4-91b53f58f8e9 req-497f002b-0cde-4c69-a81b-71800d2ac3a5 service nova] [instance: 91238923-a64c-4f41-a046-be243eff880d] Received event network-changed-4d2871cf-d6d9-4edb-9a0d-bc275ee11e13 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:44:58 user nova-compute[75100]: DEBUG nova.compute.manager [req-3e1fe2d5-2d3d-41a2-a6c4-91b53f58f8e9 req-497f002b-0cde-4c69-a81b-71800d2ac3a5 service nova] [instance: 91238923-a64c-4f41-a046-be243eff880d] Refreshing instance network info cache due to event network-changed-4d2871cf-d6d9-4edb-9a0d-bc275ee11e13. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 17:44:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3e1fe2d5-2d3d-41a2-a6c4-91b53f58f8e9 req-497f002b-0cde-4c69-a81b-71800d2ac3a5 service nova] Acquiring lock "refresh_cache-91238923-a64c-4f41-a046-be243eff880d" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:44:58 user nova-compute[75100]: DEBUG nova.network.neutron [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] [instance: 91238923-a64c-4f41-a046-be243eff880d] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 17:44:58 user nova-compute[75100]: DEBUG nova.compute.manager [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 17:44:58 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 17:44:58 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Instance spawned successfully.
Nov 10 17:44:58 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 17:44:58 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:44:58 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:44:58 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:44:58 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:44:58 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:44:58 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:44:58 user nova-compute[75100]: DEBUG nova.compute.manager [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 17:44:58 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 17:44:58 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Instance spawned successfully.
Nov 10 17:44:58 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 17:44:58 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:44:58 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:44:58 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:44:58 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:44:58 user nova-compute[75100]: INFO nova.compute.manager [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Took 10.11 seconds to spawn the instance on the hypervisor.
Nov 10 17:44:58 user nova-compute[75100]: DEBUG nova.compute.manager [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 17:44:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:58 user nova-compute[75100]: INFO nova.compute.manager [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Took 9.36 seconds to spawn the instance on the hypervisor.
Nov 10 17:44:58 user nova-compute[75100]: DEBUG nova.compute.manager [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 17:44:58 user nova-compute[75100]: INFO nova.compute.manager [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Took 11.72 seconds to build instance.
Nov 10 17:44:58 user nova-compute[75100]: INFO nova.compute.manager [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Took 10.84 seconds to build instance.
Nov 10 17:44:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4eb943aa-2e4b-4e56-bdc7-453926ec4100 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Lock "ead532eb-c8be-45fa-a8b7-0b4c4f884a90" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.899s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:44:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e61fa6ef-05d9-46b3-bf1d-18f142ef7cfc tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Lock "5b5ec5d3-fa6f-43de-b786-8c423064fe7a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:44:58 user nova-compute[75100]: DEBUG nova.network.neutron [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] [instance: 91238923-a64c-4f41-a046-be243eff880d] Updating instance_info_cache with network_info: [{"id": "4d2871cf-d6d9-4edb-9a0d-bc275ee11e13", "address": "fa:16:3e:8e:18:ef", "network": {"id": "304fddab-4cec-47aa-afab-f32de11ec897", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-288924842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c38f5a70dae74e3cb19dd6ddade72581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d2871cf-d6", "ovs_interfaceid": "4d2871cf-d6d9-4edb-9a0d-bc275ee11e13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:44:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Releasing lock "refresh_cache-91238923-a64c-4f41-a046-be243eff880d" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:44:59 user nova-compute[75100]: DEBUG nova.compute.manager [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] [instance: 91238923-a64c-4f41-a046-be243eff880d] Instance network_info: |[{"id": "4d2871cf-d6d9-4edb-9a0d-bc275ee11e13", "address": "fa:16:3e:8e:18:ef", "network": {"id": "304fddab-4cec-47aa-afab-f32de11ec897", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-288924842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c38f5a70dae74e3cb19dd6ddade72581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d2871cf-d6", "ovs_interfaceid": "4d2871cf-d6d9-4edb-9a0d-bc275ee11e13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 17:44:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3e1fe2d5-2d3d-41a2-a6c4-91b53f58f8e9 req-497f002b-0cde-4c69-a81b-71800d2ac3a5 service nova] Acquired lock "refresh_cache-91238923-a64c-4f41-a046-be243eff880d" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:44:59 user nova-compute[75100]: DEBUG nova.network.neutron [req-3e1fe2d5-2d3d-41a2-a6c4-91b53f58f8e9 req-497f002b-0cde-4c69-a81b-71800d2ac3a5 service nova] [instance: 91238923-a64c-4f41-a046-be243eff880d] Refreshing network info cache for port 4d2871cf-d6d9-4edb-9a0d-bc275ee11e13 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 17:44:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] [instance: 91238923-a64c-4f41-a046-be243eff880d] Start _get_guest_xml network_info=[{"id": "4d2871cf-d6d9-4edb-9a0d-bc275ee11e13", "address": "fa:16:3e:8e:18:ef", "network": {"id": "304fddab-4cec-47aa-afab-f32de11ec897", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-288924842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c38f5a70dae74e3cb19dd6ddade72581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d2871cf-d6", "ovs_interfaceid": "4d2871cf-d6d9-4edb-9a0d-bc275ee11e13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'e3cc5321-4d40-49ee-885c-700e14741732'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 17:44:59 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:44:59 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:44:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 17:44:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 17:44:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 17:44:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 17:44:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 17:44:59 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T17:40:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 17:44:59 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 17:44:59 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 17:44:59 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 17:44:59 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 17:44:59 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 17:44:59 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 17:44:59 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 17:44:59 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 17:44:59 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 17:44:59 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 17:44:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T17:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1217309978',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1217309978',id=7,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDg6Whui6h8FFFZnFwQnZiCuU3HjskJ2h5m1lP5l89/I6dnqvQ2dx39WpWkClYX9LsxzEk1B3cwB2sN+VxVpaZakTcKBRQUFmNH6ntC81O0eJh0TTBqxIPcr2Favd3KjTw==',key_name='tempest-keypair-326242402',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c38f5a70dae74e3cb19dd6ddade72581',ramdisk_id='',reservation_id='r-v9u7eycj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1600859769',owner_user_name='tempest-TaggedAttachmentsTest-1600859769-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:44:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83545cded878478a8c823e5614376f18',uuid=91238923-a64c-4f41-a046-be243eff880d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d2871cf-d6d9-4edb-9a0d-bc275ee11e13", "address": "fa:16:3e:8e:18:ef", "network": {"id": "304fddab-4cec-47aa-afab-f32de11ec897", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-288924842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c38f5a70dae74e3cb19dd6ddade72581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d2871cf-d6", "ovs_interfaceid": "4d2871cf-d6d9-4edb-9a0d-bc275ee11e13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 17:44:59 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Converting VIF {"id": "4d2871cf-d6d9-4edb-9a0d-bc275ee11e13", "address": "fa:16:3e:8e:18:ef", "network": {"id": "304fddab-4cec-47aa-afab-f32de11ec897", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-288924842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c38f5a70dae74e3cb19dd6ddade72581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d2871cf-d6", "ovs_interfaceid": "4d2871cf-d6d9-4edb-9a0d-bc275ee11e13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:44:59 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:18:ef,bridge_name='br-int',has_traffic_filtering=True,id=4d2871cf-d6d9-4edb-9a0d-bc275ee11e13,network=Network(304fddab-4cec-47aa-afab-f32de11ec897),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d2871cf-d6') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:44:59 user nova-compute[75100]: DEBUG nova.objects.instance [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Lazy-loading 'pci_devices' on Instance uuid 91238923-a64c-4f41-a046-be243eff880d {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:44:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] [instance: 91238923-a64c-4f41-a046-be243eff880d] End _get_guest_xml xml=<domain type="kvm">
Nov 10 17:44:59 user nova-compute[75100]:   <uuid>91238923-a64c-4f41-a046-be243eff880d</uuid>
Nov 10 17:44:59 user nova-compute[75100]:   <name>instance-00000007</name>
Nov 10 17:44:59 user nova-compute[75100]:   <memory>524288</memory>
Nov 10 17:44:59 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 10 17:44:59 user nova-compute[75100]:   <metadata>
Nov 10 17:44:59 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 17:44:59 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 10 17:44:59 user nova-compute[75100]:       <nova:name>tempest-device-tagging-server-1217309978</nova:name>
Nov 10 17:44:59 user nova-compute[75100]:       <nova:creationTime>2023-11-10 17:44:59</nova:creationTime>
Nov 10 17:44:59 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 10 17:44:59 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 10 17:44:59 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 10 17:44:59 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 10 17:44:59 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 17:44:59 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 10 17:44:59 user nova-compute[75100]:       </nova:flavor>
Nov 10 17:44:59 user nova-compute[75100]:       <nova:owner>
Nov 10 17:44:59 user nova-compute[75100]:         <nova:user uuid="83545cded878478a8c823e5614376f18">tempest-TaggedAttachmentsTest-1600859769-project-member</nova:user>
Nov 10 17:44:59 user nova-compute[75100]:         <nova:project uuid="c38f5a70dae74e3cb19dd6ddade72581">tempest-TaggedAttachmentsTest-1600859769</nova:project>
Nov 10 17:44:59 user nova-compute[75100]:       </nova:owner>
Nov 10 17:44:59 user nova-compute[75100]:       <nova:root type="image" uuid="e3cc5321-4d40-49ee-885c-700e14741732"/>
Nov 10 17:44:59 user nova-compute[75100]:       <nova:ports>
Nov 10 17:44:59 user nova-compute[75100]:         <nova:port uuid="4d2871cf-d6d9-4edb-9a0d-bc275ee11e13">
Nov 10 17:44:59 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 10 17:44:59 user nova-compute[75100]:         </nova:port>
Nov 10 17:44:59 user nova-compute[75100]:       </nova:ports>
Nov 10 17:44:59 user nova-compute[75100]:     </nova:instance>
Nov 10 17:44:59 user nova-compute[75100]:   </metadata>
Nov 10 17:44:59 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 10 17:44:59 user nova-compute[75100]:     <system>
Nov 10 17:44:59 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 17:44:59 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 10 17:44:59 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 10 17:44:59 user nova-compute[75100]:       <entry name="serial">91238923-a64c-4f41-a046-be243eff880d</entry>
Nov 10 17:44:59 user nova-compute[75100]:       <entry name="uuid">91238923-a64c-4f41-a046-be243eff880d</entry>
Nov 10 17:44:59 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 10 17:44:59 user nova-compute[75100]:     </system>
Nov 10 17:44:59 user nova-compute[75100]:   </sysinfo>
Nov 10 17:44:59 user nova-compute[75100]:   <os>
Nov 10 17:44:59 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 17:44:59 user nova-compute[75100]:     <boot dev="hd"/>
Nov 10 17:44:59 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 10 17:44:59 user nova-compute[75100]:   </os>
Nov 10 17:44:59 user nova-compute[75100]:   <features>
Nov 10 17:44:59 user nova-compute[75100]:     <acpi/>
Nov 10 17:44:59 user nova-compute[75100]:     <apic/>
Nov 10 17:44:59 user nova-compute[75100]:     <vmcoreinfo/>
Nov 10 17:44:59 user nova-compute[75100]:   </features>
Nov 10 17:44:59 user nova-compute[75100]:   <clock offset="utc">
Nov 10 17:44:59 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 17:44:59 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 17:44:59 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 10 17:44:59 user nova-compute[75100]:   </clock>
Nov 10 17:44:59 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 10 17:44:59 user nova-compute[75100]:     <model>Nehalem</model>
Nov 10 17:44:59 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 17:44:59 user nova-compute[75100]:   </cpu>
Nov 10 17:44:59 user nova-compute[75100]:   <devices>
Nov 10 17:44:59 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 10 17:44:59 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 17:44:59 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/91238923-a64c-4f41-a046-be243eff880d/disk"/>
Nov 10 17:44:59 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 10 17:44:59 user nova-compute[75100]:     </disk>
Nov 10 17:44:59 user nova-compute[75100]:     <disk type="file" device="cdrom">
Nov 10 17:44:59 user nova-compute[75100]:       <driver name="qemu" type="raw" cache="none"/>
Nov 10 17:44:59 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/91238923-a64c-4f41-a046-be243eff880d/disk.config"/>
Nov 10 17:44:59 user nova-compute[75100]:       <target dev="hda" bus="ide"/>
Nov 10 17:44:59 user nova-compute[75100]:     </disk>
Nov 10 17:44:59 user nova-compute[75100]:     <interface type="ethernet">
Nov 10 17:44:59 user nova-compute[75100]:       <mac address="fa:16:3e:8e:18:ef"/>
Nov 10 17:44:59 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:44:59 user nova-compute[75100]:       <mtu size="1442"/>
Nov 10 17:44:59 user nova-compute[75100]:       <target dev="tap4d2871cf-d6"/>
Nov 10 17:44:59 user nova-compute[75100]:     </interface>
Nov 10 17:44:59 user nova-compute[75100]:     <serial type="pty">
Nov 10 17:44:59 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/91238923-a64c-4f41-a046-be243eff880d/console.log" append="off"/>
Nov 10 17:44:59 user nova-compute[75100]:     </serial>
Nov 10 17:44:59 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 17:44:59 user nova-compute[75100]:     <video>
Nov 10 17:44:59 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:44:59 user nova-compute[75100]:     </video>
Nov 10 17:44:59 user nova-compute[75100]:     <rng model="virtio">
Nov 10 17:44:59 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 10 17:44:59 user nova-compute[75100]:     </rng>
Nov 10 17:44:59 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 10 17:44:59 user nova-compute[75100]:     <memballoon model="virtio">
Nov 10 17:44:59 user nova-compute[75100]:       <stats period="10"/>
Nov 10 17:44:59 user nova-compute[75100]:     </memballoon>
Nov 10 17:44:59 user nova-compute[75100]:   </devices>
Nov 10 17:44:59 user nova-compute[75100]: </domain>
Nov 10 17:44:59 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 17:44:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T17:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1217309978',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1217309978',id=7,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDg6Whui6h8FFFZnFwQnZiCuU3HjskJ2h5m1lP5l89/I6dnqvQ2dx39WpWkClYX9LsxzEk1B3cwB2sN+VxVpaZakTcKBRQUFmNH6ntC81O0eJh0TTBqxIPcr2Favd3KjTw==',key_name='tempest-keypair-326242402',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c38f5a70dae74e3cb19dd6ddade72581',ramdisk_id='',reservation_id='r-v9u7eycj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1600859769',owner_user_name='tempest-TaggedAttachmentsTest-1600859769-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:44:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83545cded878478a8c823e5614376f18',uuid=91238923-a64c-4f41-a046-be243eff880d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d2871cf-d6d9-4edb-9a0d-bc275ee11e13", "address": "fa:16:3e:8e:18:ef", "network": {"id": "304fddab-4cec-47aa-afab-f32de11ec897", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-288924842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c38f5a70dae74e3cb19dd6ddade72581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d2871cf-d6", "ovs_interfaceid": "4d2871cf-d6d9-4edb-9a0d-bc275ee11e13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 17:44:59 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Converting VIF {"id": "4d2871cf-d6d9-4edb-9a0d-bc275ee11e13", "address": "fa:16:3e:8e:18:ef", "network": {"id": "304fddab-4cec-47aa-afab-f32de11ec897", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-288924842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c38f5a70dae74e3cb19dd6ddade72581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d2871cf-d6", "ovs_interfaceid": "4d2871cf-d6d9-4edb-9a0d-bc275ee11e13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:44:59 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:18:ef,bridge_name='br-int',has_traffic_filtering=True,id=4d2871cf-d6d9-4edb-9a0d-bc275ee11e13,network=Network(304fddab-4cec-47aa-afab-f32de11ec897),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d2871cf-d6') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:44:59 user nova-compute[75100]: DEBUG os_vif [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:18:ef,bridge_name='br-int',has_traffic_filtering=True,id=4d2871cf-d6d9-4edb-9a0d-bc275ee11e13,network=Network(304fddab-4cec-47aa-afab-f32de11ec897),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d2871cf-d6') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 17:44:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:44:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 17:44:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd3a4ca63-15cd-52e7-b3c7-e44f2123494b', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:44:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:44:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4d2871cf-d6, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:44:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4d2871cf-d6, col_values=(('qos', UUID('ddcecfb0-9e4f-495e-a203-6619a4864f54')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:44:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4d2871cf-d6, col_values=(('external_ids', {'iface-id': '4d2871cf-d6d9-4edb-9a0d-bc275ee11e13', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:18:ef', 'vm-uuid': '91238923-a64c-4f41-a046-be243eff880d'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:44:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:44:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:44:59 user nova-compute[75100]: INFO os_vif [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:18:ef,bridge_name='br-int',has_traffic_filtering=True,id=4d2871cf-d6d9-4edb-9a0d-bc275ee11e13,network=Network(304fddab-4cec-47aa-afab-f32de11ec897),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d2871cf-d6')
Nov 10 17:44:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 17:44:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] No BDM found with device name hda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 17:44:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] No VIF found with MAC fa:16:3e:8e:18:ef, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 17:44:59 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] [instance: 91238923-a64c-4f41-a046-be243eff880d] Using config drive
Nov 10 17:44:59 user nova-compute[75100]: DEBUG nova.network.neutron [req-3e1fe2d5-2d3d-41a2-a6c4-91b53f58f8e9 req-497f002b-0cde-4c69-a81b-71800d2ac3a5 service nova] [instance: 91238923-a64c-4f41-a046-be243eff880d] Updated VIF entry in instance network info cache for port 4d2871cf-d6d9-4edb-9a0d-bc275ee11e13. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 17:44:59 user nova-compute[75100]: DEBUG nova.network.neutron [req-3e1fe2d5-2d3d-41a2-a6c4-91b53f58f8e9 req-497f002b-0cde-4c69-a81b-71800d2ac3a5 service nova] [instance: 91238923-a64c-4f41-a046-be243eff880d] Updating instance_info_cache with network_info: [{"id": "4d2871cf-d6d9-4edb-9a0d-bc275ee11e13", "address": "fa:16:3e:8e:18:ef", "network": {"id": "304fddab-4cec-47aa-afab-f32de11ec897", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-288924842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c38f5a70dae74e3cb19dd6ddade72581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d2871cf-d6", "ovs_interfaceid": "4d2871cf-d6d9-4edb-9a0d-bc275ee11e13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:44:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3e1fe2d5-2d3d-41a2-a6c4-91b53f58f8e9 req-497f002b-0cde-4c69-a81b-71800d2ac3a5 service nova] Releasing lock "refresh_cache-91238923-a64c-4f41-a046-be243eff880d" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:44:59 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] [instance: 91238923-a64c-4f41-a046-be243eff880d] Creating config drive at /opt/stack/data/nova/instances/91238923-a64c-4f41-a046-be243eff880d/disk.config
Nov 10 17:44:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/91238923-a64c-4f41-a046-be243eff880d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpmd5qmodr {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:44:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/91238923-a64c-4f41-a046-be243eff880d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpmd5qmodr" returned: 0 in 0.059s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:45:00 user nova-compute[75100]: DEBUG nova.compute.manager [req-57dff53d-593f-4b54-aa89-1fe80b299219 req-00025454-c3d3-4bc4-9711-3dc5165263b6 service nova] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Received event network-vif-plugged-be620d2e-a2ea-49fe-9205-68101009027b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:45:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-57dff53d-593f-4b54-aa89-1fe80b299219 req-00025454-c3d3-4bc4-9711-3dc5165263b6 service nova] Acquiring lock "b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:45:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-57dff53d-593f-4b54-aa89-1fe80b299219 req-00025454-c3d3-4bc4-9711-3dc5165263b6 service nova] Lock "b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:45:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-57dff53d-593f-4b54-aa89-1fe80b299219 req-00025454-c3d3-4bc4-9711-3dc5165263b6 service nova] Lock "b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:45:00 user nova-compute[75100]: DEBUG nova.compute.manager [req-57dff53d-593f-4b54-aa89-1fe80b299219 req-00025454-c3d3-4bc4-9711-3dc5165263b6 service nova] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] No waiting events found dispatching network-vif-plugged-be620d2e-a2ea-49fe-9205-68101009027b {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:45:00 user nova-compute[75100]: WARNING nova.compute.manager [req-57dff53d-593f-4b54-aa89-1fe80b299219 req-00025454-c3d3-4bc4-9711-3dc5165263b6 service nova] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Received unexpected event network-vif-plugged-be620d2e-a2ea-49fe-9205-68101009027b for instance with vm_state active and task_state None.
Nov 10 17:45:00 user nova-compute[75100]: DEBUG nova.compute.manager [req-57dff53d-593f-4b54-aa89-1fe80b299219 req-00025454-c3d3-4bc4-9711-3dc5165263b6 service nova] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Received event network-vif-plugged-be620d2e-a2ea-49fe-9205-68101009027b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:45:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-57dff53d-593f-4b54-aa89-1fe80b299219 req-00025454-c3d3-4bc4-9711-3dc5165263b6 service nova] Acquiring lock "b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:45:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-57dff53d-593f-4b54-aa89-1fe80b299219 req-00025454-c3d3-4bc4-9711-3dc5165263b6 service nova] Lock "b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:45:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-57dff53d-593f-4b54-aa89-1fe80b299219 req-00025454-c3d3-4bc4-9711-3dc5165263b6 service nova] Lock "b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:45:00 user nova-compute[75100]: DEBUG nova.compute.manager [req-57dff53d-593f-4b54-aa89-1fe80b299219 req-00025454-c3d3-4bc4-9711-3dc5165263b6 service nova] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] No waiting events found dispatching network-vif-plugged-be620d2e-a2ea-49fe-9205-68101009027b {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:45:00 user nova-compute[75100]: WARNING nova.compute.manager [req-57dff53d-593f-4b54-aa89-1fe80b299219 req-00025454-c3d3-4bc4-9711-3dc5165263b6 service nova] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Received unexpected event network-vif-plugged-be620d2e-a2ea-49fe-9205-68101009027b for instance with vm_state active and task_state None.
Nov 10 17:45:00 user nova-compute[75100]: DEBUG nova.compute.manager [req-56ddb4da-91a1-4aaa-a091-113b36799e18 req-7c1a669b-c8e7-4c78-bcc7-6013b63fb1f5 service nova] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Received event network-vif-plugged-eedb3d8e-5619-4df9-aef9-bbc44db1dba9 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:45:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-56ddb4da-91a1-4aaa-a091-113b36799e18 req-7c1a669b-c8e7-4c78-bcc7-6013b63fb1f5 service nova] Acquiring lock "c19fc271-a248-4631-a11f-89b7ed73bf85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:45:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-56ddb4da-91a1-4aaa-a091-113b36799e18 req-7c1a669b-c8e7-4c78-bcc7-6013b63fb1f5 service nova] Lock "c19fc271-a248-4631-a11f-89b7ed73bf85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:45:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-56ddb4da-91a1-4aaa-a091-113b36799e18 req-7c1a669b-c8e7-4c78-bcc7-6013b63fb1f5 service nova] Lock "c19fc271-a248-4631-a11f-89b7ed73bf85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:45:00 user nova-compute[75100]: DEBUG nova.compute.manager [req-56ddb4da-91a1-4aaa-a091-113b36799e18 req-7c1a669b-c8e7-4c78-bcc7-6013b63fb1f5 service nova] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] No waiting events found dispatching network-vif-plugged-eedb3d8e-5619-4df9-aef9-bbc44db1dba9 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:45:00 user nova-compute[75100]: WARNING nova.compute.manager [req-56ddb4da-91a1-4aaa-a091-113b36799e18 req-7c1a669b-c8e7-4c78-bcc7-6013b63fb1f5 service nova] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Received unexpected event network-vif-plugged-eedb3d8e-5619-4df9-aef9-bbc44db1dba9 for instance with vm_state active and task_state None.
Nov 10 17:45:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:45:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:45:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:45:01 user nova-compute[75100]: DEBUG nova.compute.manager [req-ade459b8-452f-4fc8-bd95-9bdfdc0c7c2f req-6185198e-23a0-493b-bd7e-828d2fc7a46a service nova] [instance: 91238923-a64c-4f41-a046-be243eff880d] Received event network-vif-plugged-4d2871cf-d6d9-4edb-9a0d-bc275ee11e13 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:45:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ade459b8-452f-4fc8-bd95-9bdfdc0c7c2f req-6185198e-23a0-493b-bd7e-828d2fc7a46a service nova] Acquiring lock "91238923-a64c-4f41-a046-be243eff880d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:45:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ade459b8-452f-4fc8-bd95-9bdfdc0c7c2f req-6185198e-23a0-493b-bd7e-828d2fc7a46a service nova] Lock "91238923-a64c-4f41-a046-be243eff880d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:45:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ade459b8-452f-4fc8-bd95-9bdfdc0c7c2f req-6185198e-23a0-493b-bd7e-828d2fc7a46a service nova] Lock "91238923-a64c-4f41-a046-be243eff880d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:45:01 user nova-compute[75100]: DEBUG nova.compute.manager [req-ade459b8-452f-4fc8-bd95-9bdfdc0c7c2f req-6185198e-23a0-493b-bd7e-828d2fc7a46a service nova] [instance: 91238923-a64c-4f41-a046-be243eff880d] No waiting events found dispatching network-vif-plugged-4d2871cf-d6d9-4edb-9a0d-bc275ee11e13 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:45:01 user nova-compute[75100]: WARNING nova.compute.manager [req-ade459b8-452f-4fc8-bd95-9bdfdc0c7c2f req-6185198e-23a0-493b-bd7e-828d2fc7a46a service nova] [instance: 91238923-a64c-4f41-a046-be243eff880d] Received unexpected event network-vif-plugged-4d2871cf-d6d9-4edb-9a0d-bc275ee11e13 for instance with vm_state building and task_state spawning.
Nov 10 17:45:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:45:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:45:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:45:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:45:02 user nova-compute[75100]: DEBUG nova.compute.manager [req-37f49cea-149f-4744-85c0-cdf92fc11e87 req-68651138-25f3-44ee-8613-18568a058276 service nova] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Received event network-vif-plugged-eedb3d8e-5619-4df9-aef9-bbc44db1dba9 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:45:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-37f49cea-149f-4744-85c0-cdf92fc11e87 req-68651138-25f3-44ee-8613-18568a058276 service nova] Acquiring lock "c19fc271-a248-4631-a11f-89b7ed73bf85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:45:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-37f49cea-149f-4744-85c0-cdf92fc11e87 req-68651138-25f3-44ee-8613-18568a058276 service nova] Lock "c19fc271-a248-4631-a11f-89b7ed73bf85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:45:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-37f49cea-149f-4744-85c0-cdf92fc11e87 req-68651138-25f3-44ee-8613-18568a058276 service nova] Lock "c19fc271-a248-4631-a11f-89b7ed73bf85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:45:02 user nova-compute[75100]: DEBUG nova.compute.manager [req-37f49cea-149f-4744-85c0-cdf92fc11e87 req-68651138-25f3-44ee-8613-18568a058276 service nova] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] No waiting events found dispatching network-vif-plugged-eedb3d8e-5619-4df9-aef9-bbc44db1dba9 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:45:02 user nova-compute[75100]: WARNING nova.compute.manager [req-37f49cea-149f-4744-85c0-cdf92fc11e87 req-68651138-25f3-44ee-8613-18568a058276 service nova] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Received unexpected event network-vif-plugged-eedb3d8e-5619-4df9-aef9-bbc44db1dba9 for instance with vm_state active and task_state None.
Nov 10 17:45:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] Acquiring lock "c790b5c3-b255-430f-8654-f0ff5d54d48c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:45:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] Lock "c790b5c3-b255-430f-8654-f0ff5d54d48c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:45:02 user nova-compute[75100]: DEBUG nova.compute.manager [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 17:45:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:45:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:45:02 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 17:45:02 user nova-compute[75100]: INFO nova.compute.claims [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Claim successful on node user
Nov 10 17:45:03 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:45:03 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:45:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.448s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:45:03 user nova-compute[75100]: DEBUG nova.compute.manager [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 17:45:03 user nova-compute[75100]: DEBUG nova.compute.manager [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 17:45:03 user nova-compute[75100]: DEBUG nova.network.neutron [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 17:45:03 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 17:45:03 user nova-compute[75100]: DEBUG nova.compute.manager [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 17:45:03 user nova-compute[75100]: DEBUG nova.policy [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b8071e00cc85457cad6d9b407d3096e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbee21b8d0b5480da833126fd57cc1ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 17:45:03 user nova-compute[75100]: DEBUG nova.compute.manager [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 17:45:03 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 17:45:03 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Creating image(s)
Nov 10 17:45:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] Acquiring lock "/opt/stack/data/nova/instances/c790b5c3-b255-430f-8654-f0ff5d54d48c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:45:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] Lock "/opt/stack/data/nova/instances/c790b5c3-b255-430f-8654-f0ff5d54d48c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.004s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:45:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] Lock "/opt/stack/data/nova/instances/c790b5c3-b255-430f-8654-f0ff5d54d48c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:45:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:45:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:45:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.212s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:45:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] Acquiring lock "818b9e28e061d41a38d903968b229be2ed9ba520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:45:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:45:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:45:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-9438bec3-3d06-4893-a5dc-21454229ace9 req-ced6d33b-543c-4160-b62e-49d254658d33 service nova] [instance: 91238923-a64c-4f41-a046-be243eff880d] Received event network-vif-plugged-4d2871cf-d6d9-4edb-9a0d-bc275ee11e13 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:45:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9438bec3-3d06-4893-a5dc-21454229ace9 req-ced6d33b-543c-4160-b62e-49d254658d33 service nova] Acquiring lock "91238923-a64c-4f41-a046-be243eff880d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:45:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9438bec3-3d06-4893-a5dc-21454229ace9 req-ced6d33b-543c-4160-b62e-49d254658d33 service nova] Lock "91238923-a64c-4f41-a046-be243eff880d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:45:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9438bec3-3d06-4893-a5dc-21454229ace9 req-ced6d33b-543c-4160-b62e-49d254658d33 service nova] Lock "91238923-a64c-4f41-a046-be243eff880d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:45:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-9438bec3-3d06-4893-a5dc-21454229ace9 req-ced6d33b-543c-4160-b62e-49d254658d33 service nova] [instance: 91238923-a64c-4f41-a046-be243eff880d] No waiting events found dispatching network-vif-plugged-4d2871cf-d6d9-4edb-9a0d-bc275ee11e13 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:45:03 user nova-compute[75100]: WARNING nova.compute.manager [req-9438bec3-3d06-4893-a5dc-21454229ace9 req-ced6d33b-543c-4160-b62e-49d254658d33 service nova] [instance: 91238923-a64c-4f41-a046-be243eff880d] Received unexpected event network-vif-plugged-4d2871cf-d6d9-4edb-9a0d-bc275ee11e13 for instance with vm_state building and task_state spawning.
Nov 10 17:45:04 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.242s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:45:04 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/c790b5c3-b255-430f-8654-f0ff5d54d48c/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:45:04 user nova-compute[75100]: DEBUG nova.network.neutron [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Successfully created port: 43c197c7-a030-40dd-809c-a6bfebfa1c12 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 17:45:04 user nova-compute[75100]: DEBUG nova.compute.manager [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] [instance: 91238923-a64c-4f41-a046-be243eff880d] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 17:45:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] [instance: 91238923-a64c-4f41-a046-be243eff880d] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 17:45:04 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/c790b5c3-b255-430f-8654-f0ff5d54d48c/disk 1073741824" returned: 0 in 0.073s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:45:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.320s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:45:04 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:45:04 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 91238923-a64c-4f41-a046-be243eff880d] Instance spawned successfully.
Nov 10 17:45:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] [instance: 91238923-a64c-4f41-a046-be243eff880d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 17:45:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:45:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] [instance: 91238923-a64c-4f41-a046-be243eff880d] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:45:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] [instance: 91238923-a64c-4f41-a046-be243eff880d] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:45:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] [instance: 91238923-a64c-4f41-a046-be243eff880d] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:45:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] [instance: 91238923-a64c-4f41-a046-be243eff880d] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:45:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] [instance: 91238923-a64c-4f41-a046-be243eff880d] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:45:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] [instance: 91238923-a64c-4f41-a046-be243eff880d] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:45:04 user nova-compute[75100]: INFO nova.compute.manager [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] [instance: 91238923-a64c-4f41-a046-be243eff880d] Took 7.27 seconds to spawn the instance on the hypervisor.
Nov 10 17:45:04 user nova-compute[75100]: DEBUG nova.compute.manager [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] [instance: 91238923-a64c-4f41-a046-be243eff880d] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 17:45:04 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.300s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:45:04 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c790b5c3-b255-430f-8654-f0ff5d54d48c/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 17:45:04 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c790b5c3-b255-430f-8654-f0ff5d54d48c/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:45:04 user nova-compute[75100]: INFO nova.compute.manager [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] [instance: 91238923-a64c-4f41-a046-be243eff880d] Took 8.20 seconds to build instance.
Nov 10 17:45:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1dc41786-28e3-4282-a652-00d71f2b9b30 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Lock "91238923-a64c-4f41-a046-be243eff880d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.351s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:45:04 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c790b5c3-b255-430f-8654-f0ff5d54d48c/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:45:04 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] Cannot resize image /opt/stack/data/nova/instances/c790b5c3-b255-430f-8654-f0ff5d54d48c/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 17:45:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 17:45:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Ensure instance console log exists: /opt/stack/data/nova/instances/c790b5c3-b255-430f-8654-f0ff5d54d48c/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 17:45:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:45:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:45:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:45:05 user nova-compute[75100]: DEBUG nova.network.neutron [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Successfully updated port: 43c197c7-a030-40dd-809c-a6bfebfa1c12 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 17:45:05 user nova-compute[75100]: DEBUG nova.compute.manager [req-495f6e13-c534-490b-81d7-4c1be5a7e190 req-d5d143c4-89a2-423b-af17-b82572b68280 service nova] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Received event network-changed-43c197c7-a030-40dd-809c-a6bfebfa1c12 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:45:05 user nova-compute[75100]: DEBUG nova.compute.manager [req-495f6e13-c534-490b-81d7-4c1be5a7e190 req-d5d143c4-89a2-423b-af17-b82572b68280 service nova] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Refreshing instance network info cache due to event network-changed-43c197c7-a030-40dd-809c-a6bfebfa1c12. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 17:45:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-495f6e13-c534-490b-81d7-4c1be5a7e190 req-d5d143c4-89a2-423b-af17-b82572b68280 service nova] Acquiring lock "refresh_cache-c790b5c3-b255-430f-8654-f0ff5d54d48c" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:45:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-495f6e13-c534-490b-81d7-4c1be5a7e190 req-d5d143c4-89a2-423b-af17-b82572b68280 service nova] Acquired lock "refresh_cache-c790b5c3-b255-430f-8654-f0ff5d54d48c" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:45:05 user nova-compute[75100]: DEBUG nova.network.neutron [req-495f6e13-c534-490b-81d7-4c1be5a7e190 req-d5d143c4-89a2-423b-af17-b82572b68280 service nova] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Refreshing network info cache for port 43c197c7-a030-40dd-809c-a6bfebfa1c12 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 17:45:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] Acquiring lock "refresh_cache-c790b5c3-b255-430f-8654-f0ff5d54d48c" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:45:05 user nova-compute[75100]: DEBUG nova.network.neutron [req-495f6e13-c534-490b-81d7-4c1be5a7e190 req-d5d143c4-89a2-423b-af17-b82572b68280 service nova] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 17:45:05 user nova-compute[75100]: DEBUG nova.network.neutron [req-495f6e13-c534-490b-81d7-4c1be5a7e190 req-d5d143c4-89a2-423b-af17-b82572b68280 service nova] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:45:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-495f6e13-c534-490b-81d7-4c1be5a7e190 req-d5d143c4-89a2-423b-af17-b82572b68280 service nova] Releasing lock "refresh_cache-c790b5c3-b255-430f-8654-f0ff5d54d48c" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:45:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] Acquired lock "refresh_cache-c790b5c3-b255-430f-8654-f0ff5d54d48c" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:45:05 user nova-compute[75100]: DEBUG nova.network.neutron [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 17:45:05 user nova-compute[75100]: DEBUG nova.network.neutron [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 17:45:05 user nova-compute[75100]: DEBUG nova.compute.manager [req-9e494027-035d-4c4b-b430-1379a7d7dbf1 req-f53a7ba8-1e03-4db6-a304-3f05ba1029a2 service nova] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Received event network-vif-plugged-d3f47ac6-ad90-4589-b41e-798c6fe6d5cf {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:45:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9e494027-035d-4c4b-b430-1379a7d7dbf1 req-f53a7ba8-1e03-4db6-a304-3f05ba1029a2 service nova] Acquiring lock "3e14de19-540d-4dc2-a058-6874d8d14478-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:45:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9e494027-035d-4c4b-b430-1379a7d7dbf1 req-f53a7ba8-1e03-4db6-a304-3f05ba1029a2 service nova] Lock "3e14de19-540d-4dc2-a058-6874d8d14478-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:45:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9e494027-035d-4c4b-b430-1379a7d7dbf1 req-f53a7ba8-1e03-4db6-a304-3f05ba1029a2 service nova] Lock "3e14de19-540d-4dc2-a058-6874d8d14478-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:45:05 user nova-compute[75100]: DEBUG nova.compute.manager [req-9e494027-035d-4c4b-b430-1379a7d7dbf1 req-f53a7ba8-1e03-4db6-a304-3f05ba1029a2 service nova] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] No waiting events found dispatching network-vif-plugged-d3f47ac6-ad90-4589-b41e-798c6fe6d5cf {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:45:05 user nova-compute[75100]: WARNING nova.compute.manager [req-9e494027-035d-4c4b-b430-1379a7d7dbf1 req-f53a7ba8-1e03-4db6-a304-3f05ba1029a2 service nova] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Received unexpected event network-vif-plugged-d3f47ac6-ad90-4589-b41e-798c6fe6d5cf for instance with vm_state active and task_state None.
Nov 10 17:45:06 user nova-compute[75100]: DEBUG nova.network.neutron [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Updating instance_info_cache with network_info: [{"id": "43c197c7-a030-40dd-809c-a6bfebfa1c12", "address": "fa:16:3e:e4:af:16", "network": {"id": "b646ed0c-9af2-495b-afc3-81a58b5c1203", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1923503231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbee21b8d0b5480da833126fd57cc1ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43c197c7-a0", "ovs_interfaceid": "43c197c7-a030-40dd-809c-a6bfebfa1c12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:45:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] Releasing lock "refresh_cache-c790b5c3-b255-430f-8654-f0ff5d54d48c" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:45:06 user nova-compute[75100]: DEBUG nova.compute.manager [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Instance network_info: |[{"id": "43c197c7-a030-40dd-809c-a6bfebfa1c12", "address": "fa:16:3e:e4:af:16", "network": {"id": "b646ed0c-9af2-495b-afc3-81a58b5c1203", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1923503231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbee21b8d0b5480da833126fd57cc1ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43c197c7-a0", "ovs_interfaceid": "43c197c7-a030-40dd-809c-a6bfebfa1c12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 17:45:06 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Start _get_guest_xml network_info=[{"id": "43c197c7-a030-40dd-809c-a6bfebfa1c12", "address": "fa:16:3e:e4:af:16", "network": {"id": "b646ed0c-9af2-495b-afc3-81a58b5c1203", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1923503231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbee21b8d0b5480da833126fd57cc1ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43c197c7-a0", "ovs_interfaceid": "43c197c7-a030-40dd-809c-a6bfebfa1c12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'e3cc5321-4d40-49ee-885c-700e14741732'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 17:45:06 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:45:06 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:45:06 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 17:45:06 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 17:45:06 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 17:45:06 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 17:45:06 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 17:45:06 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T17:40:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 17:45:06 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 17:45:06 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 17:45:06 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 17:45:06 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 17:45:06 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 17:45:06 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 17:45:06 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 17:45:06 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 17:45:06 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 17:45:06 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 17:45:06 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:45:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-142317285',display_name='tempest-VolumesAssistedSnapshotsTest-server-142317285',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-142317285',id=8,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrSM5rHIx+tKy/K5+9mjC9yrU6pMJAYMs2e/i7vKfUkYfuamBG9oEK8qK9hExhWd+aX6+KyvAZFFCTgbGMic88HLIgfBjLk7V5Os2s4WmFU19NX0cUI8EkopT7GJSiwFA==',key_name='tempest-keypair-856708127',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dbee21b8d0b5480da833126fd57cc1ce',ramdisk_id='',reservation_id='r-ct2s05vr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-392066261',owner_user_name='tempest-VolumesAssistedSnapshotsTest-392066261-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:45:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b8071e00cc85457cad6d9b407d3096e2',uuid=c790b5c3-b255-430f-8654-f0ff5d54d48c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43c197c7-a030-40dd-809c-a6bfebfa1c12", "address": "fa:16:3e:e4:af:16", "network": {"id": "b646ed0c-9af2-495b-afc3-81a58b5c1203", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1923503231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbee21b8d0b5480da833126fd57cc1ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43c197c7-a0", "ovs_interfaceid": "43c197c7-a030-40dd-809c-a6bfebfa1c12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 17:45:06 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] Converting VIF {"id": "43c197c7-a030-40dd-809c-a6bfebfa1c12", "address": "fa:16:3e:e4:af:16", "network": {"id": "b646ed0c-9af2-495b-afc3-81a58b5c1203", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1923503231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbee21b8d0b5480da833126fd57cc1ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43c197c7-a0", "ovs_interfaceid": "43c197c7-a030-40dd-809c-a6bfebfa1c12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:45:06 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:af:16,bridge_name='br-int',has_traffic_filtering=True,id=43c197c7-a030-40dd-809c-a6bfebfa1c12,network=Network(b646ed0c-9af2-495b-afc3-81a58b5c1203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43c197c7-a0') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:45:06 user nova-compute[75100]: DEBUG nova.objects.instance [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] Lazy-loading 'pci_devices' on Instance uuid c790b5c3-b255-430f-8654-f0ff5d54d48c {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:45:06 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] End _get_guest_xml xml=<domain type="kvm">
Nov 10 17:45:06 user nova-compute[75100]:   <uuid>c790b5c3-b255-430f-8654-f0ff5d54d48c</uuid>
Nov 10 17:45:06 user nova-compute[75100]:   <name>instance-00000008</name>
Nov 10 17:45:06 user nova-compute[75100]:   <memory>524288</memory>
Nov 10 17:45:06 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 10 17:45:06 user nova-compute[75100]:   <metadata>
Nov 10 17:45:06 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 17:45:06 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 10 17:45:06 user nova-compute[75100]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-142317285</nova:name>
Nov 10 17:45:06 user nova-compute[75100]:       <nova:creationTime>2023-11-10 17:45:06</nova:creationTime>
Nov 10 17:45:06 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 10 17:45:06 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 10 17:45:06 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 10 17:45:06 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 10 17:45:06 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 17:45:06 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 10 17:45:06 user nova-compute[75100]:       </nova:flavor>
Nov 10 17:45:06 user nova-compute[75100]:       <nova:owner>
Nov 10 17:45:06 user nova-compute[75100]:         <nova:user uuid="b8071e00cc85457cad6d9b407d3096e2">tempest-VolumesAssistedSnapshotsTest-392066261-project-member</nova:user>
Nov 10 17:45:06 user nova-compute[75100]:         <nova:project uuid="dbee21b8d0b5480da833126fd57cc1ce">tempest-VolumesAssistedSnapshotsTest-392066261</nova:project>
Nov 10 17:45:06 user nova-compute[75100]:       </nova:owner>
Nov 10 17:45:06 user nova-compute[75100]:       <nova:root type="image" uuid="e3cc5321-4d40-49ee-885c-700e14741732"/>
Nov 10 17:45:06 user nova-compute[75100]:       <nova:ports>
Nov 10 17:45:06 user nova-compute[75100]:         <nova:port uuid="43c197c7-a030-40dd-809c-a6bfebfa1c12">
Nov 10 17:45:06 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 10 17:45:06 user nova-compute[75100]:         </nova:port>
Nov 10 17:45:06 user nova-compute[75100]:       </nova:ports>
Nov 10 17:45:06 user nova-compute[75100]:     </nova:instance>
Nov 10 17:45:06 user nova-compute[75100]:   </metadata>
Nov 10 17:45:06 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 10 17:45:06 user nova-compute[75100]:     <system>
Nov 10 17:45:06 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 17:45:06 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 10 17:45:06 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 10 17:45:06 user nova-compute[75100]:       <entry name="serial">c790b5c3-b255-430f-8654-f0ff5d54d48c</entry>
Nov 10 17:45:06 user nova-compute[75100]:       <entry name="uuid">c790b5c3-b255-430f-8654-f0ff5d54d48c</entry>
Nov 10 17:45:06 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 10 17:45:06 user nova-compute[75100]:     </system>
Nov 10 17:45:06 user nova-compute[75100]:   </sysinfo>
Nov 10 17:45:06 user nova-compute[75100]:   <os>
Nov 10 17:45:06 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 17:45:06 user nova-compute[75100]:     <boot dev="hd"/>
Nov 10 17:45:06 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 10 17:45:06 user nova-compute[75100]:   </os>
Nov 10 17:45:06 user nova-compute[75100]:   <features>
Nov 10 17:45:06 user nova-compute[75100]:     <acpi/>
Nov 10 17:45:06 user nova-compute[75100]:     <apic/>
Nov 10 17:45:06 user nova-compute[75100]:     <vmcoreinfo/>
Nov 10 17:45:06 user nova-compute[75100]:   </features>
Nov 10 17:45:06 user nova-compute[75100]:   <clock offset="utc">
Nov 10 17:45:06 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 17:45:06 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 17:45:06 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 10 17:45:06 user nova-compute[75100]:   </clock>
Nov 10 17:45:06 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 10 17:45:06 user nova-compute[75100]:     <model>Nehalem</model>
Nov 10 17:45:06 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 17:45:06 user nova-compute[75100]:   </cpu>
Nov 10 17:45:06 user nova-compute[75100]:   <devices>
Nov 10 17:45:06 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 10 17:45:06 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 17:45:06 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/c790b5c3-b255-430f-8654-f0ff5d54d48c/disk"/>
Nov 10 17:45:06 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 10 17:45:06 user nova-compute[75100]:     </disk>
Nov 10 17:45:06 user nova-compute[75100]:     <interface type="ethernet">
Nov 10 17:45:06 user nova-compute[75100]:       <mac address="fa:16:3e:e4:af:16"/>
Nov 10 17:45:06 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:45:06 user nova-compute[75100]:       <mtu size="1442"/>
Nov 10 17:45:06 user nova-compute[75100]:       <target dev="tap43c197c7-a0"/>
Nov 10 17:45:06 user nova-compute[75100]:     </interface>
Nov 10 17:45:06 user nova-compute[75100]:     <serial type="pty">
Nov 10 17:45:06 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/c790b5c3-b255-430f-8654-f0ff5d54d48c/console.log" append="off"/>
Nov 10 17:45:06 user nova-compute[75100]:     </serial>
Nov 10 17:45:06 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 17:45:06 user nova-compute[75100]:     <video>
Nov 10 17:45:06 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:45:06 user nova-compute[75100]:     </video>
Nov 10 17:45:06 user nova-compute[75100]:     <rng model="virtio">
Nov 10 17:45:06 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 10 17:45:06 user nova-compute[75100]:     </rng>
Nov 10 17:45:06 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 10 17:45:06 user nova-compute[75100]:     <memballoon model="virtio">
Nov 10 17:45:06 user nova-compute[75100]:       <stats period="10"/>
Nov 10 17:45:06 user nova-compute[75100]:     </memballoon>
Nov 10 17:45:06 user nova-compute[75100]:   </devices>
Nov 10 17:45:06 user nova-compute[75100]: </domain>
Nov 10 17:45:06 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 17:45:06 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:45:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-142317285',display_name='tempest-VolumesAssistedSnapshotsTest-server-142317285',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-142317285',id=8,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrSM5rHIx+tKy/K5+9mjC9yrU6pMJAYMs2e/i7vKfUkYfuamBG9oEK8qK9hExhWd+aX6+KyvAZFFCTgbGMic88HLIgfBjLk7V5Os2s4WmFU19NX0cUI8EkopT7GJSiwFA==',key_name='tempest-keypair-856708127',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dbee21b8d0b5480da833126fd57cc1ce',ramdisk_id='',reservation_id='r-ct2s05vr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-392066261',owner_user_name='tempest-VolumesAssistedSnapshotsTest-392066261-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:45:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b8071e00cc85457cad6d9b407d3096e2',uuid=c790b5c3-b255-430f-8654-f0ff5d54d48c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43c197c7-a030-40dd-809c-a6bfebfa1c12", "address": "fa:16:3e:e4:af:16", "network": {"id": "b646ed0c-9af2-495b-afc3-81a58b5c1203", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1923503231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbee21b8d0b5480da833126fd57cc1ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43c197c7-a0", "ovs_interfaceid": "43c197c7-a030-40dd-809c-a6bfebfa1c12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 17:45:06 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] Converting VIF {"id": "43c197c7-a030-40dd-809c-a6bfebfa1c12", "address": "fa:16:3e:e4:af:16", "network": {"id": "b646ed0c-9af2-495b-afc3-81a58b5c1203", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1923503231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbee21b8d0b5480da833126fd57cc1ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43c197c7-a0", "ovs_interfaceid": "43c197c7-a030-40dd-809c-a6bfebfa1c12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:45:06 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:af:16,bridge_name='br-int',has_traffic_filtering=True,id=43c197c7-a030-40dd-809c-a6bfebfa1c12,network=Network(b646ed0c-9af2-495b-afc3-81a58b5c1203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43c197c7-a0') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:45:06 user nova-compute[75100]: DEBUG os_vif [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:af:16,bridge_name='br-int',has_traffic_filtering=True,id=43c197c7-a030-40dd-809c-a6bfebfa1c12,network=Network(b646ed0c-9af2-495b-afc3-81a58b5c1203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43c197c7-a0') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 17:45:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:45:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:45:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 17:45:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:45:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9d6cd90b-597a-5c53-b11e-6401533baf69', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:45:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:45:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:45:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:45:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap43c197c7-a0, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:45:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap43c197c7-a0, col_values=(('qos', UUID('52415f9b-4ccd-452b-b33d-b35eb06034ce')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:45:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap43c197c7-a0, col_values=(('external_ids', {'iface-id': '43c197c7-a030-40dd-809c-a6bfebfa1c12', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:af:16', 'vm-uuid': 'c790b5c3-b255-430f-8654-f0ff5d54d48c'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:45:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:45:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:45:06 user nova-compute[75100]: INFO os_vif [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:af:16,bridge_name='br-int',has_traffic_filtering=True,id=43c197c7-a030-40dd-809c-a6bfebfa1c12,network=Network(b646ed0c-9af2-495b-afc3-81a58b5c1203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43c197c7-a0')
Nov 10 17:45:06 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 17:45:06 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] No VIF found with MAC fa:16:3e:e4:af:16, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 17:45:07 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:45:07 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Cleaning up deleted instances {{(pid=75100) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 17:45:07 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] There are 0 instances to clean {{(pid=75100) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 17:45:07 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:45:07 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75100) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 17:45:07 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:45:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:45:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:45:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:45:07 user nova-compute[75100]: DEBUG nova.compute.manager [req-63ee0d14-63d3-444a-86de-a2d2899687cc req-51130c88-56f6-4317-8e36-a7423dcca5ad service nova] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Received event network-vif-plugged-d3f47ac6-ad90-4589-b41e-798c6fe6d5cf {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:45:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-63ee0d14-63d3-444a-86de-a2d2899687cc req-51130c88-56f6-4317-8e36-a7423dcca5ad service nova] Acquiring lock "3e14de19-540d-4dc2-a058-6874d8d14478-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:45:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-63ee0d14-63d3-444a-86de-a2d2899687cc req-51130c88-56f6-4317-8e36-a7423dcca5ad service nova] Lock "3e14de19-540d-4dc2-a058-6874d8d14478-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:45:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-63ee0d14-63d3-444a-86de-a2d2899687cc req-51130c88-56f6-4317-8e36-a7423dcca5ad service nova] Lock "3e14de19-540d-4dc2-a058-6874d8d14478-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:45:07 user nova-compute[75100]: DEBUG nova.compute.manager [req-63ee0d14-63d3-444a-86de-a2d2899687cc req-51130c88-56f6-4317-8e36-a7423dcca5ad service nova] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] No waiting events found dispatching network-vif-plugged-d3f47ac6-ad90-4589-b41e-798c6fe6d5cf {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:45:07 user nova-compute[75100]: WARNING nova.compute.manager [req-63ee0d14-63d3-444a-86de-a2d2899687cc req-51130c88-56f6-4317-8e36-a7423dcca5ad service nova] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Received unexpected event network-vif-plugged-d3f47ac6-ad90-4589-b41e-798c6fe6d5cf for instance with vm_state active and task_state None.
Nov 10 17:45:07 user nova-compute[75100]: DEBUG nova.compute.manager [req-63ee0d14-63d3-444a-86de-a2d2899687cc req-51130c88-56f6-4317-8e36-a7423dcca5ad service nova] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] Received event network-vif-plugged-c676ea25-33da-405a-84ac-9f0ad0308c08 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:45:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-63ee0d14-63d3-444a-86de-a2d2899687cc req-51130c88-56f6-4317-8e36-a7423dcca5ad service nova] Acquiring lock "45efac9f-8de9-43aa-b361-b5e4cf78795f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:45:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-63ee0d14-63d3-444a-86de-a2d2899687cc req-51130c88-56f6-4317-8e36-a7423dcca5ad service nova] Lock "45efac9f-8de9-43aa-b361-b5e4cf78795f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:45:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-63ee0d14-63d3-444a-86de-a2d2899687cc req-51130c88-56f6-4317-8e36-a7423dcca5ad service nova] Lock "45efac9f-8de9-43aa-b361-b5e4cf78795f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:45:07 user nova-compute[75100]: DEBUG nova.compute.manager [req-63ee0d14-63d3-444a-86de-a2d2899687cc req-51130c88-56f6-4317-8e36-a7423dcca5ad service nova] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] No waiting events found dispatching network-vif-plugged-c676ea25-33da-405a-84ac-9f0ad0308c08 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:45:07 user nova-compute[75100]: WARNING nova.compute.manager [req-63ee0d14-63d3-444a-86de-a2d2899687cc req-51130c88-56f6-4317-8e36-a7423dcca5ad service nova] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] Received unexpected event network-vif-plugged-c676ea25-33da-405a-84ac-9f0ad0308c08 for instance with vm_state active and task_state None.
Nov 10 17:45:07 user nova-compute[75100]: DEBUG nova.compute.manager [req-63ee0d14-63d3-444a-86de-a2d2899687cc req-51130c88-56f6-4317-8e36-a7423dcca5ad service nova] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] Received event network-vif-plugged-c676ea25-33da-405a-84ac-9f0ad0308c08 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:45:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-63ee0d14-63d3-444a-86de-a2d2899687cc req-51130c88-56f6-4317-8e36-a7423dcca5ad service nova] Acquiring lock "45efac9f-8de9-43aa-b361-b5e4cf78795f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:45:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-63ee0d14-63d3-444a-86de-a2d2899687cc req-51130c88-56f6-4317-8e36-a7423dcca5ad service nova] Lock "45efac9f-8de9-43aa-b361-b5e4cf78795f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:45:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-63ee0d14-63d3-444a-86de-a2d2899687cc req-51130c88-56f6-4317-8e36-a7423dcca5ad service nova] Lock "45efac9f-8de9-43aa-b361-b5e4cf78795f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:45:07 user nova-compute[75100]: DEBUG nova.compute.manager [req-63ee0d14-63d3-444a-86de-a2d2899687cc req-51130c88-56f6-4317-8e36-a7423dcca5ad service nova] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] No waiting events found dispatching network-vif-plugged-c676ea25-33da-405a-84ac-9f0ad0308c08 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:45:07 user nova-compute[75100]: WARNING nova.compute.manager [req-63ee0d14-63d3-444a-86de-a2d2899687cc req-51130c88-56f6-4317-8e36-a7423dcca5ad service nova] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] Received unexpected event network-vif-plugged-c676ea25-33da-405a-84ac-9f0ad0308c08 for instance with vm_state active and task_state None.
Nov 10 17:45:07 user nova-compute[75100]: DEBUG nova.compute.manager [req-63ee0d14-63d3-444a-86de-a2d2899687cc req-51130c88-56f6-4317-8e36-a7423dcca5ad service nova] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Received event network-vif-plugged-bdf312ed-cce0-4d35-9257-f6a5a80cc0d2 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:45:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-63ee0d14-63d3-444a-86de-a2d2899687cc req-51130c88-56f6-4317-8e36-a7423dcca5ad service nova] Acquiring lock "ead532eb-c8be-45fa-a8b7-0b4c4f884a90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:45:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-63ee0d14-63d3-444a-86de-a2d2899687cc req-51130c88-56f6-4317-8e36-a7423dcca5ad service nova] Lock "ead532eb-c8be-45fa-a8b7-0b4c4f884a90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:45:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-63ee0d14-63d3-444a-86de-a2d2899687cc req-51130c88-56f6-4317-8e36-a7423dcca5ad service nova] Lock "ead532eb-c8be-45fa-a8b7-0b4c4f884a90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:45:07 user nova-compute[75100]: DEBUG nova.compute.manager [req-63ee0d14-63d3-444a-86de-a2d2899687cc req-51130c88-56f6-4317-8e36-a7423dcca5ad service nova] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] No waiting events found dispatching network-vif-plugged-bdf312ed-cce0-4d35-9257-f6a5a80cc0d2 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:45:07 user nova-compute[75100]: WARNING nova.compute.manager [req-63ee0d14-63d3-444a-86de-a2d2899687cc req-51130c88-56f6-4317-8e36-a7423dcca5ad service nova] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Received unexpected event network-vif-plugged-bdf312ed-cce0-4d35-9257-f6a5a80cc0d2 for instance with vm_state active and task_state None.
Nov 10 17:45:07 user nova-compute[75100]: DEBUG nova.compute.manager [req-63ee0d14-63d3-444a-86de-a2d2899687cc req-51130c88-56f6-4317-8e36-a7423dcca5ad service nova] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Received event network-vif-plugged-bdf312ed-cce0-4d35-9257-f6a5a80cc0d2 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:45:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-63ee0d14-63d3-444a-86de-a2d2899687cc req-51130c88-56f6-4317-8e36-a7423dcca5ad service nova] Acquiring lock "ead532eb-c8be-45fa-a8b7-0b4c4f884a90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:45:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-63ee0d14-63d3-444a-86de-a2d2899687cc req-51130c88-56f6-4317-8e36-a7423dcca5ad service nova] Lock "ead532eb-c8be-45fa-a8b7-0b4c4f884a90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:45:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-63ee0d14-63d3-444a-86de-a2d2899687cc req-51130c88-56f6-4317-8e36-a7423dcca5ad service nova] Lock "ead532eb-c8be-45fa-a8b7-0b4c4f884a90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:45:07 user nova-compute[75100]: DEBUG nova.compute.manager [req-63ee0d14-63d3-444a-86de-a2d2899687cc req-51130c88-56f6-4317-8e36-a7423dcca5ad service nova] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] No waiting events found dispatching network-vif-plugged-bdf312ed-cce0-4d35-9257-f6a5a80cc0d2 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:45:07 user nova-compute[75100]: WARNING nova.compute.manager [req-63ee0d14-63d3-444a-86de-a2d2899687cc req-51130c88-56f6-4317-8e36-a7423dcca5ad service nova] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Received unexpected event network-vif-plugged-bdf312ed-cce0-4d35-9257-f6a5a80cc0d2 for instance with vm_state active and task_state None.
Nov 10 17:45:07 user nova-compute[75100]: DEBUG nova.compute.manager [req-63ee0d14-63d3-444a-86de-a2d2899687cc req-51130c88-56f6-4317-8e36-a7423dcca5ad service nova] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Received event network-vif-plugged-2b2adca0-0004-4df3-b8c8-03febbdc56ed {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:45:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-63ee0d14-63d3-444a-86de-a2d2899687cc req-51130c88-56f6-4317-8e36-a7423dcca5ad service nova] Acquiring lock "5b5ec5d3-fa6f-43de-b786-8c423064fe7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:45:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-63ee0d14-63d3-444a-86de-a2d2899687cc req-51130c88-56f6-4317-8e36-a7423dcca5ad service nova] Lock "5b5ec5d3-fa6f-43de-b786-8c423064fe7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:45:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-63ee0d14-63d3-444a-86de-a2d2899687cc req-51130c88-56f6-4317-8e36-a7423dcca5ad service nova] Lock "5b5ec5d3-fa6f-43de-b786-8c423064fe7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:45:07 user nova-compute[75100]: DEBUG nova.compute.manager [req-63ee0d14-63d3-444a-86de-a2d2899687cc req-51130c88-56f6-4317-8e36-a7423dcca5ad service nova] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] No waiting events found dispatching network-vif-plugged-2b2adca0-0004-4df3-b8c8-03febbdc56ed {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:45:07 user nova-compute[75100]: WARNING nova.compute.manager [req-63ee0d14-63d3-444a-86de-a2d2899687cc req-51130c88-56f6-4317-8e36-a7423dcca5ad service nova] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Received unexpected event network-vif-plugged-2b2adca0-0004-4df3-b8c8-03febbdc56ed for instance with vm_state active and task_state None.
Nov 10 17:45:07 user nova-compute[75100]: DEBUG nova.compute.manager [req-63ee0d14-63d3-444a-86de-a2d2899687cc req-51130c88-56f6-4317-8e36-a7423dcca5ad service nova] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Received event network-vif-plugged-2b2adca0-0004-4df3-b8c8-03febbdc56ed {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:45:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-63ee0d14-63d3-444a-86de-a2d2899687cc req-51130c88-56f6-4317-8e36-a7423dcca5ad service nova] Acquiring lock "5b5ec5d3-fa6f-43de-b786-8c423064fe7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:45:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-63ee0d14-63d3-444a-86de-a2d2899687cc req-51130c88-56f6-4317-8e36-a7423dcca5ad service nova] Lock "5b5ec5d3-fa6f-43de-b786-8c423064fe7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:45:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-63ee0d14-63d3-444a-86de-a2d2899687cc req-51130c88-56f6-4317-8e36-a7423dcca5ad service nova] Lock "5b5ec5d3-fa6f-43de-b786-8c423064fe7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:45:07 user nova-compute[75100]: DEBUG nova.compute.manager [req-63ee0d14-63d3-444a-86de-a2d2899687cc req-51130c88-56f6-4317-8e36-a7423dcca5ad service nova] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] No waiting events found dispatching network-vif-plugged-2b2adca0-0004-4df3-b8c8-03febbdc56ed {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:45:07 user nova-compute[75100]: WARNING nova.compute.manager [req-63ee0d14-63d3-444a-86de-a2d2899687cc req-51130c88-56f6-4317-8e36-a7423dcca5ad service nova] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Received unexpected event network-vif-plugged-2b2adca0-0004-4df3-b8c8-03febbdc56ed for instance with vm_state active and task_state None.
Nov 10 17:45:08 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:45:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:45:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:45:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:45:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:45:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:45:10 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:45:10 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:45:10 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 17:45:10 user nova-compute[75100]: DEBUG nova.compute.manager [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 17:45:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 17:45:10 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Instance spawned successfully.
Nov 10 17:45:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 17:45:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:45:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:45:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:45:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:45:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:45:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:45:10 user nova-compute[75100]: INFO nova.compute.manager [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Took 7.33 seconds to spawn the instance on the hypervisor.
Nov 10 17:45:10 user nova-compute[75100]: DEBUG nova.compute.manager [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 17:45:10 user nova-compute[75100]: INFO nova.compute.manager [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Took 8.22 seconds to build instance.
Nov 10 17:45:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4926ec00-a600-466b-96a0-81143b51a325 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] Lock "c790b5c3-b255-430f-8654-f0ff5d54d48c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.320s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:45:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:45:11 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:45:11 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:45:11 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:45:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:45:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.015s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:45:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:45:11 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 17:45:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:45:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:45:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:45:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:45:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:45:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:45:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:45:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:45:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5ec5d3-fa6f-43de-b786-8c423064fe7a/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:45:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5ec5d3-fa6f-43de-b786-8c423064fe7a/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:45:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5ec5d3-fa6f-43de-b786-8c423064fe7a/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:45:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5ec5d3-fa6f-43de-b786-8c423064fe7a/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:45:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45efac9f-8de9-43aa-b361-b5e4cf78795f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:45:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45efac9f-8de9-43aa-b361-b5e4cf78795f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:45:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45efac9f-8de9-43aa-b361-b5e4cf78795f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:45:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45efac9f-8de9-43aa-b361-b5e4cf78795f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:45:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c790b5c3-b255-430f-8654-f0ff5d54d48c/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:45:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c790b5c3-b255-430f-8654-f0ff5d54d48c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:45:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c790b5c3-b255-430f-8654-f0ff5d54d48c/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:45:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:45:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c790b5c3-b255-430f-8654-f0ff5d54d48c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:45:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:45:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:45:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:45:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:45:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91238923-a64c-4f41-a046-be243eff880d/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:45:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91238923-a64c-4f41-a046-be243eff880d/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:45:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91238923-a64c-4f41-a046-be243eff880d/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:45:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91238923-a64c-4f41-a046-be243eff880d/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:45:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ead532eb-c8be-45fa-a8b7-0b4c4f884a90/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:45:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ead532eb-c8be-45fa-a8b7-0b4c4f884a90/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:45:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ead532eb-c8be-45fa-a8b7-0b4c4f884a90/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:45:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ead532eb-c8be-45fa-a8b7-0b4c4f884a90/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:45:15 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:45:15 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:45:15 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Hypervisor/Node resource view: name=user free_ram=7546MB free_disk=24.90792465209961GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 17:45:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:45:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:45:16 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance c19fc271-a248-4631-a11f-89b7ed73bf85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:45:16 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:45:16 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 3e14de19-540d-4dc2-a058-6874d8d14478 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:45:16 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 45efac9f-8de9-43aa-b361-b5e4cf78795f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:45:16 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance ead532eb-c8be-45fa-a8b7-0b4c4f884a90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:45:16 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 5b5ec5d3-fa6f-43de-b786-8c423064fe7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:45:16 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 91238923-a64c-4f41-a046-be243eff880d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:45:16 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance c790b5c3-b255-430f-8654-f0ff5d54d48c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:45:16 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 17:45:16 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 17:45:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:45:16 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:45:16 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:45:16 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 17:45:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.708s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:45:17 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:45:17 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 17:45:17 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Rebuilding the list of instances to heal {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 17:45:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "refresh_cache-c19fc271-a248-4631-a11f-89b7ed73bf85" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:45:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquired lock "refresh_cache-c19fc271-a248-4631-a11f-89b7ed73bf85" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:45:17 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 17:45:17 user nova-compute[75100]: DEBUG nova.objects.instance [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lazy-loading 'info_cache' on Instance uuid c19fc271-a248-4631-a11f-89b7ed73bf85 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:45:17 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Updating instance_info_cache with network_info: [{"id": "eedb3d8e-5619-4df9-aef9-bbc44db1dba9", "address": "fa:16:3e:ee:f9:3d", "network": {"id": "f240fae3-3d7b-4b6e-b04f-18550ab4d0a3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1007355777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c970a503d74d32a1e2b71f086649fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeedb3d8e-56", "ovs_interfaceid": "eedb3d8e-5619-4df9-aef9-bbc44db1dba9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:45:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Releasing lock "refresh_cache-c19fc271-a248-4631-a11f-89b7ed73bf85" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:45:17 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 17:45:17 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:45:17 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:45:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:45:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:45:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:45:24 user nova-compute[75100]: DEBUG nova.compute.manager [req-bff605c3-10ff-49e8-8190-b392dee0154c req-f0890187-d953-4ac3-818c-04f8d7e12dfd service nova] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Received event network-vif-plugged-43c197c7-a030-40dd-809c-a6bfebfa1c12 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:45:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-bff605c3-10ff-49e8-8190-b392dee0154c req-f0890187-d953-4ac3-818c-04f8d7e12dfd service nova] Acquiring lock "c790b5c3-b255-430f-8654-f0ff5d54d48c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:45:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-bff605c3-10ff-49e8-8190-b392dee0154c req-f0890187-d953-4ac3-818c-04f8d7e12dfd service nova] Lock "c790b5c3-b255-430f-8654-f0ff5d54d48c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:45:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-bff605c3-10ff-49e8-8190-b392dee0154c req-f0890187-d953-4ac3-818c-04f8d7e12dfd service nova] Lock "c790b5c3-b255-430f-8654-f0ff5d54d48c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:45:24 user nova-compute[75100]: DEBUG nova.compute.manager [req-bff605c3-10ff-49e8-8190-b392dee0154c req-f0890187-d953-4ac3-818c-04f8d7e12dfd service nova] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] No waiting events found dispatching network-vif-plugged-43c197c7-a030-40dd-809c-a6bfebfa1c12 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:45:24 user nova-compute[75100]: WARNING nova.compute.manager [req-bff605c3-10ff-49e8-8190-b392dee0154c req-f0890187-d953-4ac3-818c-04f8d7e12dfd service nova] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Received unexpected event network-vif-plugged-43c197c7-a030-40dd-809c-a6bfebfa1c12 for instance with vm_state active and task_state None.
Nov 10 17:45:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:45:26 user nova-compute[75100]: DEBUG nova.compute.manager [req-93716e90-c1ff-4f03-9c5d-40960eb4aa9b req-7084aa96-0261-4f29-bee3-b588f85224c2 service nova] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Received event network-vif-plugged-43c197c7-a030-40dd-809c-a6bfebfa1c12 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:45:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-93716e90-c1ff-4f03-9c5d-40960eb4aa9b req-7084aa96-0261-4f29-bee3-b588f85224c2 service nova] Acquiring lock "c790b5c3-b255-430f-8654-f0ff5d54d48c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:45:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-93716e90-c1ff-4f03-9c5d-40960eb4aa9b req-7084aa96-0261-4f29-bee3-b588f85224c2 service nova] Lock "c790b5c3-b255-430f-8654-f0ff5d54d48c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:45:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-93716e90-c1ff-4f03-9c5d-40960eb4aa9b req-7084aa96-0261-4f29-bee3-b588f85224c2 service nova] Lock "c790b5c3-b255-430f-8654-f0ff5d54d48c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:45:26 user nova-compute[75100]: DEBUG nova.compute.manager [req-93716e90-c1ff-4f03-9c5d-40960eb4aa9b req-7084aa96-0261-4f29-bee3-b588f85224c2 service nova] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] No waiting events found dispatching network-vif-plugged-43c197c7-a030-40dd-809c-a6bfebfa1c12 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:45:26 user nova-compute[75100]: WARNING nova.compute.manager [req-93716e90-c1ff-4f03-9c5d-40960eb4aa9b req-7084aa96-0261-4f29-bee3-b588f85224c2 service nova] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Received unexpected event network-vif-plugged-43c197c7-a030-40dd-809c-a6bfebfa1c12 for instance with vm_state active and task_state None.
Nov 10 17:45:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:45:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:45:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Acquiring lock "db3f69df-51b2-464c-921e-33171e29f46d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:45:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Lock "db3f69df-51b2-464c-921e-33171e29f46d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:45:32 user nova-compute[75100]: DEBUG nova.compute.manager [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] [instance: db3f69df-51b2-464c-921e-33171e29f46d] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 17:45:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:45:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:45:32 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 17:45:32 user nova-compute[75100]: INFO nova.compute.claims [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] [instance: db3f69df-51b2-464c-921e-33171e29f46d] Claim successful on node user
Nov 10 17:45:33 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Refreshing inventories for resource provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 17:45:33 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Updating ProviderTree inventory for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 17:45:33 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Updating inventory in ProviderTree for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 17:45:33 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Refreshing aggregate associations for resource provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64, aggregates: None {{(pid=75100) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 17:45:33 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Refreshing trait associations for resource provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2 {{(pid=75100) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 17:45:33 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:45:33 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:45:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.628s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:45:33 user nova-compute[75100]: DEBUG nova.compute.manager [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] [instance: db3f69df-51b2-464c-921e-33171e29f46d] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 17:45:33 user nova-compute[75100]: DEBUG nova.compute.manager [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] [instance: db3f69df-51b2-464c-921e-33171e29f46d] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 17:45:33 user nova-compute[75100]: DEBUG nova.network.neutron [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] [instance: db3f69df-51b2-464c-921e-33171e29f46d] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 17:45:33 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] [instance: db3f69df-51b2-464c-921e-33171e29f46d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 17:45:33 user nova-compute[75100]: DEBUG nova.compute.manager [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] [instance: db3f69df-51b2-464c-921e-33171e29f46d] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 17:45:33 user nova-compute[75100]: DEBUG nova.policy [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aebb4562848f44268afd12b033060561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29209a67b9d48bd8067be38d95ea656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 17:45:33 user nova-compute[75100]: DEBUG nova.compute.manager [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] [instance: db3f69df-51b2-464c-921e-33171e29f46d] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 17:45:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] [instance: db3f69df-51b2-464c-921e-33171e29f46d] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 17:45:33 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] [instance: db3f69df-51b2-464c-921e-33171e29f46d] Creating image(s)
Nov 10 17:45:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Acquiring lock "/opt/stack/data/nova/instances/db3f69df-51b2-464c-921e-33171e29f46d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:45:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Lock "/opt/stack/data/nova/instances/db3f69df-51b2-464c-921e-33171e29f46d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:45:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Lock "/opt/stack/data/nova/instances/db3f69df-51b2-464c-921e-33171e29f46d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:45:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:45:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:45:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.194s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:45:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Acquiring lock "818b9e28e061d41a38d903968b229be2ed9ba520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:45:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:45:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:45:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.200s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:45:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/db3f69df-51b2-464c-921e-33171e29f46d/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:45:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/db3f69df-51b2-464c-921e-33171e29f46d/disk 1073741824" returned: 0 in 0.153s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:45:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.360s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:45:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:45:34 user nova-compute[75100]: DEBUG nova.network.neutron [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] [instance: db3f69df-51b2-464c-921e-33171e29f46d] Successfully created port: 6dee04b2-6df4-439f-93de-f474b077cd60 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 17:45:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.189s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:45:34 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Checking if we can resize image /opt/stack/data/nova/instances/db3f69df-51b2-464c-921e-33171e29f46d/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 17:45:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db3f69df-51b2-464c-921e-33171e29f46d/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:45:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db3f69df-51b2-464c-921e-33171e29f46d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:45:34 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Cannot resize image /opt/stack/data/nova/instances/db3f69df-51b2-464c-921e-33171e29f46d/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 17:45:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] [instance: db3f69df-51b2-464c-921e-33171e29f46d] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 17:45:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] [instance: db3f69df-51b2-464c-921e-33171e29f46d] Ensure instance console log exists: /opt/stack/data/nova/instances/db3f69df-51b2-464c-921e-33171e29f46d/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 17:45:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:45:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:45:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:45:34 user nova-compute[75100]: DEBUG nova.network.neutron [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] [instance: db3f69df-51b2-464c-921e-33171e29f46d] Successfully updated port: 6dee04b2-6df4-439f-93de-f474b077cd60 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 17:45:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Acquiring lock "refresh_cache-db3f69df-51b2-464c-921e-33171e29f46d" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:45:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Acquired lock "refresh_cache-db3f69df-51b2-464c-921e-33171e29f46d" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:45:35 user nova-compute[75100]: DEBUG nova.network.neutron [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] [instance: db3f69df-51b2-464c-921e-33171e29f46d] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 17:45:35 user nova-compute[75100]: DEBUG nova.compute.manager [req-fadd64c4-91f7-4a0d-bd3a-eb0a54c3778c req-817258a2-7118-4f6c-ab6b-4af93f54cb22 service nova] [instance: db3f69df-51b2-464c-921e-33171e29f46d] Received event network-changed-6dee04b2-6df4-439f-93de-f474b077cd60 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:45:35 user nova-compute[75100]: DEBUG nova.compute.manager [req-fadd64c4-91f7-4a0d-bd3a-eb0a54c3778c req-817258a2-7118-4f6c-ab6b-4af93f54cb22 service nova] [instance: db3f69df-51b2-464c-921e-33171e29f46d] Refreshing instance network info cache due to event network-changed-6dee04b2-6df4-439f-93de-f474b077cd60. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 17:45:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-fadd64c4-91f7-4a0d-bd3a-eb0a54c3778c req-817258a2-7118-4f6c-ab6b-4af93f54cb22 service nova] Acquiring lock "refresh_cache-db3f69df-51b2-464c-921e-33171e29f46d" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:45:35 user nova-compute[75100]: DEBUG nova.network.neutron [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] [instance: db3f69df-51b2-464c-921e-33171e29f46d] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 17:45:35 user nova-compute[75100]: DEBUG nova.network.neutron [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] [instance: db3f69df-51b2-464c-921e-33171e29f46d] Updating instance_info_cache with network_info: [{"id": "6dee04b2-6df4-439f-93de-f474b077cd60", "address": "fa:16:3e:0c:f1:29", "network": {"id": "d5116328-c56e-407f-8316-5ebbd31e8e64", "bridge": "br-int", "label": "tempest-TestVolumeSwap-528250751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e29209a67b9d48bd8067be38d95ea656", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dee04b2-6d", "ovs_interfaceid": "6dee04b2-6df4-439f-93de-f474b077cd60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:45:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Releasing lock "refresh_cache-db3f69df-51b2-464c-921e-33171e29f46d" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:45:35 user nova-compute[75100]: DEBUG nova.compute.manager [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] [instance: db3f69df-51b2-464c-921e-33171e29f46d] Instance network_info: |[{"id": "6dee04b2-6df4-439f-93de-f474b077cd60", "address": "fa:16:3e:0c:f1:29", "network": {"id": "d5116328-c56e-407f-8316-5ebbd31e8e64", "bridge": "br-int", "label": "tempest-TestVolumeSwap-528250751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e29209a67b9d48bd8067be38d95ea656", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dee04b2-6d", "ovs_interfaceid": "6dee04b2-6df4-439f-93de-f474b077cd60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 17:45:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-fadd64c4-91f7-4a0d-bd3a-eb0a54c3778c req-817258a2-7118-4f6c-ab6b-4af93f54cb22 service nova] Acquired lock "refresh_cache-db3f69df-51b2-464c-921e-33171e29f46d" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:45:35 user nova-compute[75100]: DEBUG nova.network.neutron [req-fadd64c4-91f7-4a0d-bd3a-eb0a54c3778c req-817258a2-7118-4f6c-ab6b-4af93f54cb22 service nova] [instance: db3f69df-51b2-464c-921e-33171e29f46d] Refreshing network info cache for port 6dee04b2-6df4-439f-93de-f474b077cd60 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 17:45:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] [instance: db3f69df-51b2-464c-921e-33171e29f46d] Start _get_guest_xml network_info=[{"id": "6dee04b2-6df4-439f-93de-f474b077cd60", "address": "fa:16:3e:0c:f1:29", "network": {"id": "d5116328-c56e-407f-8316-5ebbd31e8e64", "bridge": "br-int", "label": "tempest-TestVolumeSwap-528250751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e29209a67b9d48bd8067be38d95ea656", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dee04b2-6d", "ovs_interfaceid": "6dee04b2-6df4-439f-93de-f474b077cd60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'e3cc5321-4d40-49ee-885c-700e14741732'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 17:45:35 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:45:35 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:45:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 17:45:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 17:45:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 17:45:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 17:45:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 17:45:35 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T17:40:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 17:45:35 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 17:45:35 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 17:45:35 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 17:45:35 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 17:45:35 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 17:45:35 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 17:45:35 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 17:45:35 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 17:45:35 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 17:45:35 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 17:45:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:45:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-474483029',display_name='tempest-TestVolumeSwap-server-474483029',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-474483029',id=9,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1lLDNBgtx3q+PkD3TYvWLxFqpJI1OpVsikhMhqcZbJFFGq1rafwqwihbfVoPyMgTqb8CusBU1nzG7CgDThJvrxeNRTprDwC3j3w7x8/LkG0MFYW67Ue2HZAsAhf0ZkrA==',key_name='tempest-keypair-1000540697',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e29209a67b9d48bd8067be38d95ea656',ramdisk_id='',reservation_id='r-1aluadj6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-487928490',owner_user_name='tempest-TestVolumeSwap-487928490-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:45:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aebb4562848f44268afd12b033060561',uuid=db3f69df-51b2-464c-921e-33171e29f46d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6dee04b2-6df4-439f-93de-f474b077cd60", "address": "fa:16:3e:0c:f1:29", "network": {"id": "d5116328-c56e-407f-8316-5ebbd31e8e64", "bridge": "br-int", "label": "tempest-TestVolumeSwap-528250751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e29209a67b9d48bd8067be38d95ea656", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dee04b2-6d", "ovs_interfaceid": "6dee04b2-6df4-439f-93de-f474b077cd60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 17:45:35 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Converting VIF {"id": "6dee04b2-6df4-439f-93de-f474b077cd60", "address": "fa:16:3e:0c:f1:29", "network": {"id": "d5116328-c56e-407f-8316-5ebbd31e8e64", "bridge": "br-int", "label": "tempest-TestVolumeSwap-528250751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e29209a67b9d48bd8067be38d95ea656", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dee04b2-6d", "ovs_interfaceid": "6dee04b2-6df4-439f-93de-f474b077cd60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:45:35 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:f1:29,bridge_name='br-int',has_traffic_filtering=True,id=6dee04b2-6df4-439f-93de-f474b077cd60,network=Network(d5116328-c56e-407f-8316-5ebbd31e8e64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6dee04b2-6d') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:45:35 user nova-compute[75100]: DEBUG nova.objects.instance [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Lazy-loading 'pci_devices' on Instance uuid db3f69df-51b2-464c-921e-33171e29f46d {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:45:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] [instance: db3f69df-51b2-464c-921e-33171e29f46d] End _get_guest_xml xml=<domain type="kvm">
Nov 10 17:45:35 user nova-compute[75100]:   <uuid>db3f69df-51b2-464c-921e-33171e29f46d</uuid>
Nov 10 17:45:35 user nova-compute[75100]:   <name>instance-00000009</name>
Nov 10 17:45:35 user nova-compute[75100]:   <memory>524288</memory>
Nov 10 17:45:35 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 10 17:45:35 user nova-compute[75100]:   <metadata>
Nov 10 17:45:35 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 17:45:35 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 10 17:45:35 user nova-compute[75100]:       <nova:name>tempest-TestVolumeSwap-server-474483029</nova:name>
Nov 10 17:45:35 user nova-compute[75100]:       <nova:creationTime>2023-11-10 17:45:35</nova:creationTime>
Nov 10 17:45:35 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 10 17:45:35 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 10 17:45:35 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 10 17:45:35 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 10 17:45:35 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 17:45:35 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 10 17:45:35 user nova-compute[75100]:       </nova:flavor>
Nov 10 17:45:35 user nova-compute[75100]:       <nova:owner>
Nov 10 17:45:35 user nova-compute[75100]:         <nova:user uuid="aebb4562848f44268afd12b033060561">tempest-TestVolumeSwap-487928490-project-member</nova:user>
Nov 10 17:45:35 user nova-compute[75100]:         <nova:project uuid="e29209a67b9d48bd8067be38d95ea656">tempest-TestVolumeSwap-487928490</nova:project>
Nov 10 17:45:35 user nova-compute[75100]:       </nova:owner>
Nov 10 17:45:35 user nova-compute[75100]:       <nova:root type="image" uuid="e3cc5321-4d40-49ee-885c-700e14741732"/>
Nov 10 17:45:35 user nova-compute[75100]:       <nova:ports>
Nov 10 17:45:35 user nova-compute[75100]:         <nova:port uuid="6dee04b2-6df4-439f-93de-f474b077cd60">
Nov 10 17:45:35 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 10 17:45:35 user nova-compute[75100]:         </nova:port>
Nov 10 17:45:35 user nova-compute[75100]:       </nova:ports>
Nov 10 17:45:35 user nova-compute[75100]:     </nova:instance>
Nov 10 17:45:35 user nova-compute[75100]:   </metadata>
Nov 10 17:45:35 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 10 17:45:35 user nova-compute[75100]:     <system>
Nov 10 17:45:35 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 17:45:35 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 10 17:45:35 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 10 17:45:35 user nova-compute[75100]:       <entry name="serial">db3f69df-51b2-464c-921e-33171e29f46d</entry>
Nov 10 17:45:35 user nova-compute[75100]:       <entry name="uuid">db3f69df-51b2-464c-921e-33171e29f46d</entry>
Nov 10 17:45:35 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 10 17:45:35 user nova-compute[75100]:     </system>
Nov 10 17:45:35 user nova-compute[75100]:   </sysinfo>
Nov 10 17:45:35 user nova-compute[75100]:   <os>
Nov 10 17:45:35 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 17:45:35 user nova-compute[75100]:     <boot dev="hd"/>
Nov 10 17:45:35 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 10 17:45:35 user nova-compute[75100]:   </os>
Nov 10 17:45:35 user nova-compute[75100]:   <features>
Nov 10 17:45:35 user nova-compute[75100]:     <acpi/>
Nov 10 17:45:35 user nova-compute[75100]:     <apic/>
Nov 10 17:45:35 user nova-compute[75100]:     <vmcoreinfo/>
Nov 10 17:45:35 user nova-compute[75100]:   </features>
Nov 10 17:45:35 user nova-compute[75100]:   <clock offset="utc">
Nov 10 17:45:35 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 17:45:35 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 17:45:35 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 10 17:45:35 user nova-compute[75100]:   </clock>
Nov 10 17:45:35 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 10 17:45:35 user nova-compute[75100]:     <model>Nehalem</model>
Nov 10 17:45:35 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 17:45:35 user nova-compute[75100]:   </cpu>
Nov 10 17:45:35 user nova-compute[75100]:   <devices>
Nov 10 17:45:35 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 10 17:45:35 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 17:45:35 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/db3f69df-51b2-464c-921e-33171e29f46d/disk"/>
Nov 10 17:45:35 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 10 17:45:35 user nova-compute[75100]:     </disk>
Nov 10 17:45:35 user nova-compute[75100]:     <interface type="ethernet">
Nov 10 17:45:35 user nova-compute[75100]:       <mac address="fa:16:3e:0c:f1:29"/>
Nov 10 17:45:35 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:45:35 user nova-compute[75100]:       <mtu size="1442"/>
Nov 10 17:45:35 user nova-compute[75100]:       <target dev="tap6dee04b2-6d"/>
Nov 10 17:45:35 user nova-compute[75100]:     </interface>
Nov 10 17:45:35 user nova-compute[75100]:     <serial type="pty">
Nov 10 17:45:35 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/db3f69df-51b2-464c-921e-33171e29f46d/console.log" append="off"/>
Nov 10 17:45:35 user nova-compute[75100]:     </serial>
Nov 10 17:45:35 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 17:45:35 user nova-compute[75100]:     <video>
Nov 10 17:45:35 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:45:35 user nova-compute[75100]:     </video>
Nov 10 17:45:35 user nova-compute[75100]:     <rng model="virtio">
Nov 10 17:45:35 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 10 17:45:35 user nova-compute[75100]:     </rng>
Nov 10 17:45:35 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 10 17:45:35 user nova-compute[75100]:     <memballoon model="virtio">
Nov 10 17:45:35 user nova-compute[75100]:       <stats period="10"/>
Nov 10 17:45:35 user nova-compute[75100]:     </memballoon>
Nov 10 17:45:35 user nova-compute[75100]:   </devices>
Nov 10 17:45:35 user nova-compute[75100]: </domain>
Nov 10 17:45:35 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 17:45:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:45:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-474483029',display_name='tempest-TestVolumeSwap-server-474483029',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-474483029',id=9,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1lLDNBgtx3q+PkD3TYvWLxFqpJI1OpVsikhMhqcZbJFFGq1rafwqwihbfVoPyMgTqb8CusBU1nzG7CgDThJvrxeNRTprDwC3j3w7x8/LkG0MFYW67Ue2HZAsAhf0ZkrA==',key_name='tempest-keypair-1000540697',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e29209a67b9d48bd8067be38d95ea656',ramdisk_id='',reservation_id='r-1aluadj6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-487928490',owner_user_name='tempest-TestVolumeSwap-487928490-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:45:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aebb4562848f44268afd12b033060561',uuid=db3f69df-51b2-464c-921e-33171e29f46d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6dee04b2-6df4-439f-93de-f474b077cd60", "address": "fa:16:3e:0c:f1:29", "network": {"id": "d5116328-c56e-407f-8316-5ebbd31e8e64", "bridge": "br-int", "label": "tempest-TestVolumeSwap-528250751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e29209a67b9d48bd8067be38d95ea656", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dee04b2-6d", "ovs_interfaceid": "6dee04b2-6df4-439f-93de-f474b077cd60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 17:45:35 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Converting VIF {"id": "6dee04b2-6df4-439f-93de-f474b077cd60", "address": "fa:16:3e:0c:f1:29", "network": {"id": "d5116328-c56e-407f-8316-5ebbd31e8e64", "bridge": "br-int", "label": "tempest-TestVolumeSwap-528250751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e29209a67b9d48bd8067be38d95ea656", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dee04b2-6d", "ovs_interfaceid": "6dee04b2-6df4-439f-93de-f474b077cd60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:45:35 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:f1:29,bridge_name='br-int',has_traffic_filtering=True,id=6dee04b2-6df4-439f-93de-f474b077cd60,network=Network(d5116328-c56e-407f-8316-5ebbd31e8e64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6dee04b2-6d') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:45:35 user nova-compute[75100]: DEBUG os_vif [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:f1:29,bridge_name='br-int',has_traffic_filtering=True,id=6dee04b2-6df4-439f-93de-f474b077cd60,network=Network(d5116328-c56e-407f-8316-5ebbd31e8e64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6dee04b2-6d') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 17:45:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:45:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:45:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 17:45:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:45:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8b1dfd14-258b-5738-9abe-52ac680452ce', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:45:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:45:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:45:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:45:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6dee04b2-6d, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:45:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6dee04b2-6d, col_values=(('qos', UUID('fe19e779-7bcf-408e-8ef4-a310d456769d')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:45:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6dee04b2-6d, col_values=(('external_ids', {'iface-id': '6dee04b2-6df4-439f-93de-f474b077cd60', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:f1:29', 'vm-uuid': 'db3f69df-51b2-464c-921e-33171e29f46d'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:45:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:45:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:45:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:45:35 user nova-compute[75100]: INFO os_vif [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:f1:29,bridge_name='br-int',has_traffic_filtering=True,id=6dee04b2-6df4-439f-93de-f474b077cd60,network=Network(d5116328-c56e-407f-8316-5ebbd31e8e64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6dee04b2-6d')
Nov 10 17:45:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 17:45:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] No VIF found with MAC fa:16:3e:0c:f1:29, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 17:45:35 user nova-compute[75100]: DEBUG nova.network.neutron [req-fadd64c4-91f7-4a0d-bd3a-eb0a54c3778c req-817258a2-7118-4f6c-ab6b-4af93f54cb22 service nova] [instance: db3f69df-51b2-464c-921e-33171e29f46d] Updated VIF entry in instance network info cache for port 6dee04b2-6df4-439f-93de-f474b077cd60. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 17:45:35 user nova-compute[75100]: DEBUG nova.network.neutron [req-fadd64c4-91f7-4a0d-bd3a-eb0a54c3778c req-817258a2-7118-4f6c-ab6b-4af93f54cb22 service nova] [instance: db3f69df-51b2-464c-921e-33171e29f46d] Updating instance_info_cache with network_info: [{"id": "6dee04b2-6df4-439f-93de-f474b077cd60", "address": "fa:16:3e:0c:f1:29", "network": {"id": "d5116328-c56e-407f-8316-5ebbd31e8e64", "bridge": "br-int", "label": "tempest-TestVolumeSwap-528250751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e29209a67b9d48bd8067be38d95ea656", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dee04b2-6d", "ovs_interfaceid": "6dee04b2-6df4-439f-93de-f474b077cd60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:45:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-fadd64c4-91f7-4a0d-bd3a-eb0a54c3778c req-817258a2-7118-4f6c-ab6b-4af93f54cb22 service nova] Releasing lock "refresh_cache-db3f69df-51b2-464c-921e-33171e29f46d" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:45:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:45:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:45:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:45:37 user nova-compute[75100]: DEBUG nova.compute.manager [req-7a456e3a-2e1f-403f-ad11-93ec395b2f33 req-ac786e1c-20b5-490a-82a4-2f6cf17c091c service nova] [instance: db3f69df-51b2-464c-921e-33171e29f46d] Received event network-vif-plugged-6dee04b2-6df4-439f-93de-f474b077cd60 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:45:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7a456e3a-2e1f-403f-ad11-93ec395b2f33 req-ac786e1c-20b5-490a-82a4-2f6cf17c091c service nova] Acquiring lock "db3f69df-51b2-464c-921e-33171e29f46d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:45:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7a456e3a-2e1f-403f-ad11-93ec395b2f33 req-ac786e1c-20b5-490a-82a4-2f6cf17c091c service nova] Lock "db3f69df-51b2-464c-921e-33171e29f46d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:45:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7a456e3a-2e1f-403f-ad11-93ec395b2f33 req-ac786e1c-20b5-490a-82a4-2f6cf17c091c service nova] Lock "db3f69df-51b2-464c-921e-33171e29f46d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:45:37 user nova-compute[75100]: DEBUG nova.compute.manager [req-7a456e3a-2e1f-403f-ad11-93ec395b2f33 req-ac786e1c-20b5-490a-82a4-2f6cf17c091c service nova] [instance: db3f69df-51b2-464c-921e-33171e29f46d] No waiting events found dispatching network-vif-plugged-6dee04b2-6df4-439f-93de-f474b077cd60 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:45:37 user nova-compute[75100]: WARNING nova.compute.manager [req-7a456e3a-2e1f-403f-ad11-93ec395b2f33 req-ac786e1c-20b5-490a-82a4-2f6cf17c091c service nova] [instance: db3f69df-51b2-464c-921e-33171e29f46d] Received unexpected event network-vif-plugged-6dee04b2-6df4-439f-93de-f474b077cd60 for instance with vm_state building and task_state spawning.
Nov 10 17:45:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:45:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:45:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:45:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:45:39 user nova-compute[75100]: DEBUG nova.compute.manager [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] [instance: db3f69df-51b2-464c-921e-33171e29f46d] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 17:45:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] [instance: db3f69df-51b2-464c-921e-33171e29f46d] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 17:45:39 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: db3f69df-51b2-464c-921e-33171e29f46d] Instance spawned successfully.
Nov 10 17:45:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] [instance: db3f69df-51b2-464c-921e-33171e29f46d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 17:45:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] [instance: db3f69df-51b2-464c-921e-33171e29f46d] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:45:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] [instance: db3f69df-51b2-464c-921e-33171e29f46d] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:45:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] [instance: db3f69df-51b2-464c-921e-33171e29f46d] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:45:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] [instance: db3f69df-51b2-464c-921e-33171e29f46d] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:45:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] [instance: db3f69df-51b2-464c-921e-33171e29f46d] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:45:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] [instance: db3f69df-51b2-464c-921e-33171e29f46d] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:45:39 user nova-compute[75100]: INFO nova.compute.manager [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] [instance: db3f69df-51b2-464c-921e-33171e29f46d] Took 5.56 seconds to spawn the instance on the hypervisor.
Nov 10 17:45:39 user nova-compute[75100]: DEBUG nova.compute.manager [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] [instance: db3f69df-51b2-464c-921e-33171e29f46d] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 17:45:39 user nova-compute[75100]: DEBUG nova.compute.manager [req-62550a20-08eb-4bac-8d29-eaea6108efe3 req-e7c88f4b-2565-478f-8fdc-302ae5b60f54 service nova] [instance: db3f69df-51b2-464c-921e-33171e29f46d] Received event network-vif-plugged-6dee04b2-6df4-439f-93de-f474b077cd60 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:45:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-62550a20-08eb-4bac-8d29-eaea6108efe3 req-e7c88f4b-2565-478f-8fdc-302ae5b60f54 service nova] Acquiring lock "db3f69df-51b2-464c-921e-33171e29f46d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:45:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-62550a20-08eb-4bac-8d29-eaea6108efe3 req-e7c88f4b-2565-478f-8fdc-302ae5b60f54 service nova] Lock "db3f69df-51b2-464c-921e-33171e29f46d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:45:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-62550a20-08eb-4bac-8d29-eaea6108efe3 req-e7c88f4b-2565-478f-8fdc-302ae5b60f54 service nova] Lock "db3f69df-51b2-464c-921e-33171e29f46d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:45:39 user nova-compute[75100]: DEBUG nova.compute.manager [req-62550a20-08eb-4bac-8d29-eaea6108efe3 req-e7c88f4b-2565-478f-8fdc-302ae5b60f54 service nova] [instance: db3f69df-51b2-464c-921e-33171e29f46d] No waiting events found dispatching network-vif-plugged-6dee04b2-6df4-439f-93de-f474b077cd60 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:45:39 user nova-compute[75100]: WARNING nova.compute.manager [req-62550a20-08eb-4bac-8d29-eaea6108efe3 req-e7c88f4b-2565-478f-8fdc-302ae5b60f54 service nova] [instance: db3f69df-51b2-464c-921e-33171e29f46d] Received unexpected event network-vif-plugged-6dee04b2-6df4-439f-93de-f474b077cd60 for instance with vm_state building and task_state spawning.
Nov 10 17:45:39 user nova-compute[75100]: INFO nova.compute.manager [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] [instance: db3f69df-51b2-464c-921e-33171e29f46d] Took 6.53 seconds to build instance.
Nov 10 17:45:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e7f7f9e6-6618-4e79-a49d-7d31f6c4e470 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Lock "db3f69df-51b2-464c-921e-33171e29f46d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.633s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:45:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:45:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:45:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:45:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:45:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:45:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 17:45:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:45:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:45:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:45:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:45:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:45:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:46:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:46:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:46:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:46:08 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:46:10 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:46:10 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 17:46:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:46:10 user nova-compute[75100]: DEBUG nova.compute.manager [None req-5c25ce44-5c76-457c-957b-781c15ec39f2 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 17:46:10 user nova-compute[75100]: INFO nova.compute.manager [None req-5c25ce44-5c76-457c-957b-781c15ec39f2 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] instance snapshotting
Nov 10 17:46:10 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-5c25ce44-5c76-457c-957b-781c15ec39f2 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Beginning live snapshot process
Nov 10 17:46:10 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5c25ce44-5c76-457c-957b-781c15ec39f2 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk --force-share --output=json -f qcow2 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5c25ce44-5c76-457c-957b-781c15ec39f2 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk --force-share --output=json -f qcow2" returned: 0 in 0.187s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:46:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5c25ce44-5c76-457c-957b-781c15ec39f2 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk --force-share --output=json -f qcow2 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:11 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:46:11 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:46:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5c25ce44-5c76-457c-957b-781c15ec39f2 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk --force-share --output=json -f qcow2" returned: 0 in 0.183s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:46:11 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:46:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5c25ce44-5c76-457c-957b-781c15ec39f2 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:11 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:46:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:46:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:46:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:46:11 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 17:46:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5c25ce44-5c76-457c-957b-781c15ec39f2 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.172s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:46:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5c25ce44-5c76-457c-957b-781c15ec39f2 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp5mh7_i2r/50f0178e801d4e3997c5f2437fb24488.delta 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5c25ce44-5c76-457c-957b-781c15ec39f2 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp5mh7_i2r/50f0178e801d4e3997c5f2437fb24488.delta 1073741824" returned: 0 in 0.043s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:46:11 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-5c25ce44-5c76-457c-957b-781c15ec39f2 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 10 17:46:11 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5c25ce44-5c76-457c-957b-781c15ec39f2 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75100) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 10 17:46:11 user nova-compute[75100]: INFO nova.virt.libvirt.host [None req-5c25ce44-5c76-457c-957b-781c15ec39f2 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] UEFI support detected
Nov 10 17:46:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:12 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-5c25ce44-5c76-457c-957b-781c15ec39f2 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75100) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 17:46:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:46:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:46:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:46:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:12 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-5c25ce44-5c76-457c-957b-781c15ec39f2 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75100) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 17:46:12 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-5c25ce44-5c76-457c-957b-781c15ec39f2 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 10 17:46:12 user nova-compute[75100]: DEBUG nova.privsep.utils [None req-5c25ce44-5c76-457c-957b-781c15ec39f2 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75100) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 17:46:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5c25ce44-5c76-457c-957b-781c15ec39f2 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp5mh7_i2r/50f0178e801d4e3997c5f2437fb24488.delta /opt/stack/data/nova/instances/snapshots/tmp5mh7_i2r/50f0178e801d4e3997c5f2437fb24488 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:46:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5ec5d3-fa6f-43de-b786-8c423064fe7a/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5ec5d3-fa6f-43de-b786-8c423064fe7a/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:46:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5ec5d3-fa6f-43de-b786-8c423064fe7a/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5c25ce44-5c76-457c-957b-781c15ec39f2 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp5mh7_i2r/50f0178e801d4e3997c5f2437fb24488.delta /opt/stack/data/nova/instances/snapshots/tmp5mh7_i2r/50f0178e801d4e3997c5f2437fb24488" returned: 0 in 0.342s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:46:13 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-5c25ce44-5c76-457c-957b-781c15ec39f2 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Snapshot extracted, beginning image upload
Nov 10 17:46:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5ec5d3-fa6f-43de-b786-8c423064fe7a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:46:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45efac9f-8de9-43aa-b361-b5e4cf78795f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45efac9f-8de9-43aa-b361-b5e4cf78795f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:46:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45efac9f-8de9-43aa-b361-b5e4cf78795f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45efac9f-8de9-43aa-b361-b5e4cf78795f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:46:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c790b5c3-b255-430f-8654-f0ff5d54d48c/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c790b5c3-b255-430f-8654-f0ff5d54d48c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:46:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c790b5c3-b255-430f-8654-f0ff5d54d48c/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:13 user nova-compute[75100]: INFO nova.compute.manager [None req-7565977f-13fc-4717-85d7-fe8e31c8ddbf tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Rescuing
Nov 10 17:46:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7565977f-13fc-4717-85d7-fe8e31c8ddbf tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Acquiring lock "refresh_cache-3e14de19-540d-4dc2-a058-6874d8d14478" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:46:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7565977f-13fc-4717-85d7-fe8e31c8ddbf tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Acquired lock "refresh_cache-3e14de19-540d-4dc2-a058-6874d8d14478" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:46:13 user nova-compute[75100]: DEBUG nova.network.neutron [None req-7565977f-13fc-4717-85d7-fe8e31c8ddbf tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 17:46:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c790b5c3-b255-430f-8654-f0ff5d54d48c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:46:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:46:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:46:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91238923-a64c-4f41-a046-be243eff880d/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:14 user nova-compute[75100]: DEBUG nova.network.neutron [None req-7565977f-13fc-4717-85d7-fe8e31c8ddbf tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Updating instance_info_cache with network_info: [{"id": "d3f47ac6-ad90-4589-b41e-798c6fe6d5cf", "address": "fa:16:3e:b3:84:ec", "network": {"id": "26a554fe-9a5e-40c0-9981-5ac084c9ea73", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-269663495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19755f3e634fdfbd562c33fbfa2a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3f47ac6-ad", "ovs_interfaceid": "d3f47ac6-ad90-4589-b41e-798c6fe6d5cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:46:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7565977f-13fc-4717-85d7-fe8e31c8ddbf tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Releasing lock "refresh_cache-3e14de19-540d-4dc2-a058-6874d8d14478" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:46:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91238923-a64c-4f41-a046-be243eff880d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:46:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91238923-a64c-4f41-a046-be243eff880d/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:46:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:46:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91238923-a64c-4f41-a046-be243eff880d/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:46:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db3f69df-51b2-464c-921e-33171e29f46d/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:14 user nova-compute[75100]: DEBUG nova.compute.manager [req-4ceb6163-f3e7-485a-9a9a-4fb02acf5499 req-77c6be92-d307-4aa0-86a4-a4a306360340 service nova] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Received event network-vif-unplugged-d3f47ac6-ad90-4589-b41e-798c6fe6d5cf {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:46:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4ceb6163-f3e7-485a-9a9a-4fb02acf5499 req-77c6be92-d307-4aa0-86a4-a4a306360340 service nova] Acquiring lock "3e14de19-540d-4dc2-a058-6874d8d14478-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:46:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4ceb6163-f3e7-485a-9a9a-4fb02acf5499 req-77c6be92-d307-4aa0-86a4-a4a306360340 service nova] Lock "3e14de19-540d-4dc2-a058-6874d8d14478-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:46:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4ceb6163-f3e7-485a-9a9a-4fb02acf5499 req-77c6be92-d307-4aa0-86a4-a4a306360340 service nova] Lock "3e14de19-540d-4dc2-a058-6874d8d14478-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:46:14 user nova-compute[75100]: DEBUG nova.compute.manager [req-4ceb6163-f3e7-485a-9a9a-4fb02acf5499 req-77c6be92-d307-4aa0-86a4-a4a306360340 service nova] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] No waiting events found dispatching network-vif-unplugged-d3f47ac6-ad90-4589-b41e-798c6fe6d5cf {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:46:14 user nova-compute[75100]: WARNING nova.compute.manager [req-4ceb6163-f3e7-485a-9a9a-4fb02acf5499 req-77c6be92-d307-4aa0-86a4-a4a306360340 service nova] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Received unexpected event network-vif-unplugged-d3f47ac6-ad90-4589-b41e-798c6fe6d5cf for instance with vm_state active and task_state rescuing.
Nov 10 17:46:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:46:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:46:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db3f69df-51b2-464c-921e-33171e29f46d/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:46:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db3f69df-51b2-464c-921e-33171e29f46d/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:15 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Instance destroyed successfully.
Nov 10 17:46:15 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-7565977f-13fc-4717-85d7-fe8e31c8ddbf tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Attempting rescue
Nov 10 17:46:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7565977f-13fc-4717-85d7-fe8e31c8ddbf tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75100) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 10 17:46:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db3f69df-51b2-464c-921e-33171e29f46d/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:46:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ead532eb-c8be-45fa-a8b7-0b4c4f884a90/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7565977f-13fc-4717-85d7-fe8e31c8ddbf tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Instance directory exists: not creating {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 10 17:46:15 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-7565977f-13fc-4717-85d7-fe8e31c8ddbf tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Creating image(s)
Nov 10 17:46:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7565977f-13fc-4717-85d7-fe8e31c8ddbf tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Acquiring lock "/opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:46:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7565977f-13fc-4717-85d7-fe8e31c8ddbf tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "/opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:46:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7565977f-13fc-4717-85d7-fe8e31c8ddbf tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "/opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:46:15 user nova-compute[75100]: DEBUG nova.objects.instance [None req-7565977f-13fc-4717-85d7-fe8e31c8ddbf tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3e14de19-540d-4dc2-a058-6874d8d14478 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:46:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7565977f-13fc-4717-85d7-fe8e31c8ddbf tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Acquiring lock "818b9e28e061d41a38d903968b229be2ed9ba520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:46:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7565977f-13fc-4717-85d7-fe8e31c8ddbf tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:46:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-7565977f-13fc-4717-85d7-fe8e31c8ddbf tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ead532eb-c8be-45fa-a8b7-0b4c4f884a90/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:46:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ead532eb-c8be-45fa-a8b7-0b4c4f884a90/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-7565977f-13fc-4717-85d7-fe8e31c8ddbf tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.176s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:46:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-7565977f-13fc-4717-85d7-fe8e31c8ddbf tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk.rescue {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:46:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-7565977f-13fc-4717-85d7-fe8e31c8ddbf tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk.rescue" returned: 0 in 0.050s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:46:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7565977f-13fc-4717-85d7-fe8e31c8ddbf tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:46:15 user nova-compute[75100]: DEBUG nova.objects.instance [None req-7565977f-13fc-4717-85d7-fe8e31c8ddbf tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lazy-loading 'migration_context' on Instance uuid 3e14de19-540d-4dc2-a058-6874d8d14478 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:46:15 user nova-compute[75100]: DEBUG nova.objects.base [None req-7565977f-13fc-4717-85d7-fe8e31c8ddbf tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Object Instance<3e14de19-540d-4dc2-a058-6874d8d14478> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 17:46:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7565977f-13fc-4717-85d7-fe8e31c8ddbf tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 17:46:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7565977f-13fc-4717-85d7-fe8e31c8ddbf tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Start _get_guest_xml network_info=[{"id": "d3f47ac6-ad90-4589-b41e-798c6fe6d5cf", "address": "fa:16:3e:b3:84:ec", "network": {"id": "26a554fe-9a5e-40c0-9981-5ac084c9ea73", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-269663495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-269663495-network", "vif_mac": "fa:16:3e:b3:84:ec"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19755f3e634fdfbd562c33fbfa2a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3f47ac6-ad", "ovs_interfaceid": "d3f47ac6-ad90-4589-b41e-798c6fe6d5cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e3cc5321-4d40-49ee-885c-700e14741732', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 17:46:15 user nova-compute[75100]: DEBUG nova.objects.instance [None req-7565977f-13fc-4717-85d7-fe8e31c8ddbf tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lazy-loading 'resources' on Instance uuid 3e14de19-540d-4dc2-a058-6874d8d14478 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:46:15 user nova-compute[75100]: DEBUG nova.objects.base [None req-7565977f-13fc-4717-85d7-fe8e31c8ddbf tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Object Instance<3e14de19-540d-4dc2-a058-6874d8d14478> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 17:46:15 user nova-compute[75100]: DEBUG nova.objects.instance [None req-7565977f-13fc-4717-85d7-fe8e31c8ddbf tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lazy-loading 'numa_topology' on Instance uuid 3e14de19-540d-4dc2-a058-6874d8d14478 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:46:15 user nova-compute[75100]: DEBUG nova.objects.base [None req-7565977f-13fc-4717-85d7-fe8e31c8ddbf tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Object Instance<3e14de19-540d-4dc2-a058-6874d8d14478> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 17:46:15 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-7565977f-13fc-4717-85d7-fe8e31c8ddbf tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:46:15 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-7565977f-13fc-4717-85d7-fe8e31c8ddbf tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:46:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-7565977f-13fc-4717-85d7-fe8e31c8ddbf tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 17:46:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-7565977f-13fc-4717-85d7-fe8e31c8ddbf tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 17:46:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-7565977f-13fc-4717-85d7-fe8e31c8ddbf tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 17:46:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-7565977f-13fc-4717-85d7-fe8e31c8ddbf tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 17:46:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7565977f-13fc-4717-85d7-fe8e31c8ddbf tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 17:46:15 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7565977f-13fc-4717-85d7-fe8e31c8ddbf tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T17:40:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 17:46:15 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7565977f-13fc-4717-85d7-fe8e31c8ddbf tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 17:46:15 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7565977f-13fc-4717-85d7-fe8e31c8ddbf tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 17:46:15 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7565977f-13fc-4717-85d7-fe8e31c8ddbf tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 17:46:15 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7565977f-13fc-4717-85d7-fe8e31c8ddbf tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 17:46:15 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7565977f-13fc-4717-85d7-fe8e31c8ddbf tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 17:46:15 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7565977f-13fc-4717-85d7-fe8e31c8ddbf tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 17:46:15 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7565977f-13fc-4717-85d7-fe8e31c8ddbf tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 17:46:15 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7565977f-13fc-4717-85d7-fe8e31c8ddbf tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 17:46:15 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7565977f-13fc-4717-85d7-fe8e31c8ddbf tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 17:46:15 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7565977f-13fc-4717-85d7-fe8e31c8ddbf tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 17:46:15 user nova-compute[75100]: DEBUG nova.objects.instance [None req-7565977f-13fc-4717-85d7-fe8e31c8ddbf tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3e14de19-540d-4dc2-a058-6874d8d14478 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:46:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ead532eb-c8be-45fa-a8b7-0b4c4f884a90/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:46:15 user nova-compute[75100]: DEBUG nova.objects.base [None req-7565977f-13fc-4717-85d7-fe8e31c8ddbf tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Object Instance<3e14de19-540d-4dc2-a058-6874d8d14478> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 17:46:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-7565977f-13fc-4717-85d7-fe8e31c8ddbf tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:44:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1959011287',display_name='tempest-ServerRescueNegativeTestJSON-server-1959011287',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1959011287',id=3,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T17:44:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6b19755f3e634fdfbd562c33fbfa2a88',ramdisk_id='',reservation_id='r-6vqr8vu5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-783763036',owner_user_name='tempest-ServerRescueNegativeTestJSON-783763036-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:44:40Z,user_data=None,user_id='8cdb9250e6c7459587e429a0aea577c6',uuid=3e14de19-540d-4dc2-a058-6874d8d14478,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d3f47ac6-ad90-4589-b41e-798c6fe6d5cf", "address": "fa:16:3e:b3:84:ec", "network": {"id": "26a554fe-9a5e-40c0-9981-5ac084c9ea73", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-269663495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-269663495-network", "vif_mac": "fa:16:3e:b3:84:ec"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19755f3e634fdfbd562c33fbfa2a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3f47ac6-ad", "ovs_interfaceid": "d3f47ac6-ad90-4589-b41e-798c6fe6d5cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 17:46:15 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-7565977f-13fc-4717-85d7-fe8e31c8ddbf tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Converting VIF {"id": "d3f47ac6-ad90-4589-b41e-798c6fe6d5cf", "address": "fa:16:3e:b3:84:ec", "network": {"id": "26a554fe-9a5e-40c0-9981-5ac084c9ea73", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-269663495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-269663495-network", "vif_mac": "fa:16:3e:b3:84:ec"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19755f3e634fdfbd562c33fbfa2a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3f47ac6-ad", "ovs_interfaceid": "d3f47ac6-ad90-4589-b41e-798c6fe6d5cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:46:15 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-7565977f-13fc-4717-85d7-fe8e31c8ddbf tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:84:ec,bridge_name='br-int',has_traffic_filtering=True,id=d3f47ac6-ad90-4589-b41e-798c6fe6d5cf,network=Network(26a554fe-9a5e-40c0-9981-5ac084c9ea73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3f47ac6-ad') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:46:15 user nova-compute[75100]: DEBUG nova.objects.instance [None req-7565977f-13fc-4717-85d7-fe8e31c8ddbf tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lazy-loading 'pci_devices' on Instance uuid 3e14de19-540d-4dc2-a058-6874d8d14478 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:46:16 user nova-compute[75100]: DEBUG nova.objects.base [None req-7565977f-13fc-4717-85d7-fe8e31c8ddbf tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Object Instance<3e14de19-540d-4dc2-a058-6874d8d14478> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 17:46:16 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7565977f-13fc-4717-85d7-fe8e31c8ddbf tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] End _get_guest_xml xml=<domain type="kvm">
Nov 10 17:46:16 user nova-compute[75100]:   <uuid>3e14de19-540d-4dc2-a058-6874d8d14478</uuid>
Nov 10 17:46:16 user nova-compute[75100]:   <name>instance-00000003</name>
Nov 10 17:46:16 user nova-compute[75100]:   <memory>524288</memory>
Nov 10 17:46:16 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 10 17:46:16 user nova-compute[75100]:   <metadata>
Nov 10 17:46:16 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 17:46:16 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 10 17:46:16 user nova-compute[75100]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1959011287</nova:name>
Nov 10 17:46:16 user nova-compute[75100]:       <nova:creationTime>2023-11-10 17:46:15</nova:creationTime>
Nov 10 17:46:16 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 10 17:46:16 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 10 17:46:16 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 10 17:46:16 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 10 17:46:16 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 17:46:16 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 10 17:46:16 user nova-compute[75100]:       </nova:flavor>
Nov 10 17:46:16 user nova-compute[75100]:       <nova:owner>
Nov 10 17:46:16 user nova-compute[75100]:         <nova:user uuid="8cdb9250e6c7459587e429a0aea577c6">tempest-ServerRescueNegativeTestJSON-783763036-project-member</nova:user>
Nov 10 17:46:16 user nova-compute[75100]:         <nova:project uuid="6b19755f3e634fdfbd562c33fbfa2a88">tempest-ServerRescueNegativeTestJSON-783763036</nova:project>
Nov 10 17:46:16 user nova-compute[75100]:       </nova:owner>
Nov 10 17:46:16 user nova-compute[75100]:       <nova:root type="image" uuid="e3cc5321-4d40-49ee-885c-700e14741732"/>
Nov 10 17:46:16 user nova-compute[75100]:       <nova:ports>
Nov 10 17:46:16 user nova-compute[75100]:         <nova:port uuid="d3f47ac6-ad90-4589-b41e-798c6fe6d5cf">
Nov 10 17:46:16 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 10 17:46:16 user nova-compute[75100]:         </nova:port>
Nov 10 17:46:16 user nova-compute[75100]:       </nova:ports>
Nov 10 17:46:16 user nova-compute[75100]:     </nova:instance>
Nov 10 17:46:16 user nova-compute[75100]:   </metadata>
Nov 10 17:46:16 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 10 17:46:16 user nova-compute[75100]:     <system>
Nov 10 17:46:16 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 17:46:16 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 10 17:46:16 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 10 17:46:16 user nova-compute[75100]:       <entry name="serial">3e14de19-540d-4dc2-a058-6874d8d14478</entry>
Nov 10 17:46:16 user nova-compute[75100]:       <entry name="uuid">3e14de19-540d-4dc2-a058-6874d8d14478</entry>
Nov 10 17:46:16 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 10 17:46:16 user nova-compute[75100]:     </system>
Nov 10 17:46:16 user nova-compute[75100]:   </sysinfo>
Nov 10 17:46:16 user nova-compute[75100]:   <os>
Nov 10 17:46:16 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 17:46:16 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 10 17:46:16 user nova-compute[75100]:   </os>
Nov 10 17:46:16 user nova-compute[75100]:   <features>
Nov 10 17:46:16 user nova-compute[75100]:     <acpi/>
Nov 10 17:46:16 user nova-compute[75100]:     <apic/>
Nov 10 17:46:16 user nova-compute[75100]:     <vmcoreinfo/>
Nov 10 17:46:16 user nova-compute[75100]:   </features>
Nov 10 17:46:16 user nova-compute[75100]:   <clock offset="utc">
Nov 10 17:46:16 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 17:46:16 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 17:46:16 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 10 17:46:16 user nova-compute[75100]:   </clock>
Nov 10 17:46:16 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 10 17:46:16 user nova-compute[75100]:     <model>Nehalem</model>
Nov 10 17:46:16 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 17:46:16 user nova-compute[75100]:   </cpu>
Nov 10 17:46:16 user nova-compute[75100]:   <devices>
Nov 10 17:46:16 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 10 17:46:16 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 17:46:16 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk.rescue"/>
Nov 10 17:46:16 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 10 17:46:16 user nova-compute[75100]:     </disk>
Nov 10 17:46:16 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 10 17:46:16 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 17:46:16 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk"/>
Nov 10 17:46:16 user nova-compute[75100]:       <target dev="vdb" bus="virtio"/>
Nov 10 17:46:16 user nova-compute[75100]:     </disk>
Nov 10 17:46:16 user nova-compute[75100]:     <interface type="ethernet">
Nov 10 17:46:16 user nova-compute[75100]:       <mac address="fa:16:3e:b3:84:ec"/>
Nov 10 17:46:16 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:46:16 user nova-compute[75100]:       <mtu size="1442"/>
Nov 10 17:46:16 user nova-compute[75100]:       <target dev="tapd3f47ac6-ad"/>
Nov 10 17:46:16 user nova-compute[75100]:     </interface>
Nov 10 17:46:16 user nova-compute[75100]:     <serial type="pty">
Nov 10 17:46:16 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/console.log" append="off"/>
Nov 10 17:46:16 user nova-compute[75100]:     </serial>
Nov 10 17:46:16 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 17:46:16 user nova-compute[75100]:     <video>
Nov 10 17:46:16 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:46:16 user nova-compute[75100]:     </video>
Nov 10 17:46:16 user nova-compute[75100]:     <rng model="virtio">
Nov 10 17:46:16 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 10 17:46:16 user nova-compute[75100]:     </rng>
Nov 10 17:46:16 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 10 17:46:16 user nova-compute[75100]:     <memballoon model="virtio">
Nov 10 17:46:16 user nova-compute[75100]:       <stats period="10"/>
Nov 10 17:46:16 user nova-compute[75100]:     </memballoon>
Nov 10 17:46:16 user nova-compute[75100]:   </devices>
Nov 10 17:46:16 user nova-compute[75100]: </domain>
Nov 10 17:46:16 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 17:46:16 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:46:16 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:46:16 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Hypervisor/Node resource view: name=user free_ram=7235MB free_disk=24.829132080078125GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 17:46:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:46:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:46:16 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Instance destroyed successfully.
Nov 10 17:46:16 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-5c25ce44-5c76-457c-957b-781c15ec39f2 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Snapshot image upload complete
Nov 10 17:46:16 user nova-compute[75100]: INFO nova.compute.manager [None req-5c25ce44-5c76-457c-957b-781c15ec39f2 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Took 5.48 seconds to snapshot the instance on the hypervisor.
Nov 10 17:46:16 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7565977f-13fc-4717-85d7-fe8e31c8ddbf tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 17:46:16 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7565977f-13fc-4717-85d7-fe8e31c8ddbf tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 17:46:16 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7565977f-13fc-4717-85d7-fe8e31c8ddbf tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] No VIF found with MAC fa:16:3e:b3:84:ec, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 17:46:16 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance c19fc271-a248-4631-a11f-89b7ed73bf85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:46:16 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:46:16 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 3e14de19-540d-4dc2-a058-6874d8d14478 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:46:16 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 45efac9f-8de9-43aa-b361-b5e4cf78795f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:46:16 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance ead532eb-c8be-45fa-a8b7-0b4c4f884a90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:46:16 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 5b5ec5d3-fa6f-43de-b786-8c423064fe7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:46:16 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 91238923-a64c-4f41-a046-be243eff880d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:46:16 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance c790b5c3-b255-430f-8654-f0ff5d54d48c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:46:16 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance db3f69df-51b2-464c-921e-33171e29f46d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:46:16 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 17:46:16 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 17:46:16 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:46:16 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:46:16 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 17:46:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.524s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:46:16 user nova-compute[75100]: DEBUG nova.compute.manager [req-8775520f-7530-4985-8b75-b2ff60ee8501 req-a077a77f-3a71-4b31-a44b-256721154bc4 service nova] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Received event network-vif-plugged-d3f47ac6-ad90-4589-b41e-798c6fe6d5cf {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:46:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8775520f-7530-4985-8b75-b2ff60ee8501 req-a077a77f-3a71-4b31-a44b-256721154bc4 service nova] Acquiring lock "3e14de19-540d-4dc2-a058-6874d8d14478-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:46:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8775520f-7530-4985-8b75-b2ff60ee8501 req-a077a77f-3a71-4b31-a44b-256721154bc4 service nova] Lock "3e14de19-540d-4dc2-a058-6874d8d14478-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:46:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8775520f-7530-4985-8b75-b2ff60ee8501 req-a077a77f-3a71-4b31-a44b-256721154bc4 service nova] Lock "3e14de19-540d-4dc2-a058-6874d8d14478-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:46:16 user nova-compute[75100]: DEBUG nova.compute.manager [req-8775520f-7530-4985-8b75-b2ff60ee8501 req-a077a77f-3a71-4b31-a44b-256721154bc4 service nova] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] No waiting events found dispatching network-vif-plugged-d3f47ac6-ad90-4589-b41e-798c6fe6d5cf {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:46:16 user nova-compute[75100]: WARNING nova.compute.manager [req-8775520f-7530-4985-8b75-b2ff60ee8501 req-a077a77f-3a71-4b31-a44b-256721154bc4 service nova] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Received unexpected event network-vif-plugged-d3f47ac6-ad90-4589-b41e-798c6fe6d5cf for instance with vm_state active and task_state rescuing.
Nov 10 17:46:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:46:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:46:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:46:17 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:46:17 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:46:17 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 17:46:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "refresh_cache-b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:46:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquired lock "refresh_cache-b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:46:17 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 17:46:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:46:18 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Updating instance_info_cache with network_info: [{"id": "be620d2e-a2ea-49fe-9205-68101009027b", "address": "fa:16:3e:2d:37:4e", "network": {"id": "26a554fe-9a5e-40c0-9981-5ac084c9ea73", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-269663495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19755f3e634fdfbd562c33fbfa2a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe620d2e-a2", "ovs_interfaceid": "be620d2e-a2ea-49fe-9205-68101009027b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:46:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Releasing lock "refresh_cache-b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:46:18 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 17:46:18 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:46:18 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:46:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:46:18 user nova-compute[75100]: DEBUG nova.compute.manager [req-02a36b79-35a4-42e6-97a1-45270da98205 req-23d6beb9-707a-4d54-959d-2485e3e9aeef service nova] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Received event network-vif-plugged-d3f47ac6-ad90-4589-b41e-798c6fe6d5cf {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:46:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-02a36b79-35a4-42e6-97a1-45270da98205 req-23d6beb9-707a-4d54-959d-2485e3e9aeef service nova] Acquiring lock "3e14de19-540d-4dc2-a058-6874d8d14478-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:46:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-02a36b79-35a4-42e6-97a1-45270da98205 req-23d6beb9-707a-4d54-959d-2485e3e9aeef service nova] Lock "3e14de19-540d-4dc2-a058-6874d8d14478-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:46:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-02a36b79-35a4-42e6-97a1-45270da98205 req-23d6beb9-707a-4d54-959d-2485e3e9aeef service nova] Lock "3e14de19-540d-4dc2-a058-6874d8d14478-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:46:18 user nova-compute[75100]: DEBUG nova.compute.manager [req-02a36b79-35a4-42e6-97a1-45270da98205 req-23d6beb9-707a-4d54-959d-2485e3e9aeef service nova] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] No waiting events found dispatching network-vif-plugged-d3f47ac6-ad90-4589-b41e-798c6fe6d5cf {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:46:18 user nova-compute[75100]: WARNING nova.compute.manager [req-02a36b79-35a4-42e6-97a1-45270da98205 req-23d6beb9-707a-4d54-959d-2485e3e9aeef service nova] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Received unexpected event network-vif-plugged-d3f47ac6-ad90-4589-b41e-798c6fe6d5cf for instance with vm_state active and task_state rescuing.
Nov 10 17:46:18 user nova-compute[75100]: DEBUG nova.compute.manager [req-02a36b79-35a4-42e6-97a1-45270da98205 req-23d6beb9-707a-4d54-959d-2485e3e9aeef service nova] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Received event network-vif-plugged-d3f47ac6-ad90-4589-b41e-798c6fe6d5cf {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:46:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-02a36b79-35a4-42e6-97a1-45270da98205 req-23d6beb9-707a-4d54-959d-2485e3e9aeef service nova] Acquiring lock "3e14de19-540d-4dc2-a058-6874d8d14478-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:46:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-02a36b79-35a4-42e6-97a1-45270da98205 req-23d6beb9-707a-4d54-959d-2485e3e9aeef service nova] Lock "3e14de19-540d-4dc2-a058-6874d8d14478-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:46:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-02a36b79-35a4-42e6-97a1-45270da98205 req-23d6beb9-707a-4d54-959d-2485e3e9aeef service nova] Lock "3e14de19-540d-4dc2-a058-6874d8d14478-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:46:18 user nova-compute[75100]: DEBUG nova.compute.manager [req-02a36b79-35a4-42e6-97a1-45270da98205 req-23d6beb9-707a-4d54-959d-2485e3e9aeef service nova] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] No waiting events found dispatching network-vif-plugged-d3f47ac6-ad90-4589-b41e-798c6fe6d5cf {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:46:18 user nova-compute[75100]: WARNING nova.compute.manager [req-02a36b79-35a4-42e6-97a1-45270da98205 req-23d6beb9-707a-4d54-959d-2485e3e9aeef service nova] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Received unexpected event network-vif-plugged-d3f47ac6-ad90-4589-b41e-798c6fe6d5cf for instance with vm_state active and task_state rescuing.
Nov 10 17:46:19 user nova-compute[75100]: DEBUG nova.compute.manager [None req-7565977f-13fc-4717-85d7-fe8e31c8ddbf tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 17:46:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:46:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5178a939-7e00-4db1-94ac-39fa7a380b00 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Acquiring lock "45efac9f-8de9-43aa-b361-b5e4cf78795f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:46:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5178a939-7e00-4db1-94ac-39fa7a380b00 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Lock "45efac9f-8de9-43aa-b361-b5e4cf78795f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:46:24 user nova-compute[75100]: DEBUG nova.objects.instance [None req-5178a939-7e00-4db1-94ac-39fa7a380b00 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Lazy-loading 'flavor' on Instance uuid 45efac9f-8de9-43aa-b361-b5e4cf78795f {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:46:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5178a939-7e00-4db1-94ac-39fa7a380b00 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Lock "45efac9f-8de9-43aa-b361-b5e4cf78795f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.083s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:46:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5178a939-7e00-4db1-94ac-39fa7a380b00 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Acquiring lock "45efac9f-8de9-43aa-b361-b5e4cf78795f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:46:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5178a939-7e00-4db1-94ac-39fa7a380b00 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Lock "45efac9f-8de9-43aa-b361-b5e4cf78795f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:46:25 user nova-compute[75100]: INFO nova.compute.manager [None req-5178a939-7e00-4db1-94ac-39fa7a380b00 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] Attaching volume 5a86192d-50c5-4a8c-a6cf-8931c0d48539 to /dev/vdb
Nov 10 17:46:25 user nova-compute[75100]: DEBUG os_brick.utils [None req-5178a939-7e00-4db1-94ac-39fa7a380b00 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 17:46:25 user nova-compute[75100]: INFO oslo.privsep.daemon [None req-5178a939-7e00-4db1-94ac-39fa7a380b00 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpf2div49l/privsep.sock']
Nov 10 17:46:25 user sudo[86605]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpf2div49l/privsep.sock
Nov 10 17:46:25 user sudo[86605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 10 17:46:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:46:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:46:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 17:46:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:46:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:46:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:46:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Acquiring lock "111bd74e-2943-4f12-9514-b564cf26dadb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:46:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Lock "111bd74e-2943-4f12-9514-b564cf26dadb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:46:26 user nova-compute[75100]: DEBUG nova.compute.manager [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 17:46:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:46:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:46:26 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 17:46:26 user nova-compute[75100]: INFO nova.compute.claims [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Claim successful on node user
Nov 10 17:46:26 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:46:26 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:46:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.466s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:46:26 user nova-compute[75100]: DEBUG nova.compute.manager [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 17:46:26 user nova-compute[75100]: DEBUG nova.compute.manager [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 17:46:26 user nova-compute[75100]: DEBUG nova.network.neutron [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 17:46:26 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 17:46:26 user nova-compute[75100]: DEBUG nova.compute.manager [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 17:46:26 user sudo[86605]: pam_unix(sudo:session): session closed for user root
Nov 10 17:46:26 user nova-compute[75100]: INFO oslo.privsep.daemon [None req-5178a939-7e00-4db1-94ac-39fa7a380b00 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Spawned new privsep daemon via rootwrap
Nov 10 17:46:26 user nova-compute[75100]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 10 17:46:26 user nova-compute[75100]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 10 17:46:26 user nova-compute[75100]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 10 17:46:26 user nova-compute[75100]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86608
Nov 10 17:46:26 user nova-compute[75100]: DEBUG nova.policy [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bad2868941f0446f8674b47a316fa757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69fe121924d471abc0e62a4a32e4a75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 17:46:26 user nova-compute[75100]: INFO nova.virt.block_device [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Booting with volume 23131533-b27f-4598-84b7-44ed1d8878cb at /dev/vda
Nov 10 17:46:26 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[172b3022-2ef3-4053-a02a-4fd3feceeac1]: (2,) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:46:26 user nova-compute[75100]: DEBUG os_brick.utils [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 17:46:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:46:27 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc920f0-5ff6-409e-8146-f624cbe58541]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90b1a229568f\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:46:27 user nova-compute[75100]: WARNING os_brick.initiator.connectors.nvmeof [None req-5178a939-7e00-4db1-94ac-39fa7a380b00 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 10 17:46:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:46:27 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a606dd7-a2ab-4198-8625-62a53d4d5da1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90b1a229568f\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:46:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:46:27 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83fa878-975d-4b1e-9bdf-24c094612ea8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:46:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:46:27 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[538529d2-a450-4ce5-b65c-2a5473588df7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:46:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:46:27 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a13f55c-7e31-4fc2-b5d0-269f0cbac1e1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:46:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:46:27 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1367d8-6e40-4d43-ab83-a518324852e0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:46:27 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c844277e-2275-4b5b-81bb-b33066b5f2b7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:46:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5178a939-7e00-4db1-94ac-39fa7a380b00 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5178a939-7e00-4db1-94ac-39fa7a380b00 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 17:46:27 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ce8471-a4fc-495d-8a5d-d1d05277e741]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:46:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5178a939-7e00-4db1-94ac-39fa7a380b00 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 17:46:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 17:46:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 17:46:27 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 17:46:27 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c62be3-a24c-4f3c-9ecb-31302626ba17]: (4, '') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:46:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 17:46:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-5178a939-7e00-4db1-94ac-39fa7a380b00 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 17:46:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-5178a939-7e00-4db1-94ac-39fa7a380b00 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 17:46:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-5178a939-7e00-4db1-94ac-39fa7a380b00 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 17:46:27 user nova-compute[75100]: DEBUG os_brick.utils [None req-5178a939-7e00-4db1-94ac-39fa7a380b00 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] <== get_connector_properties: return (1973ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90b1a229568f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 17:46:27 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-5178a939-7e00-4db1-94ac-39fa7a380b00 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] Updating existing volume attachment record: 555a61c2-9690-4188-abdf-aeaa8990ca07 {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 17:46:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 17:46:27 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 17:46:27 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[86093a66-2667-45fb-8c9e-4bc950afd8ed]: (4, '') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:46:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 17:46:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 17:46:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 17:46:27 user nova-compute[75100]: DEBUG os_brick.utils [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] <== get_connector_properties: return (337ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90b1a229568f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 17:46:27 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Updating existing volume attachment record: 05e8f141-c68c-45fc-8aa2-2fce6d85e49e {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 17:46:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:46:27 user nova-compute[75100]: DEBUG nova.network.neutron [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Successfully created port: 26f643d1-0961-49af-bde1-32d1a6b0941d {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 17:46:28 user nova-compute[75100]: DEBUG nova.network.neutron [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Successfully updated port: 26f643d1-0961-49af-bde1-32d1a6b0941d {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 17:46:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Acquiring lock "refresh_cache-111bd74e-2943-4f12-9514-b564cf26dadb" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:46:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Acquired lock "refresh_cache-111bd74e-2943-4f12-9514-b564cf26dadb" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:46:28 user nova-compute[75100]: DEBUG nova.network.neutron [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 17:46:28 user nova-compute[75100]: DEBUG nova.compute.manager [req-34b9d748-c537-4add-b87f-f77a90bb2a92 req-c26caae7-f56b-4c47-8f88-08232e034c68 service nova] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Received event network-changed-26f643d1-0961-49af-bde1-32d1a6b0941d {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:46:28 user nova-compute[75100]: DEBUG nova.compute.manager [req-34b9d748-c537-4add-b87f-f77a90bb2a92 req-c26caae7-f56b-4c47-8f88-08232e034c68 service nova] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Refreshing instance network info cache due to event network-changed-26f643d1-0961-49af-bde1-32d1a6b0941d. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 17:46:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-34b9d748-c537-4add-b87f-f77a90bb2a92 req-c26caae7-f56b-4c47-8f88-08232e034c68 service nova] Acquiring lock "refresh_cache-111bd74e-2943-4f12-9514-b564cf26dadb" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:46:28 user nova-compute[75100]: DEBUG nova.network.neutron [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 17:46:28 user nova-compute[75100]: DEBUG nova.network.neutron [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Updating instance_info_cache with network_info: [{"id": "26f643d1-0961-49af-bde1-32d1a6b0941d", "address": "fa:16:3e:45:39:04", "network": {"id": "2fcf93f6-0be9-4c44-8caa-e5e556d88de8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1797631123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69fe121924d471abc0e62a4a32e4a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26f643d1-09", "ovs_interfaceid": "26f643d1-0961-49af-bde1-32d1a6b0941d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:46:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Releasing lock "refresh_cache-111bd74e-2943-4f12-9514-b564cf26dadb" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:46:28 user nova-compute[75100]: DEBUG nova.compute.manager [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Instance network_info: |[{"id": "26f643d1-0961-49af-bde1-32d1a6b0941d", "address": "fa:16:3e:45:39:04", "network": {"id": "2fcf93f6-0be9-4c44-8caa-e5e556d88de8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1797631123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69fe121924d471abc0e62a4a32e4a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26f643d1-09", "ovs_interfaceid": "26f643d1-0961-49af-bde1-32d1a6b0941d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 17:46:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-34b9d748-c537-4add-b87f-f77a90bb2a92 req-c26caae7-f56b-4c47-8f88-08232e034c68 service nova] Acquired lock "refresh_cache-111bd74e-2943-4f12-9514-b564cf26dadb" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:46:28 user nova-compute[75100]: DEBUG nova.network.neutron [req-34b9d748-c537-4add-b87f-f77a90bb2a92 req-c26caae7-f56b-4c47-8f88-08232e034c68 service nova] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Refreshing network info cache for port 26f643d1-0961-49af-bde1-32d1a6b0941d {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 17:46:29 user nova-compute[75100]: DEBUG nova.network.neutron [req-34b9d748-c537-4add-b87f-f77a90bb2a92 req-c26caae7-f56b-4c47-8f88-08232e034c68 service nova] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Updated VIF entry in instance network info cache for port 26f643d1-0961-49af-bde1-32d1a6b0941d. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 17:46:29 user nova-compute[75100]: DEBUG nova.network.neutron [req-34b9d748-c537-4add-b87f-f77a90bb2a92 req-c26caae7-f56b-4c47-8f88-08232e034c68 service nova] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Updating instance_info_cache with network_info: [{"id": "26f643d1-0961-49af-bde1-32d1a6b0941d", "address": "fa:16:3e:45:39:04", "network": {"id": "2fcf93f6-0be9-4c44-8caa-e5e556d88de8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1797631123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69fe121924d471abc0e62a4a32e4a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26f643d1-09", "ovs_interfaceid": "26f643d1-0961-49af-bde1-32d1a6b0941d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:46:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-34b9d748-c537-4add-b87f-f77a90bb2a92 req-c26caae7-f56b-4c47-8f88-08232e034c68 service nova] Releasing lock "refresh_cache-111bd74e-2943-4f12-9514-b564cf26dadb" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:46:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:46:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:46:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:46:38 user nova-compute[75100]: DEBUG nova.compute.manager [req-53f23fce-74c2-45ce-8aed-bea9873ccd1b req-e0124d4a-f7e6-47f0-8c61-bf37e13a8525 service nova] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Received event network-changed-bdf312ed-cce0-4d35-9257-f6a5a80cc0d2 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:46:38 user nova-compute[75100]: DEBUG nova.compute.manager [req-53f23fce-74c2-45ce-8aed-bea9873ccd1b req-e0124d4a-f7e6-47f0-8c61-bf37e13a8525 service nova] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Refreshing instance network info cache due to event network-changed-bdf312ed-cce0-4d35-9257-f6a5a80cc0d2. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 17:46:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-53f23fce-74c2-45ce-8aed-bea9873ccd1b req-e0124d4a-f7e6-47f0-8c61-bf37e13a8525 service nova] Acquiring lock "refresh_cache-ead532eb-c8be-45fa-a8b7-0b4c4f884a90" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:46:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-53f23fce-74c2-45ce-8aed-bea9873ccd1b req-e0124d4a-f7e6-47f0-8c61-bf37e13a8525 service nova] Acquired lock "refresh_cache-ead532eb-c8be-45fa-a8b7-0b4c4f884a90" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:46:38 user nova-compute[75100]: DEBUG nova.network.neutron [req-53f23fce-74c2-45ce-8aed-bea9873ccd1b req-e0124d4a-f7e6-47f0-8c61-bf37e13a8525 service nova] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Refreshing network info cache for port bdf312ed-cce0-4d35-9257-f6a5a80cc0d2 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 17:46:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:46:38 user nova-compute[75100]: DEBUG nova.network.neutron [req-53f23fce-74c2-45ce-8aed-bea9873ccd1b req-e0124d4a-f7e6-47f0-8c61-bf37e13a8525 service nova] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Updated VIF entry in instance network info cache for port bdf312ed-cce0-4d35-9257-f6a5a80cc0d2. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 17:46:38 user nova-compute[75100]: DEBUG nova.network.neutron [req-53f23fce-74c2-45ce-8aed-bea9873ccd1b req-e0124d4a-f7e6-47f0-8c61-bf37e13a8525 service nova] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Updating instance_info_cache with network_info: [{"id": "bdf312ed-cce0-4d35-9257-f6a5a80cc0d2", "address": "fa:16:3e:55:c2:62", "network": {"id": "7b0728f9-3997-4fbd-9583-81a235e0b690", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1553690854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8460c83146a64640ba7e549d159275c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdf312ed-cc", "ovs_interfaceid": "bdf312ed-cce0-4d35-9257-f6a5a80cc0d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:46:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-53f23fce-74c2-45ce-8aed-bea9873ccd1b req-e0124d4a-f7e6-47f0-8c61-bf37e13a8525 service nova] Releasing lock "refresh_cache-ead532eb-c8be-45fa-a8b7-0b4c4f884a90" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:46:39 user nova-compute[75100]: DEBUG nova.compute.manager [req-90821d53-e2f8-4f02-b280-32bb558d140c req-77f7269c-b1d7-4075-91f4-2278c5d1a33b service nova] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Received event network-changed-2b2adca0-0004-4df3-b8c8-03febbdc56ed {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:46:39 user nova-compute[75100]: DEBUG nova.compute.manager [req-90821d53-e2f8-4f02-b280-32bb558d140c req-77f7269c-b1d7-4075-91f4-2278c5d1a33b service nova] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Refreshing instance network info cache due to event network-changed-2b2adca0-0004-4df3-b8c8-03febbdc56ed. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 17:46:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-90821d53-e2f8-4f02-b280-32bb558d140c req-77f7269c-b1d7-4075-91f4-2278c5d1a33b service nova] Acquiring lock "refresh_cache-5b5ec5d3-fa6f-43de-b786-8c423064fe7a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:46:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-90821d53-e2f8-4f02-b280-32bb558d140c req-77f7269c-b1d7-4075-91f4-2278c5d1a33b service nova] Acquired lock "refresh_cache-5b5ec5d3-fa6f-43de-b786-8c423064fe7a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:46:39 user nova-compute[75100]: DEBUG nova.network.neutron [req-90821d53-e2f8-4f02-b280-32bb558d140c req-77f7269c-b1d7-4075-91f4-2278c5d1a33b service nova] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Refreshing network info cache for port 2b2adca0-0004-4df3-b8c8-03febbdc56ed {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 17:46:40 user nova-compute[75100]: DEBUG nova.network.neutron [req-90821d53-e2f8-4f02-b280-32bb558d140c req-77f7269c-b1d7-4075-91f4-2278c5d1a33b service nova] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Updated VIF entry in instance network info cache for port 2b2adca0-0004-4df3-b8c8-03febbdc56ed. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 17:46:40 user nova-compute[75100]: DEBUG nova.network.neutron [req-90821d53-e2f8-4f02-b280-32bb558d140c req-77f7269c-b1d7-4075-91f4-2278c5d1a33b service nova] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Updating instance_info_cache with network_info: [{"id": "2b2adca0-0004-4df3-b8c8-03febbdc56ed", "address": "fa:16:3e:4d:09:82", "network": {"id": "80d66f5d-7270-4848-992f-d7d1dd0f9d3d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1394179581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e7974315cb54b07a47f3d59fc12ae02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b2adca0-00", "ovs_interfaceid": "2b2adca0-0004-4df3-b8c8-03febbdc56ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:46:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-90821d53-e2f8-4f02-b280-32bb558d140c req-77f7269c-b1d7-4075-91f4-2278c5d1a33b service nova] Releasing lock "refresh_cache-5b5ec5d3-fa6f-43de-b786-8c423064fe7a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:46:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:46:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:46:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:46:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4574789c-f3c1-4727-86e0-74f673a36108 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Acquiring lock "ead532eb-c8be-45fa-a8b7-0b4c4f884a90" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:46:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4574789c-f3c1-4727-86e0-74f673a36108 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Lock "ead532eb-c8be-45fa-a8b7-0b4c4f884a90" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:46:45 user nova-compute[75100]: DEBUG nova.objects.instance [None req-4574789c-f3c1-4727-86e0-74f673a36108 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Lazy-loading 'flavor' on Instance uuid ead532eb-c8be-45fa-a8b7-0b4c4f884a90 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:46:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4574789c-f3c1-4727-86e0-74f673a36108 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Lock "ead532eb-c8be-45fa-a8b7-0b4c4f884a90" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.103s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:46:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4574789c-f3c1-4727-86e0-74f673a36108 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Acquiring lock "ead532eb-c8be-45fa-a8b7-0b4c4f884a90" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:46:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4574789c-f3c1-4727-86e0-74f673a36108 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Lock "ead532eb-c8be-45fa-a8b7-0b4c4f884a90" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:46:46 user nova-compute[75100]: INFO nova.compute.manager [None req-4574789c-f3c1-4727-86e0-74f673a36108 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Attaching volume 50317e9e-0c4a-4dda-87bc-7e3a23b299b8 to /dev/vdb
Nov 10 17:46:46 user nova-compute[75100]: DEBUG os_brick.utils [None req-4574789c-f3c1-4727-86e0-74f673a36108 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 17:46:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:46:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5690560-ed35-4595-bf0c-75a270126c8c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90b1a229568f\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:46:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:46:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5edd3689-a6e9-48fb-8089-1957532525eb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:46:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:46:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b34d435-97ed-4535-b829-04fd3c7d94af]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:46:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab36b1b-3159-427a-abb1-8de9c1cdbdfc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:46:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-4574789c-f3c1-4727-86e0-74f673a36108 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-4574789c-f3c1-4727-86e0-74f673a36108 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 17:46:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4574789c-f3c1-4727-86e0-74f673a36108 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 17:46:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 17:46:46 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 17:46:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b2a20d-cb7b-44de-85e6-36ee9c6b3a14]: (4, '') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:46:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-4574789c-f3c1-4727-86e0-74f673a36108 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 17:46:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-4574789c-f3c1-4727-86e0-74f673a36108 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 17:46:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-4574789c-f3c1-4727-86e0-74f673a36108 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 17:46:46 user nova-compute[75100]: DEBUG os_brick.utils [None req-4574789c-f3c1-4727-86e0-74f673a36108 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90b1a229568f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 17:46:46 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-4574789c-f3c1-4727-86e0-74f673a36108 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Updating existing volume attachment record: 89e28aba-a3a0-4a36-a411-9fd8f0f3f766 {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 17:46:47 user nova-compute[75100]: DEBUG nova.compute.manager [req-a24a3aae-32e4-4733-82da-7f1d45b02ee2 req-4633e074-79ba-42d3-ab47-960178dc0006 service nova] [instance: 91238923-a64c-4f41-a046-be243eff880d] Received event network-changed-4d2871cf-d6d9-4edb-9a0d-bc275ee11e13 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:46:47 user nova-compute[75100]: DEBUG nova.compute.manager [req-a24a3aae-32e4-4733-82da-7f1d45b02ee2 req-4633e074-79ba-42d3-ab47-960178dc0006 service nova] [instance: 91238923-a64c-4f41-a046-be243eff880d] Refreshing instance network info cache due to event network-changed-4d2871cf-d6d9-4edb-9a0d-bc275ee11e13. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 17:46:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a24a3aae-32e4-4733-82da-7f1d45b02ee2 req-4633e074-79ba-42d3-ab47-960178dc0006 service nova] Acquiring lock "refresh_cache-91238923-a64c-4f41-a046-be243eff880d" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:46:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a24a3aae-32e4-4733-82da-7f1d45b02ee2 req-4633e074-79ba-42d3-ab47-960178dc0006 service nova] Acquired lock "refresh_cache-91238923-a64c-4f41-a046-be243eff880d" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:46:47 user nova-compute[75100]: DEBUG nova.network.neutron [req-a24a3aae-32e4-4733-82da-7f1d45b02ee2 req-4633e074-79ba-42d3-ab47-960178dc0006 service nova] [instance: 91238923-a64c-4f41-a046-be243eff880d] Refreshing network info cache for port 4d2871cf-d6d9-4edb-9a0d-bc275ee11e13 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 17:46:48 user nova-compute[75100]: DEBUG nova.network.neutron [req-a24a3aae-32e4-4733-82da-7f1d45b02ee2 req-4633e074-79ba-42d3-ab47-960178dc0006 service nova] [instance: 91238923-a64c-4f41-a046-be243eff880d] Updated VIF entry in instance network info cache for port 4d2871cf-d6d9-4edb-9a0d-bc275ee11e13. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 17:46:48 user nova-compute[75100]: DEBUG nova.network.neutron [req-a24a3aae-32e4-4733-82da-7f1d45b02ee2 req-4633e074-79ba-42d3-ab47-960178dc0006 service nova] [instance: 91238923-a64c-4f41-a046-be243eff880d] Updating instance_info_cache with network_info: [{"id": "4d2871cf-d6d9-4edb-9a0d-bc275ee11e13", "address": "fa:16:3e:8e:18:ef", "network": {"id": "304fddab-4cec-47aa-afab-f32de11ec897", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-288924842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c38f5a70dae74e3cb19dd6ddade72581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d2871cf-d6", "ovs_interfaceid": "4d2871cf-d6d9-4edb-9a0d-bc275ee11e13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:46:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a24a3aae-32e4-4733-82da-7f1d45b02ee2 req-4633e074-79ba-42d3-ab47-960178dc0006 service nova] Releasing lock "refresh_cache-91238923-a64c-4f41-a046-be243eff880d" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:46:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5ca99577-6edc-4a70-aa73-69c4e7336d78 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Acquiring lock "interface-91238923-a64c-4f41-a046-be243eff880d-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:46:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5ca99577-6edc-4a70-aa73-69c4e7336d78 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Lock "interface-91238923-a64c-4f41-a046-be243eff880d-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:46:48 user nova-compute[75100]: DEBUG nova.objects.instance [None req-5ca99577-6edc-4a70-aa73-69c4e7336d78 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Lazy-loading 'flavor' on Instance uuid 91238923-a64c-4f41-a046-be243eff880d {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:46:48 user nova-compute[75100]: DEBUG nova.objects.instance [None req-5ca99577-6edc-4a70-aa73-69c4e7336d78 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Lazy-loading 'pci_requests' on Instance uuid 91238923-a64c-4f41-a046-be243eff880d {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:46:48 user nova-compute[75100]: DEBUG nova.objects.base [None req-5ca99577-6edc-4a70-aa73-69c4e7336d78 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Object Instance<91238923-a64c-4f41-a046-be243eff880d> lazy-loaded attributes: flavor,pci_requests {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 17:46:48 user nova-compute[75100]: DEBUG nova.network.neutron [None req-5ca99577-6edc-4a70-aa73-69c4e7336d78 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] [instance: 91238923-a64c-4f41-a046-be243eff880d] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 17:46:48 user nova-compute[75100]: DEBUG nova.policy [None req-5ca99577-6edc-4a70-aa73-69c4e7336d78 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '83545cded878478a8c823e5614376f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c38f5a70dae74e3cb19dd6ddade72581', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 17:46:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:46:49 user nova-compute[75100]: DEBUG nova.network.neutron [None req-5ca99577-6edc-4a70-aa73-69c4e7336d78 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] [instance: 91238923-a64c-4f41-a046-be243eff880d] Successfully created port: e628717d-728d-494a-be7e-ff3c79df75eb {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 17:46:50 user nova-compute[75100]: DEBUG nova.network.neutron [None req-5ca99577-6edc-4a70-aa73-69c4e7336d78 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] [instance: 91238923-a64c-4f41-a046-be243eff880d] Successfully updated port: e628717d-728d-494a-be7e-ff3c79df75eb {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 17:46:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5ca99577-6edc-4a70-aa73-69c4e7336d78 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Acquiring lock "refresh_cache-91238923-a64c-4f41-a046-be243eff880d" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:46:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5ca99577-6edc-4a70-aa73-69c4e7336d78 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Acquired lock "refresh_cache-91238923-a64c-4f41-a046-be243eff880d" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:46:50 user nova-compute[75100]: DEBUG nova.network.neutron [None req-5ca99577-6edc-4a70-aa73-69c4e7336d78 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] [instance: 91238923-a64c-4f41-a046-be243eff880d] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 17:46:50 user nova-compute[75100]: DEBUG nova.compute.manager [req-e2b5529c-a9b8-4592-8e41-37ac29e1c341 req-4700902f-b5ce-480d-a7d5-20b49123a274 service nova] [instance: 91238923-a64c-4f41-a046-be243eff880d] Received event network-changed-e628717d-728d-494a-be7e-ff3c79df75eb {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:46:50 user nova-compute[75100]: DEBUG nova.compute.manager [req-e2b5529c-a9b8-4592-8e41-37ac29e1c341 req-4700902f-b5ce-480d-a7d5-20b49123a274 service nova] [instance: 91238923-a64c-4f41-a046-be243eff880d] Refreshing instance network info cache due to event network-changed-e628717d-728d-494a-be7e-ff3c79df75eb. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 17:46:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-e2b5529c-a9b8-4592-8e41-37ac29e1c341 req-4700902f-b5ce-480d-a7d5-20b49123a274 service nova] Acquiring lock "refresh_cache-91238923-a64c-4f41-a046-be243eff880d" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:46:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:46:50 user nova-compute[75100]: DEBUG nova.network.neutron [None req-5ca99577-6edc-4a70-aa73-69c4e7336d78 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] [instance: 91238923-a64c-4f41-a046-be243eff880d] Updating instance_info_cache with network_info: [{"id": "4d2871cf-d6d9-4edb-9a0d-bc275ee11e13", "address": "fa:16:3e:8e:18:ef", "network": {"id": "304fddab-4cec-47aa-afab-f32de11ec897", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-288924842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c38f5a70dae74e3cb19dd6ddade72581", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d2871cf-d6", "ovs_interfaceid": "4d2871cf-d6d9-4edb-9a0d-bc275ee11e13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e628717d-728d-494a-be7e-ff3c79df75eb", "address": "fa:16:3e:cf:c8:5b", "network": {"id": "6b2b7289-3f5a-49f8-b185-8929b13584e5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-149434076", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c38f5a70dae74e3cb19dd6ddade72581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape628717d-72", "ovs_interfaceid": "e628717d-728d-494a-be7e-ff3c79df75eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:46:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5ca99577-6edc-4a70-aa73-69c4e7336d78 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Releasing lock "refresh_cache-91238923-a64c-4f41-a046-be243eff880d" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:46:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-e2b5529c-a9b8-4592-8e41-37ac29e1c341 req-4700902f-b5ce-480d-a7d5-20b49123a274 service nova] Acquired lock "refresh_cache-91238923-a64c-4f41-a046-be243eff880d" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:46:50 user nova-compute[75100]: DEBUG nova.network.neutron [req-e2b5529c-a9b8-4592-8e41-37ac29e1c341 req-4700902f-b5ce-480d-a7d5-20b49123a274 service nova] [instance: 91238923-a64c-4f41-a046-be243eff880d] Refreshing network info cache for port e628717d-728d-494a-be7e-ff3c79df75eb {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 17:46:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-5ca99577-6edc-4a70-aa73-69c4e7336d78 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T17:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1217309978',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1217309978',id=7,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDg6Whui6h8FFFZnFwQnZiCuU3HjskJ2h5m1lP5l89/I6dnqvQ2dx39WpWkClYX9LsxzEk1B3cwB2sN+VxVpaZakTcKBRQUFmNH6ntC81O0eJh0TTBqxIPcr2Favd3KjTw==',key_name='tempest-keypair-326242402',keypairs=<?>,launch_index=0,launched_at=2023-11-10T17:45:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c38f5a70dae74e3cb19dd6ddade72581',ramdisk_id='',reservation_id='r-v9u7eycj',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1600859769',owner_user_name='tempest-TaggedAttachmentsTest-1600859769-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T17:45:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83545cded878478a8c823e5614376f18',uuid=91238923-a64c-4f41-a046-be243eff880d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e628717d-728d-494a-be7e-ff3c79df75eb", "address": "fa:16:3e:cf:c8:5b", "network": {"id": "6b2b7289-3f5a-49f8-b185-8929b13584e5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-149434076", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c38f5a70dae74e3cb19dd6ddade72581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape628717d-72", "ovs_interfaceid": "e628717d-728d-494a-be7e-ff3c79df75eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 17:46:50 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-5ca99577-6edc-4a70-aa73-69c4e7336d78 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Converting VIF {"id": "e628717d-728d-494a-be7e-ff3c79df75eb", "address": "fa:16:3e:cf:c8:5b", "network": {"id": "6b2b7289-3f5a-49f8-b185-8929b13584e5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-149434076", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c38f5a70dae74e3cb19dd6ddade72581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape628717d-72", "ovs_interfaceid": "e628717d-728d-494a-be7e-ff3c79df75eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:46:50 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-5ca99577-6edc-4a70-aa73-69c4e7336d78 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:c8:5b,bridge_name='br-int',has_traffic_filtering=True,id=e628717d-728d-494a-be7e-ff3c79df75eb,network=Network(6b2b7289-3f5a-49f8-b185-8929b13584e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape628717d-72') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:46:50 user nova-compute[75100]: DEBUG os_vif [None req-5ca99577-6edc-4a70-aa73-69c4e7336d78 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:c8:5b,bridge_name='br-int',has_traffic_filtering=True,id=e628717d-728d-494a-be7e-ff3c79df75eb,network=Network(6b2b7289-3f5a-49f8-b185-8929b13584e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape628717d-72') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 17:46:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:46:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:46:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 17:46:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:46:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e592396c-d3e5-5ddf-b31f-11482fc43492', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:46:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:46:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:46:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:46:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape628717d-72, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:46:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape628717d-72, col_values=(('qos', UUID('8afefabe-558d-4e7d-925d-9a17a7307656')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:46:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape628717d-72, col_values=(('external_ids', {'iface-id': 'e628717d-728d-494a-be7e-ff3c79df75eb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:c8:5b', 'vm-uuid': '91238923-a64c-4f41-a046-be243eff880d'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:46:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:46:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:46:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:46:51 user nova-compute[75100]: INFO os_vif [None req-5ca99577-6edc-4a70-aa73-69c4e7336d78 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:c8:5b,bridge_name='br-int',has_traffic_filtering=True,id=e628717d-728d-494a-be7e-ff3c79df75eb,network=Network(6b2b7289-3f5a-49f8-b185-8929b13584e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape628717d-72')
Nov 10 17:46:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-5ca99577-6edc-4a70-aa73-69c4e7336d78 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T17:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1217309978',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1217309978',id=7,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDg6Whui6h8FFFZnFwQnZiCuU3HjskJ2h5m1lP5l89/I6dnqvQ2dx39WpWkClYX9LsxzEk1B3cwB2sN+VxVpaZakTcKBRQUFmNH6ntC81O0eJh0TTBqxIPcr2Favd3KjTw==',key_name='tempest-keypair-326242402',keypairs=<?>,launch_index=0,launched_at=2023-11-10T17:45:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c38f5a70dae74e3cb19dd6ddade72581',ramdisk_id='',reservation_id='r-v9u7eycj',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1600859769',owner_user_name='tempest-TaggedAttachmentsTest-1600859769-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T17:45:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83545cded878478a8c823e5614376f18',uuid=91238923-a64c-4f41-a046-be243eff880d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e628717d-728d-494a-be7e-ff3c79df75eb", "address": "fa:16:3e:cf:c8:5b", "network": {"id": "6b2b7289-3f5a-49f8-b185-8929b13584e5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-149434076", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c38f5a70dae74e3cb19dd6ddade72581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape628717d-72", "ovs_interfaceid": "e628717d-728d-494a-be7e-ff3c79df75eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 17:46:51 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-5ca99577-6edc-4a70-aa73-69c4e7336d78 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Converting VIF {"id": "e628717d-728d-494a-be7e-ff3c79df75eb", "address": "fa:16:3e:cf:c8:5b", "network": {"id": "6b2b7289-3f5a-49f8-b185-8929b13584e5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-149434076", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c38f5a70dae74e3cb19dd6ddade72581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape628717d-72", "ovs_interfaceid": "e628717d-728d-494a-be7e-ff3c79df75eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:46:51 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-5ca99577-6edc-4a70-aa73-69c4e7336d78 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:c8:5b,bridge_name='br-int',has_traffic_filtering=True,id=e628717d-728d-494a-be7e-ff3c79df75eb,network=Network(6b2b7289-3f5a-49f8-b185-8929b13584e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape628717d-72') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:46:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-5ca99577-6edc-4a70-aa73-69c4e7336d78 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] attach device xml: <interface type="ethernet">
Nov 10 17:46:51 user nova-compute[75100]:   <mac address="fa:16:3e:cf:c8:5b"/>
Nov 10 17:46:51 user nova-compute[75100]:   <model type="virtio"/>
Nov 10 17:46:51 user nova-compute[75100]:   <mtu size="1442"/>
Nov 10 17:46:51 user nova-compute[75100]:   <target dev="tape628717d-72"/>
Nov 10 17:46:51 user nova-compute[75100]: </interface>
Nov 10 17:46:51 user nova-compute[75100]:  {{(pid=75100) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 17:46:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:46:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:46:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:46:51 user nova-compute[75100]: DEBUG nova.compute.manager [req-f39c11ca-1264-418a-82a2-3f13ba8c37bc req-435e55b1-b4bb-440f-bc19-1235020e756b service nova] [instance: 91238923-a64c-4f41-a046-be243eff880d] Received event network-vif-plugged-e628717d-728d-494a-be7e-ff3c79df75eb {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:46:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f39c11ca-1264-418a-82a2-3f13ba8c37bc req-435e55b1-b4bb-440f-bc19-1235020e756b service nova] Acquiring lock "91238923-a64c-4f41-a046-be243eff880d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:46:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f39c11ca-1264-418a-82a2-3f13ba8c37bc req-435e55b1-b4bb-440f-bc19-1235020e756b service nova] Lock "91238923-a64c-4f41-a046-be243eff880d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:46:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f39c11ca-1264-418a-82a2-3f13ba8c37bc req-435e55b1-b4bb-440f-bc19-1235020e756b service nova] Lock "91238923-a64c-4f41-a046-be243eff880d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:46:51 user nova-compute[75100]: DEBUG nova.compute.manager [req-f39c11ca-1264-418a-82a2-3f13ba8c37bc req-435e55b1-b4bb-440f-bc19-1235020e756b service nova] [instance: 91238923-a64c-4f41-a046-be243eff880d] No waiting events found dispatching network-vif-plugged-e628717d-728d-494a-be7e-ff3c79df75eb {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:46:51 user nova-compute[75100]: WARNING nova.compute.manager [req-f39c11ca-1264-418a-82a2-3f13ba8c37bc req-435e55b1-b4bb-440f-bc19-1235020e756b service nova] [instance: 91238923-a64c-4f41-a046-be243eff880d] Received unexpected event network-vif-plugged-e628717d-728d-494a-be7e-ff3c79df75eb for instance with vm_state active and task_state None.
Nov 10 17:46:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5ca99577-6edc-4a70-aa73-69c4e7336d78 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 17:46:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5ca99577-6edc-4a70-aa73-69c4e7336d78 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] No BDM found with device name hda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 17:46:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5ca99577-6edc-4a70-aa73-69c4e7336d78 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] No VIF found with MAC fa:16:3e:8e:18:ef, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 17:46:51 user nova-compute[75100]: DEBUG nova.network.neutron [req-e2b5529c-a9b8-4592-8e41-37ac29e1c341 req-4700902f-b5ce-480d-a7d5-20b49123a274 service nova] [instance: 91238923-a64c-4f41-a046-be243eff880d] Updated VIF entry in instance network info cache for port e628717d-728d-494a-be7e-ff3c79df75eb. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 17:46:51 user nova-compute[75100]: DEBUG nova.network.neutron [req-e2b5529c-a9b8-4592-8e41-37ac29e1c341 req-4700902f-b5ce-480d-a7d5-20b49123a274 service nova] [instance: 91238923-a64c-4f41-a046-be243eff880d] Updating instance_info_cache with network_info: [{"id": "4d2871cf-d6d9-4edb-9a0d-bc275ee11e13", "address": "fa:16:3e:8e:18:ef", "network": {"id": "304fddab-4cec-47aa-afab-f32de11ec897", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-288924842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c38f5a70dae74e3cb19dd6ddade72581", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d2871cf-d6", "ovs_interfaceid": "4d2871cf-d6d9-4edb-9a0d-bc275ee11e13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e628717d-728d-494a-be7e-ff3c79df75eb", "address": "fa:16:3e:cf:c8:5b", "network": {"id": "6b2b7289-3f5a-49f8-b185-8929b13584e5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-149434076", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c38f5a70dae74e3cb19dd6ddade72581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape628717d-72", "ovs_interfaceid": "e628717d-728d-494a-be7e-ff3c79df75eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:46:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-e2b5529c-a9b8-4592-8e41-37ac29e1c341 req-4700902f-b5ce-480d-a7d5-20b49123a274 service nova] Releasing lock "refresh_cache-91238923-a64c-4f41-a046-be243eff880d" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:46:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-5ca99577-6edc-4a70-aa73-69c4e7336d78 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 17:46:51 user nova-compute[75100]:   <nova:package version="0.0.0"/>
Nov 10 17:46:51 user nova-compute[75100]:   <nova:name>tempest-device-tagging-server-1217309978</nova:name>
Nov 10 17:46:51 user nova-compute[75100]:   <nova:creationTime>2023-11-10 17:46:51</nova:creationTime>
Nov 10 17:46:51 user nova-compute[75100]:   <nova:flavor name="m1.tiny">
Nov 10 17:46:51 user nova-compute[75100]:     <nova:memory>512</nova:memory>
Nov 10 17:46:51 user nova-compute[75100]:     <nova:disk>1</nova:disk>
Nov 10 17:46:51 user nova-compute[75100]:     <nova:swap>0</nova:swap>
Nov 10 17:46:51 user nova-compute[75100]:     <nova:ephemeral>0</nova:ephemeral>
Nov 10 17:46:51 user nova-compute[75100]:     <nova:vcpus>1</nova:vcpus>
Nov 10 17:46:51 user nova-compute[75100]:   </nova:flavor>
Nov 10 17:46:51 user nova-compute[75100]:   <nova:owner>
Nov 10 17:46:51 user nova-compute[75100]:     <nova:user uuid="83545cded878478a8c823e5614376f18">tempest-TaggedAttachmentsTest-1600859769-project-member</nova:user>
Nov 10 17:46:51 user nova-compute[75100]:     <nova:project uuid="c38f5a70dae74e3cb19dd6ddade72581">tempest-TaggedAttachmentsTest-1600859769</nova:project>
Nov 10 17:46:51 user nova-compute[75100]:   </nova:owner>
Nov 10 17:46:51 user nova-compute[75100]:   <nova:root type="image" uuid="e3cc5321-4d40-49ee-885c-700e14741732"/>
Nov 10 17:46:51 user nova-compute[75100]:   <nova:ports>
Nov 10 17:46:51 user nova-compute[75100]:     <nova:port uuid="4d2871cf-d6d9-4edb-9a0d-bc275ee11e13">
Nov 10 17:46:51 user nova-compute[75100]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 10 17:46:51 user nova-compute[75100]:     </nova:port>
Nov 10 17:46:51 user nova-compute[75100]:     <nova:port uuid="e628717d-728d-494a-be7e-ff3c79df75eb">
Nov 10 17:46:51 user nova-compute[75100]:       <nova:ip type="fixed" address="10.10.10.248" ipVersion="4"/>
Nov 10 17:46:51 user nova-compute[75100]:     </nova:port>
Nov 10 17:46:51 user nova-compute[75100]:   </nova:ports>
Nov 10 17:46:51 user nova-compute[75100]: </nova:instance>
Nov 10 17:46:51 user nova-compute[75100]:  {{(pid=75100) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 10 17:46:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5ca99577-6edc-4a70-aa73-69c4e7336d78 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Lock "interface-91238923-a64c-4f41-a046-be243eff880d-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.401s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:46:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:46:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:46:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:46:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:46:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5178a939-7e00-4db1-94ac-39fa7a380b00 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5178a939-7e00-4db1-94ac-39fa7a380b00 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG os_brick.initiator.connector [None req-5178a939-7e00-4db1-94ac-39fa7a380b00 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Factory for ISCSI on None {{(pid=75100) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5178a939-7e00-4db1-94ac-39fa7a380b00 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.009s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5178a939-7e00-4db1-94ac-39fa7a380b00 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-5178a939-7e00-4db1-94ac-39fa7a380b00 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5a86192d-50c5-4a8c-a6cf-8931c0d48539', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GtnakmhN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 17:46:53 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-5178a939-7e00-4db1-94ac-39fa7a380b00 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 17:46:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-5178a939-7e00-4db1-94ac-39fa7a380b00 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-5178a939-7e00-4db1-94ac-39fa7a380b00 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 17:46:53 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-5178a939-7e00-4db1-94ac-39fa7a380b00 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 17:46:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-5178a939-7e00-4db1-94ac-39fa7a380b00 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a86192d-50c5-4a8c-a6cf-8931c0d48539" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-5178a939-7e00-4db1-94ac-39fa7a380b00 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a86192d-50c5-4a8c-a6cf-8931c0d48539" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 17:46:53 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-5178a939-7e00-4db1-94ac-39fa7a380b00 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 17:46:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a86192d-50c5-4a8c-a6cf-8931c0d48539 -p 172.16.0.220:3260 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a86192d-50c5-4a8c-a6cf-8931c0d48539 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c7d853-f770-47a3-bab9-cf4ec31ae1a1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-5178a939-7e00-4db1-94ac-39fa7a380b00 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 17:46:53 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a86192d-50c5-4a8c-a6cf-8931c0d48539 -p 172.16.0.220:3260 --interface default --op new {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a86192d-50c5-4a8c-a6cf-8931c0d48539 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5bd77a5-35cb-4bd8-83f4-2d160be83ca5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a86192d-50c5-4a8c-a6cf-8931c0d48539] added\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-5178a939-7e00-4db1-94ac-39fa7a380b00 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a86192d-50c5-4a8c-a6cf-8931c0d48539] added
Nov 10 17:46:53 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a86192d-50c5-4a8c-a6cf-8931c0d48539 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a86192d-50c5-4a8c-a6cf-8931c0d48539 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e41fbf3-a92e-4cbd-8a6c-5ea2552e3f46]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-5178a939-7e00-4db1-94ac-39fa7a380b00 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a86192d-50c5-4a8c-a6cf-8931c0d48539 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a86192d-50c5-4a8c-a6cf-8931c0d48539 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b775c9-4316-4950-a380-afe3708ae8a4]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-5178a939-7e00-4db1-94ac-39fa7a380b00 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a86192d-50c5-4a8c-a6cf-8931c0d48539 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GtnakmhN {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a86192d-50c5-4a8c-a6cf-8931c0d48539 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GtnakmhN" returned: 0 in 0.023s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9386950e-6249-4dfd-b8f6-8da1c2e0b305]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-5178a939-7e00-4db1-94ac-39fa7a380b00 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GtnakmhN'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a86192d-50c5-4a8c-a6cf-8931c0d48539 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a86192d-50c5-4a8c-a6cf-8931c0d48539 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[355b9f86-cb51-41cf-8a51-8c371f324f52]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-5178a939-7e00-4db1-94ac-39fa7a380b00 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0766cfb-a9dd-4c55-89f7-4ad394d5763d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-5178a939-7e00-4db1-94ac-39fa7a380b00 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 10 17:46:53 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-5178a939-7e00-4db1-94ac-39fa7a380b00 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 10 17:46:53 user nova-compute[75100]:  {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 17:46:53 user nova-compute[75100]: WARNING os_brick.initiator.connectors.iscsi [None req-5178a939-7e00-4db1-94ac-39fa7a380b00 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 10 17:46:53 user nova-compute[75100]: 
Nov 10 17:46:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a86192d-50c5-4a8c-a6cf-8931c0d48539 -p 172.16.0.220:3260 --login {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a86192d-50c5-4a8c-a6cf-8931c0d48539 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[722da884-6694-4ea1-afd8-964ef9b605aa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a86192d-50c5-4a8c-a6cf-8931c0d48539, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5a86192d-50c5-4a8c-a6cf-8931c0d48539, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-5178a939-7e00-4db1-94ac-39fa7a380b00 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a86192d-50c5-4a8c-a6cf-8931c0d48539, portal: 172.16.0.220,3260]
Nov 10 17:46:53 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:5a86192d-50c5-4a8c-a6cf-8931c0d48539, portal: 172.16.0.220,3260] successful.
Nov 10 17:46:53 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a86192d-50c5-4a8c-a6cf-8931c0d48539 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a86192d-50c5-4a8c-a6cf-8931c0d48539 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81e25d1-5d3f-4a88-9b4d-ab4a39cb4a4b]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-5178a939-7e00-4db1-94ac-39fa7a380b00 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5151a2c-514c-478b-9ff4-29db5853b1f5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a86192d-50c5-4a8c-a6cf-8931c0d48539 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-5178a939-7e00-4db1-94ac-39fa7a380b00 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a86192d-50c5-4a8c-a6cf-8931c0d48539 (non-flash)
Nov 10 17:46:53 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-5178a939-7e00-4db1-94ac-39fa7a380b00 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a86192d-50c5-4a8c-a6cf-8931c0d48539 (non-flash)
Nov 10 17:46:53 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-5178a939-7e00-4db1-94ac-39fa7a380b00 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a86192d-50c5-4a8c-a6cf-8931c0d48539" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-5178a939-7e00-4db1-94ac-39fa7a380b00 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-5178a939-7e00-4db1-94ac-39fa7a380b00 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-5178a939-7e00-4db1-94ac-39fa7a380b00 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a233fc44-6065-476f-8405-cdc2932ae217]: (4, ('- - 0', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-5178a939-7e00-4db1-94ac-39fa7a380b00 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-5178a939-7e00-4db1-94ac-39fa7a380b00 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5a86192d-50c5-4a8c-a6cf-8931c0d48539', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GtnakmhN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-52aff789-0151-41ea-9083-92eb5ee16207 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Acquiring lock "91238923-a64c-4f41-a046-be243eff880d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-52aff789-0151-41ea-9083-92eb5ee16207 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Lock "91238923-a64c-4f41-a046-be243eff880d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG nova.objects.instance [None req-52aff789-0151-41ea-9083-92eb5ee16207 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Lazy-loading 'flavor' on Instance uuid 91238923-a64c-4f41-a046-be243eff880d {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-52aff789-0151-41ea-9083-92eb5ee16207 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Lock "91238923-a64c-4f41-a046-be243eff880d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG nova.compute.manager [req-9ca7142a-f6cd-48f8-a77d-48c7b7390498 req-dd711862-e2c3-476f-b41a-4a9bcb9d80a7 service nova] [instance: 91238923-a64c-4f41-a046-be243eff880d] Received event network-vif-plugged-e628717d-728d-494a-be7e-ff3c79df75eb {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9ca7142a-f6cd-48f8-a77d-48c7b7390498 req-dd711862-e2c3-476f-b41a-4a9bcb9d80a7 service nova] Acquiring lock "91238923-a64c-4f41-a046-be243eff880d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9ca7142a-f6cd-48f8-a77d-48c7b7390498 req-dd711862-e2c3-476f-b41a-4a9bcb9d80a7 service nova] Lock "91238923-a64c-4f41-a046-be243eff880d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9ca7142a-f6cd-48f8-a77d-48c7b7390498 req-dd711862-e2c3-476f-b41a-4a9bcb9d80a7 service nova] Lock "91238923-a64c-4f41-a046-be243eff880d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG nova.compute.manager [req-9ca7142a-f6cd-48f8-a77d-48c7b7390498 req-dd711862-e2c3-476f-b41a-4a9bcb9d80a7 service nova] [instance: 91238923-a64c-4f41-a046-be243eff880d] No waiting events found dispatching network-vif-plugged-e628717d-728d-494a-be7e-ff3c79df75eb {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:46:53 user nova-compute[75100]: WARNING nova.compute.manager [req-9ca7142a-f6cd-48f8-a77d-48c7b7390498 req-dd711862-e2c3-476f-b41a-4a9bcb9d80a7 service nova] [instance: 91238923-a64c-4f41-a046-be243eff880d] Received unexpected event network-vif-plugged-e628717d-728d-494a-be7e-ff3c79df75eb for instance with vm_state active and task_state None.
Nov 10 17:46:53 user nova-compute[75100]: DEBUG nova.compute.manager [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 17:46:53 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Creating image(s)
Nov 10 17:46:53 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Did not create local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Ensure instance console log exists: /opt/stack/data/nova/instances/111bd74e-2943-4f12-9514-b564cf26dadb/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Start _get_guest_xml network_info=[{"id": "26f643d1-0961-49af-bde1-32d1a6b0941d", "address": "fa:16:3e:45:39:04", "network": {"id": "2fcf93f6-0be9-4c44-8caa-e5e556d88de8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1797631123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69fe121924d471abc0e62a4a32e4a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26f643d1-09", "ovs_interfaceid": "26f643d1-0961-49af-bde1-32d1a6b0941d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Yhtwynlz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '111bd74e-2943-4f12-9514-b564cf26dadb', 'attached_at': '', 'detached_at': '', 'volume_id': '23131533-b27f-4598-84b7-44ed1d8878cb', 'serial': '23131533-b27f-4598-84b7-44ed1d8878cb'}, 'mount_device': '/dev/vda', 'attachment_id': '05e8f141-c68c-45fc-8aa2-2fce6d85e49e', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 17:46:53 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:46:53 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:46:53 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T17:40:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Yhtwynlz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 17:46:53 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 17:46:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-52aff789-0151-41ea-9083-92eb5ee16207 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Acquiring lock "91238923-a64c-4f41-a046-be243eff880d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-52aff789-0151-41ea-9083-92eb5ee16207 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Lock "91238923-a64c-4f41-a046-be243eff880d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:46:53 user nova-compute[75100]: INFO nova.compute.manager [None req-52aff789-0151-41ea-9083-92eb5ee16207 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] [instance: 91238923-a64c-4f41-a046-be243eff880d] Attaching volume e4204104-cc65-42a9-9496-efb41c8f622d to /dev/vdb
Nov 10 17:46:53 user nova-compute[75100]: DEBUG nova.compute.manager [req-c6aa7a20-2f53-420e-9a60-ba67704aca0f req-84c8ca29-b48d-4519-a1ce-fdd4fccf4cb7 service nova] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Received event network-changed-43c197c7-a030-40dd-809c-a6bfebfa1c12 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG nova.compute.manager [req-c6aa7a20-2f53-420e-9a60-ba67704aca0f req-84c8ca29-b48d-4519-a1ce-fdd4fccf4cb7 service nova] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Refreshing instance network info cache due to event network-changed-43c197c7-a030-40dd-809c-a6bfebfa1c12. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c6aa7a20-2f53-420e-9a60-ba67704aca0f req-84c8ca29-b48d-4519-a1ce-fdd4fccf4cb7 service nova] Acquiring lock "refresh_cache-c790b5c3-b255-430f-8654-f0ff5d54d48c" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c6aa7a20-2f53-420e-9a60-ba67704aca0f req-84c8ca29-b48d-4519-a1ce-fdd4fccf4cb7 service nova] Acquired lock "refresh_cache-c790b5c3-b255-430f-8654-f0ff5d54d48c" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG nova.network.neutron [req-c6aa7a20-2f53-420e-9a60-ba67704aca0f req-84c8ca29-b48d-4519-a1ce-fdd4fccf4cb7 service nova] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Refreshing network info cache for port 43c197c7-a030-40dd-809c-a6bfebfa1c12 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG os_brick.utils [None req-52aff789-0151-41ea-9083-92eb5ee16207 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dfd50cf-3431-4923-adc3-33b7e324436e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90b1a229568f\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc40929-7e50-45f5-b9e0-b5115cde4cb7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cced6b2-1705-413f-a64b-822222997c94]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74bea2a-315d-46c6-9abc-92f22160c6e8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-52aff789-0151-41ea-9083-92eb5ee16207 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-52aff789-0151-41ea-9083-92eb5ee16207 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-52aff789-0151-41ea-9083-92eb5ee16207 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 17:46:53 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 17:46:53 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec347a6b-7277-46b5-b7fd-63d39a6d31c9]: (4, '') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-52aff789-0151-41ea-9083-92eb5ee16207 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-52aff789-0151-41ea-9083-92eb5ee16207 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-52aff789-0151-41ea-9083-92eb5ee16207 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG os_brick.utils [None req-52aff789-0151-41ea-9083-92eb5ee16207 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90b1a229568f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 17:46:53 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-52aff789-0151-41ea-9083-92eb5ee16207 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] [instance: 91238923-a64c-4f41-a046-be243eff880d] Updating existing volume attachment record: f32cd9ea-cd40-47d6-ae8b-c84b7546bb10 {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7fc52181-c4fd-4925-9ce9-7570afd1d76d tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] Acquiring lock "c790b5c3-b255-430f-8654-f0ff5d54d48c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7fc52181-c4fd-4925-9ce9-7570afd1d76d tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] Lock "c790b5c3-b255-430f-8654-f0ff5d54d48c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG nova.objects.instance [None req-7fc52181-c4fd-4925-9ce9-7570afd1d76d tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] Lazy-loading 'flavor' on Instance uuid c790b5c3-b255-430f-8654-f0ff5d54d48c {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7fc52181-c4fd-4925-9ce9-7570afd1d76d tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] Lock "c790b5c3-b255-430f-8654-f0ff5d54d48c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.088s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG nova.network.neutron [req-c6aa7a20-2f53-420e-9a60-ba67704aca0f req-84c8ca29-b48d-4519-a1ce-fdd4fccf4cb7 service nova] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Updated VIF entry in instance network info cache for port 43c197c7-a030-40dd-809c-a6bfebfa1c12. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG nova.network.neutron [req-c6aa7a20-2f53-420e-9a60-ba67704aca0f req-84c8ca29-b48d-4519-a1ce-fdd4fccf4cb7 service nova] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Updating instance_info_cache with network_info: [{"id": "43c197c7-a030-40dd-809c-a6bfebfa1c12", "address": "fa:16:3e:e4:af:16", "network": {"id": "b646ed0c-9af2-495b-afc3-81a58b5c1203", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1923503231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbee21b8d0b5480da833126fd57cc1ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43c197c7-a0", "ovs_interfaceid": "43c197c7-a030-40dd-809c-a6bfebfa1c12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c6aa7a20-2f53-420e-9a60-ba67704aca0f req-84c8ca29-b48d-4519-a1ce-fdd4fccf4cb7 service nova] Releasing lock "refresh_cache-c790b5c3-b255-430f-8654-f0ff5d54d48c" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7fc52181-c4fd-4925-9ce9-7570afd1d76d tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] Acquiring lock "c790b5c3-b255-430f-8654-f0ff5d54d48c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7fc52181-c4fd-4925-9ce9-7570afd1d76d tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] Lock "c790b5c3-b255-430f-8654-f0ff5d54d48c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:46:54 user nova-compute[75100]: INFO nova.compute.manager [None req-7fc52181-c4fd-4925-9ce9-7570afd1d76d tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Attaching volume d0b96731-b07d-4c4b-aa76-15b097d270b4 to /dev/vdb
Nov 10 17:46:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-5178a939-7e00-4db1-94ac-39fa7a380b00 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-5178a939-7e00-4db1-94ac-39fa7a380b00 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '26539363735623865', 'path': '/dev/sdb'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5178a939-7e00-4db1-94ac-39fa7a380b00 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26539363735623865', 'path': '/dev/sdb'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.788s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 17:46:54 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 17:46:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 17:46:54 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 17:46:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb -p 172.16.0.220:3260 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG nova.objects.instance [None req-5178a939-7e00-4db1-94ac-39fa7a380b00 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Lazy-loading 'flavor' on Instance uuid 45efac9f-8de9-43aa-b361-b5e4cf78795f {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[08777270-5be5-4aa7-9cdb-b30a529a71c7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 17:46:54 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb -p 172.16.0.220:3260 --interface default --op new {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-5178a939-7e00-4db1-94ac-39fa7a380b00 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 17:46:54 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 17:46:54 user nova-compute[75100]:   <source dev="/dev/sdb"/>
Nov 10 17:46:54 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 17:46:54 user nova-compute[75100]:   <serial>5a86192d-50c5-4a8c-a6cf-8931c0d48539</serial>
Nov 10 17:46:54 user nova-compute[75100]: </disk>
Nov 10 17:46:54 user nova-compute[75100]:  {{(pid=75100) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e25fb7a6-8695-4d58-a4ba-6f496eca2d1c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb] added\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb] added
Nov 10 17:46:54 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d414cc7a-c11d-4b74-bc8d-a3af9b2d5e08]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1bca79-5cd9-47f2-b739-890f28618e3d]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Yhtwynlz {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Yhtwynlz" returned: 0 in 0.027s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c63012-10ee-47ec-826d-f77ec1ccaa51]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'Yhtwynlz'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG os_brick.utils [None req-7fc52181-c4fd-4925-9ce9-7570afd1d76d tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0eae60c-cbb9-4cc1-9ab6-16fe88aa10b5]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[70353976-37ff-449e-8dba-2b6469fa8dcf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90b1a229568f\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0e847f-f916-49f6-9387-e927f27514ba]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a86192d-50c5-4a8c-a6cf-8931c0d48539 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a86192d-50c5-4a8c-a6cf-8931c0d48539 (non-flash)
Nov 10 17:46:54 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a86192d-50c5-4a8c-a6cf-8931c0d48539 (non-flash)
Nov 10 17:46:54 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb -p 172.16.0.220:3260 --login {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c4be93-a636-4f0f-b269-e215dccbbc5e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72f5b13-5f4c-4ea4-ae27-6d50a1785c60]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[33501a14-2d8c-4eee-a9cd-f6eb9fb35e5f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-7fc52181-c4fd-4925-9ce9-7570afd1d76d tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-7fc52181-c4fd-4925-9ce9-7570afd1d76d tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[71591412-bf2c-44fb-aef4-2c7ef7d6e936]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7fc52181-c4fd-4925-9ce9-7570afd1d76d tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb, portal: 172.16.0.220,3260]
Nov 10 17:46:54 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb, portal: 172.16.0.220,3260] successful.
Nov 10 17:46:54 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 17:46:54 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 17:46:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[758d390b-af1d-4d35-be2f-fc75d8cd11b5]: (4, '') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-7fc52181-c4fd-4925-9ce9-7570afd1d76d tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-7fc52181-c4fd-4925-9ce9-7570afd1d76d tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-7fc52181-c4fd-4925-9ce9-7570afd1d76d tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG os_brick.utils [None req-7fc52181-c4fd-4925-9ce9-7570afd1d76d tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90b1a229568f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-7fc52181-c4fd-4925-9ce9-7570afd1d76d tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Updating existing volume attachment record: 24b60b38-c168-4fa2-b3cb-4a66f85d2f08 {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0693935b-02cc-4f7e-a9d6-525552e4b8fa]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9b21bb-7134-4ed7-ad57-12b54dcfb98f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a86192d-50c5-4a8c-a6cf-8931c0d48539 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a86192d-50c5-4a8c-a6cf-8931c0d48539 (non-flash)
Nov 10 17:46:54 user nova-compute[75100]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb (non-flash)
Nov 10 17:46:54 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a86192d-50c5-4a8c-a6cf-8931c0d48539 (non-flash)
Nov 10 17:46:54 user nova-compute[75100]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb (non-flash)
Nov 10 17:46:54 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb573a6c-5fcd-4ec7-b057-e5c6e75cf714]: (4, ('- - 0', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Yhtwynlz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5178a939-7e00-4db1-94ac-39fa7a380b00 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5178a939-7e00-4db1-94ac-39fa7a380b00 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 17:46:54 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5178a939-7e00-4db1-94ac-39fa7a380b00 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] No VIF found with MAC fa:16:3e:ed:fe:82, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 17:46:55 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 17:46:55 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] <== connect_volume: return (2158ms) {'type': 'block', 'scsi_wwn': '23665616436363238', 'path': '/dev/sdc'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 17:46:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665616436363238', 'path': '/dev/sdc'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 17:46:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:46:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-51640417',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-51640417',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrKIMtk4kEwRtjbNDdESYG/eisyJknH+FhllMfNkzOhc8u5uNZOhOKf+vnV4PIFkkxSuZX7HodgT53XzLo5dAjQLzj42zR+o2Z9UiOkxsnJ+ZOoOQHi2OVpW8H5WpdMew==',key_name='tempest-keypair-1759515291',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d69fe121924d471abc0e62a4a32e4a75',ramdisk_id='',reservation_id='r-m3nm1elv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-2085671475',owner_user_name='tempest-ServerActionsV293TestJSON-2085671475-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:46:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bad2868941f0446f8674b47a316fa757',uuid=111bd74e-2943-4f12-9514-b564cf26dadb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26f643d1-0961-49af-bde1-32d1a6b0941d", "address": "fa:16:3e:45:39:04", "network": {"id": "2fcf93f6-0be9-4c44-8caa-e5e556d88de8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1797631123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69fe121924d471abc0e62a4a32e4a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26f643d1-09", "ovs_interfaceid": "26f643d1-0961-49af-bde1-32d1a6b0941d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 17:46:55 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Converting VIF {"id": "26f643d1-0961-49af-bde1-32d1a6b0941d", "address": "fa:16:3e:45:39:04", "network": {"id": "2fcf93f6-0be9-4c44-8caa-e5e556d88de8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1797631123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69fe121924d471abc0e62a4a32e4a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26f643d1-09", "ovs_interfaceid": "26f643d1-0961-49af-bde1-32d1a6b0941d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:46:55 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:39:04,bridge_name='br-int',has_traffic_filtering=True,id=26f643d1-0961-49af-bde1-32d1a6b0941d,network=Network(2fcf93f6-0be9-4c44-8caa-e5e556d88de8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26f643d1-09') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:46:55 user nova-compute[75100]: DEBUG nova.objects.instance [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Lazy-loading 'pci_devices' on Instance uuid 111bd74e-2943-4f12-9514-b564cf26dadb {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:46:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] End _get_guest_xml xml=<domain type="kvm">
Nov 10 17:46:55 user nova-compute[75100]:   <uuid>111bd74e-2943-4f12-9514-b564cf26dadb</uuid>
Nov 10 17:46:55 user nova-compute[75100]:   <name>instance-0000000a</name>
Nov 10 17:46:55 user nova-compute[75100]:   <memory>524288</memory>
Nov 10 17:46:55 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 10 17:46:55 user nova-compute[75100]:   <metadata>
Nov 10 17:46:55 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 17:46:55 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 10 17:46:55 user nova-compute[75100]:       <nova:name>tempest-ServerActionsV293TestJSON-server-51640417</nova:name>
Nov 10 17:46:55 user nova-compute[75100]:       <nova:creationTime>2023-11-10 17:46:53</nova:creationTime>
Nov 10 17:46:55 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 10 17:46:55 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 10 17:46:55 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 10 17:46:55 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 10 17:46:55 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 17:46:55 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 10 17:46:55 user nova-compute[75100]:       </nova:flavor>
Nov 10 17:46:55 user nova-compute[75100]:       <nova:owner>
Nov 10 17:46:55 user nova-compute[75100]:         <nova:user uuid="bad2868941f0446f8674b47a316fa757">tempest-ServerActionsV293TestJSON-2085671475-project-member</nova:user>
Nov 10 17:46:55 user nova-compute[75100]:         <nova:project uuid="d69fe121924d471abc0e62a4a32e4a75">tempest-ServerActionsV293TestJSON-2085671475</nova:project>
Nov 10 17:46:55 user nova-compute[75100]:       </nova:owner>
Nov 10 17:46:55 user nova-compute[75100]:       <nova:ports>
Nov 10 17:46:55 user nova-compute[75100]:         <nova:port uuid="26f643d1-0961-49af-bde1-32d1a6b0941d">
Nov 10 17:46:55 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 10 17:46:55 user nova-compute[75100]:         </nova:port>
Nov 10 17:46:55 user nova-compute[75100]:       </nova:ports>
Nov 10 17:46:55 user nova-compute[75100]:     </nova:instance>
Nov 10 17:46:55 user nova-compute[75100]:   </metadata>
Nov 10 17:46:55 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 10 17:46:55 user nova-compute[75100]:     <system>
Nov 10 17:46:55 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 17:46:55 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 10 17:46:55 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 10 17:46:55 user nova-compute[75100]:       <entry name="serial">111bd74e-2943-4f12-9514-b564cf26dadb</entry>
Nov 10 17:46:55 user nova-compute[75100]:       <entry name="uuid">111bd74e-2943-4f12-9514-b564cf26dadb</entry>
Nov 10 17:46:55 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 10 17:46:55 user nova-compute[75100]:     </system>
Nov 10 17:46:55 user nova-compute[75100]:   </sysinfo>
Nov 10 17:46:55 user nova-compute[75100]:   <os>
Nov 10 17:46:55 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 17:46:55 user nova-compute[75100]:     <boot dev="hd"/>
Nov 10 17:46:55 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 10 17:46:55 user nova-compute[75100]:   </os>
Nov 10 17:46:55 user nova-compute[75100]:   <features>
Nov 10 17:46:55 user nova-compute[75100]:     <acpi/>
Nov 10 17:46:55 user nova-compute[75100]:     <apic/>
Nov 10 17:46:55 user nova-compute[75100]:     <vmcoreinfo/>
Nov 10 17:46:55 user nova-compute[75100]:   </features>
Nov 10 17:46:55 user nova-compute[75100]:   <clock offset="utc">
Nov 10 17:46:55 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 17:46:55 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 17:46:55 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 10 17:46:55 user nova-compute[75100]:   </clock>
Nov 10 17:46:55 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 10 17:46:55 user nova-compute[75100]:     <model>Nehalem</model>
Nov 10 17:46:55 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 17:46:55 user nova-compute[75100]:   </cpu>
Nov 10 17:46:55 user nova-compute[75100]:   <devices>
Nov 10 17:46:55 user nova-compute[75100]:     <disk type="block" device="disk">
Nov 10 17:46:55 user nova-compute[75100]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 17:46:55 user nova-compute[75100]:       <source dev="/dev/sdc"/>
Nov 10 17:46:55 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 10 17:46:55 user nova-compute[75100]:       <serial>23131533-b27f-4598-84b7-44ed1d8878cb</serial>
Nov 10 17:46:55 user nova-compute[75100]:     </disk>
Nov 10 17:46:55 user nova-compute[75100]:     <interface type="ethernet">
Nov 10 17:46:55 user nova-compute[75100]:       <mac address="fa:16:3e:45:39:04"/>
Nov 10 17:46:55 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:46:55 user nova-compute[75100]:       <mtu size="1442"/>
Nov 10 17:46:55 user nova-compute[75100]:       <target dev="tap26f643d1-09"/>
Nov 10 17:46:55 user nova-compute[75100]:     </interface>
Nov 10 17:46:55 user nova-compute[75100]:     <serial type="pty">
Nov 10 17:46:55 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/111bd74e-2943-4f12-9514-b564cf26dadb/console.log" append="off"/>
Nov 10 17:46:55 user nova-compute[75100]:     </serial>
Nov 10 17:46:55 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 17:46:55 user nova-compute[75100]:     <video>
Nov 10 17:46:55 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:46:55 user nova-compute[75100]:     </video>
Nov 10 17:46:55 user nova-compute[75100]:     <rng model="virtio">
Nov 10 17:46:55 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 10 17:46:55 user nova-compute[75100]:     </rng>
Nov 10 17:46:55 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 10 17:46:55 user nova-compute[75100]:     <memballoon model="virtio">
Nov 10 17:46:55 user nova-compute[75100]:       <stats period="10"/>
Nov 10 17:46:55 user nova-compute[75100]:     </memballoon>
Nov 10 17:46:55 user nova-compute[75100]:   </devices>
Nov 10 17:46:55 user nova-compute[75100]: </domain>
Nov 10 17:46:55 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 17:46:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:46:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-51640417',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-51640417',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrKIMtk4kEwRtjbNDdESYG/eisyJknH+FhllMfNkzOhc8u5uNZOhOKf+vnV4PIFkkxSuZX7HodgT53XzLo5dAjQLzj42zR+o2Z9UiOkxsnJ+ZOoOQHi2OVpW8H5WpdMew==',key_name='tempest-keypair-1759515291',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d69fe121924d471abc0e62a4a32e4a75',ramdisk_id='',reservation_id='r-m3nm1elv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-2085671475',owner_user_name='tempest-ServerActionsV293TestJSON-2085671475-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:46:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bad2868941f0446f8674b47a316fa757',uuid=111bd74e-2943-4f12-9514-b564cf26dadb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26f643d1-0961-49af-bde1-32d1a6b0941d", "address": "fa:16:3e:45:39:04", "network": {"id": "2fcf93f6-0be9-4c44-8caa-e5e556d88de8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1797631123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69fe121924d471abc0e62a4a32e4a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26f643d1-09", "ovs_interfaceid": "26f643d1-0961-49af-bde1-32d1a6b0941d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 17:46:55 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Converting VIF {"id": "26f643d1-0961-49af-bde1-32d1a6b0941d", "address": "fa:16:3e:45:39:04", "network": {"id": "2fcf93f6-0be9-4c44-8caa-e5e556d88de8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1797631123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69fe121924d471abc0e62a4a32e4a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26f643d1-09", "ovs_interfaceid": "26f643d1-0961-49af-bde1-32d1a6b0941d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:46:55 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:39:04,bridge_name='br-int',has_traffic_filtering=True,id=26f643d1-0961-49af-bde1-32d1a6b0941d,network=Network(2fcf93f6-0be9-4c44-8caa-e5e556d88de8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26f643d1-09') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:46:55 user nova-compute[75100]: DEBUG os_vif [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:39:04,bridge_name='br-int',has_traffic_filtering=True,id=26f643d1-0961-49af-bde1-32d1a6b0941d,network=Network(2fcf93f6-0be9-4c44-8caa-e5e556d88de8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26f643d1-09') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 17:46:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:46:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:46:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 17:46:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:46:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f9fa2aab-b070-5227-a192-3feafb3d8f31', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:46:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:46:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:46:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap26f643d1-09, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:46:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap26f643d1-09, col_values=(('qos', UUID('432bd680-4d7d-4102-b213-025836606ed9')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:46:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap26f643d1-09, col_values=(('external_ids', {'iface-id': '26f643d1-0961-49af-bde1-32d1a6b0941d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:39:04', 'vm-uuid': '111bd74e-2943-4f12-9514-b564cf26dadb'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:46:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:46:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:46:55 user nova-compute[75100]: INFO os_vif [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:39:04,bridge_name='br-int',has_traffic_filtering=True,id=26f643d1-0961-49af-bde1-32d1a6b0941d,network=Network(2fcf93f6-0be9-4c44-8caa-e5e556d88de8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26f643d1-09')
Nov 10 17:46:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 17:46:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] No VIF found with MAC fa:16:3e:45:39:04, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 17:46:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:46:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:46:57 user nova-compute[75100]: DEBUG nova.compute.manager [req-8dc3728b-2d82-4d09-895d-1ad27f53f29e req-4f6b4e6e-981c-4ba3-b850-f92742b8ea70 service nova] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Received event network-vif-plugged-26f643d1-0961-49af-bde1-32d1a6b0941d {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:46:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8dc3728b-2d82-4d09-895d-1ad27f53f29e req-4f6b4e6e-981c-4ba3-b850-f92742b8ea70 service nova] Acquiring lock "111bd74e-2943-4f12-9514-b564cf26dadb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:46:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8dc3728b-2d82-4d09-895d-1ad27f53f29e req-4f6b4e6e-981c-4ba3-b850-f92742b8ea70 service nova] Lock "111bd74e-2943-4f12-9514-b564cf26dadb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:46:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8dc3728b-2d82-4d09-895d-1ad27f53f29e req-4f6b4e6e-981c-4ba3-b850-f92742b8ea70 service nova] Lock "111bd74e-2943-4f12-9514-b564cf26dadb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:46:57 user nova-compute[75100]: DEBUG nova.compute.manager [req-8dc3728b-2d82-4d09-895d-1ad27f53f29e req-4f6b4e6e-981c-4ba3-b850-f92742b8ea70 service nova] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] No waiting events found dispatching network-vif-plugged-26f643d1-0961-49af-bde1-32d1a6b0941d {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:46:57 user nova-compute[75100]: WARNING nova.compute.manager [req-8dc3728b-2d82-4d09-895d-1ad27f53f29e req-4f6b4e6e-981c-4ba3-b850-f92742b8ea70 service nova] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Received unexpected event network-vif-plugged-26f643d1-0961-49af-bde1-32d1a6b0941d for instance with vm_state building and task_state spawning.
Nov 10 17:46:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:46:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:46:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:46:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:46:59 user nova-compute[75100]: DEBUG nova.compute.manager [req-d61e0a0a-9568-492d-a3d3-04a58ab9e765 req-9e85c3ab-40d1-453b-87a7-de8654132641 service nova] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Received event network-vif-plugged-26f643d1-0961-49af-bde1-32d1a6b0941d {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:46:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d61e0a0a-9568-492d-a3d3-04a58ab9e765 req-9e85c3ab-40d1-453b-87a7-de8654132641 service nova] Acquiring lock "111bd74e-2943-4f12-9514-b564cf26dadb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:46:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d61e0a0a-9568-492d-a3d3-04a58ab9e765 req-9e85c3ab-40d1-453b-87a7-de8654132641 service nova] Lock "111bd74e-2943-4f12-9514-b564cf26dadb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:46:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d61e0a0a-9568-492d-a3d3-04a58ab9e765 req-9e85c3ab-40d1-453b-87a7-de8654132641 service nova] Lock "111bd74e-2943-4f12-9514-b564cf26dadb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:46:59 user nova-compute[75100]: DEBUG nova.compute.manager [req-d61e0a0a-9568-492d-a3d3-04a58ab9e765 req-9e85c3ab-40d1-453b-87a7-de8654132641 service nova] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] No waiting events found dispatching network-vif-plugged-26f643d1-0961-49af-bde1-32d1a6b0941d {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:46:59 user nova-compute[75100]: WARNING nova.compute.manager [req-d61e0a0a-9568-492d-a3d3-04a58ab9e765 req-9e85c3ab-40d1-453b-87a7-de8654132641 service nova] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Received unexpected event network-vif-plugged-26f643d1-0961-49af-bde1-32d1a6b0941d for instance with vm_state building and task_state spawning.
Nov 10 17:46:59 user nova-compute[75100]: DEBUG nova.compute.manager [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 17:46:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 17:46:59 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Instance spawned successfully.
Nov 10 17:46:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 17:46:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:46:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:46:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:46:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:46:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:46:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:46:59 user nova-compute[75100]: INFO nova.compute.manager [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Took 6.24 seconds to spawn the instance on the hypervisor.
Nov 10 17:46:59 user nova-compute[75100]: DEBUG nova.compute.manager [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 17:46:59 user nova-compute[75100]: INFO nova.compute.manager [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Took 33.72 seconds to build instance.
Nov 10 17:46:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-94f28359-30cd-4389-86a5-e23fdfdd6011 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Lock "111bd74e-2943-4f12-9514-b564cf26dadb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 33.829s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:47:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:47:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:47:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:47:08 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:47:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:47:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:47:11 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:47:11 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:47:11 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:47:11 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 17:47:11 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:47:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:47:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:47:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:47:11 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 17:47:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5ec5d3-fa6f-43de-b786-8c423064fe7a/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5ec5d3-fa6f-43de-b786-8c423064fe7a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5ec5d3-fa6f-43de-b786-8c423064fe7a/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5ec5d3-fa6f-43de-b786-8c423064fe7a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45efac9f-8de9-43aa-b361-b5e4cf78795f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45efac9f-8de9-43aa-b361-b5e4cf78795f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45efac9f-8de9-43aa-b361-b5e4cf78795f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45efac9f-8de9-43aa-b361-b5e4cf78795f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:12 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 17:47:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c790b5c3-b255-430f-8654-f0ff5d54d48c/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c790b5c3-b255-430f-8654-f0ff5d54d48c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c790b5c3-b255-430f-8654-f0ff5d54d48c/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c790b5c3-b255-430f-8654-f0ff5d54d48c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk.rescue --force-share --output=json" returned: 0 in 0.216s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:47:13 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4574789c-f3c1-4727-86e0-74f673a36108 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 17:47:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4574789c-f3c1-4727-86e0-74f673a36108 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TlOFWbDm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 17:47:13 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-4574789c-f3c1-4727-86e0-74f673a36108 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 17:47:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-4574789c-f3c1-4727-86e0-74f673a36108 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 17:47:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-4574789c-f3c1-4727-86e0-74f673a36108 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 17:47:13 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-4574789c-f3c1-4727-86e0-74f673a36108 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 17:47:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-4574789c-f3c1-4727-86e0-74f673a36108 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 17:47:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-4574789c-f3c1-4727-86e0-74f673a36108 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 17:47:13 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-4574789c-f3c1-4727-86e0-74f673a36108 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 17:47:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8 -p 172.16.0.220:3260 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:13 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[372f2f05-eae1-425a-8020-89b618c4620f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4574789c-f3c1-4727-86e0-74f673a36108 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 17:47:13 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:47:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:13 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d8b866-e851-43f7-90ac-0e87a38649ef]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8] added\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4574789c-f3c1-4727-86e0-74f673a36108 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8] added
Nov 10 17:47:13 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:47:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8b336c-19ce-4e17-8b3e-ed3f9cd2f73f]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4574789c-f3c1-4727-86e0-74f673a36108 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:47:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e809ad17-db0b-439e-bd8d-70371283d37e]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4574789c-f3c1-4727-86e0-74f673a36108 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:47:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TlOFWbDm {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TlOFWbDm" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[934976f7-4f3b-46c5-ad66-ba4942f8cc0f]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4574789c-f3c1-4727-86e0-74f673a36108 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TlOFWbDm'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:47:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4594da8d-86cf-4a53-a2f0-15ff8faf4eb3]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4574789c-f3c1-4727-86e0-74f673a36108 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:47:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6909a4d4-1a35-40e9-bd84-1b582be73ea0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a86192d-50c5-4a8c-a6cf-8931c0d48539 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4574789c-f3c1-4727-86e0-74f673a36108 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a86192d-50c5-4a8c-a6cf-8931c0d48539 (non-flash)
Nov 10 17:47:14 user nova-compute[75100]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb (non-flash)
Nov 10 17:47:14 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:47:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4574789c-f3c1-4727-86e0-74f673a36108 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a86192d-50c5-4a8c-a6cf-8931c0d48539 (non-flash)
Nov 10 17:47:14 user nova-compute[75100]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb (non-flash)
Nov 10 17:47:14 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 17:47:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8 -p 172.16.0.220:3260 --login {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5178a939-7e00-4db1-94ac-39fa7a380b00 tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Lock "45efac9f-8de9-43aa-b361-b5e4cf78795f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 48.903s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:47:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:14 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 17:47:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91238923-a64c-4f41-a046-be243eff880d/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d887e62b-ea36-4f16-9170-bdf7026bcd81]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4574789c-f3c1-4727-86e0-74f673a36108 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8, portal: 172.16.0.220,3260]
Nov 10 17:47:14 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8, portal: 172.16.0.220,3260] successful.
Nov 10 17:47:14 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:47:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b3dfd7-26b8-401a-a6b0-0b6d3102e4e6]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4574789c-f3c1-4727-86e0-74f673a36108 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:47:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddfabec7-48f3-498e-a622-651e55f12fe5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a86192d-50c5-4a8c-a6cf-8931c0d48539 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4574789c-f3c1-4727-86e0-74f673a36108 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a86192d-50c5-4a8c-a6cf-8931c0d48539 (non-flash)
Nov 10 17:47:14 user nova-compute[75100]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb (non-flash)
Nov 10 17:47:14 user nova-compute[75100]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8 (non-flash)
Nov 10 17:47:14 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:47:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4574789c-f3c1-4727-86e0-74f673a36108 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a86192d-50c5-4a8c-a6cf-8931c0d48539 (non-flash)
Nov 10 17:47:14 user nova-compute[75100]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb (non-flash)
Nov 10 17:47:14 user nova-compute[75100]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8 (non-flash)
Nov 10 17:47:14 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 17:47:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-4574789c-f3c1-4727-86e0-74f673a36108 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.352s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 17:47:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4574789c-f3c1-4727-86e0-74f673a36108 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 17:47:14 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-4574789c-f3c1-4727-86e0-74f673a36108 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 17:47:14 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-4574789c-f3c1-4727-86e0-74f673a36108 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 17:47:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1ed78e-417e-44ab-b817-7c66b3476d0e]: (4, ('- - 0', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:14 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-4574789c-f3c1-4727-86e0-74f673a36108 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 17:47:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4574789c-f3c1-4727-86e0-74f673a36108 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TlOFWbDm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 17:47:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91238923-a64c-4f41-a046-be243eff880d/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91238923-a64c-4f41-a046-be243eff880d/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91238923-a64c-4f41-a046-be243eff880d/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db3f69df-51b2-464c-921e-33171e29f46d/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6243d8da-d86c-401d-b652-9795868e035b tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Acquiring lock "45efac9f-8de9-43aa-b361-b5e4cf78795f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:47:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6243d8da-d86c-401d-b652-9795868e035b tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Lock "45efac9f-8de9-43aa-b361-b5e4cf78795f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:47:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6243d8da-d86c-401d-b652-9795868e035b tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Acquiring lock "45efac9f-8de9-43aa-b361-b5e4cf78795f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:47:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6243d8da-d86c-401d-b652-9795868e035b tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Lock "45efac9f-8de9-43aa-b361-b5e4cf78795f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:47:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6243d8da-d86c-401d-b652-9795868e035b tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Lock "45efac9f-8de9-43aa-b361-b5e4cf78795f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:47:14 user nova-compute[75100]: INFO nova.compute.manager [None req-6243d8da-d86c-401d-b652-9795868e035b tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] Terminating instance
Nov 10 17:47:14 user nova-compute[75100]: DEBUG nova.compute.manager [None req-6243d8da-d86c-401d-b652-9795868e035b tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 17:47:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:47:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:47:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:47:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db3f69df-51b2-464c-921e-33171e29f46d/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db3f69df-51b2-464c-921e-33171e29f46d/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:47:15 user nova-compute[75100]: DEBUG nova.compute.manager [req-de2990e9-d3c7-46bf-a014-03f288416787 req-278c3198-a6ff-42fc-99bb-4f52cc7d91bc service nova] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] Received event network-vif-unplugged-c676ea25-33da-405a-84ac-9f0ad0308c08 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:47:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-de2990e9-d3c7-46bf-a014-03f288416787 req-278c3198-a6ff-42fc-99bb-4f52cc7d91bc service nova] Acquiring lock "45efac9f-8de9-43aa-b361-b5e4cf78795f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:47:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-de2990e9-d3c7-46bf-a014-03f288416787 req-278c3198-a6ff-42fc-99bb-4f52cc7d91bc service nova] Lock "45efac9f-8de9-43aa-b361-b5e4cf78795f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:47:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-de2990e9-d3c7-46bf-a014-03f288416787 req-278c3198-a6ff-42fc-99bb-4f52cc7d91bc service nova] Lock "45efac9f-8de9-43aa-b361-b5e4cf78795f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:47:15 user nova-compute[75100]: DEBUG nova.compute.manager [req-de2990e9-d3c7-46bf-a014-03f288416787 req-278c3198-a6ff-42fc-99bb-4f52cc7d91bc service nova] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] No waiting events found dispatching network-vif-unplugged-c676ea25-33da-405a-84ac-9f0ad0308c08 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:47:15 user nova-compute[75100]: DEBUG nova.compute.manager [req-de2990e9-d3c7-46bf-a014-03f288416787 req-278c3198-a6ff-42fc-99bb-4f52cc7d91bc service nova] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] Received event network-vif-unplugged-c676ea25-33da-405a-84ac-9f0ad0308c08 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 17:47:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2001bb95-9eec-4fbd-a7af-f176bd6f7334 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Acquiring lock "5b5ec5d3-fa6f-43de-b786-8c423064fe7a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:47:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2001bb95-9eec-4fbd-a7af-f176bd6f7334 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Lock "5b5ec5d3-fa6f-43de-b786-8c423064fe7a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:47:15 user nova-compute[75100]: DEBUG nova.objects.instance [None req-2001bb95-9eec-4fbd-a7af-f176bd6f7334 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Lazy-loading 'flavor' on Instance uuid 5b5ec5d3-fa6f-43de-b786-8c423064fe7a {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:47:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db3f69df-51b2-464c-921e-33171e29f46d/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ead532eb-c8be-45fa-a8b7-0b4c4f884a90/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2001bb95-9eec-4fbd-a7af-f176bd6f7334 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Lock "5b5ec5d3-fa6f-43de-b786-8c423064fe7a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.117s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:47:15 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-4574789c-f3c1-4727-86e0-74f673a36108 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.396s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 17:47:15 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4574789c-f3c1-4727-86e0-74f673a36108 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] <== connect_volume: return (1398ms) {'type': 'block', 'scsi_wwn': '26465373037373139', 'path': '/dev/sdd'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 17:47:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4574789c-f3c1-4727-86e0-74f673a36108 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26465373037373139', 'path': '/dev/sdd'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 17:47:15 user nova-compute[75100]: DEBUG nova.objects.instance [None req-4574789c-f3c1-4727-86e0-74f673a36108 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Lazy-loading 'flavor' on Instance uuid ead532eb-c8be-45fa-a8b7-0b4c4f884a90 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:47:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ead532eb-c8be-45fa-a8b7-0b4c4f884a90/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ead532eb-c8be-45fa-a8b7-0b4c4f884a90/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-4574789c-f3c1-4727-86e0-74f673a36108 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 17:47:15 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 17:47:15 user nova-compute[75100]:   <source dev="/dev/sdd"/>
Nov 10 17:47:15 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 17:47:15 user nova-compute[75100]:   <serial>50317e9e-0c4a-4dda-87bc-7e3a23b299b8</serial>
Nov 10 17:47:15 user nova-compute[75100]: </disk>
Nov 10 17:47:15 user nova-compute[75100]:  {{(pid=75100) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 17:47:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ead532eb-c8be-45fa-a8b7-0b4c4f884a90/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:47:16 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] Instance destroyed successfully.
Nov 10 17:47:16 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:47:16 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:47:16 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Hypervisor/Node resource view: name=user free_ram=7376MB free_disk=24.774410247802734GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG nova.objects.instance [None req-6243d8da-d86c-401d-b652-9795868e035b tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Lazy-loading 'resources' on Instance uuid 45efac9f-8de9-43aa-b361-b5e4cf78795f {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2001bb95-9eec-4fbd-a7af-f176bd6f7334 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Acquiring lock "5b5ec5d3-fa6f-43de-b786-8c423064fe7a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2001bb95-9eec-4fbd-a7af-f176bd6f7334 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Lock "5b5ec5d3-fa6f-43de-b786-8c423064fe7a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:47:16 user nova-compute[75100]: INFO nova.compute.manager [None req-2001bb95-9eec-4fbd-a7af-f176bd6f7334 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Attaching volume 99db3b35-0a16-407d-976b-bd388c535b13 to /dev/sdc
Nov 10 17:47:16 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-6243d8da-d86c-401d-b652-9795868e035b tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:44:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-765158909',display_name='tempest-DeleteServersTestJSON-server-765158909',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-765158909',id=4,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T17:44:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5a2bbe56892041fc909c5664f9668d17',ramdisk_id='',reservation_id='r-ofawh396',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1805291581',owner_user_name='tempest-DeleteServersTestJSON-1805291581-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T17:44:40Z,user_data=None,user_id='b6f778e7dbee479a92186100c7ffb9b5',uuid=45efac9f-8de9-43aa-b361-b5e4cf78795f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c676ea25-33da-405a-84ac-9f0ad0308c08", "address": "fa:16:3e:ed:fe:82", "network": {"id": "92e0841d-9eee-49ac-8e59-0ddd4fc67c7d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2119900864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a2bbe56892041fc909c5664f9668d17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc676ea25-33", "ovs_interfaceid": "c676ea25-33da-405a-84ac-9f0ad0308c08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-6243d8da-d86c-401d-b652-9795868e035b tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Converting VIF {"id": "c676ea25-33da-405a-84ac-9f0ad0308c08", "address": "fa:16:3e:ed:fe:82", "network": {"id": "92e0841d-9eee-49ac-8e59-0ddd4fc67c7d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2119900864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a2bbe56892041fc909c5664f9668d17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc676ea25-33", "ovs_interfaceid": "c676ea25-33da-405a-84ac-9f0ad0308c08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-6243d8da-d86c-401d-b652-9795868e035b tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:fe:82,bridge_name='br-int',has_traffic_filtering=True,id=c676ea25-33da-405a-84ac-9f0ad0308c08,network=Network(92e0841d-9eee-49ac-8e59-0ddd4fc67c7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc676ea25-33') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG os_vif [None req-6243d8da-d86c-401d-b652-9795868e035b tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:fe:82,bridge_name='br-int',has_traffic_filtering=True,id=c676ea25-33da-405a-84ac-9f0ad0308c08,network=Network(92e0841d-9eee-49ac-8e59-0ddd4fc67c7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc676ea25-33') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc676ea25-33, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b8650ea5-2eae-4aea-951c-09151fec2d4c) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4574789c-f3c1-4727-86e0-74f673a36108 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4574789c-f3c1-4727-86e0-74f673a36108 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4574789c-f3c1-4727-86e0-74f673a36108 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] No VIF found with MAC fa:16:3e:55:c2:62, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:47:16 user nova-compute[75100]: INFO os_vif [None req-6243d8da-d86c-401d-b652-9795868e035b tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:fe:82,bridge_name='br-int',has_traffic_filtering=True,id=c676ea25-33da-405a-84ac-9f0ad0308c08,network=Network(92e0841d-9eee-49ac-8e59-0ddd4fc67c7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc676ea25-33')
Nov 10 17:47:16 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6243d8da-d86c-401d-b652-9795868e035b tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6243d8da-d86c-401d-b652-9795868e035b tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, {'target_iqn': 'iqn.2010-10.org.openstack:5a86192d-50c5-4a8c-a6cf-8931c0d48539', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GtnakmhN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 17:47:16 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-6243d8da-d86c-401d-b652-9795868e035b tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 17:47:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-6243d8da-d86c-401d-b652-9795868e035b tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-6243d8da-d86c-401d-b652-9795868e035b tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f962b79-d818-4975-8a96-485663a33d30]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a86192d-50c5-4a8c-a6cf-8931c0d48539\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6243d8da-d86c-401d-b652-9795868e035b tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 17:47:16 user nova-compute[75100]: No targets found.
Nov 10 17:47:16 user nova-compute[75100]: iSNS:
Nov 10 17:47:16 user nova-compute[75100]: No targets found.
Nov 10 17:47:16 user nova-compute[75100]: STATIC:
Nov 10 17:47:16 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb
Nov 10 17:47:16 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 17:47:16 user nova-compute[75100]:                 Iface Name: default
Nov 10 17:47:16 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8
Nov 10 17:47:16 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 17:47:16 user nova-compute[75100]:                 Iface Name: default
Nov 10 17:47:16 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:5a86192d-50c5-4a8c-a6cf-8931c0d48539
Nov 10 17:47:16 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 17:47:16 user nova-compute[75100]:                 Iface Name: default
Nov 10 17:47:16 user nova-compute[75100]: FIRMWARE:
Nov 10 17:47:16 user nova-compute[75100]: No targets found.
Nov 10 17:47:16 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6243d8da-d86c-401d-b652-9795868e035b tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 17:47:16 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 17:47:16 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6243d8da-d86c-401d-b652-9795868e035b tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a86192d-50c5-4a8c-a6cf-8931c0d48539', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG os_brick.utils [None req-2001bb95-9eec-4fbd-a7af-f176bd6f7334 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ffa4fa-aa9e-442f-844e-e34685d8a972]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a86192d-50c5-4a8c-a6cf-8931c0d48539\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.027s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c0c311-b767-4e10-861b-f0daa531d23a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90b1a229568f\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a590a70e-c516-46e6-b137-92b1c23ec746]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a86192d-50c5-4a8c-a6cf-8931c0d48539 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6243d8da-d86c-401d-b652-9795868e035b tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a86192d-50c5-4a8c-a6cf-8931c0d48539 (non-flash)
Nov 10 17:47:16 user nova-compute[75100]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb (non-flash)
Nov 10 17:47:16 user nova-compute[75100]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8 (non-flash)
Nov 10 17:47:16 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6243d8da-d86c-401d-b652-9795868e035b tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a86192d-50c5-4a8c-a6cf-8931c0d48539 (non-flash)
Nov 10 17:47:16 user nova-compute[75100]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb (non-flash)
Nov 10 17:47:16 user nova-compute[75100]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8 (non-flash)
Nov 10 17:47:16 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6243d8da-d86c-401d-b652-9795868e035b tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3bc6ce7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a86192d-50c5-4a8c-a6cf-8931c0d48539'): ({'sdb'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-6243d8da-d86c-401d-b652-9795868e035b tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Removing single pathed devices sdb {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.028s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c83a0c-8a95-4040-bd8f-57a4131f0ed3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[326b46af-b015-407d-ac99-2bbe4bee3ce0]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance c19fc271-a248-4631-a11f-89b7ed73bf85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 3e14de19-540d-4dc2-a058-6874d8d14478 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 45efac9f-8de9-43aa-b361-b5e4cf78795f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance ead532eb-c8be-45fa-a8b7-0b4c4f884a90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 5b5ec5d3-fa6f-43de-b786-8c423064fe7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 91238923-a64c-4f41-a046-be243eff880d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance c790b5c3-b255-430f-8654-f0ff5d54d48c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance db3f69df-51b2-464c-921e-33171e29f46d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 111bd74e-2943-4f12-9514-b564cf26dadb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.029s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[03bd815a-9137-4289-8e91-6f1f7eb5c930]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31f7b36-fb40-495d-88d0-eedf1532242f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-2001bb95-9eec-4fbd-a7af-f176bd6f7334 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-2001bb95-9eec-4fbd-a7af-f176bd6f7334 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[262437a6-8c4d-44b9-b891-481f3f49b45d]: (4, ('ok\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2001bb95-9eec-4fbd-a7af-f176bd6f7334 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-6243d8da-d86c-401d-b652-9795868e035b tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Flushing IO for device /dev/sdb {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4574789c-f3c1-4727-86e0-74f673a36108 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Lock "ead532eb-c8be-45fa-a8b7-0b4c4f884a90" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 30.584s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:47:16 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 17:47:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d9f409-f2c0-44b1-8757-48bb56d99751]: (4, '') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.027s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8175a512-fd1b-447c-8bbd-b0e3f8a6c44e]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-6243d8da-d86c-401d-b652-9795868e035b tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-2001bb95-9eec-4fbd-a7af-f176bd6f7334 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-2001bb95-9eec-4fbd-a7af-f176bd6f7334 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-2001bb95-9eec-4fbd-a7af-f176bd6f7334 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG os_brick.utils [None req-2001bb95-9eec-4fbd-a7af-f176bd6f7334 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] <== get_connector_properties: return (218ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90b1a229568f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-2001bb95-9eec-4fbd-a7af-f176bd6f7334 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Updating existing volume attachment record: ac04b060-aacc-410d-bf9e-26505b444ef8 {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[84442d26-4dfd-4b12-955a-dec5ab802a58]: (4, ('1', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-6243d8da-d86c-401d-b652-9795868e035b tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-6243d8da-d86c-401d-b652-9795868e035b tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6243d8da-d86c-401d-b652-9795868e035b tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a86192d-50c5-4a8c-a6cf-8931c0d48539')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a86192d-50c5-4a8c-a6cf-8931c0d48539 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a86192d-50c5-4a8c-a6cf-8931c0d48539 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[196eb4fa-8b65-40d7-9f60-d66d313535d8]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6243d8da-d86c-401d-b652-9795868e035b tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a86192d-50c5-4a8c-a6cf-8931c0d48539 -p 172.16.0.220:3260 --logout {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a86192d-50c5-4a8c-a6cf-8931c0d48539 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a919e2f-b5ca-402c-88a1-dfdb21f1b16b]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:5a86192d-50c5-4a8c-a6cf-8931c0d48539, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:5a86192d-50c5-4a8c-a6cf-8931c0d48539, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6243d8da-d86c-401d-b652-9795868e035b tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:5a86192d-50c5-4a8c-a6cf-8931c0d48539, portal: 172.16.0.220,3260]
Nov 10 17:47:16 user nova-compute[75100]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:5a86192d-50c5-4a8c-a6cf-8931c0d48539, portal: 172.16.0.220,3260] successful.
Nov 10 17:47:16 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a86192d-50c5-4a8c-a6cf-8931c0d48539 -p 172.16.0.220:3260 --op delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a86192d-50c5-4a8c-a6cf-8931c0d48539 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec3b5f0-46a9-4485-9da7-d33c2947ebef]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6243d8da-d86c-401d-b652-9795868e035b tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-6243d8da-d86c-401d-b652-9795868e035b tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.437s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6243d8da-d86c-401d-b652-9795868e035b tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] <== disconnect_volume: return (439ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6243d8da-d86c-401d-b652-9795868e035b tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 17:47:16 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-6243d8da-d86c-401d-b652-9795868e035b tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] Deleting instance files /opt/stack/data/nova/instances/45efac9f-8de9-43aa-b361-b5e4cf78795f_del
Nov 10 17:47:16 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-6243d8da-d86c-401d-b652-9795868e035b tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] Deletion of /opt/stack/data/nova/instances/45efac9f-8de9-43aa-b361-b5e4cf78795f_del complete
Nov 10 17:47:16 user nova-compute[75100]: INFO nova.compute.manager [None req-6243d8da-d86c-401d-b652-9795868e035b tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] Took 2.18 seconds to destroy the instance on the hypervisor.
Nov 10 17:47:16 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-6243d8da-d86c-401d-b652-9795868e035b tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 17:47:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.737s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:47:17 user nova-compute[75100]: DEBUG nova.compute.manager [req-be0a7439-c7d5-4f54-8e89-642965a03aa6 req-08d808a0-8ee9-400d-b7e8-4aee7b6bf492 service nova] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] Received event network-vif-plugged-c676ea25-33da-405a-84ac-9f0ad0308c08 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:47:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-be0a7439-c7d5-4f54-8e89-642965a03aa6 req-08d808a0-8ee9-400d-b7e8-4aee7b6bf492 service nova] Acquiring lock "45efac9f-8de9-43aa-b361-b5e4cf78795f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:47:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-be0a7439-c7d5-4f54-8e89-642965a03aa6 req-08d808a0-8ee9-400d-b7e8-4aee7b6bf492 service nova] Lock "45efac9f-8de9-43aa-b361-b5e4cf78795f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:47:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-be0a7439-c7d5-4f54-8e89-642965a03aa6 req-08d808a0-8ee9-400d-b7e8-4aee7b6bf492 service nova] Lock "45efac9f-8de9-43aa-b361-b5e4cf78795f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:47:17 user nova-compute[75100]: DEBUG nova.compute.manager [req-be0a7439-c7d5-4f54-8e89-642965a03aa6 req-08d808a0-8ee9-400d-b7e8-4aee7b6bf492 service nova] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] No waiting events found dispatching network-vif-plugged-c676ea25-33da-405a-84ac-9f0ad0308c08 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:47:17 user nova-compute[75100]: WARNING nova.compute.manager [req-be0a7439-c7d5-4f54-8e89-642965a03aa6 req-08d808a0-8ee9-400d-b7e8-4aee7b6bf492 service nova] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] Received unexpected event network-vif-plugged-c676ea25-33da-405a-84ac-9f0ad0308c08 for instance with vm_state active and task_state deleting.
Nov 10 17:47:17 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:47:17 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] Took 0.76 seconds to deallocate network for instance.
Nov 10 17:47:17 user nova-compute[75100]: DEBUG nova.compute.manager [req-8de3c6fa-8e3b-492d-9bdc-f359a8ab56a0 req-2a178017-1eb1-4557-a2d3-0ee494ed0590 service nova] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] Received event network-vif-deleted-c676ea25-33da-405a-84ac-9f0ad0308c08 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:47:17 user nova-compute[75100]: INFO nova.compute.manager [req-8de3c6fa-8e3b-492d-9bdc-f359a8ab56a0 req-2a178017-1eb1-4557-a2d3-0ee494ed0590 service nova] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] Neutron deleted interface c676ea25-33da-405a-84ac-9f0ad0308c08; detaching it from the instance and deleting it from the info cache
Nov 10 17:47:17 user nova-compute[75100]: DEBUG nova.network.neutron [req-8de3c6fa-8e3b-492d-9bdc-f359a8ab56a0 req-2a178017-1eb1-4557-a2d3-0ee494ed0590 service nova] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:47:17 user nova-compute[75100]: DEBUG nova.compute.manager [req-8de3c6fa-8e3b-492d-9bdc-f359a8ab56a0 req-2a178017-1eb1-4557-a2d3-0ee494ed0590 service nova] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] Detach interface failed, port_id=c676ea25-33da-405a-84ac-9f0ad0308c08, reason: Instance 45efac9f-8de9-43aa-b361-b5e4cf78795f could not be found. {{(pid=75100) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 17:47:17 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:47:17 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 17:47:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "refresh_cache-3e14de19-540d-4dc2-a058-6874d8d14478" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:47:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquired lock "refresh_cache-3e14de19-540d-4dc2-a058-6874d8d14478" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:47:18 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 17:47:18 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Updating instance_info_cache with network_info: [{"id": "d3f47ac6-ad90-4589-b41e-798c6fe6d5cf", "address": "fa:16:3e:b3:84:ec", "network": {"id": "26a554fe-9a5e-40c0-9981-5ac084c9ea73", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-269663495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19755f3e634fdfbd562c33fbfa2a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3f47ac6-ad", "ovs_interfaceid": "d3f47ac6-ad90-4589-b41e-798c6fe6d5cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:47:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Releasing lock "refresh_cache-3e14de19-540d-4dc2-a058-6874d8d14478" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:47:18 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 17:47:18 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:47:18 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:47:18 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:47:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c25b2780-4005-494a-9d39-001fe3d9ff47 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Acquiring lock "4487e074-c245-44b2-a77e-3f1acde34d45" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:47:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c25b2780-4005-494a-9d39-001fe3d9ff47 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lock "4487e074-c245-44b2-a77e-3f1acde34d45" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:47:18 user nova-compute[75100]: DEBUG nova.compute.manager [None req-c25b2780-4005-494a-9d39-001fe3d9ff47 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: 4487e074-c245-44b2-a77e-3f1acde34d45] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 17:47:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:47:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c25b2780-4005-494a-9d39-001fe3d9ff47 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:47:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c25b2780-4005-494a-9d39-001fe3d9ff47 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:47:18 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-c25b2780-4005-494a-9d39-001fe3d9ff47 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 17:47:18 user nova-compute[75100]: INFO nova.compute.claims [None req-c25b2780-4005-494a-9d39-001fe3d9ff47 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: 4487e074-c245-44b2-a77e-3f1acde34d45] Claim successful on node user
Nov 10 17:47:19 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-c25b2780-4005-494a-9d39-001fe3d9ff47 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:47:19 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-c25b2780-4005-494a-9d39-001fe3d9ff47 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:47:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c25b2780-4005-494a-9d39-001fe3d9ff47 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.469s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:47:19 user nova-compute[75100]: DEBUG nova.compute.manager [None req-c25b2780-4005-494a-9d39-001fe3d9ff47 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: 4487e074-c245-44b2-a77e-3f1acde34d45] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 17:47:19 user nova-compute[75100]: DEBUG nova.compute.manager [None req-c25b2780-4005-494a-9d39-001fe3d9ff47 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: 4487e074-c245-44b2-a77e-3f1acde34d45] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 17:47:19 user nova-compute[75100]: DEBUG nova.network.neutron [None req-c25b2780-4005-494a-9d39-001fe3d9ff47 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: 4487e074-c245-44b2-a77e-3f1acde34d45] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 17:47:19 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-c25b2780-4005-494a-9d39-001fe3d9ff47 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: 4487e074-c245-44b2-a77e-3f1acde34d45] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 17:47:19 user nova-compute[75100]: DEBUG nova.compute.manager [None req-c25b2780-4005-494a-9d39-001fe3d9ff47 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: 4487e074-c245-44b2-a77e-3f1acde34d45] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 17:47:19 user nova-compute[75100]: DEBUG nova.policy [None req-c25b2780-4005-494a-9d39-001fe3d9ff47 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b79cb22ab5774ce8991f237bd2204555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c970a503d74d32a1e2b71f086649fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 17:47:19 user nova-compute[75100]: INFO nova.virt.block_device [None req-c25b2780-4005-494a-9d39-001fe3d9ff47 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: 4487e074-c245-44b2-a77e-3f1acde34d45] Booting with blank volume at /dev/vda
Nov 10 17:47:20 user nova-compute[75100]: DEBUG nova.network.neutron [None req-c25b2780-4005-494a-9d39-001fe3d9ff47 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: 4487e074-c245-44b2-a77e-3f1acde34d45] Successfully created port: 2af34931-32be-4aa2-a74f-2ce9d0a3a6de {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 17:47:20 user nova-compute[75100]: DEBUG nova.network.neutron [None req-c25b2780-4005-494a-9d39-001fe3d9ff47 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: 4487e074-c245-44b2-a77e-3f1acde34d45] Successfully updated port: 2af34931-32be-4aa2-a74f-2ce9d0a3a6de {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 17:47:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c25b2780-4005-494a-9d39-001fe3d9ff47 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Acquiring lock "refresh_cache-4487e074-c245-44b2-a77e-3f1acde34d45" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:47:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c25b2780-4005-494a-9d39-001fe3d9ff47 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Acquired lock "refresh_cache-4487e074-c245-44b2-a77e-3f1acde34d45" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:47:20 user nova-compute[75100]: DEBUG nova.network.neutron [None req-c25b2780-4005-494a-9d39-001fe3d9ff47 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: 4487e074-c245-44b2-a77e-3f1acde34d45] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 17:47:20 user nova-compute[75100]: DEBUG nova.compute.manager [req-75d61642-6b13-4c42-b259-f6e2e1f53010 req-6aff1c4e-4357-43ef-9b0d-c16a9ed7641f service nova] [instance: 4487e074-c245-44b2-a77e-3f1acde34d45] Received event network-changed-2af34931-32be-4aa2-a74f-2ce9d0a3a6de {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:47:20 user nova-compute[75100]: DEBUG nova.compute.manager [req-75d61642-6b13-4c42-b259-f6e2e1f53010 req-6aff1c4e-4357-43ef-9b0d-c16a9ed7641f service nova] [instance: 4487e074-c245-44b2-a77e-3f1acde34d45] Refreshing instance network info cache due to event network-changed-2af34931-32be-4aa2-a74f-2ce9d0a3a6de. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 17:47:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-75d61642-6b13-4c42-b259-f6e2e1f53010 req-6aff1c4e-4357-43ef-9b0d-c16a9ed7641f service nova] Acquiring lock "refresh_cache-4487e074-c245-44b2-a77e-3f1acde34d45" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:47:20 user nova-compute[75100]: DEBUG nova.network.neutron [None req-c25b2780-4005-494a-9d39-001fe3d9ff47 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: 4487e074-c245-44b2-a77e-3f1acde34d45] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 17:47:21 user nova-compute[75100]: DEBUG nova.network.neutron [None req-c25b2780-4005-494a-9d39-001fe3d9ff47 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: 4487e074-c245-44b2-a77e-3f1acde34d45] Updating instance_info_cache with network_info: [{"id": "2af34931-32be-4aa2-a74f-2ce9d0a3a6de", "address": "fa:16:3e:34:8e:74", "network": {"id": "f240fae3-3d7b-4b6e-b04f-18550ab4d0a3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1007355777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c970a503d74d32a1e2b71f086649fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2af34931-32", "ovs_interfaceid": "2af34931-32be-4aa2-a74f-2ce9d0a3a6de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:47:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c25b2780-4005-494a-9d39-001fe3d9ff47 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Releasing lock "refresh_cache-4487e074-c245-44b2-a77e-3f1acde34d45" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:47:21 user nova-compute[75100]: DEBUG nova.compute.manager [None req-c25b2780-4005-494a-9d39-001fe3d9ff47 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: 4487e074-c245-44b2-a77e-3f1acde34d45] Instance network_info: |[{"id": "2af34931-32be-4aa2-a74f-2ce9d0a3a6de", "address": "fa:16:3e:34:8e:74", "network": {"id": "f240fae3-3d7b-4b6e-b04f-18550ab4d0a3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1007355777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c970a503d74d32a1e2b71f086649fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2af34931-32", "ovs_interfaceid": "2af34931-32be-4aa2-a74f-2ce9d0a3a6de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 17:47:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-75d61642-6b13-4c42-b259-f6e2e1f53010 req-6aff1c4e-4357-43ef-9b0d-c16a9ed7641f service nova] Acquired lock "refresh_cache-4487e074-c245-44b2-a77e-3f1acde34d45" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:47:21 user nova-compute[75100]: DEBUG nova.network.neutron [req-75d61642-6b13-4c42-b259-f6e2e1f53010 req-6aff1c4e-4357-43ef-9b0d-c16a9ed7641f service nova] [instance: 4487e074-c245-44b2-a77e-3f1acde34d45] Refreshing network info cache for port 2af34931-32be-4aa2-a74f-2ce9d0a3a6de {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 17:47:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:47:21 user nova-compute[75100]: DEBUG nova.network.neutron [req-75d61642-6b13-4c42-b259-f6e2e1f53010 req-6aff1c4e-4357-43ef-9b0d-c16a9ed7641f service nova] [instance: 4487e074-c245-44b2-a77e-3f1acde34d45] Updated VIF entry in instance network info cache for port 2af34931-32be-4aa2-a74f-2ce9d0a3a6de. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 17:47:21 user nova-compute[75100]: DEBUG nova.network.neutron [req-75d61642-6b13-4c42-b259-f6e2e1f53010 req-6aff1c4e-4357-43ef-9b0d-c16a9ed7641f service nova] [instance: 4487e074-c245-44b2-a77e-3f1acde34d45] Updating instance_info_cache with network_info: [{"id": "2af34931-32be-4aa2-a74f-2ce9d0a3a6de", "address": "fa:16:3e:34:8e:74", "network": {"id": "f240fae3-3d7b-4b6e-b04f-18550ab4d0a3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1007355777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c970a503d74d32a1e2b71f086649fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2af34931-32", "ovs_interfaceid": "2af34931-32be-4aa2-a74f-2ce9d0a3a6de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:47:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-75d61642-6b13-4c42-b259-f6e2e1f53010 req-6aff1c4e-4357-43ef-9b0d-c16a9ed7641f service nova] Releasing lock "refresh_cache-4487e074-c245-44b2-a77e-3f1acde34d45" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:47:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52aff789-0151-41ea-9083-92eb5ee16207 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] [instance: 91238923-a64c-4f41-a046-be243eff880d] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 17:47:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-52aff789-0151-41ea-9083-92eb5ee16207 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e4204104-cc65-42a9-9496-efb41c8f622d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jupJgOmR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 17:47:22 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-52aff789-0151-41ea-9083-92eb5ee16207 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 17:47:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-52aff789-0151-41ea-9083-92eb5ee16207 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 17:47:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-52aff789-0151-41ea-9083-92eb5ee16207 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 17:47:22 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-52aff789-0151-41ea-9083-92eb5ee16207 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 17:47:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-52aff789-0151-41ea-9083-92eb5ee16207 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4204104-cc65-42a9-9496-efb41c8f622d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 17:47:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-52aff789-0151-41ea-9083-92eb5ee16207 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4204104-cc65-42a9-9496-efb41c8f622d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 17:47:22 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-52aff789-0151-41ea-9083-92eb5ee16207 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 17:47:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4204104-cc65-42a9-9496-efb41c8f622d -p 172.16.0.220:3260 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4204104-cc65-42a9-9496-efb41c8f622d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9bd83a-d293-40d8-82c1-059f081614e0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-52aff789-0151-41ea-9083-92eb5ee16207 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 17:47:22 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:47:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4204104-cc65-42a9-9496-efb41c8f622d -p 172.16.0.220:3260 --interface default --op new {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4204104-cc65-42a9-9496-efb41c8f622d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae8c9fd-c505-44b1-be38-46a59797f474]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4204104-cc65-42a9-9496-efb41c8f622d] added\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-52aff789-0151-41ea-9083-92eb5ee16207 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4204104-cc65-42a9-9496-efb41c8f622d] added
Nov 10 17:47:22 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:47:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4204104-cc65-42a9-9496-efb41c8f622d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4204104-cc65-42a9-9496-efb41c8f622d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[405d46ad-d00a-4f77-85cb-e1be1ee608ff]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-52aff789-0151-41ea-9083-92eb5ee16207 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:47:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4204104-cc65-42a9-9496-efb41c8f622d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4204104-cc65-42a9-9496-efb41c8f622d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ceb49d5-4886-4898-a530-32f412138ebc]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-52aff789-0151-41ea-9083-92eb5ee16207 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:47:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4204104-cc65-42a9-9496-efb41c8f622d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jupJgOmR {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4204104-cc65-42a9-9496-efb41c8f622d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jupJgOmR" returned: 0 in 0.024s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[25cd3183-d222-4e6d-b723-1d761fee668d]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-52aff789-0151-41ea-9083-92eb5ee16207 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jupJgOmR'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:47:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4204104-cc65-42a9-9496-efb41c8f622d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4204104-cc65-42a9-9496-efb41c8f622d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[52eebd6d-378b-439a-93f1-9cd09e79576b]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-52aff789-0151-41ea-9083-92eb5ee16207 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:47:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f9902a-f277-45a7-aacb-a39da4dc0f03]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-52aff789-0151-41ea-9083-92eb5ee16207 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb (non-flash)
Nov 10 17:47:22 user nova-compute[75100]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8 (non-flash)
Nov 10 17:47:22 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:47:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-52aff789-0151-41ea-9083-92eb5ee16207 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb (non-flash)
Nov 10 17:47:22 user nova-compute[75100]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8 (non-flash)
Nov 10 17:47:22 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 17:47:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4204104-cc65-42a9-9496-efb41c8f622d -p 172.16.0.220:3260 --login {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4204104-cc65-42a9-9496-efb41c8f622d -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[00130061-012a-4b49-8bd6-99e5b6139685]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4204104-cc65-42a9-9496-efb41c8f622d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e4204104-cc65-42a9-9496-efb41c8f622d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-52aff789-0151-41ea-9083-92eb5ee16207 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4204104-cc65-42a9-9496-efb41c8f622d, portal: 172.16.0.220,3260]
Nov 10 17:47:22 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:e4204104-cc65-42a9-9496-efb41c8f622d, portal: 172.16.0.220,3260] successful.
Nov 10 17:47:22 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:47:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4204104-cc65-42a9-9496-efb41c8f622d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4204104-cc65-42a9-9496-efb41c8f622d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2d02d4-eeae-47c5-a3c7-3173dbdbaf00]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-52aff789-0151-41ea-9083-92eb5ee16207 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:47:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f86da8b9-5e26-4945-8fc8-c5a40b39bbaf]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4204104-cc65-42a9-9496-efb41c8f622d (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-52aff789-0151-41ea-9083-92eb5ee16207 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb (non-flash)
Nov 10 17:47:22 user nova-compute[75100]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8 (non-flash)
Nov 10 17:47:22 user nova-compute[75100]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4204104-cc65-42a9-9496-efb41c8f622d (non-flash)
Nov 10 17:47:22 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:47:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-52aff789-0151-41ea-9083-92eb5ee16207 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb (non-flash)
Nov 10 17:47:22 user nova-compute[75100]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8 (non-flash)
Nov 10 17:47:22 user nova-compute[75100]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4204104-cc65-42a9-9496-efb41c8f622d (non-flash)
Nov 10 17:47:22 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 17:47:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-52aff789-0151-41ea-9083-92eb5ee16207 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4204104-cc65-42a9-9496-efb41c8f622d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 17:47:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-52aff789-0151-41ea-9083-92eb5ee16207 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 17:47:22 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-52aff789-0151-41ea-9083-92eb5ee16207 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] HCTL ('33', '-', '-', 0) found on session 5 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 17:47:22 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-52aff789-0151-41ea-9083-92eb5ee16207 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 17:47:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e113506-ca64-4394-872f-0b5e1a670dbd]: (4, ('- - 0', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:22 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-52aff789-0151-41ea-9083-92eb5ee16207 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Searching for a device in session 5 and hctl ['33', '*', '*', 0] yield: None {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 17:47:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7fc52181-c4fd-4925-9ce9-7570afd1d76d tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 17:47:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fc52181-c4fd-4925-9ce9-7570afd1d76d tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d0b96731-b07d-4c4b-aa76-15b097d270b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YUnATLXM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 17:47:22 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-7fc52181-c4fd-4925-9ce9-7570afd1d76d tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 17:47:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-7fc52181-c4fd-4925-9ce9-7570afd1d76d tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 17:47:23 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-52aff789-0151-41ea-9083-92eb5ee16207 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Searching for a device in session 5 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 17:47:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-52aff789-0151-41ea-9083-92eb5ee16207 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e4204104-cc65-42a9-9496-efb41c8f622d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jupJgOmR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 17:47:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-52aff789-0151-41ea-9083-92eb5ee16207 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 17:47:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-52aff789-0151-41ea-9083-92eb5ee16207 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '23332633164633839', 'path': '/dev/sdb'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 17:47:23 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52aff789-0151-41ea-9083-92eb5ee16207 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] [instance: 91238923-a64c-4f41-a046-be243eff880d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23332633164633839', 'path': '/dev/sdb'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 17:47:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-7fc52181-c4fd-4925-9ce9-7570afd1d76d tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.712s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 17:47:23 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-7fc52181-c4fd-4925-9ce9-7570afd1d76d tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 17:47:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-7fc52181-c4fd-4925-9ce9-7570afd1d76d tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0b96731-b07d-4c4b-aa76-15b097d270b4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 17:47:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-7fc52181-c4fd-4925-9ce9-7570afd1d76d tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0b96731-b07d-4c4b-aa76-15b097d270b4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 17:47:23 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-7fc52181-c4fd-4925-9ce9-7570afd1d76d tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 17:47:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0b96731-b07d-4c4b-aa76-15b097d270b4 -p 172.16.0.220:3260 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0b96731-b07d-4c4b-aa76-15b097d270b4 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:23 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e400414-9f91-4a27-bf9d-37f7f6f55afd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fc52181-c4fd-4925-9ce9-7570afd1d76d tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 17:47:23 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:47:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0b96731-b07d-4c4b-aa76-15b097d270b4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:23 user nova-compute[75100]: DEBUG nova.objects.instance [None req-52aff789-0151-41ea-9083-92eb5ee16207 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Lazy-loading 'flavor' on Instance uuid 91238923-a64c-4f41-a046-be243eff880d {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:47:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0b96731-b07d-4c4b-aa76-15b097d270b4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.044s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:23 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[db204e06-85f8-47e4-a390-84f22144c18a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d0b96731-b07d-4c4b-aa76-15b097d270b4] added\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fc52181-c4fd-4925-9ce9-7570afd1d76d tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d0b96731-b07d-4c4b-aa76-15b097d270b4] added
Nov 10 17:47:23 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:47:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0b96731-b07d-4c4b-aa76-15b097d270b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:23 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-52aff789-0151-41ea-9083-92eb5ee16207 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 17:47:23 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 17:47:23 user nova-compute[75100]:   <source dev="/dev/sdb"/>
Nov 10 17:47:23 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 17:47:23 user nova-compute[75100]:   <serial>e4204104-cc65-42a9-9496-efb41c8f622d</serial>
Nov 10 17:47:23 user nova-compute[75100]: </disk>
Nov 10 17:47:23 user nova-compute[75100]:  {{(pid=75100) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 17:47:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0b96731-b07d-4c4b-aa76-15b097d270b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:23 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ca471c-c628-4a19-b917-4377e77b85a1]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fc52181-c4fd-4925-9ce9-7570afd1d76d tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:47:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0b96731-b07d-4c4b-aa76-15b097d270b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0b96731-b07d-4c4b-aa76-15b097d270b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:23 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab53ae51-6908-4b36-a9fc-94f7234aa9a5]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fc52181-c4fd-4925-9ce9-7570afd1d76d tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:47:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0b96731-b07d-4c4b-aa76-15b097d270b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YUnATLXM {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0b96731-b07d-4c4b-aa76-15b097d270b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YUnATLXM" returned: 0 in 0.022s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:23 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7819ea-0ebe-4c0d-9323-adaf5bc62207]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fc52181-c4fd-4925-9ce9-7570afd1d76d tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YUnATLXM'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:47:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0b96731-b07d-4c4b-aa76-15b097d270b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0b96731-b07d-4c4b-aa76-15b097d270b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:23 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c869af5-56b3-4b79-9e0a-8c1b40d5803d]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fc52181-c4fd-4925-9ce9-7570afd1d76d tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:47:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:23 user nova-compute[75100]: INFO nova.compute.manager [None req-6243d8da-d86c-401d-b652-9795868e035b tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] [instance: 45efac9f-8de9-43aa-b361-b5e4cf78795f] Took 6.10 seconds to detach 1 volumes for instance.
Nov 10 17:47:23 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0789c24-dc38-4801-a712-d75ffa64d9d8]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4204104-cc65-42a9-9496-efb41c8f622d (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fc52181-c4fd-4925-9ce9-7570afd1d76d tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb (non-flash)
Nov 10 17:47:23 user nova-compute[75100]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8 (non-flash)
Nov 10 17:47:23 user nova-compute[75100]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4204104-cc65-42a9-9496-efb41c8f622d (non-flash)
Nov 10 17:47:23 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:47:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fc52181-c4fd-4925-9ce9-7570afd1d76d tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb (non-flash)
Nov 10 17:47:23 user nova-compute[75100]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8 (non-flash)
Nov 10 17:47:23 user nova-compute[75100]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4204104-cc65-42a9-9496-efb41c8f622d (non-flash)
Nov 10 17:47:23 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 17:47:23 user nova-compute[75100]: DEBUG nova.compute.manager [req-1d55a0de-f115-41fe-94e1-8ab789d922be req-2e7a9f75-b77c-498d-b554-115e9c9585f4 service nova] [instance: db3f69df-51b2-464c-921e-33171e29f46d] Received event network-changed-6dee04b2-6df4-439f-93de-f474b077cd60 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:47:23 user nova-compute[75100]: DEBUG nova.compute.manager [req-1d55a0de-f115-41fe-94e1-8ab789d922be req-2e7a9f75-b77c-498d-b554-115e9c9585f4 service nova] [instance: db3f69df-51b2-464c-921e-33171e29f46d] Refreshing instance network info cache due to event network-changed-6dee04b2-6df4-439f-93de-f474b077cd60. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 17:47:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-1d55a0de-f115-41fe-94e1-8ab789d922be req-2e7a9f75-b77c-498d-b554-115e9c9585f4 service nova] Acquiring lock "refresh_cache-db3f69df-51b2-464c-921e-33171e29f46d" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:47:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-1d55a0de-f115-41fe-94e1-8ab789d922be req-2e7a9f75-b77c-498d-b554-115e9c9585f4 service nova] Acquired lock "refresh_cache-db3f69df-51b2-464c-921e-33171e29f46d" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:47:23 user nova-compute[75100]: DEBUG nova.network.neutron [req-1d55a0de-f115-41fe-94e1-8ab789d922be req-2e7a9f75-b77c-498d-b554-115e9c9585f4 service nova] [instance: db3f69df-51b2-464c-921e-33171e29f46d] Refreshing network info cache for port 6dee04b2-6df4-439f-93de-f474b077cd60 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 17:47:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0b96731-b07d-4c4b-aa76-15b097d270b4 -p 172.16.0.220:3260 --login {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:47:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0b96731-b07d-4c4b-aa76-15b097d270b4 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:23 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d34d23-1f68-4e04-be48-b60112623446]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d0b96731-b07d-4c4b-aa76-15b097d270b4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d0b96731-b07d-4c4b-aa76-15b097d270b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fc52181-c4fd-4925-9ce9-7570afd1d76d tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d0b96731-b07d-4c4b-aa76-15b097d270b4, portal: 172.16.0.220,3260]
Nov 10 17:47:23 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:d0b96731-b07d-4c4b-aa76-15b097d270b4, portal: 172.16.0.220,3260] successful.
Nov 10 17:47:23 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:47:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0b96731-b07d-4c4b-aa76-15b097d270b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6243d8da-d86c-401d-b652-9795868e035b tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:47:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6243d8da-d86c-401d-b652-9795868e035b tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:47:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0b96731-b07d-4c4b-aa76-15b097d270b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:23 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[98893833-4b3a-4b9e-bce0-81b81baa262e]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fc52181-c4fd-4925-9ce9-7570afd1d76d tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:47:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:23 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71ca321-7e48-4303-a552-58efec9bc5e3]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4204104-cc65-42a9-9496-efb41c8f622d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b96731-b07d-4c4b-aa76-15b097d270b4 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fc52181-c4fd-4925-9ce9-7570afd1d76d tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb (non-flash)
Nov 10 17:47:23 user nova-compute[75100]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8 (non-flash)
Nov 10 17:47:23 user nova-compute[75100]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4204104-cc65-42a9-9496-efb41c8f622d (non-flash)
Nov 10 17:47:23 user nova-compute[75100]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b96731-b07d-4c4b-aa76-15b097d270b4 (non-flash)
Nov 10 17:47:23 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:47:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fc52181-c4fd-4925-9ce9-7570afd1d76d tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb (non-flash)
Nov 10 17:47:23 user nova-compute[75100]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8 (non-flash)
Nov 10 17:47:23 user nova-compute[75100]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4204104-cc65-42a9-9496-efb41c8f622d (non-flash)
Nov 10 17:47:23 user nova-compute[75100]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b96731-b07d-4c4b-aa76-15b097d270b4 (non-flash)
Nov 10 17:47:23 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 17:47:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-7fc52181-c4fd-4925-9ce9-7570afd1d76d tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0b96731-b07d-4c4b-aa76-15b097d270b4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.420s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 17:47:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fc52181-c4fd-4925-9ce9-7570afd1d76d tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 17:47:23 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-7fc52181-c4fd-4925-9ce9-7570afd1d76d tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 17:47:23 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-7fc52181-c4fd-4925-9ce9-7570afd1d76d tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 17:47:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.027s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:23 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0a3832-79c7-4e92-a1ae-ab3007c7d6ea]: (4, ('- - 0', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:23 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-7fc52181-c4fd-4925-9ce9-7570afd1d76d tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 17:47:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fc52181-c4fd-4925-9ce9-7570afd1d76d tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:d0b96731-b07d-4c4b-aa76-15b097d270b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YUnATLXM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 17:47:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ffe8abf1-8810-4412-abd1-001a8a9e15dc tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Acquiring lock "db3f69df-51b2-464c-921e-33171e29f46d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:47:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ffe8abf1-8810-4412-abd1-001a8a9e15dc tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Lock "db3f69df-51b2-464c-921e-33171e29f46d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:47:24 user nova-compute[75100]: DEBUG nova.objects.instance [None req-ffe8abf1-8810-4412-abd1-001a8a9e15dc tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Lazy-loading 'flavor' on Instance uuid db3f69df-51b2-464c-921e-33171e29f46d {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:47:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-52aff789-0151-41ea-9083-92eb5ee16207 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 17:47:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-52aff789-0151-41ea-9083-92eb5ee16207 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] No BDM found with device name hda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 17:47:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-52aff789-0151-41ea-9083-92eb5ee16207 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] No VIF found with MAC fa:16:3e:8e:18:ef, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 17:47:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ffe8abf1-8810-4412-abd1-001a8a9e15dc tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Lock "db3f69df-51b2-464c-921e-33171e29f46d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.094s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:47:24 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-6243d8da-d86c-401d-b652-9795868e035b tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:47:24 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-6243d8da-d86c-401d-b652-9795868e035b tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:47:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-52aff789-0151-41ea-9083-92eb5ee16207 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Lock "91238923-a64c-4f41-a046-be243eff880d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 30.657s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:47:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6243d8da-d86c-401d-b652-9795868e035b tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.526s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:47:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ffe8abf1-8810-4412-abd1-001a8a9e15dc tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Acquiring lock "db3f69df-51b2-464c-921e-33171e29f46d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:47:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ffe8abf1-8810-4412-abd1-001a8a9e15dc tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Lock "db3f69df-51b2-464c-921e-33171e29f46d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:47:24 user nova-compute[75100]: INFO nova.compute.manager [None req-ffe8abf1-8810-4412-abd1-001a8a9e15dc tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] [instance: db3f69df-51b2-464c-921e-33171e29f46d] Attaching volume deb00979-ec6a-493d-9c69-a088a9fd213a to /dev/vdb
Nov 10 17:47:24 user nova-compute[75100]: DEBUG nova.network.neutron [req-1d55a0de-f115-41fe-94e1-8ab789d922be req-2e7a9f75-b77c-498d-b554-115e9c9585f4 service nova] [instance: db3f69df-51b2-464c-921e-33171e29f46d] Updated VIF entry in instance network info cache for port 6dee04b2-6df4-439f-93de-f474b077cd60. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 17:47:24 user nova-compute[75100]: DEBUG nova.network.neutron [req-1d55a0de-f115-41fe-94e1-8ab789d922be req-2e7a9f75-b77c-498d-b554-115e9c9585f4 service nova] [instance: db3f69df-51b2-464c-921e-33171e29f46d] Updating instance_info_cache with network_info: [{"id": "6dee04b2-6df4-439f-93de-f474b077cd60", "address": "fa:16:3e:0c:f1:29", "network": {"id": "d5116328-c56e-407f-8316-5ebbd31e8e64", "bridge": "br-int", "label": "tempest-TestVolumeSwap-528250751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e29209a67b9d48bd8067be38d95ea656", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dee04b2-6d", "ovs_interfaceid": "6dee04b2-6df4-439f-93de-f474b077cd60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:47:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fa7532bb-ba7e-47d5-a542-d364fb08be7e tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Acquiring lock "ead532eb-c8be-45fa-a8b7-0b4c4f884a90" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:47:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fa7532bb-ba7e-47d5-a542-d364fb08be7e tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Lock "ead532eb-c8be-45fa-a8b7-0b4c4f884a90" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:47:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-1d55a0de-f115-41fe-94e1-8ab789d922be req-2e7a9f75-b77c-498d-b554-115e9c9585f4 service nova] Releasing lock "refresh_cache-db3f69df-51b2-464c-921e-33171e29f46d" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:47:24 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-6243d8da-d86c-401d-b652-9795868e035b tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Deleted allocations for instance 45efac9f-8de9-43aa-b361-b5e4cf78795f
Nov 10 17:47:24 user nova-compute[75100]: INFO nova.compute.manager [None req-fa7532bb-ba7e-47d5-a542-d364fb08be7e tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Detaching volume 50317e9e-0c4a-4dda-87bc-7e3a23b299b8
Nov 10 17:47:24 user nova-compute[75100]: DEBUG os_brick.utils [None req-ffe8abf1-8810-4412-abd1-001a8a9e15dc tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 17:47:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:24 user nova-compute[75100]: INFO nova.virt.block_device [None req-fa7532bb-ba7e-47d5-a542-d364fb08be7e tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Attempting to driver detach volume 50317e9e-0c4a-4dda-87bc-7e3a23b299b8 from mountpoint /dev/vdb
Nov 10 17:47:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:24 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4963bdb5-d311-40c0-9cb2-31ef894a39b3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90b1a229568f\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fa7532bb-ba7e-47d5-a542-d364fb08be7e tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Attempting to detach device vdb from instance ead532eb-c8be-45fa-a8b7-0b4c4f884a90 from the persistent domain config. {{(pid=75100) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 17:47:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-fa7532bb-ba7e-47d5-a542-d364fb08be7e tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 17:47:24 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 17:47:24 user nova-compute[75100]:   <source dev="/dev/sdd"/>
Nov 10 17:47:24 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 17:47:24 user nova-compute[75100]:   <serial>50317e9e-0c4a-4dda-87bc-7e3a23b299b8</serial>
Nov 10 17:47:24 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 17:47:24 user nova-compute[75100]: </disk>
Nov 10 17:47:24 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 17:47:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:24 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-fa7532bb-ba7e-47d5-a542-d364fb08be7e tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Successfully detached device vdb from instance ead532eb-c8be-45fa-a8b7-0b4c4f884a90 from the persistent domain config.
Nov 10 17:47:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fa7532bb-ba7e-47d5-a542-d364fb08be7e tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ead532eb-c8be-45fa-a8b7-0b4c4f884a90 from the live domain config. {{(pid=75100) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 17:47:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-fa7532bb-ba7e-47d5-a542-d364fb08be7e tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 17:47:24 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 17:47:24 user nova-compute[75100]:   <source dev="/dev/sdd"/>
Nov 10 17:47:24 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 17:47:24 user nova-compute[75100]:   <serial>50317e9e-0c4a-4dda-87bc-7e3a23b299b8</serial>
Nov 10 17:47:24 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 17:47:24 user nova-compute[75100]: </disk>
Nov 10 17:47:24 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 17:47:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:24 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26494e8-db71-41be-8352-abcf33118e6a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6243d8da-d86c-401d-b652-9795868e035b tempest-DeleteServersTestJSON-1805291581 tempest-DeleteServersTestJSON-1805291581-project-member] Lock "45efac9f-8de9-43aa-b361-b5e4cf78795f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.901s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:47:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:24 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4e4670-f94c-45b2-9eeb-834e0b344637]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:24 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0cb0db-8bdd-4bb5-9978-7d613b4032d1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ffe8abf1-8810-4412-abd1-001a8a9e15dc tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ffe8abf1-8810-4412-abd1-001a8a9e15dc tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 17:47:24 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ffe8abf1-8810-4412-abd1-001a8a9e15dc tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 17:47:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 17:47:24 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 17:47:24 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ed56ab-15fd-419b-a299-a8eb14586711]: (4, '') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:24 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-ffe8abf1-8810-4412-abd1-001a8a9e15dc tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 17:47:24 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-ffe8abf1-8810-4412-abd1-001a8a9e15dc tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 17:47:24 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-ffe8abf1-8810-4412-abd1-001a8a9e15dc tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 17:47:24 user nova-compute[75100]: DEBUG os_brick.utils [None req-ffe8abf1-8810-4412-abd1-001a8a9e15dc tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90b1a229568f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 17:47:24 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-ffe8abf1-8810-4412-abd1-001a8a9e15dc tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] [instance: db3f69df-51b2-464c-921e-33171e29f46d] Updating existing volume attachment record: c53b9a08-099f-46a2-a0ae-e4043d6346ad {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 17:47:24 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-7fc52181-c4fd-4925-9ce9-7570afd1d76d tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.480s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 17:47:24 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fc52181-c4fd-4925-9ce9-7570afd1d76d tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] <== connect_volume: return (2193ms) {'type': 'block', 'scsi_wwn': '23362663362346664', 'path': '/dev/sde'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 17:47:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7fc52181-c4fd-4925-9ce9-7570afd1d76d tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23362663362346664', 'path': '/dev/sde'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 17:47:24 user nova-compute[75100]: DEBUG nova.objects.instance [None req-7fc52181-c4fd-4925-9ce9-7570afd1d76d tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] Lazy-loading 'flavor' on Instance uuid c790b5c3-b255-430f-8654-f0ff5d54d48c {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:47:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fa7532bb-ba7e-47d5-a542-d364fb08be7e tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ead532eb-c8be-45fa-a8b7-0b4c4f884a90 {{(pid=75100) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 17:47:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-7fc52181-c4fd-4925-9ce9-7570afd1d76d tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] attach device xml: <disk type="block" device="disk">
Nov 10 17:47:25 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 17:47:25 user nova-compute[75100]:   <source dev="/dev/sde"/>
Nov 10 17:47:25 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 17:47:25 user nova-compute[75100]:   <serial>d0b96731-b07d-4c4b-aa76-15b097d270b4</serial>
Nov 10 17:47:25 user nova-compute[75100]: </disk>
Nov 10 17:47:25 user nova-compute[75100]:  {{(pid=75100) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 17:47:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7fc52181-c4fd-4925-9ce9-7570afd1d76d tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 17:47:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7fc52181-c4fd-4925-9ce9-7570afd1d76d tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 17:47:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7fc52181-c4fd-4925-9ce9-7570afd1d76d tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] No VIF found with MAC fa:16:3e:e4:af:16, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 17:47:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7fc52181-c4fd-4925-9ce9-7570afd1d76d tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] Lock "c790b5c3-b255-430f-8654-f0ff5d54d48c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 31.335s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:47:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-19959c89-aeca-448b-aff2-0c691f45ef0d tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Acquiring lock "91238923-a64c-4f41-a046-be243eff880d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:47:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-19959c89-aeca-448b-aff2-0c691f45ef0d tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Lock "91238923-a64c-4f41-a046-be243eff880d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:47:26 user nova-compute[75100]: INFO nova.compute.manager [None req-19959c89-aeca-448b-aff2-0c691f45ef0d tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] [instance: 91238923-a64c-4f41-a046-be243eff880d] Detaching volume e4204104-cc65-42a9-9496-efb41c8f622d
Nov 10 17:47:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:47:26 user nova-compute[75100]: INFO nova.virt.block_device [None req-19959c89-aeca-448b-aff2-0c691f45ef0d tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] [instance: 91238923-a64c-4f41-a046-be243eff880d] Attempting to driver detach volume e4204104-cc65-42a9-9496-efb41c8f622d from mountpoint /dev/vdb
Nov 10 17:47:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-19959c89-aeca-448b-aff2-0c691f45ef0d tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Attempting to detach device vdb from instance 91238923-a64c-4f41-a046-be243eff880d from the persistent domain config. {{(pid=75100) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 17:47:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-19959c89-aeca-448b-aff2-0c691f45ef0d tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 17:47:26 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 17:47:26 user nova-compute[75100]:   <source dev="/dev/sdb"/>
Nov 10 17:47:26 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 17:47:26 user nova-compute[75100]:   <serial>e4204104-cc65-42a9-9496-efb41c8f622d</serial>
Nov 10 17:47:26 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 10 17:47:26 user nova-compute[75100]: </disk>
Nov 10 17:47:26 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 17:47:26 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-19959c89-aeca-448b-aff2-0c691f45ef0d tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Successfully detached device vdb from instance 91238923-a64c-4f41-a046-be243eff880d from the persistent domain config.
Nov 10 17:47:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-19959c89-aeca-448b-aff2-0c691f45ef0d tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 91238923-a64c-4f41-a046-be243eff880d from the live domain config. {{(pid=75100) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 17:47:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-19959c89-aeca-448b-aff2-0c691f45ef0d tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 17:47:26 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 17:47:26 user nova-compute[75100]:   <source dev="/dev/sdb"/>
Nov 10 17:47:26 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 17:47:26 user nova-compute[75100]:   <serial>e4204104-cc65-42a9-9496-efb41c8f622d</serial>
Nov 10 17:47:26 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 10 17:47:26 user nova-compute[75100]: </disk>
Nov 10 17:47:26 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 17:47:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-94a151b1-992e-427e-bfb3-ffad0e118f6b tempest-VolumesAssistedSnapshotsTest-1204665407 tempest-VolumesAssistedSnapshotsTest-1204665407-project] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] volume_snapshot_create: create_info: {'snapshot_id': '50788795-96d6-4f37-a6a7-533b398b32f1', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75100) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 10 17:47:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-94a151b1-992e-427e-bfb3-ffad0e118f6b tempest-VolumesAssistedSnapshotsTest-1204665407 tempest-VolumesAssistedSnapshotsTest-1204665407-project] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] snap xml: <domainsnapshot>
Nov 10 17:47:26 user nova-compute[75100]:   <disks>
Nov 10 17:47:26 user nova-compute[75100]:     <disk name="/dev/sde" snapshot="external" type="file">
Nov 10 17:47:26 user nova-compute[75100]:       <source file="/dev/new_file"/>
Nov 10 17:47:26 user nova-compute[75100]:     </disk>
Nov 10 17:47:26 user nova-compute[75100]:     <disk name="vda" snapshot="no"/>
Nov 10 17:47:26 user nova-compute[75100]:   </disks>
Nov 10 17:47:26 user nova-compute[75100]: </domainsnapshot>
Nov 10 17:47:26 user nova-compute[75100]:  {{(pid=75100) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 10 17:47:26 user nova-compute[75100]: DEBUG nova.objects.instance [None req-94a151b1-992e-427e-bfb3-ffad0e118f6b tempest-VolumesAssistedSnapshotsTest-1204665407 tempest-VolumesAssistedSnapshotsTest-1204665407-project] Lazy-loading 'system_metadata' on Instance uuid c790b5c3-b255-430f-8654-f0ff5d54d48c {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:47:26 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-94a151b1-992e-427e-bfb3-ffad0e118f6b tempest-VolumesAssistedSnapshotsTest-1204665407 tempest-VolumesAssistedSnapshotsTest-1204665407-project] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [None req-94a151b1-992e-427e-bfb3-ffad0e118f6b tempest-VolumesAssistedSnapshotsTest-1204665407 tempest-VolumesAssistedSnapshotsTest-1204665407-project] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Traceback (most recent call last):
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c]     rv = execute(f, *args, **kwargs)
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c]     six.reraise(c, e, tb)
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c]     raise value
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c]     rv = meth(*args, **kwargs)
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] 
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [None req-94a151b1-992e-427e-bfb3-ffad0e118f6b tempest-VolumesAssistedSnapshotsTest-1204665407 tempest-VolumesAssistedSnapshotsTest-1204665407-project] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Traceback (most recent call last):
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c]     self._volume_snapshot_create(context, instance, guest,
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c]     rv = execute(f, *args, **kwargs)
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c]     six.reraise(c, e, tb)
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c]     raise value
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c]     rv = meth(*args, **kwargs)
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] 
Nov 10 17:47:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-eccbd02c-6a9d-49f6-9b0a-f5aaed780c68 tempest-VolumesAssistedSnapshotsTest-1204665407 tempest-VolumesAssistedSnapshotsTest-1204665407-project] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] volume_snapshot_delete: delete_info: {'volume_id': 'd0b96731-b07d-4c4b-aa76-15b097d270b4'} {{(pid=75100) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [None req-eccbd02c-6a9d-49f6-9b0a-f5aaed780c68 tempest-VolumesAssistedSnapshotsTest-1204665407 tempest-VolumesAssistedSnapshotsTest-1204665407-project] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Traceback (most recent call last):
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c]     if delete_info['type'] != 'qcow2':
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] KeyError: 'type'
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] 
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [None req-94a151b1-992e-427e-bfb3-ffad0e118f6b tempest-VolumesAssistedSnapshotsTest-1204665407 tempest-VolumesAssistedSnapshotsTest-1204665407-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 50788795-96d6-4f37-a6a7-533b398b32f1 could not be found.
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     raise value
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver 
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver 
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 50788795-96d6-4f37-a6a7-533b398b32f1 could not be found. (HTTP 404) (Request-ID: req-58c2845c-570f-4373-9bcb-c21afac9b727)
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver 
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver 
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 50788795-96d6-4f37-a6a7-533b398b32f1 could not be found.
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver 
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server [None req-94a151b1-992e-427e-bfb3-ffad0e118f6b tempest-VolumesAssistedSnapshotsTest-1204665407 tempest-VolumesAssistedSnapshotsTest-1204665407-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     raise value
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server 
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [None req-eccbd02c-6a9d-49f6-9b0a-f5aaed780c68 tempest-VolumesAssistedSnapshotsTest-1204665407 tempest-VolumesAssistedSnapshotsTest-1204665407-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver 
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver 
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-5e6af660-272f-4a6b-8c6f-80330e678832)
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver 
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver 
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 10 17:47:26 user nova-compute[75100]: ERROR nova.virt.libvirt.driver 
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server [None req-eccbd02c-6a9d-49f6-9b0a-f5aaed780c68 tempest-VolumesAssistedSnapshotsTest-1204665407 tempest-VolumesAssistedSnapshotsTest-1204665407-project] Exception during message handling: KeyError: 'type'
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 10 17:47:26 user nova-compute[75100]: ERROR oslo_messaging.rpc.server 
Nov 10 17:47:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-19959c89-aeca-448b-aff2-0c691f45ef0d tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 91238923-a64c-4f41-a046-be243eff880d {{(pid=75100) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 17:47:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6756fc07-4c6a-49e1-b9c1-54e168e1268c tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] Acquiring lock "c790b5c3-b255-430f-8654-f0ff5d54d48c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:47:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6756fc07-4c6a-49e1-b9c1-54e168e1268c tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] Lock "c790b5c3-b255-430f-8654-f0ff5d54d48c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:47:27 user nova-compute[75100]: INFO nova.compute.manager [None req-6756fc07-4c6a-49e1-b9c1-54e168e1268c tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Detaching volume d0b96731-b07d-4c4b-aa76-15b097d270b4
Nov 10 17:47:27 user nova-compute[75100]: INFO nova.virt.block_device [None req-6756fc07-4c6a-49e1-b9c1-54e168e1268c tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Attempting to driver detach volume d0b96731-b07d-4c4b-aa76-15b097d270b4 from mountpoint /dev/vdb
Nov 10 17:47:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6756fc07-4c6a-49e1-b9c1-54e168e1268c tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] Attempting to detach device vdb from instance c790b5c3-b255-430f-8654-f0ff5d54d48c from the persistent domain config. {{(pid=75100) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 17:47:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-6756fc07-4c6a-49e1-b9c1-54e168e1268c tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] detach device xml: <disk type="block" device="disk">
Nov 10 17:47:27 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 17:47:27 user nova-compute[75100]:   <source dev="/dev/sde"/>
Nov 10 17:47:27 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 17:47:27 user nova-compute[75100]:   <serial>d0b96731-b07d-4c4b-aa76-15b097d270b4</serial>
Nov 10 17:47:27 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 17:47:27 user nova-compute[75100]: </disk>
Nov 10 17:47:27 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 17:47:27 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-6756fc07-4c6a-49e1-b9c1-54e168e1268c tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] Successfully detached device vdb from instance c790b5c3-b255-430f-8654-f0ff5d54d48c from the persistent domain config.
Nov 10 17:47:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6756fc07-4c6a-49e1-b9c1-54e168e1268c tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c790b5c3-b255-430f-8654-f0ff5d54d48c from the live domain config. {{(pid=75100) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 17:47:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-6756fc07-4c6a-49e1-b9c1-54e168e1268c tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] detach device xml: <disk type="block" device="disk">
Nov 10 17:47:27 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 17:47:27 user nova-compute[75100]:   <source dev="/dev/sde"/>
Nov 10 17:47:27 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 17:47:27 user nova-compute[75100]:   <serial>d0b96731-b07d-4c4b-aa76-15b097d270b4</serial>
Nov 10 17:47:27 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 17:47:27 user nova-compute[75100]: </disk>
Nov 10 17:47:27 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 17:47:28 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6756fc07-4c6a-49e1-b9c1-54e168e1268c tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c790b5c3-b255-430f-8654-f0ff5d54d48c {{(pid=75100) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 17:47:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:47:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:47:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:47:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:47:34 user nova-compute[75100]: DEBUG os_brick.utils [None req-c25b2780-4005-494a-9d39-001fe3d9ff47 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 17:47:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:34 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1818f59-9e7c-49e4-8146-d2895fa518fe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90b1a229568f\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:34 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0cb9d3a-c509-4b2d-b68e-7bbf5619a98e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:34 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[92518a8a-163e-4d72-ba91-4a5a8ff5b0a5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:34 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1d5d80-5737-440b-80ea-72e00eaf2aa0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-c25b2780-4005-494a-9d39-001fe3d9ff47 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-c25b2780-4005-494a-9d39-001fe3d9ff47 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 17:47:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c25b2780-4005-494a-9d39-001fe3d9ff47 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 17:47:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 17:47:34 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 17:47:34 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a20a7d-bf41-4d76-9ce0-cdf713808e81]: (4, '') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-c25b2780-4005-494a-9d39-001fe3d9ff47 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 17:47:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-c25b2780-4005-494a-9d39-001fe3d9ff47 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 17:47:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-c25b2780-4005-494a-9d39-001fe3d9ff47 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 17:47:34 user nova-compute[75100]: DEBUG os_brick.utils [None req-c25b2780-4005-494a-9d39-001fe3d9ff47 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90b1a229568f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 17:47:34 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-c25b2780-4005-494a-9d39-001fe3d9ff47 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: 4487e074-c245-44b2-a77e-3f1acde34d45] Updating existing volume attachment record: 1f0fc16c-d1f6-462d-9ae7-9795042e5c42 {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 17:47:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:47:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:47:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:47:44 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2001bb95-9eec-4fbd-a7af-f176bd6f7334 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 17:47:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-2001bb95-9eec-4fbd-a7af-f176bd6f7334 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:99db3b35-0a16-407d-976b-bd388c535b13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fWmHOurw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 17:47:44 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-2001bb95-9eec-4fbd-a7af-f176bd6f7334 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 17:47:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-2001bb95-9eec-4fbd-a7af-f176bd6f7334 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 17:47:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-2001bb95-9eec-4fbd-a7af-f176bd6f7334 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 17:47:44 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-2001bb95-9eec-4fbd-a7af-f176bd6f7334 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 17:47:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-2001bb95-9eec-4fbd-a7af-f176bd6f7334 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99db3b35-0a16-407d-976b-bd388c535b13" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 17:47:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-2001bb95-9eec-4fbd-a7af-f176bd6f7334 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99db3b35-0a16-407d-976b-bd388c535b13" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 17:47:44 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-2001bb95-9eec-4fbd-a7af-f176bd6f7334 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 17:47:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99db3b35-0a16-407d-976b-bd388c535b13 -p 172.16.0.220:3260 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99db3b35-0a16-407d-976b-bd388c535b13 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:44 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24ffed3-89f5-479e-b1b5-9b389848d354]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-2001bb95-9eec-4fbd-a7af-f176bd6f7334 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 17:47:44 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:47:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99db3b35-0a16-407d-976b-bd388c535b13 -p 172.16.0.220:3260 --interface default --op new {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99db3b35-0a16-407d-976b-bd388c535b13 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:44 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2d65fc-12fa-4608-a4ff-2dfe879c5c8e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99db3b35-0a16-407d-976b-bd388c535b13] added\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-2001bb95-9eec-4fbd-a7af-f176bd6f7334 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99db3b35-0a16-407d-976b-bd388c535b13] added
Nov 10 17:47:44 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:47:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99db3b35-0a16-407d-976b-bd388c535b13 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99db3b35-0a16-407d-976b-bd388c535b13 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:44 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5dc0fa4-1f88-4d74-acf7-6dfa340dc263]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-2001bb95-9eec-4fbd-a7af-f176bd6f7334 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:47:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99db3b35-0a16-407d-976b-bd388c535b13 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99db3b35-0a16-407d-976b-bd388c535b13 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:44 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a20cef1-42e3-4529-82a1-52ec5fe85b1e]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-2001bb95-9eec-4fbd-a7af-f176bd6f7334 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:47:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99db3b35-0a16-407d-976b-bd388c535b13 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fWmHOurw {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99db3b35-0a16-407d-976b-bd388c535b13 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fWmHOurw" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:44 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea84a1a-585c-4727-80e7-4db6571bda68]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-2001bb95-9eec-4fbd-a7af-f176bd6f7334 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fWmHOurw'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:47:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99db3b35-0a16-407d-976b-bd388c535b13 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99db3b35-0a16-407d-976b-bd388c535b13 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:44 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4214e142-4f2e-4cec-9539-f2596c832d57]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-2001bb95-9eec-4fbd-a7af-f176bd6f7334 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:47:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:44 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a3426a-f5f5-45d7-afcc-9888a1a225fe]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4204104-cc65-42a9-9496-efb41c8f622d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b96731-b07d-4c4b-aa76-15b097d270b4 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-2001bb95-9eec-4fbd-a7af-f176bd6f7334 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb (non-flash)
Nov 10 17:47:44 user nova-compute[75100]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8 (non-flash)
Nov 10 17:47:44 user nova-compute[75100]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4204104-cc65-42a9-9496-efb41c8f622d (non-flash)
Nov 10 17:47:44 user nova-compute[75100]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b96731-b07d-4c4b-aa76-15b097d270b4 (non-flash)
Nov 10 17:47:44 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:47:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-2001bb95-9eec-4fbd-a7af-f176bd6f7334 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb (non-flash)
Nov 10 17:47:44 user nova-compute[75100]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8 (non-flash)
Nov 10 17:47:44 user nova-compute[75100]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4204104-cc65-42a9-9496-efb41c8f622d (non-flash)
Nov 10 17:47:44 user nova-compute[75100]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b96731-b07d-4c4b-aa76-15b097d270b4 (non-flash)
Nov 10 17:47:44 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 17:47:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99db3b35-0a16-407d-976b-bd388c535b13 -p 172.16.0.220:3260 --login {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99db3b35-0a16-407d-976b-bd388c535b13 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:44 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1290b268-cb0d-4c4f-9a65-a4a6d5a2aa70]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:99db3b35-0a16-407d-976b-bd388c535b13, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:99db3b35-0a16-407d-976b-bd388c535b13, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-2001bb95-9eec-4fbd-a7af-f176bd6f7334 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:99db3b35-0a16-407d-976b-bd388c535b13, portal: 172.16.0.220,3260]
Nov 10 17:47:44 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:99db3b35-0a16-407d-976b-bd388c535b13, portal: 172.16.0.220,3260] successful.
Nov 10 17:47:44 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:47:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99db3b35-0a16-407d-976b-bd388c535b13 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99db3b35-0a16-407d-976b-bd388c535b13 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:44 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8949cc13-8c21-433e-bf11-4920282d6779]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-2001bb95-9eec-4fbd-a7af-f176bd6f7334 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:47:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:44 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9a44f1-c71a-4861-859f-82b710dc5f73]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4204104-cc65-42a9-9496-efb41c8f622d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b96731-b07d-4c4b-aa76-15b097d270b4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99db3b35-0a16-407d-976b-bd388c535b13 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-2001bb95-9eec-4fbd-a7af-f176bd6f7334 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb (non-flash)
Nov 10 17:47:44 user nova-compute[75100]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8 (non-flash)
Nov 10 17:47:44 user nova-compute[75100]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4204104-cc65-42a9-9496-efb41c8f622d (non-flash)
Nov 10 17:47:44 user nova-compute[75100]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b96731-b07d-4c4b-aa76-15b097d270b4 (non-flash)
Nov 10 17:47:44 user nova-compute[75100]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99db3b35-0a16-407d-976b-bd388c535b13 (non-flash)
Nov 10 17:47:44 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:47:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-2001bb95-9eec-4fbd-a7af-f176bd6f7334 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb (non-flash)
Nov 10 17:47:44 user nova-compute[75100]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8 (non-flash)
Nov 10 17:47:44 user nova-compute[75100]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4204104-cc65-42a9-9496-efb41c8f622d (non-flash)
Nov 10 17:47:44 user nova-compute[75100]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b96731-b07d-4c4b-aa76-15b097d270b4 (non-flash)
Nov 10 17:47:44 user nova-compute[75100]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99db3b35-0a16-407d-976b-bd388c535b13 (non-flash)
Nov 10 17:47:44 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 17:47:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-2001bb95-9eec-4fbd-a7af-f176bd6f7334 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99db3b35-0a16-407d-976b-bd388c535b13" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 17:47:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-2001bb95-9eec-4fbd-a7af-f176bd6f7334 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 17:47:44 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-2001bb95-9eec-4fbd-a7af-f176bd6f7334 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 17:47:44 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-2001bb95-9eec-4fbd-a7af-f176bd6f7334 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 17:47:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:44 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fcb5bd3-ff58-4752-8d62-97b938b2110b]: (4, ('- - 0', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:44 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-2001bb95-9eec-4fbd-a7af-f176bd6f7334 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 17:47:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-2001bb95-9eec-4fbd-a7af-f176bd6f7334 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:99db3b35-0a16-407d-976b-bd388c535b13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fWmHOurw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 17:47:45 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-fa7532bb-ba7e-47d5-a542-d364fb08be7e tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ead532eb-c8be-45fa-a8b7-0b4c4f884a90 is timed out.
Nov 10 17:47:45 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-fa7532bb-ba7e-47d5-a542-d364fb08be7e tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Successfully detached device vdb from instance ead532eb-c8be-45fa-a8b7-0b4c4f884a90 from the live domain config.
Nov 10 17:47:45 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa7532bb-ba7e-47d5-a542-d364fb08be7e tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 17:47:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7532bb-ba7e-47d5-a542-d364fb08be7e tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, {'target_iqn': 'iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TlOFWbDm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 17:47:45 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-fa7532bb-ba7e-47d5-a542-d364fb08be7e tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 17:47:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-fa7532bb-ba7e-47d5-a542-d364fb08be7e tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 17:47:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-2001bb95-9eec-4fbd-a7af-f176bd6f7334 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 17:47:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-2001bb95-9eec-4fbd-a7af-f176bd6f7334 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '23236313331373832', 'path': '/dev/sdf'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 17:47:45 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2001bb95-9eec-4fbd-a7af-f176bd6f7334 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236313331373832', 'path': '/dev/sdf'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 17:47:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-fa7532bb-ba7e-47d5-a542-d364fb08be7e tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.962s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 17:47:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG nova.objects.instance [None req-2001bb95-9eec-4fbd-a7af-f176bd6f7334 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Lazy-loading 'flavor' on Instance uuid 5b5ec5d3-fa6f-43de-b786-8c423064fe7a {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ea0851-2be8-4cf4-8987-e448557f551c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:99db3b35-0a16-407d-976b-bd388c535b13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d0b96731-b07d-4c4b-aa76-15b097d270b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4204104-cc65-42a9-9496-efb41c8f622d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7532bb-ba7e-47d5-a542-d364fb08be7e tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 17:47:46 user nova-compute[75100]: No targets found.
Nov 10 17:47:46 user nova-compute[75100]: iSNS:
Nov 10 17:47:46 user nova-compute[75100]: No targets found.
Nov 10 17:47:46 user nova-compute[75100]: STATIC:
Nov 10 17:47:46 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:99db3b35-0a16-407d-976b-bd388c535b13
Nov 10 17:47:46 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 17:47:46 user nova-compute[75100]:                 Iface Name: default
Nov 10 17:47:46 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb
Nov 10 17:47:46 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 17:47:46 user nova-compute[75100]:                 Iface Name: default
Nov 10 17:47:46 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:d0b96731-b07d-4c4b-aa76-15b097d270b4
Nov 10 17:47:46 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 17:47:46 user nova-compute[75100]:                 Iface Name: default
Nov 10 17:47:46 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:e4204104-cc65-42a9-9496-efb41c8f622d
Nov 10 17:47:46 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 17:47:46 user nova-compute[75100]:                 Iface Name: default
Nov 10 17:47:46 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8
Nov 10 17:47:46 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 17:47:46 user nova-compute[75100]:                 Iface Name: default
Nov 10 17:47:46 user nova-compute[75100]: FIRMWARE:
Nov 10 17:47:46 user nova-compute[75100]: No targets found.
Nov 10 17:47:46 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7532bb-ba7e-47d5-a542-d364fb08be7e tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 17:47:46 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 17:47:46 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7532bb-ba7e-47d5-a542-d364fb08be7e tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-2001bb95-9eec-4fbd-a7af-f176bd6f7334 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 17:47:46 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 17:47:46 user nova-compute[75100]:   <source dev="/dev/sdf"/>
Nov 10 17:47:46 user nova-compute[75100]:   <target dev="sdc" bus="scsi"/>
Nov 10 17:47:46 user nova-compute[75100]:   <serial>99db3b35-0a16-407d-976b-bd388c535b13</serial>
Nov 10 17:47:46 user nova-compute[75100]:   <address type="drive" controller="0" unit="2"/>
Nov 10 17:47:46 user nova-compute[75100]: </disk>
Nov 10 17:47:46 user nova-compute[75100]:  {{(pid=75100) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e778c9fd-4023-436f-b7c1-81d039fc04bb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99db3b35-0a16-407d-976b-bd388c535b13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0b96731-b07d-4c4b-aa76-15b097d270b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4204104-cc65-42a9-9496-efb41c8f622d\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d50ee8cb-d370-44d7-aee3-6b57e7ff47d8]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4204104-cc65-42a9-9496-efb41c8f622d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b96731-b07d-4c4b-aa76-15b097d270b4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99db3b35-0a16-407d-976b-bd388c535b13 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7532bb-ba7e-47d5-a542-d364fb08be7e tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb (non-flash)
Nov 10 17:47:46 user nova-compute[75100]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8 (non-flash)
Nov 10 17:47:46 user nova-compute[75100]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4204104-cc65-42a9-9496-efb41c8f622d (non-flash)
Nov 10 17:47:46 user nova-compute[75100]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b96731-b07d-4c4b-aa76-15b097d270b4 (non-flash)
Nov 10 17:47:46 user nova-compute[75100]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99db3b35-0a16-407d-976b-bd388c535b13 (non-flash)
Nov 10 17:47:46 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7532bb-ba7e-47d5-a542-d364fb08be7e tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb (non-flash)
Nov 10 17:47:46 user nova-compute[75100]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8 (non-flash)
Nov 10 17:47:46 user nova-compute[75100]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4204104-cc65-42a9-9496-efb41c8f622d (non-flash)
Nov 10 17:47:46 user nova-compute[75100]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b96731-b07d-4c4b-aa76-15b097d270b4 (non-flash)
Nov 10 17:47:46 user nova-compute[75100]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99db3b35-0a16-407d-976b-bd388c535b13 (non-flash)
Nov 10 17:47:46 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7532bb-ba7e-47d5-a542-d364fb08be7e tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3bc7891b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8'): ({'sdd'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-fa7532bb-ba7e-47d5-a542-d364fb08be7e tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Removing single pathed devices sdd {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[873a2939-ad9a-4ca6-a550-1fb15d93cee3]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c3e602-a896-446c-8c9f-82c283583b41]: (4, ('ok\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-fa7532bb-ba7e-47d5-a542-d364fb08be7e tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Flushing IO for device /dev/sdd {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6a6738-7773-40bd-a204-1a5c5308edbf]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-fa7532bb-ba7e-47d5-a542-d364fb08be7e tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.052s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d69c6db-fab5-4ef2-b31c-ba873840122b]: (4, ('1', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-fa7532bb-ba7e-47d5-a542-d364fb08be7e tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-fa7532bb-ba7e-47d5-a542-d364fb08be7e tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] SCSI volumes sdd have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7532bb-ba7e-47d5-a542-d364fb08be7e tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[365d34fa-2cfe-4426-9e64-0c15f0c2a308]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7532bb-ba7e-47d5-a542-d364fb08be7e tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8 -p 172.16.0.220:3260 --logout {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ecab5e2-e896-4c67-9bf2-a29e96a64a92]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7532bb-ba7e-47d5-a542-d364fb08be7e tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8, portal: 172.16.0.220,3260]
Nov 10 17:47:46 user nova-compute[75100]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8, portal: 172.16.0.220,3260] successful.
Nov 10 17:47:46 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8 -p 172.16.0.220:3260 --op delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50317e9e-0c4a-4dda-87bc-7e3a23b299b8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead4abae-e47e-4c80-b5bd-96f18c22d1b4]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7532bb-ba7e-47d5-a542-d364fb08be7e tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-fa7532bb-ba7e-47d5-a542-d364fb08be7e tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.377s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7532bb-ba7e-47d5-a542-d364fb08be7e tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] <== disconnect_volume: return (1339ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa7532bb-ba7e-47d5-a542-d364fb08be7e tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-2001bb95-9eec-4fbd-a7af-f176bd6f7334 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] No BDM found with device name sda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-2001bb95-9eec-4fbd-a7af-f176bd6f7334 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-2001bb95-9eec-4fbd-a7af-f176bd6f7334 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-2001bb95-9eec-4fbd-a7af-f176bd6f7334 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] No VIF found with MAC fa:16:3e:4d:09:82, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] Acquiring lock "78d2732a-9eff-480e-b844-d216537c5d91" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] Lock "78d2732a-9eff-480e-b844-d216537c5d91" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG nova.compute.manager [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 17:47:46 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-19959c89-aeca-448b-aff2-0c691f45ef0d tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 91238923-a64c-4f41-a046-be243eff880d is timed out.
Nov 10 17:47:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] Acquiring lock "ed8fb592-b4c8-4634-a618-0405d70a1acc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] Lock "ed8fb592-b4c8-4634-a618-0405d70a1acc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:47:46 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-19959c89-aeca-448b-aff2-0c691f45ef0d tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Successfully detached device vdb from instance 91238923-a64c-4f41-a046-be243eff880d from the live domain config.
Nov 10 17:47:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19959c89-aeca-448b-aff2-0c691f45ef0d tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] [instance: 91238923-a64c-4f41-a046-be243eff880d] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-19959c89-aeca-448b-aff2-0c691f45ef0d tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, {'target_iqn': 'iqn.2010-10.org.openstack:e4204104-cc65-42a9-9496-efb41c8f622d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jupJgOmR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 17:47:46 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-19959c89-aeca-448b-aff2-0c691f45ef0d tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 17:47:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-19959c89-aeca-448b-aff2-0c691f45ef0d tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-19959c89-aeca-448b-aff2-0c691f45ef0d tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[58920379-0f03-48ea-8284-1e87d3794e55]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:99db3b35-0a16-407d-976b-bd388c535b13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d0b96731-b07d-4c4b-aa76-15b097d270b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4204104-cc65-42a9-9496-efb41c8f622d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-19959c89-aeca-448b-aff2-0c691f45ef0d tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 17:47:46 user nova-compute[75100]: No targets found.
Nov 10 17:47:46 user nova-compute[75100]: iSNS:
Nov 10 17:47:46 user nova-compute[75100]: No targets found.
Nov 10 17:47:46 user nova-compute[75100]: STATIC:
Nov 10 17:47:46 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:99db3b35-0a16-407d-976b-bd388c535b13
Nov 10 17:47:46 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 17:47:46 user nova-compute[75100]:                 Iface Name: default
Nov 10 17:47:46 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb
Nov 10 17:47:46 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 17:47:46 user nova-compute[75100]:                 Iface Name: default
Nov 10 17:47:46 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:d0b96731-b07d-4c4b-aa76-15b097d270b4
Nov 10 17:47:46 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 17:47:46 user nova-compute[75100]:                 Iface Name: default
Nov 10 17:47:46 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:e4204104-cc65-42a9-9496-efb41c8f622d
Nov 10 17:47:46 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 17:47:46 user nova-compute[75100]:                 Iface Name: default
Nov 10 17:47:46 user nova-compute[75100]: FIRMWARE:
Nov 10 17:47:46 user nova-compute[75100]: No targets found.
Nov 10 17:47:46 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-19959c89-aeca-448b-aff2-0c691f45ef0d tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 17:47:46 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 17:47:46 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-19959c89-aeca-448b-aff2-0c691f45ef0d tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4204104-cc65-42a9-9496-efb41c8f622d', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6028f2b0-1457-48ca-aeff-c7c7f297bb35]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99db3b35-0a16-407d-976b-bd388c535b13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0b96731-b07d-4c4b-aa76-15b097d270b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4204104-cc65-42a9-9496-efb41c8f622d\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:47:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:47:47 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 17:47:47 user nova-compute[75100]: INFO nova.compute.claims [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Claim successful on node user
Nov 10 17:47:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:47 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6ef752-d6ab-4742-bbbf-f1987c79931e]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4204104-cc65-42a9-9496-efb41c8f622d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b96731-b07d-4c4b-aa76-15b097d270b4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99db3b35-0a16-407d-976b-bd388c535b13 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:47 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-19959c89-aeca-448b-aff2-0c691f45ef0d tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb (non-flash)
Nov 10 17:47:47 user nova-compute[75100]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4204104-cc65-42a9-9496-efb41c8f622d (non-flash)
Nov 10 17:47:47 user nova-compute[75100]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b96731-b07d-4c4b-aa76-15b097d270b4 (non-flash)
Nov 10 17:47:47 user nova-compute[75100]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99db3b35-0a16-407d-976b-bd388c535b13 (non-flash)
Nov 10 17:47:47 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:47:47 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-19959c89-aeca-448b-aff2-0c691f45ef0d tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb (non-flash)
Nov 10 17:47:47 user nova-compute[75100]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4204104-cc65-42a9-9496-efb41c8f622d (non-flash)
Nov 10 17:47:47 user nova-compute[75100]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b96731-b07d-4c4b-aa76-15b097d270b4 (non-flash)
Nov 10 17:47:47 user nova-compute[75100]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99db3b35-0a16-407d-976b-bd388c535b13 (non-flash)
Nov 10 17:47:47 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 17:47:47 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-19959c89-aeca-448b-aff2-0c691f45ef0d tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3dc2a5ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4204104-cc65-42a9-9496-efb41c8f622d'): ({'sdb'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 17:47:47 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-19959c89-aeca-448b-aff2-0c691f45ef0d tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Removing single pathed devices sdb {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 17:47:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:47 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1eb9f84-bec2-4f71-bc16-999843297c73]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:47:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:47 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ad960a-0e36-4ea0-a4a0-179d768bd53d]: (4, ('ok\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:47 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-19959c89-aeca-448b-aff2-0c691f45ef0d tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Flushing IO for device /dev/sdb {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 17:47:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:47 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7b4193-349f-4cbd-a7de-596686a77919]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:47 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-19959c89-aeca-448b-aff2-0c691f45ef0d tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 17:47:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.080s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:47 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74a6beb-63b5-48ec-a48a-7a19cf772db8]: (4, ('1', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:47 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-19959c89-aeca-448b-aff2-0c691f45ef0d tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 17:47:47 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-19959c89-aeca-448b-aff2-0c691f45ef0d tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 17:47:47 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-19959c89-aeca-448b-aff2-0c691f45ef0d tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4204104-cc65-42a9-9496-efb41c8f622d')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 17:47:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4204104-cc65-42a9-9496-efb41c8f622d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4204104-cc65-42a9-9496-efb41c8f622d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:47 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5dd691-7fc8-413f-bde4-7a01efc3b3cb]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:47 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-19959c89-aeca-448b-aff2-0c691f45ef0d tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:47:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4204104-cc65-42a9-9496-efb41c8f622d -p 172.16.0.220:3260 --logout {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4204104-cc65-42a9-9496-efb41c8f622d -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:47 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1936cc-0bfa-43a0-a8d3-88c96576e7c8]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:e4204104-cc65-42a9-9496-efb41c8f622d, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:e4204104-cc65-42a9-9496-efb41c8f622d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:47 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-19959c89-aeca-448b-aff2-0c691f45ef0d tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:e4204104-cc65-42a9-9496-efb41c8f622d, portal: 172.16.0.220,3260]
Nov 10 17:47:47 user nova-compute[75100]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:e4204104-cc65-42a9-9496-efb41c8f622d, portal: 172.16.0.220,3260] successful.
Nov 10 17:47:47 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:47:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4204104-cc65-42a9-9496-efb41c8f622d -p 172.16.0.220:3260 --op delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4204104-cc65-42a9-9496-efb41c8f622d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:47 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e722ad-922f-476d-a8ec-aa34881ffac3]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:47 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-19959c89-aeca-448b-aff2-0c691f45ef0d tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:47:47 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-19959c89-aeca-448b-aff2-0c691f45ef0d tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.391s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 17:47:47 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-19959c89-aeca-448b-aff2-0c691f45ef0d tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] <== disconnect_volume: return (392ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 17:47:47 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19959c89-aeca-448b-aff2-0c691f45ef0d tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] [instance: 91238923-a64c-4f41-a046-be243eff880d] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 17:47:47 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:47:47 user nova-compute[75100]: DEBUG nova.objects.instance [None req-fa7532bb-ba7e-47d5-a542-d364fb08be7e tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Lazy-loading 'flavor' on Instance uuid ead532eb-c8be-45fa-a8b7-0b4c4f884a90 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:47:47 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:47:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fa7532bb-ba7e-47d5-a542-d364fb08be7e tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Lock "ead532eb-c8be-45fa-a8b7-0b4c4f884a90" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.130s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:47:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.552s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:47:47 user nova-compute[75100]: DEBUG nova.compute.manager [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 17:47:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.504s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:47:47 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 17:47:47 user nova-compute[75100]: INFO nova.compute.claims [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Claim successful on node user
Nov 10 17:47:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2001bb95-9eec-4fbd-a7af-f176bd6f7334 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Lock "5b5ec5d3-fa6f-43de-b786-8c423064fe7a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 31.349s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:47:47 user nova-compute[75100]: DEBUG nova.compute.manager [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 17:47:47 user nova-compute[75100]: DEBUG nova.network.neutron [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 17:47:47 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 17:47:47 user nova-compute[75100]: DEBUG nova.compute.manager [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 17:47:47 user nova-compute[75100]: INFO nova.virt.block_device [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Booting with volume ae380714-1745-40c8-9c64-1204499b902a at /dev/vda
Nov 10 17:47:47 user nova-compute[75100]: DEBUG nova.policy [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '105a4e4b920a47e4993736766132ab73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a7b57245324938a0f28dbf22654838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 17:47:48 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:47:48 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:47:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.516s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:47:48 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 17:47:48 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-6756fc07-4c6a-49e1-b9c1-54e168e1268c tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c790b5c3-b255-430f-8654-f0ff5d54d48c is timed out.
Nov 10 17:47:48 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-6756fc07-4c6a-49e1-b9c1-54e168e1268c tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] Successfully detached device vdb from instance c790b5c3-b255-430f-8654-f0ff5d54d48c from the live domain config.
Nov 10 17:47:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6756fc07-4c6a-49e1-b9c1-54e168e1268c tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 17:47:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6756fc07-4c6a-49e1-b9c1-54e168e1268c tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, {'target_iqn': 'iqn.2010-10.org.openstack:d0b96731-b07d-4c4b-aa76-15b097d270b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YUnATLXM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 17:47:48 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-6756fc07-4c6a-49e1-b9c1-54e168e1268c tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 17:47:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-6756fc07-4c6a-49e1-b9c1-54e168e1268c tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 17:47:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-6756fc07-4c6a-49e1-b9c1-54e168e1268c tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 17:47:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:48 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d853242-6636-4e5c-9bc0-8a4dccf99a08]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:99db3b35-0a16-407d-976b-bd388c535b13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d0b96731-b07d-4c4b-aa76-15b097d270b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6756fc07-4c6a-49e1-b9c1-54e168e1268c tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 17:47:48 user nova-compute[75100]: No targets found.
Nov 10 17:47:48 user nova-compute[75100]: iSNS:
Nov 10 17:47:48 user nova-compute[75100]: No targets found.
Nov 10 17:47:48 user nova-compute[75100]: STATIC:
Nov 10 17:47:48 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:99db3b35-0a16-407d-976b-bd388c535b13
Nov 10 17:47:48 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 17:47:48 user nova-compute[75100]:                 Iface Name: default
Nov 10 17:47:48 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb
Nov 10 17:47:48 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 17:47:48 user nova-compute[75100]:                 Iface Name: default
Nov 10 17:47:48 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:d0b96731-b07d-4c4b-aa76-15b097d270b4
Nov 10 17:47:48 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 17:47:48 user nova-compute[75100]:                 Iface Name: default
Nov 10 17:47:48 user nova-compute[75100]: FIRMWARE:
Nov 10 17:47:48 user nova-compute[75100]: No targets found.
Nov 10 17:47:48 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:47:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6756fc07-4c6a-49e1-b9c1-54e168e1268c tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 17:47:48 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 17:47:48 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 17:47:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6756fc07-4c6a-49e1-b9c1-54e168e1268c tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0b96731-b07d-4c4b-aa76-15b097d270b4', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 17:47:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:48 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5274f2f-64a7-445f-a6ce-db9d8c88c204]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99db3b35-0a16-407d-976b-bd388c535b13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0b96731-b07d-4c4b-aa76-15b097d270b4\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:48 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 17:47:48 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 17:47:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:48 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c588e862-47e2-476e-bdce-bf5a86f978df]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b96731-b07d-4c4b-aa76-15b097d270b4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99db3b35-0a16-407d-976b-bd388c535b13 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6756fc07-4c6a-49e1-b9c1-54e168e1268c tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb (non-flash)
Nov 10 17:47:48 user nova-compute[75100]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b96731-b07d-4c4b-aa76-15b097d270b4 (non-flash)
Nov 10 17:47:48 user nova-compute[75100]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99db3b35-0a16-407d-976b-bd388c535b13 (non-flash)
Nov 10 17:47:48 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:47:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6756fc07-4c6a-49e1-b9c1-54e168e1268c tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb (non-flash)
Nov 10 17:47:48 user nova-compute[75100]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b96731-b07d-4c4b-aa76-15b097d270b4 (non-flash)
Nov 10 17:47:48 user nova-compute[75100]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99db3b35-0a16-407d-976b-bd388c535b13 (non-flash)
Nov 10 17:47:48 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 17:47:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6756fc07-4c6a-49e1-b9c1-54e168e1268c tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3bc3c1cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0b96731-b07d-4c4b-aa76-15b097d270b4'): ({'sde'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 17:47:48 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-6756fc07-4c6a-49e1-b9c1-54e168e1268c tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] Removing single pathed devices sde {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 17:47:48 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 17:47:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:48 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef922375-9a04-4c7c-addc-86fe6222b4c8]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:48 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b306dbf-c997-4d69-a0d0-0ad41c7c4148]: (4, ('ok\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:48 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-6756fc07-4c6a-49e1-b9c1-54e168e1268c tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] Flushing IO for device /dev/sde {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 17:47:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:48 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[537cad4c-be91-48c6-b34d-834f2e7587d4]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:48 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-6756fc07-4c6a-49e1-b9c1-54e168e1268c tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 17:47:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:48 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 17:47:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:48 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[484f0f89-4bee-43d3-8c39-fe53fe6e7966]: (4, ('1', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:48 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-6756fc07-4c6a-49e1-b9c1-54e168e1268c tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 17:47:48 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-6756fc07-4c6a-49e1-b9c1-54e168e1268c tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] SCSI volumes sde have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 17:47:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6756fc07-4c6a-49e1-b9c1-54e168e1268c tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0b96731-b07d-4c4b-aa76-15b097d270b4')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 17:47:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0b96731-b07d-4c4b-aa76-15b097d270b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:48 user nova-compute[75100]: INFO nova.virt.block_device [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Booting with volume fe1ea42d-7d7a-4a58-ab63-7f831350e780 at /dev/vda
Nov 10 17:47:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0b96731-b07d-4c4b-aa76-15b097d270b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:48 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[003d8aac-ecd1-4c95-934a-3ee9e1c6b21b]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6756fc07-4c6a-49e1-b9c1-54e168e1268c tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:47:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0b96731-b07d-4c4b-aa76-15b097d270b4 -p 172.16.0.220:3260 --logout {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0b96731-b07d-4c4b-aa76-15b097d270b4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:48 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c996413f-af65-495b-bd0e-27a2a9a124db]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:d0b96731-b07d-4c4b-aa76-15b097d270b4, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:d0b96731-b07d-4c4b-aa76-15b097d270b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6756fc07-4c6a-49e1-b9c1-54e168e1268c tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:d0b96731-b07d-4c4b-aa76-15b097d270b4, portal: 172.16.0.220,3260]
Nov 10 17:47:48 user nova-compute[75100]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:d0b96731-b07d-4c4b-aa76-15b097d270b4, portal: 172.16.0.220,3260] successful.
Nov 10 17:47:48 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:47:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0b96731-b07d-4c4b-aa76-15b097d270b4 -p 172.16.0.220:3260 --op delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0b96731-b07d-4c4b-aa76-15b097d270b4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:48 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7109d8e-988f-4923-ac40-93396b1ad64f]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6756fc07-4c6a-49e1-b9c1-54e168e1268c tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:47:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-6756fc07-4c6a-49e1-b9c1-54e168e1268c tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 17:47:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6756fc07-4c6a-49e1-b9c1-54e168e1268c tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] <== disconnect_volume: return (351ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 17:47:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6756fc07-4c6a-49e1-b9c1-54e168e1268c tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 17:47:48 user nova-compute[75100]: DEBUG nova.policy [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '558a504dcf6d4fd0898ace7e7d44b7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98ad0aacb594a5cb077b7dbb783e2a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 17:47:48 user nova-compute[75100]: DEBUG nova.network.neutron [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Successfully created port: 28207b6f-d154-47a5-9b82-24cda17c04ee {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 17:47:48 user nova-compute[75100]: DEBUG nova.objects.instance [None req-19959c89-aeca-448b-aff2-0c691f45ef0d tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Lazy-loading 'flavor' on Instance uuid 91238923-a64c-4f41-a046-be243eff880d {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:47:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-19959c89-aeca-448b-aff2-0c691f45ef0d tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Lock "91238923-a64c-4f41-a046-be243eff880d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.627s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:47:49 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Successfully created port: 390c843a-5638-4ddb-aa25-622a55b1e89e {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 17:47:49 user nova-compute[75100]: DEBUG nova.network.neutron [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Successfully created port: df32706a-68b5-4554-bbe3-220b4311c054 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 17:47:49 user nova-compute[75100]: DEBUG nova.network.neutron [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Successfully created port: d0c5fcaa-e79c-41a5-8f36-18ac282f103a {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 17:47:49 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Successfully created port: dccf5548-9267-43d7-93e8-10cf08624d0c {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 17:47:50 user nova-compute[75100]: DEBUG nova.objects.instance [None req-6756fc07-4c6a-49e1-b9c1-54e168e1268c tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] Lazy-loading 'flavor' on Instance uuid c790b5c3-b255-430f-8654-f0ff5d54d48c {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:47:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6756fc07-4c6a-49e1-b9c1-54e168e1268c tempest-VolumesAssistedSnapshotsTest-1834722069 tempest-VolumesAssistedSnapshotsTest-1834722069-project-admin] Lock "c790b5c3-b255-430f-8654-f0ff5d54d48c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.941s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:47:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f8c06f7f-be58-4b53-80dd-139748e13b94 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Acquiring lock "interface-91238923-a64c-4f41-a046-be243eff880d-e628717d-728d-494a-be7e-ff3c79df75eb" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:47:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f8c06f7f-be58-4b53-80dd-139748e13b94 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Lock "interface-91238923-a64c-4f41-a046-be243eff880d-e628717d-728d-494a-be7e-ff3c79df75eb" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:47:50 user nova-compute[75100]: DEBUG nova.network.neutron [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Successfully created port: c63180df-c18f-473e-b3be-7b5bc22eccfa {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 17:47:50 user nova-compute[75100]: DEBUG nova.objects.instance [None req-f8c06f7f-be58-4b53-80dd-139748e13b94 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Lazy-loading 'flavor' on Instance uuid 91238923-a64c-4f41-a046-be243eff880d {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:47:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-f8c06f7f-be58-4b53-80dd-139748e13b94 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T17:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1217309978',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1217309978',id=7,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDg6Whui6h8FFFZnFwQnZiCuU3HjskJ2h5m1lP5l89/I6dnqvQ2dx39WpWkClYX9LsxzEk1B3cwB2sN+VxVpaZakTcKBRQUFmNH6ntC81O0eJh0TTBqxIPcr2Favd3KjTw==',key_name='tempest-keypair-326242402',keypairs=<?>,launch_index=0,launched_at=2023-11-10T17:45:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c38f5a70dae74e3cb19dd6ddade72581',ramdisk_id='',reservation_id='r-v9u7eycj',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1600859769',owner_user_name='tempest-TaggedAttachmentsTest-1600859769-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T17:45:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83545cded878478a8c823e5614376f18',uuid=91238923-a64c-4f41-a046-be243eff880d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e628717d-728d-494a-be7e-ff3c79df75eb", "address": "fa:16:3e:cf:c8:5b", "network": {"id": "6b2b7289-3f5a-49f8-b185-8929b13584e5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-149434076", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c38f5a70dae74e3cb19dd6ddade72581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape628717d-72", "ovs_interfaceid": "e628717d-728d-494a-be7e-ff3c79df75eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 17:47:50 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-f8c06f7f-be58-4b53-80dd-139748e13b94 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Converting VIF {"id": "e628717d-728d-494a-be7e-ff3c79df75eb", "address": "fa:16:3e:cf:c8:5b", "network": {"id": "6b2b7289-3f5a-49f8-b185-8929b13584e5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-149434076", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c38f5a70dae74e3cb19dd6ddade72581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape628717d-72", "ovs_interfaceid": "e628717d-728d-494a-be7e-ff3c79df75eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:47:50 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-f8c06f7f-be58-4b53-80dd-139748e13b94 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:c8:5b,bridge_name='br-int',has_traffic_filtering=True,id=e628717d-728d-494a-be7e-ff3c79df75eb,network=Network(6b2b7289-3f5a-49f8-b185-8929b13584e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape628717d-72') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:47:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-f8c06f7f-be58-4b53-80dd-139748e13b94 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:cf:c8:5b"/><model type="virtio"/><mtu size="1442"/><target dev="tape628717d-72"/></interface> {{(pid=75100) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 10 17:47:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-f8c06f7f-be58-4b53-80dd-139748e13b94 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:cf:c8:5b"/><model type="virtio"/><mtu size="1442"/><target dev="tape628717d-72"/></interface> {{(pid=75100) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 10 17:47:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f8c06f7f-be58-4b53-80dd-139748e13b94 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Attempting to detach device tape628717d-72 from instance 91238923-a64c-4f41-a046-be243eff880d from the persistent domain config. {{(pid=75100) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 17:47:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-f8c06f7f-be58-4b53-80dd-139748e13b94 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] detach device xml: <interface type="ethernet">
Nov 10 17:47:50 user nova-compute[75100]:   <mac address="fa:16:3e:cf:c8:5b"/>
Nov 10 17:47:50 user nova-compute[75100]:   <model type="virtio"/>
Nov 10 17:47:50 user nova-compute[75100]:   <mtu size="1442"/>
Nov 10 17:47:50 user nova-compute[75100]:   <target dev="tape628717d-72"/>
Nov 10 17:47:50 user nova-compute[75100]: </interface>
Nov 10 17:47:50 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 17:47:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-f8c06f7f-be58-4b53-80dd-139748e13b94 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:cf:c8:5b"/><model type="virtio"/><mtu size="1442"/><target dev="tape628717d-72"/></interface> {{(pid=75100) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 10 17:47:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-f8c06f7f-be58-4b53-80dd-139748e13b94 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:cf:c8:5b"/><model type="virtio"/><mtu size="1442"/><target dev="tape628717d-72"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 10 17:47:50 user nova-compute[75100]:   <name>instance-00000007</name>
Nov 10 17:47:50 user nova-compute[75100]:   <uuid>91238923-a64c-4f41-a046-be243eff880d</uuid>
Nov 10 17:47:50 user nova-compute[75100]:   <metadata>
Nov 10 17:47:50 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 17:47:50 user nova-compute[75100]:   <nova:package version="0.0.0"/>
Nov 10 17:47:50 user nova-compute[75100]:   <nova:name>tempest-device-tagging-server-1217309978</nova:name>
Nov 10 17:47:50 user nova-compute[75100]:   <nova:creationTime>2023-11-10 17:46:51</nova:creationTime>
Nov 10 17:47:50 user nova-compute[75100]:   <nova:flavor name="m1.tiny">
Nov 10 17:47:50 user nova-compute[75100]:     <nova:memory>512</nova:memory>
Nov 10 17:47:50 user nova-compute[75100]:     <nova:disk>1</nova:disk>
Nov 10 17:47:50 user nova-compute[75100]:     <nova:swap>0</nova:swap>
Nov 10 17:47:50 user nova-compute[75100]:     <nova:ephemeral>0</nova:ephemeral>
Nov 10 17:47:50 user nova-compute[75100]:     <nova:vcpus>1</nova:vcpus>
Nov 10 17:47:50 user nova-compute[75100]:   </nova:flavor>
Nov 10 17:47:50 user nova-compute[75100]:   <nova:owner>
Nov 10 17:47:50 user nova-compute[75100]:     <nova:user uuid="83545cded878478a8c823e5614376f18">tempest-TaggedAttachmentsTest-1600859769-project-member</nova:user>
Nov 10 17:47:50 user nova-compute[75100]:     <nova:project uuid="c38f5a70dae74e3cb19dd6ddade72581">tempest-TaggedAttachmentsTest-1600859769</nova:project>
Nov 10 17:47:50 user nova-compute[75100]:   </nova:owner>
Nov 10 17:47:50 user nova-compute[75100]:   <nova:root type="image" uuid="e3cc5321-4d40-49ee-885c-700e14741732"/>
Nov 10 17:47:50 user nova-compute[75100]:   <nova:ports>
Nov 10 17:47:50 user nova-compute[75100]:     <nova:port uuid="4d2871cf-d6d9-4edb-9a0d-bc275ee11e13">
Nov 10 17:47:50 user nova-compute[75100]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 10 17:47:50 user nova-compute[75100]:     </nova:port>
Nov 10 17:47:50 user nova-compute[75100]:     <nova:port uuid="e628717d-728d-494a-be7e-ff3c79df75eb">
Nov 10 17:47:50 user nova-compute[75100]:       <nova:ip type="fixed" address="10.10.10.248" ipVersion="4"/>
Nov 10 17:47:50 user nova-compute[75100]:     </nova:port>
Nov 10 17:47:50 user nova-compute[75100]:   </nova:ports>
Nov 10 17:47:50 user nova-compute[75100]: </nova:instance>
Nov 10 17:47:50 user nova-compute[75100]:   </metadata>
Nov 10 17:47:50 user nova-compute[75100]:   <memory unit='KiB'>524288</memory>
Nov 10 17:47:50 user nova-compute[75100]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 10 17:47:50 user nova-compute[75100]:   <vcpu placement='static'>1</vcpu>
Nov 10 17:47:50 user nova-compute[75100]:   <resource>
Nov 10 17:47:50 user nova-compute[75100]:     <partition>/machine</partition>
Nov 10 17:47:50 user nova-compute[75100]:   </resource>
Nov 10 17:47:50 user nova-compute[75100]:   <sysinfo type='smbios'>
Nov 10 17:47:50 user nova-compute[75100]:     <system>
Nov 10 17:47:50 user nova-compute[75100]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 10 17:47:50 user nova-compute[75100]:       <entry name='product'>OpenStack Nova</entry>
Nov 10 17:47:50 user nova-compute[75100]:       <entry name='version'>0.0.0</entry>
Nov 10 17:47:50 user nova-compute[75100]:       <entry name='serial'>91238923-a64c-4f41-a046-be243eff880d</entry>
Nov 10 17:47:50 user nova-compute[75100]:       <entry name='uuid'>91238923-a64c-4f41-a046-be243eff880d</entry>
Nov 10 17:47:50 user nova-compute[75100]:       <entry name='family'>Virtual Machine</entry>
Nov 10 17:47:50 user nova-compute[75100]:     </system>
Nov 10 17:47:50 user nova-compute[75100]:   </sysinfo>
Nov 10 17:47:50 user nova-compute[75100]:   <os>
Nov 10 17:47:50 user nova-compute[75100]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 10 17:47:50 user nova-compute[75100]:     <boot dev='hd'/>
Nov 10 17:47:50 user nova-compute[75100]:     <smbios mode='sysinfo'/>
Nov 10 17:47:50 user nova-compute[75100]:   </os>
Nov 10 17:47:50 user nova-compute[75100]:   <features>
Nov 10 17:47:50 user nova-compute[75100]:     <acpi/>
Nov 10 17:47:50 user nova-compute[75100]:     <apic/>
Nov 10 17:47:50 user nova-compute[75100]:     <vmcoreinfo state='on'/>
Nov 10 17:47:50 user nova-compute[75100]:   </features>
Nov 10 17:47:50 user nova-compute[75100]:   <cpu mode='custom' match='exact' check='full'>
Nov 10 17:47:50 user nova-compute[75100]:     <model fallback='forbid'>Nehalem</model>
Nov 10 17:47:50 user nova-compute[75100]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 10 17:47:50 user nova-compute[75100]:     <feature policy='require' name='vme'/>
Nov 10 17:47:50 user nova-compute[75100]:     <feature policy='require' name='x2apic'/>
Nov 10 17:47:50 user nova-compute[75100]:     <feature policy='require' name='hypervisor'/>
Nov 10 17:47:50 user nova-compute[75100]:   </cpu>
Nov 10 17:47:50 user nova-compute[75100]:   <clock offset='utc'>
Nov 10 17:47:50 user nova-compute[75100]:     <timer name='pit' tickpolicy='delay'/>
Nov 10 17:47:50 user nova-compute[75100]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 10 17:47:50 user nova-compute[75100]:     <timer name='hpet' present='no'/>
Nov 10 17:47:50 user nova-compute[75100]:   </clock>
Nov 10 17:47:50 user nova-compute[75100]:   <on_poweroff>destroy</on_poweroff>
Nov 10 17:47:50 user nova-compute[75100]:   <on_reboot>restart</on_reboot>
Nov 10 17:47:50 user nova-compute[75100]:   <on_crash>destroy</on_crash>
Nov 10 17:47:50 user nova-compute[75100]:   <devices>
Nov 10 17:47:50 user nova-compute[75100]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 10 17:47:50 user nova-compute[75100]:     <disk type='file' device='disk'>
Nov 10 17:47:50 user nova-compute[75100]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 10 17:47:50 user nova-compute[75100]:       <source file='/opt/stack/data/nova/instances/91238923-a64c-4f41-a046-be243eff880d/disk' index='2'/>
Nov 10 17:47:50 user nova-compute[75100]:       <backingStore type='file' index='3'>
Nov 10 17:47:50 user nova-compute[75100]:         <format type='raw'/>
Nov 10 17:47:50 user nova-compute[75100]:         <source file='/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520'/>
Nov 10 17:47:50 user nova-compute[75100]:         <backingStore/>
Nov 10 17:47:50 user nova-compute[75100]:       </backingStore>
Nov 10 17:47:50 user nova-compute[75100]:       <target dev='vda' bus='virtio'/>
Nov 10 17:47:50 user nova-compute[75100]:       <alias name='virtio-disk0'/>
Nov 10 17:47:50 user nova-compute[75100]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 10 17:47:50 user nova-compute[75100]:     </disk>
Nov 10 17:47:50 user nova-compute[75100]:     <disk type='file' device='cdrom'>
Nov 10 17:47:50 user nova-compute[75100]:       <driver name='qemu' type='raw' cache='none'/>
Nov 10 17:47:50 user nova-compute[75100]:       <source file='/opt/stack/data/nova/instances/91238923-a64c-4f41-a046-be243eff880d/disk.config' index='1'/>
Nov 10 17:47:50 user nova-compute[75100]:       <backingStore/>
Nov 10 17:47:50 user nova-compute[75100]:       <target dev='hda' bus='ide'/>
Nov 10 17:47:50 user nova-compute[75100]:       <readonly/>
Nov 10 17:47:50 user nova-compute[75100]:       <alias name='ide0-0-0'/>
Nov 10 17:47:50 user nova-compute[75100]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 10 17:47:50 user nova-compute[75100]:     </disk>
Nov 10 17:47:50 user nova-compute[75100]:     <controller type='usb' index='0' model='none'>
Nov 10 17:47:50 user nova-compute[75100]:       <alias name='usb'/>
Nov 10 17:47:50 user nova-compute[75100]:     </controller>
Nov 10 17:47:50 user nova-compute[75100]:     <controller type='pci' index='0' model='pci-root'>
Nov 10 17:47:50 user nova-compute[75100]:       <alias name='pci.0'/>
Nov 10 17:47:50 user nova-compute[75100]:     </controller>
Nov 10 17:47:50 user nova-compute[75100]:     <controller type='ide' index='0'>
Nov 10 17:47:50 user nova-compute[75100]:       <alias name='ide'/>
Nov 10 17:47:50 user nova-compute[75100]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 10 17:47:50 user nova-compute[75100]:     </controller>
Nov 10 17:47:50 user nova-compute[75100]:     <interface type='ethernet'>
Nov 10 17:47:50 user nova-compute[75100]:       <mac address='fa:16:3e:8e:18:ef'/>
Nov 10 17:47:50 user nova-compute[75100]:       <target dev='tap4d2871cf-d6'/>
Nov 10 17:47:50 user nova-compute[75100]:       <model type='virtio'/>
Nov 10 17:47:50 user nova-compute[75100]:       <mtu size='1442'/>
Nov 10 17:47:50 user nova-compute[75100]:       <alias name='net0'/>
Nov 10 17:47:50 user nova-compute[75100]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 10 17:47:50 user nova-compute[75100]:     </interface>
Nov 10 17:47:50 user nova-compute[75100]:     <interface type='ethernet'>
Nov 10 17:47:50 user nova-compute[75100]:       <mac address='fa:16:3e:cf:c8:5b'/>
Nov 10 17:47:50 user nova-compute[75100]:       <target dev='tape628717d-72'/>
Nov 10 17:47:50 user nova-compute[75100]:       <model type='virtio'/>
Nov 10 17:47:50 user nova-compute[75100]:       <mtu size='1442'/>
Nov 10 17:47:50 user nova-compute[75100]:       <alias name='net1'/>
Nov 10 17:47:50 user nova-compute[75100]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 10 17:47:50 user nova-compute[75100]:     </interface>
Nov 10 17:47:50 user nova-compute[75100]:     <serial type='pty'>
Nov 10 17:47:50 user nova-compute[75100]:       <source path='/dev/pts/6'/>
Nov 10 17:47:50 user nova-compute[75100]:       <log file='/opt/stack/data/nova/instances/91238923-a64c-4f41-a046-be243eff880d/console.log' append='off'/>
Nov 10 17:47:50 user nova-compute[75100]:       <target type='isa-serial' port='0'>
Nov 10 17:47:50 user nova-compute[75100]:         <model name='isa-serial'/>
Nov 10 17:47:50 user nova-compute[75100]:       </target>
Nov 10 17:47:50 user nova-compute[75100]:       <alias name='serial0'/>
Nov 10 17:47:50 user nova-compute[75100]:     </serial>
Nov 10 17:47:50 user nova-compute[75100]:     <console type='pty' tty='/dev/pts/6'>
Nov 10 17:47:50 user nova-compute[75100]:       <source path='/dev/pts/6'/>
Nov 10 17:47:50 user nova-compute[75100]:       <log file='/opt/stack/data/nova/instances/91238923-a64c-4f41-a046-be243eff880d/console.log' append='off'/>
Nov 10 17:47:50 user nova-compute[75100]:       <target type='serial' port='0'/>
Nov 10 17:47:50 user nova-compute[75100]:       <alias name='serial0'/>
Nov 10 17:47:50 user nova-compute[75100]:     </console>
Nov 10 17:47:50 user nova-compute[75100]:     <input type='mouse' bus='ps2'>
Nov 10 17:47:50 user nova-compute[75100]:       <alias name='input0'/>
Nov 10 17:47:50 user nova-compute[75100]:     </input>
Nov 10 17:47:50 user nova-compute[75100]:     <input type='keyboard' bus='ps2'>
Nov 10 17:47:50 user nova-compute[75100]:       <alias name='input1'/>
Nov 10 17:47:50 user nova-compute[75100]:     </input>
Nov 10 17:47:50 user nova-compute[75100]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 10 17:47:50 user nova-compute[75100]:       <listen type='address' address='0.0.0.0'/>
Nov 10 17:47:50 user nova-compute[75100]:     </graphics>
Nov 10 17:47:50 user nova-compute[75100]:     <audio id='1' type='none'/>
Nov 10 17:47:50 user nova-compute[75100]:     <video>
Nov 10 17:47:50 user nova-compute[75100]:       <model type='virtio' heads='1' primary='yes'/>
Nov 10 17:47:50 user nova-compute[75100]:       <alias name='video0'/>
Nov 10 17:47:50 user nova-compute[75100]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 10 17:47:50 user nova-compute[75100]:     </video>
Nov 10 17:47:50 user nova-compute[75100]:     <memballoon model='virtio'>
Nov 10 17:47:50 user nova-compute[75100]:       <stats period='10'/>
Nov 10 17:47:50 user nova-compute[75100]:       <alias name='balloon0'/>
Nov 10 17:47:50 user nova-compute[75100]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 10 17:47:50 user nova-compute[75100]:     </memballoon>
Nov 10 17:47:50 user nova-compute[75100]:     <rng model='virtio'>
Nov 10 17:47:50 user nova-compute[75100]:       <backend model='random'>/dev/urandom</backend>
Nov 10 17:47:50 user nova-compute[75100]:       <alias name='rng0'/>
Nov 10 17:47:50 user nova-compute[75100]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 10 17:47:50 user nova-compute[75100]:     </rng>
Nov 10 17:47:50 user nova-compute[75100]:   </devices>
Nov 10 17:47:50 user nova-compute[75100]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 10 17:47:50 user nova-compute[75100]:     <label>libvirt-91238923-a64c-4f41-a046-be243eff880d</label>
Nov 10 17:47:50 user nova-compute[75100]:     <imagelabel>libvirt-91238923-a64c-4f41-a046-be243eff880d</imagelabel>
Nov 10 17:47:50 user nova-compute[75100]:   </seclabel>
Nov 10 17:47:50 user nova-compute[75100]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 10 17:47:50 user nova-compute[75100]:     <label>+64055:+108</label>
Nov 10 17:47:50 user nova-compute[75100]:     <imagelabel>+64055:+108</imagelabel>
Nov 10 17:47:50 user nova-compute[75100]:   </seclabel>
Nov 10 17:47:50 user nova-compute[75100]: </domain>
Nov 10 17:47:50 user nova-compute[75100]:  {{(pid=75100) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 10 17:47:50 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-f8c06f7f-be58-4b53-80dd-139748e13b94 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Successfully detached device tape628717d-72 from instance 91238923-a64c-4f41-a046-be243eff880d from the persistent domain config.
Nov 10 17:47:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f8c06f7f-be58-4b53-80dd-139748e13b94 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] (1/8): Attempting to detach device tape628717d-72 with device alias net1 from instance 91238923-a64c-4f41-a046-be243eff880d from the live domain config. {{(pid=75100) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 17:47:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-f8c06f7f-be58-4b53-80dd-139748e13b94 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] detach device xml: <interface type="ethernet">
Nov 10 17:47:50 user nova-compute[75100]:   <mac address="fa:16:3e:cf:c8:5b"/>
Nov 10 17:47:50 user nova-compute[75100]:   <model type="virtio"/>
Nov 10 17:47:50 user nova-compute[75100]:   <mtu size="1442"/>
Nov 10 17:47:50 user nova-compute[75100]:   <target dev="tape628717d-72"/>
Nov 10 17:47:50 user nova-compute[75100]: </interface>
Nov 10 17:47:50 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 17:47:50 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Successfully created port: aaf512fe-ddb0-4593-81ab-48c0bf0239b9 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 17:47:50 user nova-compute[75100]: DEBUG os_brick.utils [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.volume.cinder [None req-c25b2780-4005-494a-9d39-001fe3d9ff47 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Update attachment failed for attachment 1f0fc16c-d1f6-462d-9ae7-9795042e5c42. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ef320304-201e-40d8-8cff-5d61fc40fa98) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ef320304-201e-40d8-8cff-5d61fc40fa98)
Nov 10 17:47:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.volume.cinder [None req-ffe8abf1-8810-4412-abd1-001a8a9e15dc tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Update attachment failed for attachment c53b9a08-099f-46a2-a0ae-e4043d6346ad. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-14b67197-884d-40d1-a91c-80954306f564) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-14b67197-884d-40d1-a91c-80954306f564)
Nov 10 17:47:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.028s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec64233d-37e7-4251-8d0a-28132efd2ee8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90b1a229568f\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:50 user nova-compute[75100]: DEBUG os_brick.utils [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 17:47:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [None req-c25b2780-4005-494a-9d39-001fe3d9ff47 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: 4487e074-c245-44b2-a77e-3f1acde34d45] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ef320304-201e-40d8-8cff-5d61fc40fa98)
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: 4487e074-c245-44b2-a77e-3f1acde34d45] Traceback (most recent call last):
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: 4487e074-c245-44b2-a77e-3f1acde34d45]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: 4487e074-c245-44b2-a77e-3f1acde34d45]     driver_block_device.attach_block_devices(
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: 4487e074-c245-44b2-a77e-3f1acde34d45]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: 4487e074-c245-44b2-a77e-3f1acde34d45]     _log_and_attach(device)
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: 4487e074-c245-44b2-a77e-3f1acde34d45]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: 4487e074-c245-44b2-a77e-3f1acde34d45]     bdm.attach(*attach_args, **attach_kwargs)
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: 4487e074-c245-44b2-a77e-3f1acde34d45]   File "/opt/stack/nova/nova/virt/block_device.py", line 852, in attach
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: 4487e074-c245-44b2-a77e-3f1acde34d45]     super(DriverVolBlankBlockDevice, self).attach(
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: 4487e074-c245-44b2-a77e-3f1acde34d45]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: 4487e074-c245-44b2-a77e-3f1acde34d45]     ret_val = method(obj, context, *args, **kwargs)
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: 4487e074-c245-44b2-a77e-3f1acde34d45]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: 4487e074-c245-44b2-a77e-3f1acde34d45]     self._do_attach(context, instance, volume, volume_api,
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: 4487e074-c245-44b2-a77e-3f1acde34d45]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: 4487e074-c245-44b2-a77e-3f1acde34d45]     self._volume_attach(context, volume, connector, instance,
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: 4487e074-c245-44b2-a77e-3f1acde34d45]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: 4487e074-c245-44b2-a77e-3f1acde34d45]     connection_info = volume_api.attachment_update(
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: 4487e074-c245-44b2-a77e-3f1acde34d45]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: 4487e074-c245-44b2-a77e-3f1acde34d45]     res = method(self, ctx, *args, **kwargs)
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: 4487e074-c245-44b2-a77e-3f1acde34d45]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: 4487e074-c245-44b2-a77e-3f1acde34d45]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: 4487e074-c245-44b2-a77e-3f1acde34d45]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: 4487e074-c245-44b2-a77e-3f1acde34d45]     with excutils.save_and_reraise_exception():
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: 4487e074-c245-44b2-a77e-3f1acde34d45]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: 4487e074-c245-44b2-a77e-3f1acde34d45]     self.force_reraise()
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: 4487e074-c245-44b2-a77e-3f1acde34d45]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: 4487e074-c245-44b2-a77e-3f1acde34d45]     raise self.value
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: 4487e074-c245-44b2-a77e-3f1acde34d45]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: 4487e074-c245-44b2-a77e-3f1acde34d45]     context, '3.44', skip_version_check=True).attachments.update(
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: 4487e074-c245-44b2-a77e-3f1acde34d45]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: 4487e074-c245-44b2-a77e-3f1acde34d45]     return method.func(obj, *args, **kwargs)
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: 4487e074-c245-44b2-a77e-3f1acde34d45]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: 4487e074-c245-44b2-a77e-3f1acde34d45]     resp = self._update('/attachments/%s' % id, body)
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: 4487e074-c245-44b2-a77e-3f1acde34d45]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: 4487e074-c245-44b2-a77e-3f1acde34d45]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: 4487e074-c245-44b2-a77e-3f1acde34d45]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: 4487e074-c245-44b2-a77e-3f1acde34d45]     return self._cs_request(url, 'PUT', **kwargs)
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: 4487e074-c245-44b2-a77e-3f1acde34d45]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: 4487e074-c245-44b2-a77e-3f1acde34d45]     return self.request(url, method, **kwargs)
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: 4487e074-c245-44b2-a77e-3f1acde34d45]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: 4487e074-c245-44b2-a77e-3f1acde34d45]     raise exceptions.from_response(resp, body)
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: 4487e074-c245-44b2-a77e-3f1acde34d45] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ef320304-201e-40d8-8cff-5d61fc40fa98)
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: 4487e074-c245-44b2-a77e-3f1acde34d45] 
Nov 10 17:47:50 user nova-compute[75100]: DEBUG nova.compute.claims [None req-c25b2780-4005-494a-9d39-001fe3d9ff47 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: 4487e074-c245-44b2-a77e-3f1acde34d45] Aborting claim: <nova.compute.claims.Claim object at 0x7fa3bc71b490> {{(pid=75100) abort /opt/stack/nova/nova/compute/claims.py:84}}
Nov 10 17:47:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c25b2780-4005-494a-9d39-001fe3d9ff47 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:47:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c25b2780-4005-494a-9d39-001fe3d9ff47 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:47:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[676568af-6fe5-463a-a3d3-f5f6e806b013]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90b1a229568f\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.028s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03e6e0e-2e04-4060-b9e8-c1b34ed8321a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [None req-ffe8abf1-8810-4412-abd1-001a8a9e15dc tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] [instance: db3f69df-51b2-464c-921e-33171e29f46d] Failed to attach deb00979-ec6a-493d-9c69-a088a9fd213a at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-14b67197-884d-40d1-a91c-80954306f564)
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: db3f69df-51b2-464c-921e-33171e29f46d] Traceback (most recent call last):
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: db3f69df-51b2-464c-921e-33171e29f46d]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: db3f69df-51b2-464c-921e-33171e29f46d]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: db3f69df-51b2-464c-921e-33171e29f46d]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: db3f69df-51b2-464c-921e-33171e29f46d]     ret_val = method(obj, context, *args, **kwargs)
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: db3f69df-51b2-464c-921e-33171e29f46d]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: db3f69df-51b2-464c-921e-33171e29f46d]     self._do_attach(context, instance, volume, volume_api,
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: db3f69df-51b2-464c-921e-33171e29f46d]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: db3f69df-51b2-464c-921e-33171e29f46d]     self._volume_attach(context, volume, connector, instance,
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: db3f69df-51b2-464c-921e-33171e29f46d]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: db3f69df-51b2-464c-921e-33171e29f46d]     connection_info = volume_api.attachment_update(
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: db3f69df-51b2-464c-921e-33171e29f46d]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: db3f69df-51b2-464c-921e-33171e29f46d]     res = method(self, ctx, *args, **kwargs)
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: db3f69df-51b2-464c-921e-33171e29f46d]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: db3f69df-51b2-464c-921e-33171e29f46d]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: db3f69df-51b2-464c-921e-33171e29f46d]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: db3f69df-51b2-464c-921e-33171e29f46d]     with excutils.save_and_reraise_exception():
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: db3f69df-51b2-464c-921e-33171e29f46d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: db3f69df-51b2-464c-921e-33171e29f46d]     self.force_reraise()
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: db3f69df-51b2-464c-921e-33171e29f46d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: db3f69df-51b2-464c-921e-33171e29f46d]     raise self.value
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: db3f69df-51b2-464c-921e-33171e29f46d]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: db3f69df-51b2-464c-921e-33171e29f46d]     context, '3.44', skip_version_check=True).attachments.update(
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: db3f69df-51b2-464c-921e-33171e29f46d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: db3f69df-51b2-464c-921e-33171e29f46d]     return method.func(obj, *args, **kwargs)
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: db3f69df-51b2-464c-921e-33171e29f46d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: db3f69df-51b2-464c-921e-33171e29f46d]     resp = self._update('/attachments/%s' % id, body)
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: db3f69df-51b2-464c-921e-33171e29f46d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: db3f69df-51b2-464c-921e-33171e29f46d]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: db3f69df-51b2-464c-921e-33171e29f46d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: db3f69df-51b2-464c-921e-33171e29f46d]     return self._cs_request(url, 'PUT', **kwargs)
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: db3f69df-51b2-464c-921e-33171e29f46d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: db3f69df-51b2-464c-921e-33171e29f46d]     return self.request(url, method, **kwargs)
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: db3f69df-51b2-464c-921e-33171e29f46d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: db3f69df-51b2-464c-921e-33171e29f46d]     raise exceptions.from_response(resp, body)
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: db3f69df-51b2-464c-921e-33171e29f46d] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-14b67197-884d-40d1-a91c-80954306f564)
Nov 10 17:47:50 user nova-compute[75100]: ERROR nova.compute.manager [instance: db3f69df-51b2-464c-921e-33171e29f46d] 
Nov 10 17:47:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:47:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.030s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[90052aa4-43e6-4ee9-86e9-d397958ada6e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.031s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5db5c61-d288-4946-9b8e-855ebbaab99c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f02233-ed37-430b-a014-5a2767878e51]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:47:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[78127298-29f6-44cd-831f-3b24b0097d15]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:47:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 17:47:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f8c06f7f-be58-4b53-80dd-139748e13b94 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Start waiting for the detach event from libvirt for device tape628717d-72 with device alias net1 for instance 91238923-a64c-4f41-a046-be243eff880d {{(pid=75100) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 17:47:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ffe8abf1-8810-4412-abd1-001a8a9e15dc tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Lock "db3f69df-51b2-464c-921e-33171e29f46d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.272s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:47:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ded4cd-e14d-4b8e-aba4-c7ccfd4e01ee]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:47:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 17:47:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 17:47:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 17:47:50 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 17:47:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c67e4a-3b49-46f7-bcb3-caa5df0fb4a7]: (4, '') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 17:47:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 17:47:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 17:47:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 17:47:50 user nova-compute[75100]: DEBUG os_brick.utils [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] <== get_connector_properties: return (313ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90b1a229568f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 17:47:50 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Updating existing volume attachment record: 8c1ef3a7-38de-44ca-98ea-fd8b6ef31348 {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 17:47:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:47:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 17:47:50 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 17:47:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e78e90b-c212-4cd1-8cdb-c6715ae34b1e]: (4, '') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:47:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 17:47:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 17:47:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 17:47:50 user nova-compute[75100]: DEBUG os_brick.utils [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] <== get_connector_properties: return (285ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90b1a229568f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 17:47:50 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Updating existing volume attachment record: 36111bdf-1391-4447-83bc-f2e7066671ae {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server [None req-ffe8abf1-8810-4412-abd1-001a8a9e15dc tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-14b67197-884d-40d1-a91c-80954306f564)
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-14b67197-884d-40d1-a91c-80954306f564)
Nov 10 17:47:50 user nova-compute[75100]: ERROR oslo_messaging.rpc.server 
Nov 10 17:47:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-784d58a2-fcac-45b3-b3cd-8051eee8940a tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Acquiring lock "5b5ec5d3-fa6f-43de-b786-8c423064fe7a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:47:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-784d58a2-fcac-45b3-b3cd-8051eee8940a tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Lock "5b5ec5d3-fa6f-43de-b786-8c423064fe7a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:47:50 user nova-compute[75100]: INFO nova.compute.manager [None req-784d58a2-fcac-45b3-b3cd-8051eee8940a tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Detaching volume 99db3b35-0a16-407d-976b-bd388c535b13
Nov 10 17:47:50 user nova-compute[75100]: DEBUG nova.network.neutron [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Successfully created port: c6999453-6b72-4e2d-8fa2-d77386b95791 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 17:47:51 user nova-compute[75100]: INFO nova.virt.block_device [None req-784d58a2-fcac-45b3-b3cd-8051eee8940a tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Attempting to driver detach volume 99db3b35-0a16-407d-976b-bd388c535b13 from mountpoint /dev/sdc
Nov 10 17:47:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-784d58a2-fcac-45b3-b3cd-8051eee8940a tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Attempting to detach device sdc from instance 5b5ec5d3-fa6f-43de-b786-8c423064fe7a from the persistent domain config. {{(pid=75100) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 17:47:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-784d58a2-fcac-45b3-b3cd-8051eee8940a tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 17:47:51 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 17:47:51 user nova-compute[75100]:   <source dev="/dev/sdf"/>
Nov 10 17:47:51 user nova-compute[75100]:   <target dev="sdc" bus="scsi"/>
Nov 10 17:47:51 user nova-compute[75100]:   <serial>99db3b35-0a16-407d-976b-bd388c535b13</serial>
Nov 10 17:47:51 user nova-compute[75100]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 10 17:47:51 user nova-compute[75100]: </disk>
Nov 10 17:47:51 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 17:47:51 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-784d58a2-fcac-45b3-b3cd-8051eee8940a tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Successfully detached device sdc from instance 5b5ec5d3-fa6f-43de-b786-8c423064fe7a from the persistent domain config.
Nov 10 17:47:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-784d58a2-fcac-45b3-b3cd-8051eee8940a tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 5b5ec5d3-fa6f-43de-b786-8c423064fe7a from the live domain config. {{(pid=75100) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 17:47:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-784d58a2-fcac-45b3-b3cd-8051eee8940a tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 17:47:51 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 17:47:51 user nova-compute[75100]:   <source dev="/dev/sdf"/>
Nov 10 17:47:51 user nova-compute[75100]:   <target dev="sdc" bus="scsi"/>
Nov 10 17:47:51 user nova-compute[75100]:   <serial>99db3b35-0a16-407d-976b-bd388c535b13</serial>
Nov 10 17:47:51 user nova-compute[75100]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 10 17:47:51 user nova-compute[75100]: </disk>
Nov 10 17:47:51 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 17:47:51 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-c25b2780-4005-494a-9d39-001fe3d9ff47 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:47:51 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-c25b2780-4005-494a-9d39-001fe3d9ff47 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:47:51 user nova-compute[75100]: DEBUG nova.compute.manager [req-0c71d7ad-2911-494e-abea-feee5c358043 req-1a22ec1e-bfca-41f8-bf3d-f0229ff830a0 service nova] [instance: 91238923-a64c-4f41-a046-be243eff880d] Received event network-vif-unplugged-e628717d-728d-494a-be7e-ff3c79df75eb {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:47:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0c71d7ad-2911-494e-abea-feee5c358043 req-1a22ec1e-bfca-41f8-bf3d-f0229ff830a0 service nova] Acquiring lock "91238923-a64c-4f41-a046-be243eff880d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:47:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0c71d7ad-2911-494e-abea-feee5c358043 req-1a22ec1e-bfca-41f8-bf3d-f0229ff830a0 service nova] Lock "91238923-a64c-4f41-a046-be243eff880d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:47:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0c71d7ad-2911-494e-abea-feee5c358043 req-1a22ec1e-bfca-41f8-bf3d-f0229ff830a0 service nova] Lock "91238923-a64c-4f41-a046-be243eff880d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:47:51 user nova-compute[75100]: DEBUG nova.compute.manager [req-0c71d7ad-2911-494e-abea-feee5c358043 req-1a22ec1e-bfca-41f8-bf3d-f0229ff830a0 service nova] [instance: 91238923-a64c-4f41-a046-be243eff880d] No waiting events found dispatching network-vif-unplugged-e628717d-728d-494a-be7e-ff3c79df75eb {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:47:51 user nova-compute[75100]: WARNING nova.compute.manager [req-0c71d7ad-2911-494e-abea-feee5c358043 req-1a22ec1e-bfca-41f8-bf3d-f0229ff830a0 service nova] [instance: 91238923-a64c-4f41-a046-be243eff880d] Received unexpected event network-vif-unplugged-e628717d-728d-494a-be7e-ff3c79df75eb for instance with vm_state active and task_state None.
Nov 10 17:47:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c25b2780-4005-494a-9d39-001fe3d9ff47 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.758s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:47:51 user nova-compute[75100]: DEBUG nova.compute.manager [None req-c25b2780-4005-494a-9d39-001fe3d9ff47 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: 4487e074-c245-44b2-a77e-3f1acde34d45] Build of instance 4487e074-c245-44b2-a77e-3f1acde34d45 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ef320304-201e-40d8-8cff-5d61fc40fa98) {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2660}}
Nov 10 17:47:51 user nova-compute[75100]: DEBUG nova.compute.utils [None req-c25b2780-4005-494a-9d39-001fe3d9ff47 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: 4487e074-c245-44b2-a77e-3f1acde34d45] Build of instance 4487e074-c245-44b2-a77e-3f1acde34d45 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: {{(pid=75100) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Nov 10 17:47:51 user nova-compute[75100]: ERROR nova.compute.manager [None req-c25b2780-4005-494a-9d39-001fe3d9ff47 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: 4487e074-c245-44b2-a77e-3f1acde34d45] Build of instance 4487e074-c245-44b2-a77e-3f1acde34d45 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ef320304-201e-40d8-8cff-5d61fc40fa98): nova.exception.BuildAbortException: Build of instance 4487e074-c245-44b2-a77e-3f1acde34d45 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ef320304-201e-40d8-8cff-5d61fc40fa98)
Nov 10 17:47:51 user nova-compute[75100]: DEBUG nova.compute.manager [None req-c25b2780-4005-494a-9d39-001fe3d9ff47 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: 4487e074-c245-44b2-a77e-3f1acde34d45] Unplugging VIFs for instance {{(pid=75100) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2996}}
Nov 10 17:47:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-c25b2780-4005-494a-9d39-001fe3d9ff47 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1201414079',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1201414079',id=11,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72c970a503d74d32a1e2b71f086649fd',ramdisk_id='',reservation_id='r-nm7ymk8i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2001759307',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:47:19Z,user_data=None,user_id='b79cb22ab5774ce8991f237bd2204555',uuid=4487e074-c245-44b2-a77e-3f1acde34d45,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2af34931-32be-4aa2-a74f-2ce9d0a3a6de", "address": "fa:16:3e:34:8e:74", "network": {"id": "f240fae3-3d7b-4b6e-b04f-18550ab4d0a3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1007355777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c970a503d74d32a1e2b71f086649fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2af34931-32", "ovs_interfaceid": "2af34931-32be-4aa2-a74f-2ce9d0a3a6de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 17:47:51 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-c25b2780-4005-494a-9d39-001fe3d9ff47 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Converting VIF {"id": "2af34931-32be-4aa2-a74f-2ce9d0a3a6de", "address": "fa:16:3e:34:8e:74", "network": {"id": "f240fae3-3d7b-4b6e-b04f-18550ab4d0a3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1007355777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c970a503d74d32a1e2b71f086649fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2af34931-32", "ovs_interfaceid": "2af34931-32be-4aa2-a74f-2ce9d0a3a6de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:47:51 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-c25b2780-4005-494a-9d39-001fe3d9ff47 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:8e:74,bridge_name='br-int',has_traffic_filtering=True,id=2af34931-32be-4aa2-a74f-2ce9d0a3a6de,network=Network(f240fae3-3d7b-4b6e-b04f-18550ab4d0a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2af34931-32') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:47:51 user nova-compute[75100]: DEBUG os_vif [None req-c25b2780-4005-494a-9d39-001fe3d9ff47 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:8e:74,bridge_name='br-int',has_traffic_filtering=True,id=2af34931-32be-4aa2-a74f-2ce9d0a3a6de,network=Network(f240fae3-3d7b-4b6e-b04f-18550ab4d0a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2af34931-32') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 17:47:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:47:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2af34931-32, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:47:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 17:47:51 user nova-compute[75100]: INFO os_vif [None req-c25b2780-4005-494a-9d39-001fe3d9ff47 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:8e:74,bridge_name='br-int',has_traffic_filtering=True,id=2af34931-32be-4aa2-a74f-2ce9d0a3a6de,network=Network(f240fae3-3d7b-4b6e-b04f-18550ab4d0a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2af34931-32')
Nov 10 17:47:51 user nova-compute[75100]: DEBUG nova.compute.manager [None req-c25b2780-4005-494a-9d39-001fe3d9ff47 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: 4487e074-c245-44b2-a77e-3f1acde34d45] Unplugged VIFs for instance {{(pid=75100) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:3032}}
Nov 10 17:47:51 user nova-compute[75100]: DEBUG nova.compute.manager [None req-c25b2780-4005-494a-9d39-001fe3d9ff47 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: 4487e074-c245-44b2-a77e-3f1acde34d45] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 17:47:51 user nova-compute[75100]: DEBUG nova.network.neutron [None req-c25b2780-4005-494a-9d39-001fe3d9ff47 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: 4487e074-c245-44b2-a77e-3f1acde34d45] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 17:47:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:47:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-784d58a2-fcac-45b3-b3cd-8051eee8940a tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 5b5ec5d3-fa6f-43de-b786-8c423064fe7a {{(pid=75100) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 17:47:51 user nova-compute[75100]: DEBUG nova.network.neutron [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Successfully updated port: 28207b6f-d154-47a5-9b82-24cda17c04ee {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 17:47:51 user nova-compute[75100]: DEBUG nova.compute.manager [req-913f9118-17f2-49b7-af37-95ca8e8e77a4 req-8be62ad2-4d4d-4a37-9dda-f7bf874cc599 service nova] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Received event network-changed-28207b6f-d154-47a5-9b82-24cda17c04ee {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:47:51 user nova-compute[75100]: DEBUG nova.compute.manager [req-913f9118-17f2-49b7-af37-95ca8e8e77a4 req-8be62ad2-4d4d-4a37-9dda-f7bf874cc599 service nova] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Refreshing instance network info cache due to event network-changed-28207b6f-d154-47a5-9b82-24cda17c04ee. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 17:47:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-913f9118-17f2-49b7-af37-95ca8e8e77a4 req-8be62ad2-4d4d-4a37-9dda-f7bf874cc599 service nova] Acquiring lock "refresh_cache-78d2732a-9eff-480e-b844-d216537c5d91" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:47:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-913f9118-17f2-49b7-af37-95ca8e8e77a4 req-8be62ad2-4d4d-4a37-9dda-f7bf874cc599 service nova] Acquired lock "refresh_cache-78d2732a-9eff-480e-b844-d216537c5d91" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:47:51 user nova-compute[75100]: DEBUG nova.network.neutron [req-913f9118-17f2-49b7-af37-95ca8e8e77a4 req-8be62ad2-4d4d-4a37-9dda-f7bf874cc599 service nova] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Refreshing network info cache for port 28207b6f-d154-47a5-9b82-24cda17c04ee {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 17:47:51 user nova-compute[75100]: DEBUG nova.network.neutron [req-913f9118-17f2-49b7-af37-95ca8e8e77a4 req-8be62ad2-4d4d-4a37-9dda-f7bf874cc599 service nova] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 17:47:51 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Successfully created port: c33e37de-48ac-423f-93a4-311fb1fdfc0d {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 17:47:52 user nova-compute[75100]: DEBUG nova.network.neutron [None req-c25b2780-4005-494a-9d39-001fe3d9ff47 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: 4487e074-c245-44b2-a77e-3f1acde34d45] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:47:52 user nova-compute[75100]: INFO nova.compute.manager [None req-c25b2780-4005-494a-9d39-001fe3d9ff47 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: 4487e074-c245-44b2-a77e-3f1acde34d45] Took 0.93 seconds to deallocate network for instance.
Nov 10 17:47:52 user nova-compute[75100]: DEBUG nova.network.neutron [req-913f9118-17f2-49b7-af37-95ca8e8e77a4 req-8be62ad2-4d4d-4a37-9dda-f7bf874cc599 service nova] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:47:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-913f9118-17f2-49b7-af37-95ca8e8e77a4 req-8be62ad2-4d4d-4a37-9dda-f7bf874cc599 service nova] Releasing lock "refresh_cache-78d2732a-9eff-480e-b844-d216537c5d91" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:47:52 user nova-compute[75100]: DEBUG nova.compute.manager [None req-c25b2780-4005-494a-9d39-001fe3d9ff47 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: 4487e074-c245-44b2-a77e-3f1acde34d45] Detaching volume: 1c6d0fa4-b368-45a1-9902-bccfa2cb68df {{(pid=75100) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 10 17:47:52 user nova-compute[75100]: INFO nova.compute.manager [None req-c25b2780-4005-494a-9d39-001fe3d9ff47 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: 4487e074-c245-44b2-a77e-3f1acde34d45] Detaching volume 1c6d0fa4-b368-45a1-9902-bccfa2cb68df
Nov 10 17:47:52 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-c25b2780-4005-494a-9d39-001fe3d9ff47 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: 4487e074-c245-44b2-a77e-3f1acde34d45] Skipping driver_detach during remote rebuild. {{(pid=75100) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Nov 10 17:47:52 user nova-compute[75100]: DEBUG nova.network.neutron [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Successfully updated port: 60b2fd6c-b917-4212-bbc0-3b240bfc8cca {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 17:47:52 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-c25b2780-4005-494a-9d39-001fe3d9ff47 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Deleted allocations for instance 4487e074-c245-44b2-a77e-3f1acde34d45
Nov 10 17:47:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c25b2780-4005-494a-9d39-001fe3d9ff47 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lock "4487e074-c245-44b2-a77e-3f1acde34d45" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 33.937s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:47:52 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Successfully created port: f6738e49-d2d2-48d8-b355-3bbbe262ca20 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 17:47:53 user nova-compute[75100]: DEBUG nova.network.neutron [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Successfully updated port: e9c17c97-703b-42e1-8c85-36b37435fe47 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 17:47:53 user nova-compute[75100]: DEBUG nova.compute.manager [req-fb6c909b-1b13-479e-af38-316b37ad7203 req-9cec00e7-5480-4275-9a75-003e4e4ac708 service nova] [instance: 91238923-a64c-4f41-a046-be243eff880d] Received event network-vif-plugged-e628717d-728d-494a-be7e-ff3c79df75eb {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:47:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-fb6c909b-1b13-479e-af38-316b37ad7203 req-9cec00e7-5480-4275-9a75-003e4e4ac708 service nova] Acquiring lock "91238923-a64c-4f41-a046-be243eff880d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:47:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-fb6c909b-1b13-479e-af38-316b37ad7203 req-9cec00e7-5480-4275-9a75-003e4e4ac708 service nova] Lock "91238923-a64c-4f41-a046-be243eff880d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:47:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-fb6c909b-1b13-479e-af38-316b37ad7203 req-9cec00e7-5480-4275-9a75-003e4e4ac708 service nova] Lock "91238923-a64c-4f41-a046-be243eff880d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:47:53 user nova-compute[75100]: DEBUG nova.compute.manager [req-fb6c909b-1b13-479e-af38-316b37ad7203 req-9cec00e7-5480-4275-9a75-003e4e4ac708 service nova] [instance: 91238923-a64c-4f41-a046-be243eff880d] No waiting events found dispatching network-vif-plugged-e628717d-728d-494a-be7e-ff3c79df75eb {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:47:53 user nova-compute[75100]: WARNING nova.compute.manager [req-fb6c909b-1b13-479e-af38-316b37ad7203 req-9cec00e7-5480-4275-9a75-003e4e4ac708 service nova] [instance: 91238923-a64c-4f41-a046-be243eff880d] Received unexpected event network-vif-plugged-e628717d-728d-494a-be7e-ff3c79df75eb for instance with vm_state active and task_state None.
Nov 10 17:47:53 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Successfully updated port: 390c843a-5638-4ddb-aa25-622a55b1e89e {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 17:47:53 user nova-compute[75100]: DEBUG nova.compute.manager [req-beca2b47-1887-48da-b54d-aa5d957c0318 req-f5d84de9-07f4-467c-a8d3-594d0516a2df service nova] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Received event network-changed-60b2fd6c-b917-4212-bbc0-3b240bfc8cca {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:47:53 user nova-compute[75100]: DEBUG nova.compute.manager [req-beca2b47-1887-48da-b54d-aa5d957c0318 req-f5d84de9-07f4-467c-a8d3-594d0516a2df service nova] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Refreshing instance network info cache due to event network-changed-60b2fd6c-b917-4212-bbc0-3b240bfc8cca. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 17:47:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-beca2b47-1887-48da-b54d-aa5d957c0318 req-f5d84de9-07f4-467c-a8d3-594d0516a2df service nova] Acquiring lock "refresh_cache-78d2732a-9eff-480e-b844-d216537c5d91" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:47:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-beca2b47-1887-48da-b54d-aa5d957c0318 req-f5d84de9-07f4-467c-a8d3-594d0516a2df service nova] Acquired lock "refresh_cache-78d2732a-9eff-480e-b844-d216537c5d91" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:47:53 user nova-compute[75100]: DEBUG nova.network.neutron [req-beca2b47-1887-48da-b54d-aa5d957c0318 req-f5d84de9-07f4-467c-a8d3-594d0516a2df service nova] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Refreshing network info cache for port 60b2fd6c-b917-4212-bbc0-3b240bfc8cca {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 17:47:53 user nova-compute[75100]: DEBUG nova.network.neutron [req-beca2b47-1887-48da-b54d-aa5d957c0318 req-f5d84de9-07f4-467c-a8d3-594d0516a2df service nova] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 17:47:53 user nova-compute[75100]: DEBUG nova.network.neutron [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Successfully updated port: df32706a-68b5-4554-bbe3-220b4311c054 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 17:47:54 user nova-compute[75100]: DEBUG nova.network.neutron [req-beca2b47-1887-48da-b54d-aa5d957c0318 req-f5d84de9-07f4-467c-a8d3-594d0516a2df service nova] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:47:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-beca2b47-1887-48da-b54d-aa5d957c0318 req-f5d84de9-07f4-467c-a8d3-594d0516a2df service nova] Releasing lock "refresh_cache-78d2732a-9eff-480e-b844-d216537c5d91" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:47:54 user nova-compute[75100]: DEBUG nova.compute.manager [req-beca2b47-1887-48da-b54d-aa5d957c0318 req-f5d84de9-07f4-467c-a8d3-594d0516a2df service nova] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Received event network-changed-e9c17c97-703b-42e1-8c85-36b37435fe47 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:47:54 user nova-compute[75100]: DEBUG nova.compute.manager [req-beca2b47-1887-48da-b54d-aa5d957c0318 req-f5d84de9-07f4-467c-a8d3-594d0516a2df service nova] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Refreshing instance network info cache due to event network-changed-e9c17c97-703b-42e1-8c85-36b37435fe47. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 17:47:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-beca2b47-1887-48da-b54d-aa5d957c0318 req-f5d84de9-07f4-467c-a8d3-594d0516a2df service nova] Acquiring lock "refresh_cache-78d2732a-9eff-480e-b844-d216537c5d91" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:47:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-beca2b47-1887-48da-b54d-aa5d957c0318 req-f5d84de9-07f4-467c-a8d3-594d0516a2df service nova] Acquired lock "refresh_cache-78d2732a-9eff-480e-b844-d216537c5d91" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:47:54 user nova-compute[75100]: DEBUG nova.network.neutron [req-beca2b47-1887-48da-b54d-aa5d957c0318 req-f5d84de9-07f4-467c-a8d3-594d0516a2df service nova] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Refreshing network info cache for port e9c17c97-703b-42e1-8c85-36b37435fe47 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 17:47:54 user nova-compute[75100]: DEBUG nova.network.neutron [req-beca2b47-1887-48da-b54d-aa5d957c0318 req-f5d84de9-07f4-467c-a8d3-594d0516a2df service nova] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 17:47:54 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Successfully updated port: 95359730-5a6b-462b-bd0f-68ea44304d5a {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 17:47:54 user nova-compute[75100]: DEBUG nova.network.neutron [req-beca2b47-1887-48da-b54d-aa5d957c0318 req-f5d84de9-07f4-467c-a8d3-594d0516a2df service nova] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:47:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-beca2b47-1887-48da-b54d-aa5d957c0318 req-f5d84de9-07f4-467c-a8d3-594d0516a2df service nova] Releasing lock "refresh_cache-78d2732a-9eff-480e-b844-d216537c5d91" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:47:54 user nova-compute[75100]: DEBUG nova.network.neutron [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Successfully updated port: d0c5fcaa-e79c-41a5-8f36-18ac282f103a {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 17:47:54 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Successfully updated port: 610eef6d-c52f-4f14-9b7c-09739a395ecb {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 17:47:55 user nova-compute[75100]: DEBUG nova.network.neutron [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Successfully updated port: c63180df-c18f-473e-b3be-7b5bc22eccfa {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 17:47:55 user nova-compute[75100]: DEBUG nova.compute.manager [req-09931c04-9134-44eb-971b-ef95d260040c req-e277f697-d062-41f3-aa3d-dc102161e580 service nova] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Received event network-changed-390c843a-5638-4ddb-aa25-622a55b1e89e {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:47:55 user nova-compute[75100]: DEBUG nova.compute.manager [req-09931c04-9134-44eb-971b-ef95d260040c req-e277f697-d062-41f3-aa3d-dc102161e580 service nova] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Refreshing instance network info cache due to event network-changed-390c843a-5638-4ddb-aa25-622a55b1e89e. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 17:47:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-09931c04-9134-44eb-971b-ef95d260040c req-e277f697-d062-41f3-aa3d-dc102161e580 service nova] Acquiring lock "refresh_cache-ed8fb592-b4c8-4634-a618-0405d70a1acc" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:47:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-09931c04-9134-44eb-971b-ef95d260040c req-e277f697-d062-41f3-aa3d-dc102161e580 service nova] Acquired lock "refresh_cache-ed8fb592-b4c8-4634-a618-0405d70a1acc" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:47:55 user nova-compute[75100]: DEBUG nova.network.neutron [req-09931c04-9134-44eb-971b-ef95d260040c req-e277f697-d062-41f3-aa3d-dc102161e580 service nova] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Refreshing network info cache for port 390c843a-5638-4ddb-aa25-622a55b1e89e {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 17:47:55 user nova-compute[75100]: DEBUG nova.network.neutron [req-09931c04-9134-44eb-971b-ef95d260040c req-e277f697-d062-41f3-aa3d-dc102161e580 service nova] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 17:47:55 user nova-compute[75100]: DEBUG nova.compute.manager [req-750bbf64-5094-45d3-a4eb-fab500ef17f2 req-ead9e144-d20d-4a9a-b9de-d3fbf5938d74 service nova] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Received event network-changed-df32706a-68b5-4554-bbe3-220b4311c054 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:47:55 user nova-compute[75100]: DEBUG nova.compute.manager [req-750bbf64-5094-45d3-a4eb-fab500ef17f2 req-ead9e144-d20d-4a9a-b9de-d3fbf5938d74 service nova] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Refreshing instance network info cache due to event network-changed-df32706a-68b5-4554-bbe3-220b4311c054. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 17:47:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-750bbf64-5094-45d3-a4eb-fab500ef17f2 req-ead9e144-d20d-4a9a-b9de-d3fbf5938d74 service nova] Acquiring lock "refresh_cache-78d2732a-9eff-480e-b844-d216537c5d91" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:47:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-750bbf64-5094-45d3-a4eb-fab500ef17f2 req-ead9e144-d20d-4a9a-b9de-d3fbf5938d74 service nova] Acquired lock "refresh_cache-78d2732a-9eff-480e-b844-d216537c5d91" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:47:55 user nova-compute[75100]: DEBUG nova.network.neutron [req-750bbf64-5094-45d3-a4eb-fab500ef17f2 req-ead9e144-d20d-4a9a-b9de-d3fbf5938d74 service nova] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Refreshing network info cache for port df32706a-68b5-4554-bbe3-220b4311c054 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 17:47:55 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Successfully updated port: dccf5548-9267-43d7-93e8-10cf08624d0c {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 17:47:55 user nova-compute[75100]: DEBUG nova.network.neutron [req-09931c04-9134-44eb-971b-ef95d260040c req-e277f697-d062-41f3-aa3d-dc102161e580 service nova] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:47:55 user nova-compute[75100]: DEBUG nova.network.neutron [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Successfully updated port: c6999453-6b72-4e2d-8fa2-d77386b95791 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 17:47:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-09931c04-9134-44eb-971b-ef95d260040c req-e277f697-d062-41f3-aa3d-dc102161e580 service nova] Releasing lock "refresh_cache-ed8fb592-b4c8-4634-a618-0405d70a1acc" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:47:55 user nova-compute[75100]: DEBUG nova.compute.manager [req-09931c04-9134-44eb-971b-ef95d260040c req-e277f697-d062-41f3-aa3d-dc102161e580 service nova] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Received event network-changed-95359730-5a6b-462b-bd0f-68ea44304d5a {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:47:55 user nova-compute[75100]: DEBUG nova.compute.manager [req-09931c04-9134-44eb-971b-ef95d260040c req-e277f697-d062-41f3-aa3d-dc102161e580 service nova] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Refreshing instance network info cache due to event network-changed-95359730-5a6b-462b-bd0f-68ea44304d5a. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 17:47:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-09931c04-9134-44eb-971b-ef95d260040c req-e277f697-d062-41f3-aa3d-dc102161e580 service nova] Acquiring lock "refresh_cache-ed8fb592-b4c8-4634-a618-0405d70a1acc" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:47:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-09931c04-9134-44eb-971b-ef95d260040c req-e277f697-d062-41f3-aa3d-dc102161e580 service nova] Acquired lock "refresh_cache-ed8fb592-b4c8-4634-a618-0405d70a1acc" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:47:55 user nova-compute[75100]: DEBUG nova.network.neutron [req-09931c04-9134-44eb-971b-ef95d260040c req-e277f697-d062-41f3-aa3d-dc102161e580 service nova] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Refreshing network info cache for port 95359730-5a6b-462b-bd0f-68ea44304d5a {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 17:47:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] Acquiring lock "refresh_cache-78d2732a-9eff-480e-b844-d216537c5d91" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:47:55 user nova-compute[75100]: DEBUG nova.network.neutron [req-750bbf64-5094-45d3-a4eb-fab500ef17f2 req-ead9e144-d20d-4a9a-b9de-d3fbf5938d74 service nova] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 17:47:55 user nova-compute[75100]: DEBUG nova.network.neutron [req-09931c04-9134-44eb-971b-ef95d260040c req-e277f697-d062-41f3-aa3d-dc102161e580 service nova] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 17:47:56 user nova-compute[75100]: DEBUG nova.network.neutron [req-09931c04-9134-44eb-971b-ef95d260040c req-e277f697-d062-41f3-aa3d-dc102161e580 service nova] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:47:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-09931c04-9134-44eb-971b-ef95d260040c req-e277f697-d062-41f3-aa3d-dc102161e580 service nova] Releasing lock "refresh_cache-ed8fb592-b4c8-4634-a618-0405d70a1acc" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:47:56 user nova-compute[75100]: DEBUG nova.compute.manager [req-09931c04-9134-44eb-971b-ef95d260040c req-e277f697-d062-41f3-aa3d-dc102161e580 service nova] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Received event network-changed-610eef6d-c52f-4f14-9b7c-09739a395ecb {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:47:56 user nova-compute[75100]: DEBUG nova.compute.manager [req-09931c04-9134-44eb-971b-ef95d260040c req-e277f697-d062-41f3-aa3d-dc102161e580 service nova] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Refreshing instance network info cache due to event network-changed-610eef6d-c52f-4f14-9b7c-09739a395ecb. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 17:47:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-09931c04-9134-44eb-971b-ef95d260040c req-e277f697-d062-41f3-aa3d-dc102161e580 service nova] Acquiring lock "refresh_cache-ed8fb592-b4c8-4634-a618-0405d70a1acc" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:47:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-09931c04-9134-44eb-971b-ef95d260040c req-e277f697-d062-41f3-aa3d-dc102161e580 service nova] Acquired lock "refresh_cache-ed8fb592-b4c8-4634-a618-0405d70a1acc" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:47:56 user nova-compute[75100]: DEBUG nova.network.neutron [req-09931c04-9134-44eb-971b-ef95d260040c req-e277f697-d062-41f3-aa3d-dc102161e580 service nova] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Refreshing network info cache for port 610eef6d-c52f-4f14-9b7c-09739a395ecb {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 17:47:56 user nova-compute[75100]: DEBUG nova.network.neutron [req-09931c04-9134-44eb-971b-ef95d260040c req-e277f697-d062-41f3-aa3d-dc102161e580 service nova] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 17:47:56 user nova-compute[75100]: DEBUG nova.network.neutron [req-750bbf64-5094-45d3-a4eb-fab500ef17f2 req-ead9e144-d20d-4a9a-b9de-d3fbf5938d74 service nova] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:47:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-750bbf64-5094-45d3-a4eb-fab500ef17f2 req-ead9e144-d20d-4a9a-b9de-d3fbf5938d74 service nova] Releasing lock "refresh_cache-78d2732a-9eff-480e-b844-d216537c5d91" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:47:56 user nova-compute[75100]: DEBUG nova.compute.manager [req-750bbf64-5094-45d3-a4eb-fab500ef17f2 req-ead9e144-d20d-4a9a-b9de-d3fbf5938d74 service nova] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Received event network-changed-d0c5fcaa-e79c-41a5-8f36-18ac282f103a {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:47:56 user nova-compute[75100]: DEBUG nova.compute.manager [req-750bbf64-5094-45d3-a4eb-fab500ef17f2 req-ead9e144-d20d-4a9a-b9de-d3fbf5938d74 service nova] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Refreshing instance network info cache due to event network-changed-d0c5fcaa-e79c-41a5-8f36-18ac282f103a. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 17:47:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-750bbf64-5094-45d3-a4eb-fab500ef17f2 req-ead9e144-d20d-4a9a-b9de-d3fbf5938d74 service nova] Acquiring lock "refresh_cache-78d2732a-9eff-480e-b844-d216537c5d91" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:47:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-750bbf64-5094-45d3-a4eb-fab500ef17f2 req-ead9e144-d20d-4a9a-b9de-d3fbf5938d74 service nova] Acquired lock "refresh_cache-78d2732a-9eff-480e-b844-d216537c5d91" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:47:56 user nova-compute[75100]: DEBUG nova.network.neutron [req-750bbf64-5094-45d3-a4eb-fab500ef17f2 req-ead9e144-d20d-4a9a-b9de-d3fbf5938d74 service nova] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Refreshing network info cache for port d0c5fcaa-e79c-41a5-8f36-18ac282f103a {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 17:47:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:47:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:47:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 17:47:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:47:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:47:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:47:56 user nova-compute[75100]: DEBUG nova.network.neutron [req-09931c04-9134-44eb-971b-ef95d260040c req-e277f697-d062-41f3-aa3d-dc102161e580 service nova] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:47:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-09931c04-9134-44eb-971b-ef95d260040c req-e277f697-d062-41f3-aa3d-dc102161e580 service nova] Releasing lock "refresh_cache-ed8fb592-b4c8-4634-a618-0405d70a1acc" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:47:56 user nova-compute[75100]: DEBUG nova.network.neutron [req-750bbf64-5094-45d3-a4eb-fab500ef17f2 req-ead9e144-d20d-4a9a-b9de-d3fbf5938d74 service nova] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 17:47:56 user nova-compute[75100]: DEBUG nova.network.neutron [req-750bbf64-5094-45d3-a4eb-fab500ef17f2 req-ead9e144-d20d-4a9a-b9de-d3fbf5938d74 service nova] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:47:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-750bbf64-5094-45d3-a4eb-fab500ef17f2 req-ead9e144-d20d-4a9a-b9de-d3fbf5938d74 service nova] Releasing lock "refresh_cache-78d2732a-9eff-480e-b844-d216537c5d91" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:47:56 user nova-compute[75100]: DEBUG nova.compute.manager [req-750bbf64-5094-45d3-a4eb-fab500ef17f2 req-ead9e144-d20d-4a9a-b9de-d3fbf5938d74 service nova] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Received event network-changed-c63180df-c18f-473e-b3be-7b5bc22eccfa {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:47:56 user nova-compute[75100]: DEBUG nova.compute.manager [req-750bbf64-5094-45d3-a4eb-fab500ef17f2 req-ead9e144-d20d-4a9a-b9de-d3fbf5938d74 service nova] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Refreshing instance network info cache due to event network-changed-c63180df-c18f-473e-b3be-7b5bc22eccfa. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 17:47:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-750bbf64-5094-45d3-a4eb-fab500ef17f2 req-ead9e144-d20d-4a9a-b9de-d3fbf5938d74 service nova] Acquiring lock "refresh_cache-78d2732a-9eff-480e-b844-d216537c5d91" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:47:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-750bbf64-5094-45d3-a4eb-fab500ef17f2 req-ead9e144-d20d-4a9a-b9de-d3fbf5938d74 service nova] Acquired lock "refresh_cache-78d2732a-9eff-480e-b844-d216537c5d91" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:47:56 user nova-compute[75100]: DEBUG nova.network.neutron [req-750bbf64-5094-45d3-a4eb-fab500ef17f2 req-ead9e144-d20d-4a9a-b9de-d3fbf5938d74 service nova] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Refreshing network info cache for port c63180df-c18f-473e-b3be-7b5bc22eccfa {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 17:47:56 user nova-compute[75100]: DEBUG nova.network.neutron [req-750bbf64-5094-45d3-a4eb-fab500ef17f2 req-ead9e144-d20d-4a9a-b9de-d3fbf5938d74 service nova] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 17:47:57 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Successfully updated port: aaf512fe-ddb0-4593-81ab-48c0bf0239b9 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 17:47:57 user nova-compute[75100]: DEBUG nova.network.neutron [req-750bbf64-5094-45d3-a4eb-fab500ef17f2 req-ead9e144-d20d-4a9a-b9de-d3fbf5938d74 service nova] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:47:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-750bbf64-5094-45d3-a4eb-fab500ef17f2 req-ead9e144-d20d-4a9a-b9de-d3fbf5938d74 service nova] Releasing lock "refresh_cache-78d2732a-9eff-480e-b844-d216537c5d91" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:47:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] Acquired lock "refresh_cache-78d2732a-9eff-480e-b844-d216537c5d91" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:47:57 user nova-compute[75100]: DEBUG nova.network.neutron [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 17:47:57 user nova-compute[75100]: DEBUG nova.network.neutron [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 17:47:57 user nova-compute[75100]: DEBUG nova.compute.manager [req-03c4fe6b-e1be-45d5-8d83-a506dba6e594 req-19d21fb9-0521-4cf6-aa23-00388555e853 service nova] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Received event network-changed-dccf5548-9267-43d7-93e8-10cf08624d0c {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:47:57 user nova-compute[75100]: DEBUG nova.compute.manager [req-03c4fe6b-e1be-45d5-8d83-a506dba6e594 req-19d21fb9-0521-4cf6-aa23-00388555e853 service nova] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Refreshing instance network info cache due to event network-changed-dccf5548-9267-43d7-93e8-10cf08624d0c. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 17:47:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-03c4fe6b-e1be-45d5-8d83-a506dba6e594 req-19d21fb9-0521-4cf6-aa23-00388555e853 service nova] Acquiring lock "refresh_cache-ed8fb592-b4c8-4634-a618-0405d70a1acc" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:47:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-03c4fe6b-e1be-45d5-8d83-a506dba6e594 req-19d21fb9-0521-4cf6-aa23-00388555e853 service nova] Acquired lock "refresh_cache-ed8fb592-b4c8-4634-a618-0405d70a1acc" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:47:57 user nova-compute[75100]: DEBUG nova.network.neutron [req-03c4fe6b-e1be-45d5-8d83-a506dba6e594 req-19d21fb9-0521-4cf6-aa23-00388555e853 service nova] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Refreshing network info cache for port dccf5548-9267-43d7-93e8-10cf08624d0c {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 17:47:57 user nova-compute[75100]: DEBUG nova.network.neutron [req-03c4fe6b-e1be-45d5-8d83-a506dba6e594 req-19d21fb9-0521-4cf6-aa23-00388555e853 service nova] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 17:47:57 user nova-compute[75100]: DEBUG nova.network.neutron [req-03c4fe6b-e1be-45d5-8d83-a506dba6e594 req-19d21fb9-0521-4cf6-aa23-00388555e853 service nova] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:47:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-03c4fe6b-e1be-45d5-8d83-a506dba6e594 req-19d21fb9-0521-4cf6-aa23-00388555e853 service nova] Releasing lock "refresh_cache-ed8fb592-b4c8-4634-a618-0405d70a1acc" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:47:57 user nova-compute[75100]: DEBUG nova.compute.manager [req-03c4fe6b-e1be-45d5-8d83-a506dba6e594 req-19d21fb9-0521-4cf6-aa23-00388555e853 service nova] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Received event network-changed-aaf512fe-ddb0-4593-81ab-48c0bf0239b9 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:47:57 user nova-compute[75100]: DEBUG nova.compute.manager [req-03c4fe6b-e1be-45d5-8d83-a506dba6e594 req-19d21fb9-0521-4cf6-aa23-00388555e853 service nova] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Refreshing instance network info cache due to event network-changed-aaf512fe-ddb0-4593-81ab-48c0bf0239b9. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 17:47:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-03c4fe6b-e1be-45d5-8d83-a506dba6e594 req-19d21fb9-0521-4cf6-aa23-00388555e853 service nova] Acquiring lock "refresh_cache-ed8fb592-b4c8-4634-a618-0405d70a1acc" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:47:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-03c4fe6b-e1be-45d5-8d83-a506dba6e594 req-19d21fb9-0521-4cf6-aa23-00388555e853 service nova] Acquired lock "refresh_cache-ed8fb592-b4c8-4634-a618-0405d70a1acc" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:47:57 user nova-compute[75100]: DEBUG nova.network.neutron [req-03c4fe6b-e1be-45d5-8d83-a506dba6e594 req-19d21fb9-0521-4cf6-aa23-00388555e853 service nova] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Refreshing network info cache for port aaf512fe-ddb0-4593-81ab-48c0bf0239b9 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 17:47:57 user nova-compute[75100]: DEBUG nova.network.neutron [req-03c4fe6b-e1be-45d5-8d83-a506dba6e594 req-19d21fb9-0521-4cf6-aa23-00388555e853 service nova] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 17:47:58 user nova-compute[75100]: DEBUG nova.compute.manager [req-cbd994a8-5e0e-422c-9583-0ee3bdff40dc req-8048d35f-5e94-4335-a144-215f322745a6 service nova] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Received event network-changed-c6999453-6b72-4e2d-8fa2-d77386b95791 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:47:58 user nova-compute[75100]: DEBUG nova.compute.manager [req-cbd994a8-5e0e-422c-9583-0ee3bdff40dc req-8048d35f-5e94-4335-a144-215f322745a6 service nova] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Refreshing instance network info cache due to event network-changed-c6999453-6b72-4e2d-8fa2-d77386b95791. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 17:47:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cbd994a8-5e0e-422c-9583-0ee3bdff40dc req-8048d35f-5e94-4335-a144-215f322745a6 service nova] Acquiring lock "refresh_cache-78d2732a-9eff-480e-b844-d216537c5d91" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:47:58 user nova-compute[75100]: DEBUG nova.network.neutron [req-03c4fe6b-e1be-45d5-8d83-a506dba6e594 req-19d21fb9-0521-4cf6-aa23-00388555e853 service nova] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:47:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-03c4fe6b-e1be-45d5-8d83-a506dba6e594 req-19d21fb9-0521-4cf6-aa23-00388555e853 service nova] Releasing lock "refresh_cache-ed8fb592-b4c8-4634-a618-0405d70a1acc" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:47:58 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Successfully updated port: c33e37de-48ac-423f-93a4-311fb1fdfc0d {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 17:47:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:47:59 user nova-compute[75100]: DEBUG nova.compute.manager [req-821dea87-51ff-4cb1-9564-c745f1413460 req-2efc646a-d335-449e-b1e7-19e391c27ac3 service nova] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Received event network-changed-c33e37de-48ac-423f-93a4-311fb1fdfc0d {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:47:59 user nova-compute[75100]: DEBUG nova.compute.manager [req-821dea87-51ff-4cb1-9564-c745f1413460 req-2efc646a-d335-449e-b1e7-19e391c27ac3 service nova] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Refreshing instance network info cache due to event network-changed-c33e37de-48ac-423f-93a4-311fb1fdfc0d. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 17:47:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-821dea87-51ff-4cb1-9564-c745f1413460 req-2efc646a-d335-449e-b1e7-19e391c27ac3 service nova] Acquiring lock "refresh_cache-ed8fb592-b4c8-4634-a618-0405d70a1acc" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:47:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-821dea87-51ff-4cb1-9564-c745f1413460 req-2efc646a-d335-449e-b1e7-19e391c27ac3 service nova] Acquired lock "refresh_cache-ed8fb592-b4c8-4634-a618-0405d70a1acc" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:47:59 user nova-compute[75100]: DEBUG nova.network.neutron [req-821dea87-51ff-4cb1-9564-c745f1413460 req-2efc646a-d335-449e-b1e7-19e391c27ac3 service nova] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Refreshing network info cache for port c33e37de-48ac-423f-93a4-311fb1fdfc0d {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 17:47:59 user nova-compute[75100]: DEBUG nova.network.neutron [req-821dea87-51ff-4cb1-9564-c745f1413460 req-2efc646a-d335-449e-b1e7-19e391c27ac3 service nova] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 17:47:59 user nova-compute[75100]: DEBUG nova.network.neutron [req-821dea87-51ff-4cb1-9564-c745f1413460 req-2efc646a-d335-449e-b1e7-19e391c27ac3 service nova] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:47:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-821dea87-51ff-4cb1-9564-c745f1413460 req-2efc646a-d335-449e-b1e7-19e391c27ac3 service nova] Releasing lock "refresh_cache-ed8fb592-b4c8-4634-a618-0405d70a1acc" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:48:00 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Successfully updated port: f6738e49-d2d2-48d8-b355-3bbbe262ca20 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 17:48:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] Acquiring lock "refresh_cache-ed8fb592-b4c8-4634-a618-0405d70a1acc" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:48:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] Acquired lock "refresh_cache-ed8fb592-b4c8-4634-a618-0405d70a1acc" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:48:00 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 17:48:00 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 17:48:01 user nova-compute[75100]: DEBUG nova.network.neutron [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Updating instance_info_cache with network_info: [{"id": "28207b6f-d154-47a5-9b82-24cda17c04ee", "address": "fa:16:3e:87:da:93", "network": {"id": "0ab6fffb-433e-4e11-adcf-d028af23e504", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1202459467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27a7b57245324938a0f28dbf22654838", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28207b6f-d1", "ovs_interfaceid": "28207b6f-d154-47a5-9b82-24cda17c04ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "60b2fd6c-b917-4212-bbc0-3b240bfc8cca", "address": "fa:16:3e:e1:52:2a", "network": {"id": "bda18aa0-61d4-45b8-8c06-9533d9d94ccc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1082967403", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27a7b57245324938a0f28dbf22654838", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60b2fd6c-b9", "ovs_interfaceid": "60b2fd6c-b917-4212-bbc0-3b240bfc8cca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e9c17c97-703b-42e1-8c85-36b37435fe47", "address": "fa:16:3e:b6:7c:21", "network": {"id": "bda18aa0-61d4-45b8-8c06-9533d9d94ccc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1082967403", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27a7b57245324938a0f28dbf22654838", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9c17c97-70", "ovs_interfaceid": "e9c17c97-703b-42e1-8c85-36b37435fe47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "df32706a-68b5-4554-bbe3-220b4311c054", "address": "fa:16:3e:98:8d:63", "network": {"id": "bda18aa0-61d4-45b8-8c06-9533d9d94ccc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1082967403", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27a7b57245324938a0f28dbf22654838", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf32706a-68", "ovs_interfaceid": "df32706a-68b5-4554-bbe3-220b4311c054", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d0c5fcaa-e79c-41a5-8f36-18ac282f103a", "address": "fa:16:3e:5d:54:19", "network": {"id": "bda18aa0-61d4-45b8-8c06-9533d9d94ccc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1082967403", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27a7b57245324938a0f28dbf22654838", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0c5fcaa-e7", "ovs_interfaceid": "d0c5fcaa-e79c-41a5-8f36-18ac282f103a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c63180df-c18f-473e-b3be-7b5bc22eccfa", "address": "fa:16:3e:01:e5:39", "network": {"id": "dc736961-0336-4b20-ae04-9d9e0b69a208", "bridge": "br-int", "label": "tempest-device-tagging-net2-396395134", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "27a7b57245324938a0f28dbf22654838", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63180df-c1", "ovs_interfaceid": "c63180df-c18f-473e-b3be-7b5bc22eccfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c6999453-6b72-4e2d-8fa2-d77386b95791", "address": "fa:16:3e:05:31:e2", "network": {"id": "dc736961-0336-4b20-ae04-9d9e0b69a208", "bridge": "br-int", "label": "tempest-device-tagging-net2-396395134", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "27a7b57245324938a0f28dbf22654838", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6999453-6b", "ovs_interfaceid": "c6999453-6b72-4e2d-8fa2-d77386b95791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:48:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] Releasing lock "refresh_cache-78d2732a-9eff-480e-b844-d216537c5d91" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:48:01 user nova-compute[75100]: DEBUG nova.compute.manager [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Instance network_info: |[{"id": "28207b6f-d154-47a5-9b82-24cda17c04ee", "address": "fa:16:3e:87:da:93", "network": {"id": "0ab6fffb-433e-4e11-adcf-d028af23e504", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1202459467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27a7b57245324938a0f28dbf22654838", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28207b6f-d1", "ovs_interfaceid": "28207b6f-d154-47a5-9b82-24cda17c04ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "60b2fd6c-b917-4212-bbc0-3b240bfc8cca", "address": "fa:16:3e:e1:52:2a", "network": {"id": "bda18aa0-61d4-45b8-8c06-9533d9d94ccc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1082967403", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27a7b57245324938a0f28dbf22654838", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60b2fd6c-b9", "ovs_interfaceid": "60b2fd6c-b917-4212-bbc0-3b240bfc8cca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e9c17c97-703b-42e1-8c85-36b37435fe47", "address": "fa:16:3e:b6:7c:21", "network": {"id": "bda18aa0-61d4-45b8-8c06-9533d9d94ccc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1082967403", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27a7b57245324938a0f28dbf22654838", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9c17c97-70", "ovs_interfaceid": "e9c17c97-703b-42e1-8c85-36b37435fe47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "df32706a-68b5-4554-bbe3-220b4311c054", "address": "fa:16:3e:98:8d:63", "network": {"id": "bda18aa0-61d4-45b8-8c06-9533d9d94ccc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1082967403", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27a7b57245324938a0f28dbf22654838", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf32706a-68", "ovs_interfaceid": "df32706a-68b5-4554-bbe3-220b4311c054", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d0c5fcaa-e79c-41a5-8f36-18ac282f103a", "address": "fa:16:3e:5d:54:19", "network": {"id": "bda18aa0-61d4-45b8-8c06-9533d9d94ccc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1082967403", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27a7b57245324938a0f28dbf22654838", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0c5fcaa-e7", "ovs_interfaceid": "d0c5fcaa-e79c-41a5-8f36-18ac282f103a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c63180df-c18f-473e-b3be-7b5bc22eccfa", "address": "fa:16:3e:01:e5:39", "network": {"id": "dc736961-0336-4b20-ae04-9d9e0b69a208", "bridge": "br-int", "label": "tempest-device-tagging-net2-396395134", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "27a7b57245324938a0f28dbf22654838", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63180df-c1", "ovs_interfaceid": "c63180df-c18f-473e-b3be-7b5bc22eccfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c6999453-6b72-4e2d-8fa2-d77386b95791", "address": "fa:16:3e:05:31:e2", "network": {"id": "dc736961-0336-4b20-ae04-9d9e0b69a208", "bridge": "br-int", "label": "tempest-device-tagging-net2-396395134", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "27a7b57245324938a0f28dbf22654838", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6999453-6b", "ovs_interfaceid": "c6999453-6b72-4e2d-8fa2-d77386b95791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 17:48:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cbd994a8-5e0e-422c-9583-0ee3bdff40dc req-8048d35f-5e94-4335-a144-215f322745a6 service nova] Acquired lock "refresh_cache-78d2732a-9eff-480e-b844-d216537c5d91" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:48:01 user nova-compute[75100]: DEBUG nova.network.neutron [req-cbd994a8-5e0e-422c-9583-0ee3bdff40dc req-8048d35f-5e94-4335-a144-215f322745a6 service nova] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Refreshing network info cache for port c6999453-6b72-4e2d-8fa2-d77386b95791 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 17:48:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:01 user nova-compute[75100]: DEBUG nova.network.neutron [req-cbd994a8-5e0e-422c-9583-0ee3bdff40dc req-8048d35f-5e94-4335-a144-215f322745a6 service nova] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Updated VIF entry in instance network info cache for port c6999453-6b72-4e2d-8fa2-d77386b95791. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 17:48:01 user nova-compute[75100]: DEBUG nova.network.neutron [req-cbd994a8-5e0e-422c-9583-0ee3bdff40dc req-8048d35f-5e94-4335-a144-215f322745a6 service nova] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Updating instance_info_cache with network_info: [{"id": "28207b6f-d154-47a5-9b82-24cda17c04ee", "address": "fa:16:3e:87:da:93", "network": {"id": "0ab6fffb-433e-4e11-adcf-d028af23e504", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1202459467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27a7b57245324938a0f28dbf22654838", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28207b6f-d1", "ovs_interfaceid": "28207b6f-d154-47a5-9b82-24cda17c04ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "60b2fd6c-b917-4212-bbc0-3b240bfc8cca", "address": "fa:16:3e:e1:52:2a", "network": {"id": "bda18aa0-61d4-45b8-8c06-9533d9d94ccc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1082967403", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27a7b57245324938a0f28dbf22654838", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60b2fd6c-b9", "ovs_interfaceid": "60b2fd6c-b917-4212-bbc0-3b240bfc8cca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e9c17c97-703b-42e1-8c85-36b37435fe47", "address": "fa:16:3e:b6:7c:21", "network": {"id": "bda18aa0-61d4-45b8-8c06-9533d9d94ccc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1082967403", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27a7b57245324938a0f28dbf22654838", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9c17c97-70", "ovs_interfaceid": "e9c17c97-703b-42e1-8c85-36b37435fe47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "df32706a-68b5-4554-bbe3-220b4311c054", "address": "fa:16:3e:98:8d:63", "network": {"id": "bda18aa0-61d4-45b8-8c06-9533d9d94ccc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1082967403", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27a7b57245324938a0f28dbf22654838", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf32706a-68", "ovs_interfaceid": "df32706a-68b5-4554-bbe3-220b4311c054", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d0c5fcaa-e79c-41a5-8f36-18ac282f103a", "address": "fa:16:3e:5d:54:19", "network": {"id": "bda18aa0-61d4-45b8-8c06-9533d9d94ccc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1082967403", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27a7b57245324938a0f28dbf22654838", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0c5fcaa-e7", "ovs_interfaceid": "d0c5fcaa-e79c-41a5-8f36-18ac282f103a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c63180df-c18f-473e-b3be-7b5bc22eccfa", "address": "fa:16:3e:01:e5:39", "network": {"id": "dc736961-0336-4b20-ae04-9d9e0b69a208", "bridge": "br-int", "label": "tempest-device-tagging-net2-396395134", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "27a7b57245324938a0f28dbf22654838", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63180df-c1", "ovs_interfaceid": "c63180df-c18f-473e-b3be-7b5bc22eccfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c6999453-6b72-4e2d-8fa2-d77386b95791", "address": "fa:16:3e:05:31:e2", "network": {"id": "dc736961-0336-4b20-ae04-9d9e0b69a208", "bridge": "br-int", "label": "tempest-device-tagging-net2-396395134", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "27a7b57245324938a0f28dbf22654838", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6999453-6b", "ovs_interfaceid": "c6999453-6b72-4e2d-8fa2-d77386b95791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:48:01 user nova-compute[75100]: DEBUG nova.compute.manager [req-8f21aaea-1eab-43a1-b5c3-656be26ee6c3 req-2d1d46c0-faaf-4f89-be23-036c784f85ed service nova] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Received event network-changed-f6738e49-d2d2-48d8-b355-3bbbe262ca20 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:48:01 user nova-compute[75100]: DEBUG nova.compute.manager [req-8f21aaea-1eab-43a1-b5c3-656be26ee6c3 req-2d1d46c0-faaf-4f89-be23-036c784f85ed service nova] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Refreshing instance network info cache due to event network-changed-f6738e49-d2d2-48d8-b355-3bbbe262ca20. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 17:48:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8f21aaea-1eab-43a1-b5c3-656be26ee6c3 req-2d1d46c0-faaf-4f89-be23-036c784f85ed service nova] Acquiring lock "refresh_cache-ed8fb592-b4c8-4634-a618-0405d70a1acc" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:48:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cbd994a8-5e0e-422c-9583-0ee3bdff40dc req-8048d35f-5e94-4335-a144-215f322745a6 service nova] Releasing lock "refresh_cache-78d2732a-9eff-480e-b844-d216537c5d91" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:48:02 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Updating instance_info_cache with network_info: [{"id": "390c843a-5638-4ddb-aa25-622a55b1e89e", "address": "fa:16:3e:91:9b:34", "network": {"id": "492646a3-e87c-4e73-b830-5b82236e10bc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1282598664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a98ad0aacb594a5cb077b7dbb783e2a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap390c843a-56", "ovs_interfaceid": "390c843a-5638-4ddb-aa25-622a55b1e89e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "95359730-5a6b-462b-bd0f-68ea44304d5a", "address": "fa:16:3e:d5:cc:0b", "network": {"id": "e586a8bc-f76f-47af-8a8e-18f0303b0f48", "bridge": "br-int", "label": "tempest-device-tagging-net1-16513699", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a98ad0aacb594a5cb077b7dbb783e2a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95359730-5a", "ovs_interfaceid": "95359730-5a6b-462b-bd0f-68ea44304d5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "610eef6d-c52f-4f14-9b7c-09739a395ecb", "address": "fa:16:3e:63:43:5a", "network": {"id": "e586a8bc-f76f-47af-8a8e-18f0303b0f48", "bridge": "br-int", "label": "tempest-device-tagging-net1-16513699", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a98ad0aacb594a5cb077b7dbb783e2a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap610eef6d-c5", "ovs_interfaceid": "610eef6d-c52f-4f14-9b7c-09739a395ecb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dccf5548-9267-43d7-93e8-10cf08624d0c", "address": "fa:16:3e:cf:75:47", "network": {"id": "e586a8bc-f76f-47af-8a8e-18f0303b0f48", "bridge": "br-int", "label": "tempest-device-tagging-net1-16513699", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a98ad0aacb594a5cb077b7dbb783e2a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdccf5548-92", "ovs_interfaceid": "dccf5548-9267-43d7-93e8-10cf08624d0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "aaf512fe-ddb0-4593-81ab-48c0bf0239b9", "address": "fa:16:3e:ef:47:43", "network": {"id": "e586a8bc-f76f-47af-8a8e-18f0303b0f48", "bridge": "br-int", "label": "tempest-device-tagging-net1-16513699", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a98ad0aacb594a5cb077b7dbb783e2a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaf512fe-dd", "ovs_interfaceid": "aaf512fe-ddb0-4593-81ab-48c0bf0239b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c33e37de-48ac-423f-93a4-311fb1fdfc0d", "address": "fa:16:3e:71:cb:fd", "network": {"id": "da135c9a-a62d-4b7f-95b1-c61665b4eb92", "bridge": "br-int", "label": "tempest-device-tagging-net2-346127362", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a98ad0aacb594a5cb077b7dbb783e2a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc33e37de-48", "ovs_interfaceid": "c33e37de-48ac-423f-93a4-311fb1fdfc0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f6738e49-d2d2-48d8-b355-3bbbe262ca20", "address": "fa:16:3e:06:8c:c5", "network": {"id": "da135c9a-a62d-4b7f-95b1-c61665b4eb92", "bridge": "br-int", "label": "tempest-device-tagging-net2-346127362", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a98ad0aacb594a5cb077b7dbb783e2a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6738e49-d2", "ovs_interfaceid": "f6738e49-d2d2-48d8-b355-3bbbe262ca20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:48:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] Releasing lock "refresh_cache-ed8fb592-b4c8-4634-a618-0405d70a1acc" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:48:02 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Instance network_info: |[{"id": "390c843a-5638-4ddb-aa25-622a55b1e89e", "address": "fa:16:3e:91:9b:34", "network": {"id": "492646a3-e87c-4e73-b830-5b82236e10bc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1282598664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a98ad0aacb594a5cb077b7dbb783e2a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap390c843a-56", "ovs_interfaceid": "390c843a-5638-4ddb-aa25-622a55b1e89e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "95359730-5a6b-462b-bd0f-68ea44304d5a", "address": "fa:16:3e:d5:cc:0b", "network": {"id": "e586a8bc-f76f-47af-8a8e-18f0303b0f48", "bridge": "br-int", "label": "tempest-device-tagging-net1-16513699", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a98ad0aacb594a5cb077b7dbb783e2a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95359730-5a", "ovs_interfaceid": "95359730-5a6b-462b-bd0f-68ea44304d5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "610eef6d-c52f-4f14-9b7c-09739a395ecb", "address": "fa:16:3e:63:43:5a", "network": {"id": "e586a8bc-f76f-47af-8a8e-18f0303b0f48", "bridge": "br-int", "label": "tempest-device-tagging-net1-16513699", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a98ad0aacb594a5cb077b7dbb783e2a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap610eef6d-c5", "ovs_interfaceid": "610eef6d-c52f-4f14-9b7c-09739a395ecb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dccf5548-9267-43d7-93e8-10cf08624d0c", "address": "fa:16:3e:cf:75:47", "network": {"id": "e586a8bc-f76f-47af-8a8e-18f0303b0f48", "bridge": "br-int", "label": "tempest-device-tagging-net1-16513699", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a98ad0aacb594a5cb077b7dbb783e2a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdccf5548-92", "ovs_interfaceid": "dccf5548-9267-43d7-93e8-10cf08624d0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "aaf512fe-ddb0-4593-81ab-48c0bf0239b9", "address": "fa:16:3e:ef:47:43", "network": {"id": "e586a8bc-f76f-47af-8a8e-18f0303b0f48", "bridge": "br-int", "label": "tempest-device-tagging-net1-16513699", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a98ad0aacb594a5cb077b7dbb783e2a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaf512fe-dd", "ovs_interfaceid": "aaf512fe-ddb0-4593-81ab-48c0bf0239b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c33e37de-48ac-423f-93a4-311fb1fdfc0d", "address": "fa:16:3e:71:cb:fd", "network": {"id": "da135c9a-a62d-4b7f-95b1-c61665b4eb92", "bridge": "br-int", "label": "tempest-device-tagging-net2-346127362", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a98ad0aacb594a5cb077b7dbb783e2a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc33e37de-48", "ovs_interfaceid": "c33e37de-48ac-423f-93a4-311fb1fdfc0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f6738e49-d2d2-48d8-b355-3bbbe262ca20", "address": "fa:16:3e:06:8c:c5", "network": {"id": "da135c9a-a62d-4b7f-95b1-c61665b4eb92", "bridge": "br-int", "label": "tempest-device-tagging-net2-346127362", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a98ad0aacb594a5cb077b7dbb783e2a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6738e49-d2", "ovs_interfaceid": "f6738e49-d2d2-48d8-b355-3bbbe262ca20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 17:48:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8f21aaea-1eab-43a1-b5c3-656be26ee6c3 req-2d1d46c0-faaf-4f89-be23-036c784f85ed service nova] Acquired lock "refresh_cache-ed8fb592-b4c8-4634-a618-0405d70a1acc" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:48:02 user nova-compute[75100]: DEBUG nova.network.neutron [req-8f21aaea-1eab-43a1-b5c3-656be26ee6c3 req-2d1d46c0-faaf-4f89-be23-036c784f85ed service nova] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Refreshing network info cache for port f6738e49-d2d2-48d8-b355-3bbbe262ca20 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 17:48:03 user nova-compute[75100]: DEBUG nova.network.neutron [req-8f21aaea-1eab-43a1-b5c3-656be26ee6c3 req-2d1d46c0-faaf-4f89-be23-036c784f85ed service nova] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Updated VIF entry in instance network info cache for port f6738e49-d2d2-48d8-b355-3bbbe262ca20. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 17:48:03 user nova-compute[75100]: DEBUG nova.network.neutron [req-8f21aaea-1eab-43a1-b5c3-656be26ee6c3 req-2d1d46c0-faaf-4f89-be23-036c784f85ed service nova] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Updating instance_info_cache with network_info: [{"id": "390c843a-5638-4ddb-aa25-622a55b1e89e", "address": "fa:16:3e:91:9b:34", "network": {"id": "492646a3-e87c-4e73-b830-5b82236e10bc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1282598664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a98ad0aacb594a5cb077b7dbb783e2a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap390c843a-56", "ovs_interfaceid": "390c843a-5638-4ddb-aa25-622a55b1e89e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "95359730-5a6b-462b-bd0f-68ea44304d5a", "address": "fa:16:3e:d5:cc:0b", "network": {"id": "e586a8bc-f76f-47af-8a8e-18f0303b0f48", "bridge": "br-int", "label": "tempest-device-tagging-net1-16513699", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a98ad0aacb594a5cb077b7dbb783e2a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95359730-5a", "ovs_interfaceid": "95359730-5a6b-462b-bd0f-68ea44304d5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "610eef6d-c52f-4f14-9b7c-09739a395ecb", "address": "fa:16:3e:63:43:5a", "network": {"id": "e586a8bc-f76f-47af-8a8e-18f0303b0f48", "bridge": "br-int", "label": "tempest-device-tagging-net1-16513699", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a98ad0aacb594a5cb077b7dbb783e2a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap610eef6d-c5", "ovs_interfaceid": "610eef6d-c52f-4f14-9b7c-09739a395ecb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dccf5548-9267-43d7-93e8-10cf08624d0c", "address": "fa:16:3e:cf:75:47", "network": {"id": "e586a8bc-f76f-47af-8a8e-18f0303b0f48", "bridge": "br-int", "label": "tempest-device-tagging-net1-16513699", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a98ad0aacb594a5cb077b7dbb783e2a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdccf5548-92", "ovs_interfaceid": "dccf5548-9267-43d7-93e8-10cf08624d0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "aaf512fe-ddb0-4593-81ab-48c0bf0239b9", "address": "fa:16:3e:ef:47:43", "network": {"id": "e586a8bc-f76f-47af-8a8e-18f0303b0f48", "bridge": "br-int", "label": "tempest-device-tagging-net1-16513699", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a98ad0aacb594a5cb077b7dbb783e2a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaf512fe-dd", "ovs_interfaceid": "aaf512fe-ddb0-4593-81ab-48c0bf0239b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c33e37de-48ac-423f-93a4-311fb1fdfc0d", "address": "fa:16:3e:71:cb:fd", "network": {"id": "da135c9a-a62d-4b7f-95b1-c61665b4eb92", "bridge": "br-int", "label": "tempest-device-tagging-net2-346127362", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a98ad0aacb594a5cb077b7dbb783e2a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc33e37de-48", "ovs_interfaceid": "c33e37de-48ac-423f-93a4-311fb1fdfc0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f6738e49-d2d2-48d8-b355-3bbbe262ca20", "address": "fa:16:3e:06:8c:c5", "network": {"id": "da135c9a-a62d-4b7f-95b1-c61665b4eb92", "bridge": "br-int", "label": "tempest-device-tagging-net2-346127362", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a98ad0aacb594a5cb077b7dbb783e2a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6738e49-d2", "ovs_interfaceid": "f6738e49-d2d2-48d8-b355-3bbbe262ca20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:48:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8f21aaea-1eab-43a1-b5c3-656be26ee6c3 req-2d1d46c0-faaf-4f89-be23-036c784f85ed service nova] Releasing lock "refresh_cache-ed8fb592-b4c8-4634-a618-0405d70a1acc" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:48:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Acquiring lock "d61d3862-5be7-45cc-95a0-88124ac1725d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:48:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lock "d61d3862-5be7-45cc-95a0-88124ac1725d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:48:10 user nova-compute[75100]: DEBUG nova.compute.manager [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 17:48:10 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:48:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:48:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:48:10 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 17:48:10 user nova-compute[75100]: INFO nova.compute.claims [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] Claim successful on node user
Nov 10 17:48:10 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-f8c06f7f-be58-4b53-80dd-139748e13b94 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Waiting for libvirt event about the detach of device tape628717d-72 with device alias net1 from instance 91238923-a64c-4f41-a046-be243eff880d is timed out.
Nov 10 17:48:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-f8c06f7f-be58-4b53-80dd-139748e13b94 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:cf:c8:5b"/><model type="virtio"/><mtu size="1442"/><target dev="tape628717d-72"/></interface> {{(pid=75100) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 10 17:48:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-f8c06f7f-be58-4b53-80dd-139748e13b94 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:cf:c8:5b"/><model type="virtio"/><mtu size="1442"/><target dev="tape628717d-72"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 10 17:48:10 user nova-compute[75100]:   <name>instance-00000007</name>
Nov 10 17:48:10 user nova-compute[75100]:   <uuid>91238923-a64c-4f41-a046-be243eff880d</uuid>
Nov 10 17:48:10 user nova-compute[75100]:   <metadata>
Nov 10 17:48:10 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 17:48:10 user nova-compute[75100]:   <nova:package version="0.0.0"/>
Nov 10 17:48:10 user nova-compute[75100]:   <nova:name>tempest-device-tagging-server-1217309978</nova:name>
Nov 10 17:48:10 user nova-compute[75100]:   <nova:creationTime>2023-11-10 17:46:51</nova:creationTime>
Nov 10 17:48:10 user nova-compute[75100]:   <nova:flavor name="m1.tiny">
Nov 10 17:48:10 user nova-compute[75100]:     <nova:memory>512</nova:memory>
Nov 10 17:48:10 user nova-compute[75100]:     <nova:disk>1</nova:disk>
Nov 10 17:48:10 user nova-compute[75100]:     <nova:swap>0</nova:swap>
Nov 10 17:48:10 user nova-compute[75100]:     <nova:ephemeral>0</nova:ephemeral>
Nov 10 17:48:10 user nova-compute[75100]:     <nova:vcpus>1</nova:vcpus>
Nov 10 17:48:10 user nova-compute[75100]:   </nova:flavor>
Nov 10 17:48:10 user nova-compute[75100]:   <nova:owner>
Nov 10 17:48:10 user nova-compute[75100]:     <nova:user uuid="83545cded878478a8c823e5614376f18">tempest-TaggedAttachmentsTest-1600859769-project-member</nova:user>
Nov 10 17:48:10 user nova-compute[75100]:     <nova:project uuid="c38f5a70dae74e3cb19dd6ddade72581">tempest-TaggedAttachmentsTest-1600859769</nova:project>
Nov 10 17:48:10 user nova-compute[75100]:   </nova:owner>
Nov 10 17:48:10 user nova-compute[75100]:   <nova:root type="image" uuid="e3cc5321-4d40-49ee-885c-700e14741732"/>
Nov 10 17:48:10 user nova-compute[75100]:   <nova:ports>
Nov 10 17:48:10 user nova-compute[75100]:     <nova:port uuid="4d2871cf-d6d9-4edb-9a0d-bc275ee11e13">
Nov 10 17:48:10 user nova-compute[75100]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 10 17:48:10 user nova-compute[75100]:     </nova:port>
Nov 10 17:48:10 user nova-compute[75100]:     <nova:port uuid="e628717d-728d-494a-be7e-ff3c79df75eb">
Nov 10 17:48:10 user nova-compute[75100]:       <nova:ip type="fixed" address="10.10.10.248" ipVersion="4"/>
Nov 10 17:48:10 user nova-compute[75100]:     </nova:port>
Nov 10 17:48:10 user nova-compute[75100]:   </nova:ports>
Nov 10 17:48:10 user nova-compute[75100]: </nova:instance>
Nov 10 17:48:10 user nova-compute[75100]:   </metadata>
Nov 10 17:48:10 user nova-compute[75100]:   <memory unit='KiB'>524288</memory>
Nov 10 17:48:10 user nova-compute[75100]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 10 17:48:10 user nova-compute[75100]:   <vcpu placement='static'>1</vcpu>
Nov 10 17:48:10 user nova-compute[75100]:   <resource>
Nov 10 17:48:10 user nova-compute[75100]:     <partition>/machine</partition>
Nov 10 17:48:10 user nova-compute[75100]:   </resource>
Nov 10 17:48:10 user nova-compute[75100]:   <sysinfo type='smbios'>
Nov 10 17:48:10 user nova-compute[75100]:     <system>
Nov 10 17:48:10 user nova-compute[75100]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 10 17:48:10 user nova-compute[75100]:       <entry name='product'>OpenStack Nova</entry>
Nov 10 17:48:10 user nova-compute[75100]:       <entry name='version'>0.0.0</entry>
Nov 10 17:48:10 user nova-compute[75100]:       <entry name='serial'>91238923-a64c-4f41-a046-be243eff880d</entry>
Nov 10 17:48:10 user nova-compute[75100]:       <entry name='uuid'>91238923-a64c-4f41-a046-be243eff880d</entry>
Nov 10 17:48:10 user nova-compute[75100]:       <entry name='family'>Virtual Machine</entry>
Nov 10 17:48:10 user nova-compute[75100]:     </system>
Nov 10 17:48:10 user nova-compute[75100]:   </sysinfo>
Nov 10 17:48:10 user nova-compute[75100]:   <os>
Nov 10 17:48:10 user nova-compute[75100]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 10 17:48:10 user nova-compute[75100]:     <boot dev='hd'/>
Nov 10 17:48:10 user nova-compute[75100]:     <smbios mode='sysinfo'/>
Nov 10 17:48:10 user nova-compute[75100]:   </os>
Nov 10 17:48:10 user nova-compute[75100]:   <features>
Nov 10 17:48:10 user nova-compute[75100]:     <acpi/>
Nov 10 17:48:10 user nova-compute[75100]:     <apic/>
Nov 10 17:48:10 user nova-compute[75100]:     <vmcoreinfo state='on'/>
Nov 10 17:48:10 user nova-compute[75100]:   </features>
Nov 10 17:48:10 user nova-compute[75100]:   <cpu mode='custom' match='exact' check='full'>
Nov 10 17:48:10 user nova-compute[75100]:     <model fallback='forbid'>Nehalem</model>
Nov 10 17:48:10 user nova-compute[75100]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 10 17:48:10 user nova-compute[75100]:     <feature policy='require' name='vme'/>
Nov 10 17:48:10 user nova-compute[75100]:     <feature policy='require' name='x2apic'/>
Nov 10 17:48:10 user nova-compute[75100]:     <feature policy='require' name='hypervisor'/>
Nov 10 17:48:10 user nova-compute[75100]:   </cpu>
Nov 10 17:48:10 user nova-compute[75100]:   <clock offset='utc'>
Nov 10 17:48:10 user nova-compute[75100]:     <timer name='pit' tickpolicy='delay'/>
Nov 10 17:48:10 user nova-compute[75100]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 10 17:48:10 user nova-compute[75100]:     <timer name='hpet' present='no'/>
Nov 10 17:48:10 user nova-compute[75100]:   </clock>
Nov 10 17:48:10 user nova-compute[75100]:   <on_poweroff>destroy</on_poweroff>
Nov 10 17:48:10 user nova-compute[75100]:   <on_reboot>restart</on_reboot>
Nov 10 17:48:10 user nova-compute[75100]:   <on_crash>destroy</on_crash>
Nov 10 17:48:10 user nova-compute[75100]:   <devices>
Nov 10 17:48:10 user nova-compute[75100]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 10 17:48:10 user nova-compute[75100]:     <disk type='file' device='disk'>
Nov 10 17:48:10 user nova-compute[75100]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 10 17:48:10 user nova-compute[75100]:       <source file='/opt/stack/data/nova/instances/91238923-a64c-4f41-a046-be243eff880d/disk' index='2'/>
Nov 10 17:48:10 user nova-compute[75100]:       <backingStore type='file' index='3'>
Nov 10 17:48:10 user nova-compute[75100]:         <format type='raw'/>
Nov 10 17:48:10 user nova-compute[75100]:         <source file='/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520'/>
Nov 10 17:48:10 user nova-compute[75100]:         <backingStore/>
Nov 10 17:48:10 user nova-compute[75100]:       </backingStore>
Nov 10 17:48:10 user nova-compute[75100]:       <target dev='vda' bus='virtio'/>
Nov 10 17:48:10 user nova-compute[75100]:       <alias name='virtio-disk0'/>
Nov 10 17:48:10 user nova-compute[75100]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 10 17:48:10 user nova-compute[75100]:     </disk>
Nov 10 17:48:10 user nova-compute[75100]:     <disk type='file' device='cdrom'>
Nov 10 17:48:10 user nova-compute[75100]:       <driver name='qemu' type='raw' cache='none'/>
Nov 10 17:48:10 user nova-compute[75100]:       <source file='/opt/stack/data/nova/instances/91238923-a64c-4f41-a046-be243eff880d/disk.config' index='1'/>
Nov 10 17:48:10 user nova-compute[75100]:       <backingStore/>
Nov 10 17:48:10 user nova-compute[75100]:       <target dev='hda' bus='ide'/>
Nov 10 17:48:10 user nova-compute[75100]:       <readonly/>
Nov 10 17:48:10 user nova-compute[75100]:       <alias name='ide0-0-0'/>
Nov 10 17:48:10 user nova-compute[75100]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 10 17:48:10 user nova-compute[75100]:     </disk>
Nov 10 17:48:10 user nova-compute[75100]:     <controller type='usb' index='0' model='none'>
Nov 10 17:48:10 user nova-compute[75100]:       <alias name='usb'/>
Nov 10 17:48:10 user nova-compute[75100]:     </controller>
Nov 10 17:48:10 user nova-compute[75100]:     <controller type='pci' index='0' model='pci-root'>
Nov 10 17:48:10 user nova-compute[75100]:       <alias name='pci.0'/>
Nov 10 17:48:10 user nova-compute[75100]:     </controller>
Nov 10 17:48:10 user nova-compute[75100]:     <controller type='ide' index='0'>
Nov 10 17:48:10 user nova-compute[75100]:       <alias name='ide'/>
Nov 10 17:48:10 user nova-compute[75100]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 10 17:48:10 user nova-compute[75100]:     </controller>
Nov 10 17:48:10 user nova-compute[75100]:     <interface type='ethernet'>
Nov 10 17:48:10 user nova-compute[75100]:       <mac address='fa:16:3e:8e:18:ef'/>
Nov 10 17:48:10 user nova-compute[75100]:       <target dev='tap4d2871cf-d6'/>
Nov 10 17:48:10 user nova-compute[75100]:       <model type='virtio'/>
Nov 10 17:48:10 user nova-compute[75100]:       <mtu size='1442'/>
Nov 10 17:48:10 user nova-compute[75100]:       <alias name='net0'/>
Nov 10 17:48:10 user nova-compute[75100]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 10 17:48:10 user nova-compute[75100]:     </interface>
Nov 10 17:48:10 user nova-compute[75100]:     <serial type='pty'>
Nov 10 17:48:10 user nova-compute[75100]:       <source path='/dev/pts/6'/>
Nov 10 17:48:10 user nova-compute[75100]:       <log file='/opt/stack/data/nova/instances/91238923-a64c-4f41-a046-be243eff880d/console.log' append='off'/>
Nov 10 17:48:10 user nova-compute[75100]:       <target type='isa-serial' port='0'>
Nov 10 17:48:10 user nova-compute[75100]:         <model name='isa-serial'/>
Nov 10 17:48:10 user nova-compute[75100]:       </target>
Nov 10 17:48:10 user nova-compute[75100]:       <alias name='serial0'/>
Nov 10 17:48:10 user nova-compute[75100]:     </serial>
Nov 10 17:48:10 user nova-compute[75100]:     <console type='pty' tty='/dev/pts/6'>
Nov 10 17:48:10 user nova-compute[75100]:       <source path='/dev/pts/6'/>
Nov 10 17:48:10 user nova-compute[75100]:       <log file='/opt/stack/data/nova/instances/91238923-a64c-4f41-a046-be243eff880d/console.log' append='off'/>
Nov 10 17:48:10 user nova-compute[75100]:       <target type='serial' port='0'/>
Nov 10 17:48:10 user nova-compute[75100]:       <alias name='serial0'/>
Nov 10 17:48:10 user nova-compute[75100]:     </console>
Nov 10 17:48:10 user nova-compute[75100]:     <input type='mouse' bus='ps2'>
Nov 10 17:48:10 user nova-compute[75100]:       <alias name='input0'/>
Nov 10 17:48:10 user nova-compute[75100]:     </input>
Nov 10 17:48:10 user nova-compute[75100]:     <input type='keyboard' bus='ps2'>
Nov 10 17:48:10 user nova-compute[75100]:       <alias name='input1'/>
Nov 10 17:48:10 user nova-compute[75100]:     </input>
Nov 10 17:48:10 user nova-compute[75100]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 10 17:48:10 user nova-compute[75100]:       <listen type='address' address='0.0.0.0'/>
Nov 10 17:48:10 user nova-compute[75100]:     </graphics>
Nov 10 17:48:10 user nova-compute[75100]:     <audio id='1' type='none'/>
Nov 10 17:48:10 user nova-compute[75100]:     <video>
Nov 10 17:48:10 user nova-compute[75100]:       <model type='virtio' heads='1' primary='yes'/>
Nov 10 17:48:10 user nova-compute[75100]:       <alias name='video0'/>
Nov 10 17:48:10 user nova-compute[75100]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 10 17:48:10 user nova-compute[75100]:     </video>
Nov 10 17:48:10 user nova-compute[75100]:     <memballoon model='virtio'>
Nov 10 17:48:10 user nova-compute[75100]:       <stats period='10'/>
Nov 10 17:48:10 user nova-compute[75100]:       <alias name='balloon0'/>
Nov 10 17:48:10 user nova-compute[75100]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 10 17:48:10 user nova-compute[75100]:     </memballoon>
Nov 10 17:48:10 user nova-compute[75100]:     <rng model='virtio'>
Nov 10 17:48:10 user nova-compute[75100]:       <backend model='random'>/dev/urandom</backend>
Nov 10 17:48:10 user nova-compute[75100]:       <alias name='rng0'/>
Nov 10 17:48:10 user nova-compute[75100]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 10 17:48:10 user nova-compute[75100]:     </rng>
Nov 10 17:48:10 user nova-compute[75100]:   </devices>
Nov 10 17:48:10 user nova-compute[75100]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 10 17:48:10 user nova-compute[75100]:     <label>libvirt-91238923-a64c-4f41-a046-be243eff880d</label>
Nov 10 17:48:10 user nova-compute[75100]:     <imagelabel>libvirt-91238923-a64c-4f41-a046-be243eff880d</imagelabel>
Nov 10 17:48:10 user nova-compute[75100]:   </seclabel>
Nov 10 17:48:10 user nova-compute[75100]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 10 17:48:10 user nova-compute[75100]:     <label>+64055:+108</label>
Nov 10 17:48:10 user nova-compute[75100]:     <imagelabel>+64055:+108</imagelabel>
Nov 10 17:48:10 user nova-compute[75100]:   </seclabel>
Nov 10 17:48:10 user nova-compute[75100]: </domain>
Nov 10 17:48:10 user nova-compute[75100]:  {{(pid=75100) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 10 17:48:10 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-f8c06f7f-be58-4b53-80dd-139748e13b94 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Successfully detached device tape628717d-72 from instance 91238923-a64c-4f41-a046-be243eff880d from the live domain config.
Nov 10 17:48:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-f8c06f7f-be58-4b53-80dd-139748e13b94 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T17:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1217309978',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1217309978',id=7,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDg6Whui6h8FFFZnFwQnZiCuU3HjskJ2h5m1lP5l89/I6dnqvQ2dx39WpWkClYX9LsxzEk1B3cwB2sN+VxVpaZakTcKBRQUFmNH6ntC81O0eJh0TTBqxIPcr2Favd3KjTw==',key_name='tempest-keypair-326242402',keypairs=<?>,launch_index=0,launched_at=2023-11-10T17:45:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c38f5a70dae74e3cb19dd6ddade72581',ramdisk_id='',reservation_id='r-v9u7eycj',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1600859769',owner_user_name='tempest-TaggedAttachmentsTest-1600859769-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T17:45:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83545cded878478a8c823e5614376f18',uuid=91238923-a64c-4f41-a046-be243eff880d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e628717d-728d-494a-be7e-ff3c79df75eb", "address": "fa:16:3e:cf:c8:5b", "network": {"id": "6b2b7289-3f5a-49f8-b185-8929b13584e5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-149434076", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c38f5a70dae74e3cb19dd6ddade72581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape628717d-72", "ovs_interfaceid": "e628717d-728d-494a-be7e-ff3c79df75eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 17:48:10 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-f8c06f7f-be58-4b53-80dd-139748e13b94 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Converting VIF {"id": "e628717d-728d-494a-be7e-ff3c79df75eb", "address": "fa:16:3e:cf:c8:5b", "network": {"id": "6b2b7289-3f5a-49f8-b185-8929b13584e5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-149434076", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c38f5a70dae74e3cb19dd6ddade72581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape628717d-72", "ovs_interfaceid": "e628717d-728d-494a-be7e-ff3c79df75eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:48:10 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-f8c06f7f-be58-4b53-80dd-139748e13b94 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:c8:5b,bridge_name='br-int',has_traffic_filtering=True,id=e628717d-728d-494a-be7e-ff3c79df75eb,network=Network(6b2b7289-3f5a-49f8-b185-8929b13584e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape628717d-72') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:48:10 user nova-compute[75100]: DEBUG os_vif [None req-f8c06f7f-be58-4b53-80dd-139748e13b94 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:c8:5b,bridge_name='br-int',has_traffic_filtering=True,id=e628717d-728d-494a-be7e-ff3c79df75eb,network=Network(6b2b7289-3f5a-49f8-b185-8929b13584e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape628717d-72') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 17:48:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape628717d-72, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:48:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:48:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8afefabe-558d-4e7d-925d-9a17a7307656) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:48:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:48:10 user nova-compute[75100]: INFO os_vif [None req-f8c06f7f-be58-4b53-80dd-139748e13b94 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:c8:5b,bridge_name='br-int',has_traffic_filtering=True,id=e628717d-728d-494a-be7e-ff3c79df75eb,network=Network(6b2b7289-3f5a-49f8-b185-8929b13584e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape628717d-72')
Nov 10 17:48:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-f8c06f7f-be58-4b53-80dd-139748e13b94 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 17:48:10 user nova-compute[75100]:   <nova:package version="0.0.0"/>
Nov 10 17:48:10 user nova-compute[75100]:   <nova:name>tempest-device-tagging-server-1217309978</nova:name>
Nov 10 17:48:10 user nova-compute[75100]:   <nova:creationTime>2023-11-10 17:48:10</nova:creationTime>
Nov 10 17:48:10 user nova-compute[75100]:   <nova:flavor name="m1.tiny">
Nov 10 17:48:10 user nova-compute[75100]:     <nova:memory>512</nova:memory>
Nov 10 17:48:10 user nova-compute[75100]:     <nova:disk>1</nova:disk>
Nov 10 17:48:10 user nova-compute[75100]:     <nova:swap>0</nova:swap>
Nov 10 17:48:10 user nova-compute[75100]:     <nova:ephemeral>0</nova:ephemeral>
Nov 10 17:48:10 user nova-compute[75100]:     <nova:vcpus>1</nova:vcpus>
Nov 10 17:48:10 user nova-compute[75100]:   </nova:flavor>
Nov 10 17:48:10 user nova-compute[75100]:   <nova:owner>
Nov 10 17:48:10 user nova-compute[75100]:     <nova:user uuid="83545cded878478a8c823e5614376f18">tempest-TaggedAttachmentsTest-1600859769-project-member</nova:user>
Nov 10 17:48:10 user nova-compute[75100]:     <nova:project uuid="c38f5a70dae74e3cb19dd6ddade72581">tempest-TaggedAttachmentsTest-1600859769</nova:project>
Nov 10 17:48:10 user nova-compute[75100]:   </nova:owner>
Nov 10 17:48:10 user nova-compute[75100]:   <nova:root type="image" uuid="e3cc5321-4d40-49ee-885c-700e14741732"/>
Nov 10 17:48:10 user nova-compute[75100]:   <nova:ports>
Nov 10 17:48:10 user nova-compute[75100]:     <nova:port uuid="4d2871cf-d6d9-4edb-9a0d-bc275ee11e13">
Nov 10 17:48:10 user nova-compute[75100]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 10 17:48:10 user nova-compute[75100]:     </nova:port>
Nov 10 17:48:10 user nova-compute[75100]:   </nova:ports>
Nov 10 17:48:10 user nova-compute[75100]: </nova:instance>
Nov 10 17:48:10 user nova-compute[75100]:  {{(pid=75100) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 10 17:48:10 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:48:10 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:48:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.531s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:48:10 user nova-compute[75100]: DEBUG nova.compute.manager [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 17:48:10 user nova-compute[75100]: DEBUG nova.compute.manager [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 17:48:10 user nova-compute[75100]: DEBUG nova.network.neutron [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 17:48:11 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 17:48:11 user nova-compute[75100]: DEBUG nova.compute.manager [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG nova.policy [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b79cb22ab5774ce8991f237bd2204555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c970a503d74d32a1e2b71f086649fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG nova.compute.manager [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 17:48:11 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] Creating image(s)
Nov 10 17:48:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Acquiring lock "/opt/stack/data/nova/instances/d61d3862-5be7-45cc-95a0-88124ac1725d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lock "/opt/stack/data/nova/instances/d61d3862-5be7-45cc-95a0-88124ac1725d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lock "/opt/stack/data/nova/instances/d61d3862-5be7-45cc-95a0-88124ac1725d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.207s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Acquiring lock "818b9e28e061d41a38d903968b229be2ed9ba520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f8c06f7f-be58-4b53-80dd-139748e13b94 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Acquiring lock "refresh_cache-91238923-a64c-4f41-a046-be243eff880d" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f8c06f7f-be58-4b53-80dd-139748e13b94 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Acquired lock "refresh_cache-91238923-a64c-4f41-a046-be243eff880d" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG nova.network.neutron [None req-f8c06f7f-be58-4b53-80dd-139748e13b94 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] [instance: 91238923-a64c-4f41-a046-be243eff880d] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 17:48:11 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-784d58a2-fcac-45b3-b3cd-8051eee8940a tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 5b5ec5d3-fa6f-43de-b786-8c423064fe7a is timed out.
Nov 10 17:48:11 user nova-compute[75100]: DEBUG nova.compute.manager [req-dd2f88c3-78a7-4e04-8c92-53d8404eba99 req-5a6efcd4-79fa-41c6-85c2-95aec4512fbc service nova] [instance: 91238923-a64c-4f41-a046-be243eff880d] Received event network-vif-deleted-e628717d-728d-494a-be7e-ff3c79df75eb {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:48:11 user nova-compute[75100]: INFO nova.compute.manager [req-dd2f88c3-78a7-4e04-8c92-53d8404eba99 req-5a6efcd4-79fa-41c6-85c2-95aec4512fbc service nova] [instance: 91238923-a64c-4f41-a046-be243eff880d] Neutron deleted interface e628717d-728d-494a-be7e-ff3c79df75eb; detaching it from the instance and deleting it from the info cache
Nov 10 17:48:11 user nova-compute[75100]: DEBUG nova.network.neutron [req-dd2f88c3-78a7-4e04-8c92-53d8404eba99 req-5a6efcd4-79fa-41c6-85c2-95aec4512fbc service nova] [instance: 91238923-a64c-4f41-a046-be243eff880d] Updating instance_info_cache with network_info: [{"id": "4d2871cf-d6d9-4edb-9a0d-bc275ee11e13", "address": "fa:16:3e:8e:18:ef", "network": {"id": "304fddab-4cec-47aa-afab-f32de11ec897", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-288924842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c38f5a70dae74e3cb19dd6ddade72581", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d2871cf-d6", "ovs_interfaceid": "4d2871cf-d6d9-4edb-9a0d-bc275ee11e13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:48:11 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-784d58a2-fcac-45b3-b3cd-8051eee8940a tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Successfully detached device sdc from instance 5b5ec5d3-fa6f-43de-b786-8c423064fe7a from the live domain config.
Nov 10 17:48:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.187s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/d61d3862-5be7-45cc-95a0-88124ac1725d/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-784d58a2-fcac-45b3-b3cd-8051eee8940a tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-784d58a2-fcac-45b3-b3cd-8051eee8940a tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, {'target_iqn': 'iqn.2010-10.org.openstack:99db3b35-0a16-407d-976b-bd388c535b13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fWmHOurw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 17:48:11 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-784d58a2-fcac-45b3-b3cd-8051eee8940a tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 17:48:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-784d58a2-fcac-45b3-b3cd-8051eee8940a tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-784d58a2-fcac-45b3-b3cd-8051eee8940a tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/d61d3862-5be7-45cc-95a0-88124ac1725d/disk 1073741824" returned: 0 in 0.056s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[af16912f-ecea-4573-aa3e-6bc6f49ddc6b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:99db3b35-0a16-407d-976b-bd388c535b13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-784d58a2-fcac-45b3-b3cd-8051eee8940a tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 17:48:11 user nova-compute[75100]: No targets found.
Nov 10 17:48:11 user nova-compute[75100]: iSNS:
Nov 10 17:48:11 user nova-compute[75100]: No targets found.
Nov 10 17:48:11 user nova-compute[75100]: STATIC:
Nov 10 17:48:11 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:99db3b35-0a16-407d-976b-bd388c535b13
Nov 10 17:48:11 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 17:48:11 user nova-compute[75100]:                 Iface Name: default
Nov 10 17:48:11 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb
Nov 10 17:48:11 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 17:48:11 user nova-compute[75100]:                 Iface Name: default
Nov 10 17:48:11 user nova-compute[75100]: FIRMWARE:
Nov 10 17:48:11 user nova-compute[75100]: No targets found.
Nov 10 17:48:11 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-784d58a2-fcac-45b3-b3cd-8051eee8940a tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 17:48:11 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 17:48:11 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-784d58a2-fcac-45b3-b3cd-8051eee8940a tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99db3b35-0a16-407d-976b-bd388c535b13', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG nova.objects.instance [req-dd2f88c3-78a7-4e04-8c92-53d8404eba99 req-5a6efcd4-79fa-41c6-85c2-95aec4512fbc service nova] Lazy-loading 'system_metadata' on Instance uuid 91238923-a64c-4f41-a046-be243eff880d {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecad0478-0821-424d-a98f-5b3f4f3b44f0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99db3b35-0a16-407d-976b-bd388c535b13\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG nova.objects.instance [req-dd2f88c3-78a7-4e04-8c92-53d8404eba99 req-5a6efcd4-79fa-41c6-85c2-95aec4512fbc service nova] Lazy-loading 'flavor' on Instance uuid 91238923-a64c-4f41-a046-be243eff880d {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f58cea-92d7-43b1-a729-46ba980217af]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99db3b35-0a16-407d-976b-bd388c535b13 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-784d58a2-fcac-45b3-b3cd-8051eee8940a tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb (non-flash)
Nov 10 17:48:11 user nova-compute[75100]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99db3b35-0a16-407d-976b-bd388c535b13 (non-flash)
Nov 10 17:48:11 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-784d58a2-fcac-45b3-b3cd-8051eee8940a tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb (non-flash)
Nov 10 17:48:11 user nova-compute[75100]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99db3b35-0a16-407d-976b-bd388c535b13 (non-flash)
Nov 10 17:48:11 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-784d58a2-fcac-45b3-b3cd-8051eee8940a tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3dc170c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99db3b35-0a16-407d-976b-bd388c535b13'): ({'sdf'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-784d58a2-fcac-45b3-b3cd-8051eee8940a tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Removing single pathed devices sdf {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG nova.objects.base [req-dd2f88c3-78a7-4e04-8c92-53d8404eba99 req-5a6efcd4-79fa-41c6-85c2-95aec4512fbc service nova] Object Instance<91238923-a64c-4f41-a046-be243eff880d> lazy-loaded attributes: system_metadata,flavor {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [req-dd2f88c3-78a7-4e04-8c92-53d8404eba99 req-5a6efcd4-79fa-41c6-85c2-95aec4512fbc service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T17:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1217309978',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1217309978',id=7,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDg6Whui6h8FFFZnFwQnZiCuU3HjskJ2h5m1lP5l89/I6dnqvQ2dx39WpWkClYX9LsxzEk1B3cwB2sN+VxVpaZakTcKBRQUFmNH6ntC81O0eJh0TTBqxIPcr2Favd3KjTw==',key_name='tempest-keypair-326242402',keypairs=<?>,launch_index=0,launched_at=2023-11-10T17:45:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c38f5a70dae74e3cb19dd6ddade72581',ramdisk_id='',reservation_id='r-v9u7eycj',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1600859769',owner_user_name='tempest-TaggedAttachmentsTest-1600859769-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T17:45:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83545cded878478a8c823e5614376f18',uuid=91238923-a64c-4f41-a046-be243eff880d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e628717d-728d-494a-be7e-ff3c79df75eb", "address": "fa:16:3e:cf:c8:5b", "network": {"id": "6b2b7289-3f5a-49f8-b185-8929b13584e5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-149434076", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c38f5a70dae74e3cb19dd6ddade72581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape628717d-72", "ovs_interfaceid": "e628717d-728d-494a-be7e-ff3c79df75eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG nova.network.os_vif_util [req-dd2f88c3-78a7-4e04-8c92-53d8404eba99 req-5a6efcd4-79fa-41c6-85c2-95aec4512fbc service nova] Converting VIF {"id": "e628717d-728d-494a-be7e-ff3c79df75eb", "address": "fa:16:3e:cf:c8:5b", "network": {"id": "6b2b7289-3f5a-49f8-b185-8929b13584e5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-149434076", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c38f5a70dae74e3cb19dd6ddade72581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape628717d-72", "ovs_interfaceid": "e628717d-728d-494a-be7e-ff3c79df75eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG nova.network.os_vif_util [req-dd2f88c3-78a7-4e04-8c92-53d8404eba99 req-5a6efcd4-79fa-41c6-85c2-95aec4512fbc service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:c8:5b,bridge_name='br-int',has_traffic_filtering=True,id=e628717d-728d-494a-be7e-ff3c79df75eb,network=Network(6b2b7289-3f5a-49f8-b185-8929b13584e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape628717d-72') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [req-dd2f88c3-78a7-4e04-8c92-53d8404eba99 req-5a6efcd4-79fa-41c6-85c2-95aec4512fbc service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:cf:c8:5b"/><model type="virtio"/><mtu size="1442"/><target dev="tape628717d-72"/></interface> {{(pid=75100) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[41dde6bd-b82e-4f75-b030-279b01326cf3]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [req-dd2f88c3-78a7-4e04-8c92-53d8404eba99 req-5a6efcd4-79fa-41c6-85c2-95aec4512fbc service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:cf:c8:5b"/><model type="virtio"/><mtu size="1442"/><target dev="tape628717d-72"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 10 17:48:11 user nova-compute[75100]:   <name>instance-00000007</name>
Nov 10 17:48:11 user nova-compute[75100]:   <uuid>91238923-a64c-4f41-a046-be243eff880d</uuid>
Nov 10 17:48:11 user nova-compute[75100]:   <metadata>
Nov 10 17:48:11 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 17:48:11 user nova-compute[75100]:   <nova:package version="0.0.0"/>
Nov 10 17:48:11 user nova-compute[75100]:   <nova:name>tempest-device-tagging-server-1217309978</nova:name>
Nov 10 17:48:11 user nova-compute[75100]:   <nova:creationTime>2023-11-10 17:48:10</nova:creationTime>
Nov 10 17:48:11 user nova-compute[75100]:   <nova:flavor name="m1.tiny">
Nov 10 17:48:11 user nova-compute[75100]:     <nova:memory>512</nova:memory>
Nov 10 17:48:11 user nova-compute[75100]:     <nova:disk>1</nova:disk>
Nov 10 17:48:11 user nova-compute[75100]:     <nova:swap>0</nova:swap>
Nov 10 17:48:11 user nova-compute[75100]:     <nova:ephemeral>0</nova:ephemeral>
Nov 10 17:48:11 user nova-compute[75100]:     <nova:vcpus>1</nova:vcpus>
Nov 10 17:48:11 user nova-compute[75100]:   </nova:flavor>
Nov 10 17:48:11 user nova-compute[75100]:   <nova:owner>
Nov 10 17:48:11 user nova-compute[75100]:     <nova:user uuid="83545cded878478a8c823e5614376f18">tempest-TaggedAttachmentsTest-1600859769-project-member</nova:user>
Nov 10 17:48:11 user nova-compute[75100]:     <nova:project uuid="c38f5a70dae74e3cb19dd6ddade72581">tempest-TaggedAttachmentsTest-1600859769</nova:project>
Nov 10 17:48:11 user nova-compute[75100]:   </nova:owner>
Nov 10 17:48:11 user nova-compute[75100]:   <nova:root type="image" uuid="e3cc5321-4d40-49ee-885c-700e14741732"/>
Nov 10 17:48:11 user nova-compute[75100]:   <nova:ports>
Nov 10 17:48:11 user nova-compute[75100]:     <nova:port uuid="4d2871cf-d6d9-4edb-9a0d-bc275ee11e13">
Nov 10 17:48:11 user nova-compute[75100]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 10 17:48:11 user nova-compute[75100]:     </nova:port>
Nov 10 17:48:11 user nova-compute[75100]:   </nova:ports>
Nov 10 17:48:11 user nova-compute[75100]: </nova:instance>
Nov 10 17:48:11 user nova-compute[75100]:   </metadata>
Nov 10 17:48:11 user nova-compute[75100]:   <memory unit='KiB'>524288</memory>
Nov 10 17:48:11 user nova-compute[75100]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 10 17:48:11 user nova-compute[75100]:   <vcpu placement='static'>1</vcpu>
Nov 10 17:48:11 user nova-compute[75100]:   <resource>
Nov 10 17:48:11 user nova-compute[75100]:     <partition>/machine</partition>
Nov 10 17:48:11 user nova-compute[75100]:   </resource>
Nov 10 17:48:11 user nova-compute[75100]:   <sysinfo type='smbios'>
Nov 10 17:48:11 user nova-compute[75100]:     <system>
Nov 10 17:48:11 user nova-compute[75100]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 10 17:48:11 user nova-compute[75100]:       <entry name='product'>OpenStack Nova</entry>
Nov 10 17:48:11 user nova-compute[75100]:       <entry name='version'>0.0.0</entry>
Nov 10 17:48:11 user nova-compute[75100]:       <entry name='serial'>91238923-a64c-4f41-a046-be243eff880d</entry>
Nov 10 17:48:11 user nova-compute[75100]:       <entry name='uuid'>91238923-a64c-4f41-a046-be243eff880d</entry>
Nov 10 17:48:11 user nova-compute[75100]:       <entry name='family'>Virtual Machine</entry>
Nov 10 17:48:11 user nova-compute[75100]:     </system>
Nov 10 17:48:11 user nova-compute[75100]:   </sysinfo>
Nov 10 17:48:11 user nova-compute[75100]:   <os>
Nov 10 17:48:11 user nova-compute[75100]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 10 17:48:11 user nova-compute[75100]:     <boot dev='hd'/>
Nov 10 17:48:11 user nova-compute[75100]:     <smbios mode='sysinfo'/>
Nov 10 17:48:11 user nova-compute[75100]:   </os>
Nov 10 17:48:11 user nova-compute[75100]:   <features>
Nov 10 17:48:11 user nova-compute[75100]:     <acpi/>
Nov 10 17:48:11 user nova-compute[75100]:     <apic/>
Nov 10 17:48:11 user nova-compute[75100]:     <vmcoreinfo state='on'/>
Nov 10 17:48:11 user nova-compute[75100]:   </features>
Nov 10 17:48:11 user nova-compute[75100]:   <cpu mode='custom' match='exact' check='full'>
Nov 10 17:48:11 user nova-compute[75100]:     <model fallback='forbid'>Nehalem</model>
Nov 10 17:48:11 user nova-compute[75100]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 10 17:48:11 user nova-compute[75100]:     <feature policy='require' name='vme'/>
Nov 10 17:48:11 user nova-compute[75100]:     <feature policy='require' name='x2apic'/>
Nov 10 17:48:11 user nova-compute[75100]:     <feature policy='require' name='hypervisor'/>
Nov 10 17:48:11 user nova-compute[75100]:   </cpu>
Nov 10 17:48:11 user nova-compute[75100]:   <clock offset='utc'>
Nov 10 17:48:11 user nova-compute[75100]:     <timer name='pit' tickpolicy='delay'/>
Nov 10 17:48:11 user nova-compute[75100]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 10 17:48:11 user nova-compute[75100]:     <timer name='hpet' present='no'/>
Nov 10 17:48:11 user nova-compute[75100]:   </clock>
Nov 10 17:48:11 user nova-compute[75100]:   <on_poweroff>destroy</on_poweroff>
Nov 10 17:48:11 user nova-compute[75100]:   <on_reboot>restart</on_reboot>
Nov 10 17:48:11 user nova-compute[75100]:   <on_crash>destroy</on_crash>
Nov 10 17:48:11 user nova-compute[75100]:   <devices>
Nov 10 17:48:11 user nova-compute[75100]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 10 17:48:11 user nova-compute[75100]:     <disk type='file' device='disk'>
Nov 10 17:48:11 user nova-compute[75100]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 10 17:48:11 user nova-compute[75100]:       <source file='/opt/stack/data/nova/instances/91238923-a64c-4f41-a046-be243eff880d/disk' index='2'/>
Nov 10 17:48:11 user nova-compute[75100]:       <backingStore type='file' index='3'>
Nov 10 17:48:11 user nova-compute[75100]:         <format type='raw'/>
Nov 10 17:48:11 user nova-compute[75100]:         <source file='/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520'/>
Nov 10 17:48:11 user nova-compute[75100]:         <backingStore/>
Nov 10 17:48:11 user nova-compute[75100]:       </backingStore>
Nov 10 17:48:11 user nova-compute[75100]:       <target dev='vda' bus='virtio'/>
Nov 10 17:48:11 user nova-compute[75100]:       <alias name='virtio-disk0'/>
Nov 10 17:48:11 user nova-compute[75100]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 10 17:48:11 user nova-compute[75100]:     </disk>
Nov 10 17:48:11 user nova-compute[75100]:     <disk type='file' device='cdrom'>
Nov 10 17:48:11 user nova-compute[75100]:       <driver name='qemu' type='raw' cache='none'/>
Nov 10 17:48:11 user nova-compute[75100]:       <source file='/opt/stack/data/nova/instances/91238923-a64c-4f41-a046-be243eff880d/disk.config' index='1'/>
Nov 10 17:48:11 user nova-compute[75100]:       <backingStore/>
Nov 10 17:48:11 user nova-compute[75100]:       <target dev='hda' bus='ide'/>
Nov 10 17:48:11 user nova-compute[75100]:       <readonly/>
Nov 10 17:48:11 user nova-compute[75100]:       <alias name='ide0-0-0'/>
Nov 10 17:48:11 user nova-compute[75100]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 10 17:48:11 user nova-compute[75100]:     </disk>
Nov 10 17:48:11 user nova-compute[75100]:     <controller type='usb' index='0' model='none'>
Nov 10 17:48:11 user nova-compute[75100]:       <alias name='usb'/>
Nov 10 17:48:11 user nova-compute[75100]:     </controller>
Nov 10 17:48:11 user nova-compute[75100]:     <controller type='pci' index='0' model='pci-root'>
Nov 10 17:48:11 user nova-compute[75100]:       <alias name='pci.0'/>
Nov 10 17:48:11 user nova-compute[75100]:     </controller>
Nov 10 17:48:11 user nova-compute[75100]:     <controller type='ide' index='0'>
Nov 10 17:48:11 user nova-compute[75100]:       <alias name='ide'/>
Nov 10 17:48:11 user nova-compute[75100]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 10 17:48:11 user nova-compute[75100]:     </controller>
Nov 10 17:48:11 user nova-compute[75100]:     <interface type='ethernet'>
Nov 10 17:48:11 user nova-compute[75100]:       <mac address='fa:16:3e:8e:18:ef'/>
Nov 10 17:48:11 user nova-compute[75100]:       <target dev='tap4d2871cf-d6'/>
Nov 10 17:48:11 user nova-compute[75100]:       <model type='virtio'/>
Nov 10 17:48:11 user nova-compute[75100]:       <mtu size='1442'/>
Nov 10 17:48:11 user nova-compute[75100]:       <alias name='net0'/>
Nov 10 17:48:11 user nova-compute[75100]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 10 17:48:11 user nova-compute[75100]:     </interface>
Nov 10 17:48:11 user nova-compute[75100]:     <serial type='pty'>
Nov 10 17:48:11 user nova-compute[75100]:       <source path='/dev/pts/6'/>
Nov 10 17:48:11 user nova-compute[75100]:       <log file='/opt/stack/data/nova/instances/91238923-a64c-4f41-a046-be243eff880d/console.log' append='off'/>
Nov 10 17:48:11 user nova-compute[75100]:       <target type='isa-serial' port='0'>
Nov 10 17:48:11 user nova-compute[75100]:         <model name='isa-serial'/>
Nov 10 17:48:11 user nova-compute[75100]:       </target>
Nov 10 17:48:11 user nova-compute[75100]:       <alias name='serial0'/>
Nov 10 17:48:11 user nova-compute[75100]:     </serial>
Nov 10 17:48:11 user nova-compute[75100]:     <console type='pty' tty='/dev/pts/6'>
Nov 10 17:48:11 user nova-compute[75100]:       <source path='/dev/pts/6'/>
Nov 10 17:48:11 user nova-compute[75100]:       <log file='/opt/stack/data/nova/instances/91238923-a64c-4f41-a046-be243eff880d/console.log' append='off'/>
Nov 10 17:48:11 user nova-compute[75100]:       <target type='serial' port='0'/>
Nov 10 17:48:11 user nova-compute[75100]:       <alias name='serial0'/>
Nov 10 17:48:11 user nova-compute[75100]:     </console>
Nov 10 17:48:11 user nova-compute[75100]:     <input type='mouse' bus='ps2'>
Nov 10 17:48:11 user nova-compute[75100]:       <alias name='input0'/>
Nov 10 17:48:11 user nova-compute[75100]:     </input>
Nov 10 17:48:11 user nova-compute[75100]:     <input type='keyboard' bus='ps2'>
Nov 10 17:48:11 user nova-compute[75100]:       <alias name='input1'/>
Nov 10 17:48:11 user nova-compute[75100]:     </input>
Nov 10 17:48:11 user nova-compute[75100]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 10 17:48:11 user nova-compute[75100]:       <listen type='address' address='0.0.0.0'/>
Nov 10 17:48:11 user nova-compute[75100]:     </graphics>
Nov 10 17:48:11 user nova-compute[75100]:     <audio id='1' type='none'/>
Nov 10 17:48:11 user nova-compute[75100]:     <video>
Nov 10 17:48:11 user nova-compute[75100]:       <model type='virtio' heads='1' primary='yes'/>
Nov 10 17:48:11 user nova-compute[75100]:       <alias name='video0'/>
Nov 10 17:48:11 user nova-compute[75100]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 10 17:48:11 user nova-compute[75100]:     </video>
Nov 10 17:48:11 user nova-compute[75100]:     <memballoon model='virtio'>
Nov 10 17:48:11 user nova-compute[75100]:       <stats period='10'/>
Nov 10 17:48:11 user nova-compute[75100]:       <alias name='balloon0'/>
Nov 10 17:48:11 user nova-compute[75100]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 10 17:48:11 user nova-compute[75100]:     </memballoon>
Nov 10 17:48:11 user nova-compute[75100]:     <rng model='virtio'>
Nov 10 17:48:11 user nova-compute[75100]:       <backend model='random'>/dev/urandom</backend>
Nov 10 17:48:11 user nova-compute[75100]:       <alias name='rng0'/>
Nov 10 17:48:11 user nova-compute[75100]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 10 17:48:11 user nova-compute[75100]:     </rng>
Nov 10 17:48:11 user nova-compute[75100]:   </devices>
Nov 10 17:48:11 user nova-compute[75100]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 10 17:48:11 user nova-compute[75100]:     <label>libvirt-91238923-a64c-4f41-a046-be243eff880d</label>
Nov 10 17:48:11 user nova-compute[75100]:     <imagelabel>libvirt-91238923-a64c-4f41-a046-be243eff880d</imagelabel>
Nov 10 17:48:11 user nova-compute[75100]:   </seclabel>
Nov 10 17:48:11 user nova-compute[75100]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 10 17:48:11 user nova-compute[75100]:     <label>+64055:+108</label>
Nov 10 17:48:11 user nova-compute[75100]:     <imagelabel>+64055:+108</imagelabel>
Nov 10 17:48:11 user nova-compute[75100]:   </seclabel>
Nov 10 17:48:11 user nova-compute[75100]: </domain>
Nov 10 17:48:11 user nova-compute[75100]:  {{(pid=75100) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [req-dd2f88c3-78a7-4e04-8c92-53d8404eba99 req-5a6efcd4-79fa-41c6-85c2-95aec4512fbc service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:cf:c8:5b"/><model type="virtio"/><mtu size="1442"/><target dev="tape628717d-72"/></interface> {{(pid=75100) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [req-dd2f88c3-78a7-4e04-8c92-53d8404eba99 req-5a6efcd4-79fa-41c6-85c2-95aec4512fbc service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:cf:c8:5b"/><model type="virtio"/><mtu size="1442"/><target dev="tape628717d-72"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 10 17:48:11 user nova-compute[75100]:   <name>instance-00000007</name>
Nov 10 17:48:11 user nova-compute[75100]:   <uuid>91238923-a64c-4f41-a046-be243eff880d</uuid>
Nov 10 17:48:11 user nova-compute[75100]:   <metadata>
Nov 10 17:48:11 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 17:48:11 user nova-compute[75100]:   <nova:package version="0.0.0"/>
Nov 10 17:48:11 user nova-compute[75100]:   <nova:name>tempest-device-tagging-server-1217309978</nova:name>
Nov 10 17:48:11 user nova-compute[75100]:   <nova:creationTime>2023-11-10 17:48:10</nova:creationTime>
Nov 10 17:48:11 user nova-compute[75100]:   <nova:flavor name="m1.tiny">
Nov 10 17:48:11 user nova-compute[75100]:     <nova:memory>512</nova:memory>
Nov 10 17:48:11 user nova-compute[75100]:     <nova:disk>1</nova:disk>
Nov 10 17:48:11 user nova-compute[75100]:     <nova:swap>0</nova:swap>
Nov 10 17:48:11 user nova-compute[75100]:     <nova:ephemeral>0</nova:ephemeral>
Nov 10 17:48:11 user nova-compute[75100]:     <nova:vcpus>1</nova:vcpus>
Nov 10 17:48:11 user nova-compute[75100]:   </nova:flavor>
Nov 10 17:48:11 user nova-compute[75100]:   <nova:owner>
Nov 10 17:48:11 user nova-compute[75100]:     <nova:user uuid="83545cded878478a8c823e5614376f18">tempest-TaggedAttachmentsTest-1600859769-project-member</nova:user>
Nov 10 17:48:11 user nova-compute[75100]:     <nova:project uuid="c38f5a70dae74e3cb19dd6ddade72581">tempest-TaggedAttachmentsTest-1600859769</nova:project>
Nov 10 17:48:11 user nova-compute[75100]:   </nova:owner>
Nov 10 17:48:11 user nova-compute[75100]:   <nova:root type="image" uuid="e3cc5321-4d40-49ee-885c-700e14741732"/>
Nov 10 17:48:11 user nova-compute[75100]:   <nova:ports>
Nov 10 17:48:11 user nova-compute[75100]:     <nova:port uuid="4d2871cf-d6d9-4edb-9a0d-bc275ee11e13">
Nov 10 17:48:11 user nova-compute[75100]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 10 17:48:11 user nova-compute[75100]:     </nova:port>
Nov 10 17:48:11 user nova-compute[75100]:   </nova:ports>
Nov 10 17:48:11 user nova-compute[75100]: </nova:instance>
Nov 10 17:48:11 user nova-compute[75100]:   </metadata>
Nov 10 17:48:11 user nova-compute[75100]:   <memory unit='KiB'>524288</memory>
Nov 10 17:48:11 user nova-compute[75100]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 10 17:48:11 user nova-compute[75100]:   <vcpu placement='static'>1</vcpu>
Nov 10 17:48:11 user nova-compute[75100]:   <resource>
Nov 10 17:48:11 user nova-compute[75100]:     <partition>/machine</partition>
Nov 10 17:48:11 user nova-compute[75100]:   </resource>
Nov 10 17:48:11 user nova-compute[75100]:   <sysinfo type='smbios'>
Nov 10 17:48:11 user nova-compute[75100]:     <system>
Nov 10 17:48:11 user nova-compute[75100]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 10 17:48:11 user nova-compute[75100]:       <entry name='product'>OpenStack Nova</entry>
Nov 10 17:48:11 user nova-compute[75100]:       <entry name='version'>0.0.0</entry>
Nov 10 17:48:11 user nova-compute[75100]:       <entry name='serial'>91238923-a64c-4f41-a046-be243eff880d</entry>
Nov 10 17:48:11 user nova-compute[75100]:       <entry name='uuid'>91238923-a64c-4f41-a046-be243eff880d</entry>
Nov 10 17:48:11 user nova-compute[75100]:       <entry name='family'>Virtual Machine</entry>
Nov 10 17:48:11 user nova-compute[75100]:     </system>
Nov 10 17:48:11 user nova-compute[75100]:   </sysinfo>
Nov 10 17:48:11 user nova-compute[75100]:   <os>
Nov 10 17:48:11 user nova-compute[75100]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 10 17:48:11 user nova-compute[75100]:     <boot dev='hd'/>
Nov 10 17:48:11 user nova-compute[75100]:     <smbios mode='sysinfo'/>
Nov 10 17:48:11 user nova-compute[75100]:   </os>
Nov 10 17:48:11 user nova-compute[75100]:   <features>
Nov 10 17:48:11 user nova-compute[75100]:     <acpi/>
Nov 10 17:48:11 user nova-compute[75100]:     <apic/>
Nov 10 17:48:11 user nova-compute[75100]:     <vmcoreinfo state='on'/>
Nov 10 17:48:11 user nova-compute[75100]:   </features>
Nov 10 17:48:11 user nova-compute[75100]:   <cpu mode='custom' match='exact' check='full'>
Nov 10 17:48:11 user nova-compute[75100]:     <model fallback='forbid'>Nehalem</model>
Nov 10 17:48:11 user nova-compute[75100]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 10 17:48:11 user nova-compute[75100]:     <feature policy='require' name='vme'/>
Nov 10 17:48:11 user nova-compute[75100]:     <feature policy='require' name='x2apic'/>
Nov 10 17:48:11 user nova-compute[75100]:     <feature policy='require' name='hypervisor'/>
Nov 10 17:48:11 user nova-compute[75100]:   </cpu>
Nov 10 17:48:11 user nova-compute[75100]:   <clock offset='utc'>
Nov 10 17:48:11 user nova-compute[75100]:     <timer name='pit' tickpolicy='delay'/>
Nov 10 17:48:11 user nova-compute[75100]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 10 17:48:11 user nova-compute[75100]:     <timer name='hpet' present='no'/>
Nov 10 17:48:11 user nova-compute[75100]:   </clock>
Nov 10 17:48:11 user nova-compute[75100]:   <on_poweroff>destroy</on_poweroff>
Nov 10 17:48:11 user nova-compute[75100]:   <on_reboot>restart</on_reboot>
Nov 10 17:48:11 user nova-compute[75100]:   <on_crash>destroy</on_crash>
Nov 10 17:48:11 user nova-compute[75100]:   <devices>
Nov 10 17:48:11 user nova-compute[75100]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 10 17:48:11 user nova-compute[75100]:     <disk type='file' device='disk'>
Nov 10 17:48:11 user nova-compute[75100]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 10 17:48:11 user nova-compute[75100]:       <source file='/opt/stack/data/nova/instances/91238923-a64c-4f41-a046-be243eff880d/disk' index='2'/>
Nov 10 17:48:11 user nova-compute[75100]:       <backingStore type='file' index='3'>
Nov 10 17:48:11 user nova-compute[75100]:         <format type='raw'/>
Nov 10 17:48:11 user nova-compute[75100]:         <source file='/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520'/>
Nov 10 17:48:11 user nova-compute[75100]:         <backingStore/>
Nov 10 17:48:11 user nova-compute[75100]:       </backingStore>
Nov 10 17:48:11 user nova-compute[75100]:       <target dev='vda' bus='virtio'/>
Nov 10 17:48:11 user nova-compute[75100]:       <alias name='virtio-disk0'/>
Nov 10 17:48:11 user nova-compute[75100]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 10 17:48:11 user nova-compute[75100]:     </disk>
Nov 10 17:48:11 user nova-compute[75100]:     <disk type='file' device='cdrom'>
Nov 10 17:48:11 user nova-compute[75100]:       <driver name='qemu' type='raw' cache='none'/>
Nov 10 17:48:11 user nova-compute[75100]:       <source file='/opt/stack/data/nova/instances/91238923-a64c-4f41-a046-be243eff880d/disk.config' index='1'/>
Nov 10 17:48:11 user nova-compute[75100]:       <backingStore/>
Nov 10 17:48:11 user nova-compute[75100]:       <target dev='hda' bus='ide'/>
Nov 10 17:48:11 user nova-compute[75100]:       <readonly/>
Nov 10 17:48:11 user nova-compute[75100]:       <alias name='ide0-0-0'/>
Nov 10 17:48:11 user nova-compute[75100]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 10 17:48:11 user nova-compute[75100]:     </disk>
Nov 10 17:48:11 user nova-compute[75100]:     <controller type='usb' index='0' model='none'>
Nov 10 17:48:11 user nova-compute[75100]:       <alias name='usb'/>
Nov 10 17:48:11 user nova-compute[75100]:     </controller>
Nov 10 17:48:11 user nova-compute[75100]:     <controller type='pci' index='0' model='pci-root'>
Nov 10 17:48:11 user nova-compute[75100]:       <alias name='pci.0'/>
Nov 10 17:48:11 user nova-compute[75100]:     </controller>
Nov 10 17:48:11 user nova-compute[75100]:     <controller type='ide' index='0'>
Nov 10 17:48:11 user nova-compute[75100]:       <alias name='ide'/>
Nov 10 17:48:11 user nova-compute[75100]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 10 17:48:11 user nova-compute[75100]:     </controller>
Nov 10 17:48:11 user nova-compute[75100]:     <interface type='ethernet'>
Nov 10 17:48:11 user nova-compute[75100]:       <mac address='fa:16:3e:8e:18:ef'/>
Nov 10 17:48:11 user nova-compute[75100]:       <target dev='tap4d2871cf-d6'/>
Nov 10 17:48:11 user nova-compute[75100]:       <model type='virtio'/>
Nov 10 17:48:11 user nova-compute[75100]:       <mtu size='1442'/>
Nov 10 17:48:11 user nova-compute[75100]:       <alias name='net0'/>
Nov 10 17:48:11 user nova-compute[75100]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 10 17:48:11 user nova-compute[75100]:     </interface>
Nov 10 17:48:11 user nova-compute[75100]:     <serial type='pty'>
Nov 10 17:48:11 user nova-compute[75100]:       <source path='/dev/pts/6'/>
Nov 10 17:48:11 user nova-compute[75100]:       <log file='/opt/stack/data/nova/instances/91238923-a64c-4f41-a046-be243eff880d/console.log' append='off'/>
Nov 10 17:48:11 user nova-compute[75100]:       <target type='isa-serial' port='0'>
Nov 10 17:48:11 user nova-compute[75100]:         <model name='isa-serial'/>
Nov 10 17:48:11 user nova-compute[75100]:       </target>
Nov 10 17:48:11 user nova-compute[75100]:       <alias name='serial0'/>
Nov 10 17:48:11 user nova-compute[75100]:     </serial>
Nov 10 17:48:11 user nova-compute[75100]:     <console type='pty' tty='/dev/pts/6'>
Nov 10 17:48:11 user nova-compute[75100]:       <source path='/dev/pts/6'/>
Nov 10 17:48:11 user nova-compute[75100]:       <log file='/opt/stack/data/nova/instances/91238923-a64c-4f41-a046-be243eff880d/console.log' append='off'/>
Nov 10 17:48:11 user nova-compute[75100]:       <target type='serial' port='0'/>
Nov 10 17:48:11 user nova-compute[75100]:       <alias name='serial0'/>
Nov 10 17:48:11 user nova-compute[75100]:     </console>
Nov 10 17:48:11 user nova-compute[75100]:     <input type='mouse' bus='ps2'>
Nov 10 17:48:11 user nova-compute[75100]:       <alias name='input0'/>
Nov 10 17:48:11 user nova-compute[75100]:     </input>
Nov 10 17:48:11 user nova-compute[75100]:     <input type='keyboard' bus='ps2'>
Nov 10 17:48:11 user nova-compute[75100]:       <alias name='input1'/>
Nov 10 17:48:11 user nova-compute[75100]:     </input>
Nov 10 17:48:11 user nova-compute[75100]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 10 17:48:11 user nova-compute[75100]:       <listen type='address' address='0.0.0.0'/>
Nov 10 17:48:11 user nova-compute[75100]:     </graphics>
Nov 10 17:48:11 user nova-compute[75100]:     <audio id='1' type='none'/>
Nov 10 17:48:11 user nova-compute[75100]:     <video>
Nov 10 17:48:11 user nova-compute[75100]:       <model type='virtio' heads='1' primary='yes'/>
Nov 10 17:48:11 user nova-compute[75100]:       <alias name='video0'/>
Nov 10 17:48:11 user nova-compute[75100]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 10 17:48:11 user nova-compute[75100]:     </video>
Nov 10 17:48:11 user nova-compute[75100]:     <memballoon model='virtio'>
Nov 10 17:48:11 user nova-compute[75100]:       <stats period='10'/>
Nov 10 17:48:11 user nova-compute[75100]:       <alias name='balloon0'/>
Nov 10 17:48:11 user nova-compute[75100]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 10 17:48:11 user nova-compute[75100]:     </memballoon>
Nov 10 17:48:11 user nova-compute[75100]:     <rng model='virtio'>
Nov 10 17:48:11 user nova-compute[75100]:       <backend model='random'>/dev/urandom</backend>
Nov 10 17:48:11 user nova-compute[75100]:       <alias name='rng0'/>
Nov 10 17:48:11 user nova-compute[75100]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 10 17:48:11 user nova-compute[75100]:     </rng>
Nov 10 17:48:11 user nova-compute[75100]:   </devices>
Nov 10 17:48:11 user nova-compute[75100]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 10 17:48:11 user nova-compute[75100]:     <label>libvirt-91238923-a64c-4f41-a046-be243eff880d</label>
Nov 10 17:48:11 user nova-compute[75100]:     <imagelabel>libvirt-91238923-a64c-4f41-a046-be243eff880d</imagelabel>
Nov 10 17:48:11 user nova-compute[75100]:   </seclabel>
Nov 10 17:48:11 user nova-compute[75100]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 10 17:48:11 user nova-compute[75100]:     <label>+64055:+108</label>
Nov 10 17:48:11 user nova-compute[75100]:     <imagelabel>+64055:+108</imagelabel>
Nov 10 17:48:11 user nova-compute[75100]:   </seclabel>
Nov 10 17:48:11 user nova-compute[75100]: </domain>
Nov 10 17:48:11 user nova-compute[75100]:  {{(pid=75100) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 10 17:48:11 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [req-dd2f88c3-78a7-4e04-8c92-53d8404eba99 req-5a6efcd4-79fa-41c6-85c2-95aec4512fbc service nova] [instance: 91238923-a64c-4f41-a046-be243eff880d] Detaching interface fa:16:3e:cf:c8:5b failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tape628717d-72' not found.
Nov 10 17:48:11 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [req-dd2f88c3-78a7-4e04-8c92-53d8404eba99 req-5a6efcd4-79fa-41c6-85c2-95aec4512fbc service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T17:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1217309978',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1217309978',id=7,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDg6Whui6h8FFFZnFwQnZiCuU3HjskJ2h5m1lP5l89/I6dnqvQ2dx39WpWkClYX9LsxzEk1B3cwB2sN+VxVpaZakTcKBRQUFmNH6ntC81O0eJh0TTBqxIPcr2Favd3KjTw==',key_name='tempest-keypair-326242402',keypairs=<?>,launch_index=0,launched_at=2023-11-10T17:45:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c38f5a70dae74e3cb19dd6ddade72581',ramdisk_id='',reservation_id='r-v9u7eycj',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1600859769',owner_user_name='tempest-TaggedAttachmentsTest-1600859769-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T17:45:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83545cded878478a8c823e5614376f18',uuid=91238923-a64c-4f41-a046-be243eff880d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e628717d-728d-494a-be7e-ff3c79df75eb", "address": "fa:16:3e:cf:c8:5b", "network": {"id": "6b2b7289-3f5a-49f8-b185-8929b13584e5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-149434076", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c38f5a70dae74e3cb19dd6ddade72581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape628717d-72", "ovs_interfaceid": "e628717d-728d-494a-be7e-ff3c79df75eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG nova.network.os_vif_util [req-dd2f88c3-78a7-4e04-8c92-53d8404eba99 req-5a6efcd4-79fa-41c6-85c2-95aec4512fbc service nova] Converting VIF {"id": "e628717d-728d-494a-be7e-ff3c79df75eb", "address": "fa:16:3e:cf:c8:5b", "network": {"id": "6b2b7289-3f5a-49f8-b185-8929b13584e5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-149434076", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c38f5a70dae74e3cb19dd6ddade72581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape628717d-72", "ovs_interfaceid": "e628717d-728d-494a-be7e-ff3c79df75eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG nova.network.os_vif_util [req-dd2f88c3-78a7-4e04-8c92-53d8404eba99 req-5a6efcd4-79fa-41c6-85c2-95aec4512fbc service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:c8:5b,bridge_name='br-int',has_traffic_filtering=True,id=e628717d-728d-494a-be7e-ff3c79df75eb,network=Network(6b2b7289-3f5a-49f8-b185-8929b13584e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape628717d-72') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG os_vif [req-dd2f88c3-78a7-4e04-8c92-53d8404eba99 req-5a6efcd4-79fa-41c6-85c2-95aec4512fbc service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:c8:5b,bridge_name='br-int',has_traffic_filtering=True,id=e628717d-728d-494a-be7e-ff3c79df75eb,network=Network(6b2b7289-3f5a-49f8-b185-8929b13584e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape628717d-72') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[324212e1-fba5-4e81-8390-eee1c28ec6d6]: (4, ('ok\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-784d58a2-fcac-45b3-b3cd-8051eee8940a tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Flushing IO for device /dev/sdf {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape628717d-72, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaee6ff5-a37c-470d-81e9-a276942d923e]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-784d58a2-fcac-45b3-b3cd-8051eee8940a tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 17:48:11 user nova-compute[75100]: INFO os_vif [req-dd2f88c3-78a7-4e04-8c92-53d8404eba99 req-5a6efcd4-79fa-41c6-85c2-95aec4512fbc service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:c8:5b,bridge_name='br-int',has_traffic_filtering=True,id=e628717d-728d-494a-be7e-ff3c79df75eb,network=Network(6b2b7289-3f5a-49f8-b185-8929b13584e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape628717d-72')
Nov 10 17:48:11 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [req-dd2f88c3-78a7-4e04-8c92-53d8404eba99 req-5a6efcd4-79fa-41c6-85c2-95aec4512fbc service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 17:48:11 user nova-compute[75100]:   <nova:package version="0.0.0"/>
Nov 10 17:48:11 user nova-compute[75100]:   <nova:name>tempest-device-tagging-server-1217309978</nova:name>
Nov 10 17:48:11 user nova-compute[75100]:   <nova:creationTime>2023-11-10 17:48:11</nova:creationTime>
Nov 10 17:48:11 user nova-compute[75100]:   <nova:flavor name="m1.tiny">
Nov 10 17:48:11 user nova-compute[75100]:     <nova:memory>512</nova:memory>
Nov 10 17:48:11 user nova-compute[75100]:     <nova:disk>1</nova:disk>
Nov 10 17:48:11 user nova-compute[75100]:     <nova:swap>0</nova:swap>
Nov 10 17:48:11 user nova-compute[75100]:     <nova:ephemeral>0</nova:ephemeral>
Nov 10 17:48:11 user nova-compute[75100]:     <nova:vcpus>1</nova:vcpus>
Nov 10 17:48:11 user nova-compute[75100]:   </nova:flavor>
Nov 10 17:48:11 user nova-compute[75100]:   <nova:owner>
Nov 10 17:48:11 user nova-compute[75100]:     <nova:user uuid="83545cded878478a8c823e5614376f18">tempest-TaggedAttachmentsTest-1600859769-project-member</nova:user>
Nov 10 17:48:11 user nova-compute[75100]:     <nova:project uuid="c38f5a70dae74e3cb19dd6ddade72581">tempest-TaggedAttachmentsTest-1600859769</nova:project>
Nov 10 17:48:11 user nova-compute[75100]:   </nova:owner>
Nov 10 17:48:11 user nova-compute[75100]:   <nova:root type="image" uuid="e3cc5321-4d40-49ee-885c-700e14741732"/>
Nov 10 17:48:11 user nova-compute[75100]:   <nova:ports>
Nov 10 17:48:11 user nova-compute[75100]:     <nova:port uuid="4d2871cf-d6d9-4edb-9a0d-bc275ee11e13">
Nov 10 17:48:11 user nova-compute[75100]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 10 17:48:11 user nova-compute[75100]:     </nova:port>
Nov 10 17:48:11 user nova-compute[75100]:   </nova:ports>
Nov 10 17:48:11 user nova-compute[75100]: </nova:instance>
Nov 10 17:48:11 user nova-compute[75100]:  {{(pid=75100) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.227s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d61d3862-5be7-45cc-95a0-88124ac1725d/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61d3862-5be7-45cc-95a0-88124ac1725d/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.041s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9d50bc-ec7a-4209-a416-251bf06eec56]: (4, ('1', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-784d58a2-fcac-45b3-b3cd-8051eee8940a tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-784d58a2-fcac-45b3-b3cd-8051eee8940a tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] SCSI volumes sdf have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-784d58a2-fcac-45b3-b3cd-8051eee8940a tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99db3b35-0a16-407d-976b-bd388c535b13')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99db3b35-0a16-407d-976b-bd388c535b13 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99db3b35-0a16-407d-976b-bd388c535b13 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe55b26d-6660-4598-97d6-24aba3701ac4]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-784d58a2-fcac-45b3-b3cd-8051eee8940a tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:48:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99db3b35-0a16-407d-976b-bd388c535b13 -p 172.16.0.220:3260 --logout {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:48:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99db3b35-0a16-407d-976b-bd388c535b13 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:48:12 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8031cb-20d7-420a-981a-201f1fe8e7cc]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:99db3b35-0a16-407d-976b-bd388c535b13, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:99db3b35-0a16-407d-976b-bd388c535b13, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:48:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-784d58a2-fcac-45b3-b3cd-8051eee8940a tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:99db3b35-0a16-407d-976b-bd388c535b13, portal: 172.16.0.220,3260]
Nov 10 17:48:12 user nova-compute[75100]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:99db3b35-0a16-407d-976b-bd388c535b13, portal: 172.16.0.220,3260] successful.
Nov 10 17:48:12 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:48:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99db3b35-0a16-407d-976b-bd388c535b13 -p 172.16.0.220:3260 --op delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:48:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99db3b35-0a16-407d-976b-bd388c535b13 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:48:12 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[fafd7817-4e92-45cf-9993-60a465bde64a]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:48:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-784d58a2-fcac-45b3-b3cd-8051eee8940a tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:48:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-784d58a2-fcac-45b3-b3cd-8051eee8940a tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.414s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 17:48:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-784d58a2-fcac-45b3-b3cd-8051eee8940a tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] <== disconnect_volume: return (416ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 17:48:12 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-784d58a2-fcac-45b3-b3cd-8051eee8940a tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 17:48:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61d3862-5be7-45cc-95a0-88124ac1725d/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:48:12 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Cannot resize image /opt/stack/data/nova/instances/d61d3862-5be7-45cc-95a0-88124ac1725d/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 17:48:12 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 17:48:12 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] Ensure instance console log exists: /opt/stack/data/nova/instances/d61d3862-5be7-45cc-95a0-88124ac1725d/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 17:48:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:48:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:48:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:48:12 user nova-compute[75100]: DEBUG nova.network.neutron [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] Successfully created port: 27667bd1-cc0b-47d7-9e63-5fcc05f8bca7 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 17:48:12 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:48:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:48:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:48:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:48:12 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 17:48:12 user nova-compute[75100]: INFO nova.network.neutron [None req-f8c06f7f-be58-4b53-80dd-139748e13b94 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] [instance: 91238923-a64c-4f41-a046-be243eff880d] Port e628717d-728d-494a-be7e-ff3c79df75eb from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Nov 10 17:48:12 user nova-compute[75100]: DEBUG nova.network.neutron [None req-f8c06f7f-be58-4b53-80dd-139748e13b94 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] [instance: 91238923-a64c-4f41-a046-be243eff880d] Updating instance_info_cache with network_info: [{"id": "4d2871cf-d6d9-4edb-9a0d-bc275ee11e13", "address": "fa:16:3e:8e:18:ef", "network": {"id": "304fddab-4cec-47aa-afab-f32de11ec897", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-288924842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c38f5a70dae74e3cb19dd6ddade72581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d2871cf-d6", "ovs_interfaceid": "4d2871cf-d6d9-4edb-9a0d-bc275ee11e13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:48:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f8c06f7f-be58-4b53-80dd-139748e13b94 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Releasing lock "refresh_cache-91238923-a64c-4f41-a046-be243eff880d" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:48:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:48:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f8c06f7f-be58-4b53-80dd-139748e13b94 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Lock "interface-91238923-a64c-4f41-a046-be243eff880d-e628717d-728d-494a-be7e-ff3c79df75eb" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 22.424s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:48:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:48:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:48:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:48:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:48:13 user nova-compute[75100]: DEBUG nova.objects.instance [None req-784d58a2-fcac-45b3-b3cd-8051eee8940a tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Lazy-loading 'flavor' on Instance uuid 5b5ec5d3-fa6f-43de-b786-8c423064fe7a {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:48:13 user nova-compute[75100]: DEBUG nova.network.neutron [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] Successfully updated port: 27667bd1-cc0b-47d7-9e63-5fcc05f8bca7 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 17:48:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Acquiring lock "refresh_cache-d61d3862-5be7-45cc-95a0-88124ac1725d" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:48:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Acquired lock "refresh_cache-d61d3862-5be7-45cc-95a0-88124ac1725d" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:48:13 user nova-compute[75100]: DEBUG nova.network.neutron [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 17:48:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-784d58a2-fcac-45b3-b3cd-8051eee8940a tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Lock "5b5ec5d3-fa6f-43de-b786-8c423064fe7a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.373s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:48:13 user nova-compute[75100]: DEBUG nova.network.neutron [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 17:48:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:48:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:48:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:48:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5ec5d3-fa6f-43de-b786-8c423064fe7a/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.volume.cinder [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] Update attachment failed for attachment 36111bdf-1391-4447-83bc-f2e7066671ae. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-0dd77a96-7897-4218-903d-0cccfac0359a) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-0dd77a96-7897-4218-903d-0cccfac0359a)
Nov 10 17:48:13 user nova-compute[75100]: DEBUG nova.network.neutron [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] Updating instance_info_cache with network_info: [{"id": "27667bd1-cc0b-47d7-9e63-5fcc05f8bca7", "address": "fa:16:3e:2e:83:6b", "network": {"id": "f240fae3-3d7b-4b6e-b04f-18550ab4d0a3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1007355777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c970a503d74d32a1e2b71f086649fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27667bd1-cc", "ovs_interfaceid": "27667bd1-cc0b-47d7-9e63-5fcc05f8bca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-0dd77a96-7897-4218-903d-0cccfac0359a)
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Traceback (most recent call last):
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc]     driver_block_device.attach_block_devices(
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc]     _log_and_attach(device)
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc]     bdm.attach(*attach_args, **attach_kwargs)
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc]     ret_val = method(obj, context, *args, **kwargs)
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc]     self._do_attach(context, instance, volume, volume_api,
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc]     self._volume_attach(context, volume, connector, instance,
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc]     connection_info = volume_api.attachment_update(
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc]     res = method(self, ctx, *args, **kwargs)
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc]     with excutils.save_and_reraise_exception():
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc]     self.force_reraise()
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc]     raise self.value
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc]     context, '3.44', skip_version_check=True).attachments.update(
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc]     return method.func(obj, *args, **kwargs)
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc]     resp = self._update('/attachments/%s' % id, body)
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc]     return self._cs_request(url, 'PUT', **kwargs)
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc]     return self.request(url, method, **kwargs)
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc]     raise exceptions.from_response(resp, body)
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-0dd77a96-7897-4218-903d-0cccfac0359a)
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] 
Nov 10 17:48:13 user nova-compute[75100]: DEBUG nova.compute.claims [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Aborting claim: <nova.compute.claims.Claim object at 0x7fa3d4269750> {{(pid=75100) abort /opt/stack/nova/nova/compute/claims.py:84}}
Nov 10 17:48:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:48:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:48:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Releasing lock "refresh_cache-d61d3862-5be7-45cc-95a0-88124ac1725d" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:48:13 user nova-compute[75100]: DEBUG nova.compute.manager [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] Instance network_info: |[{"id": "27667bd1-cc0b-47d7-9e63-5fcc05f8bca7", "address": "fa:16:3e:2e:83:6b", "network": {"id": "f240fae3-3d7b-4b6e-b04f-18550ab4d0a3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1007355777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c970a503d74d32a1e2b71f086649fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27667bd1-cc", "ovs_interfaceid": "27667bd1-cc0b-47d7-9e63-5fcc05f8bca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 17:48:13 user nova-compute[75100]: DEBUG nova.compute.manager [req-d039003f-afc2-43a0-95e6-693b6f5f3e7c req-7da68551-9e3d-47ac-b4c6-1114b380880a service nova] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] Received event network-changed-27667bd1-cc0b-47d7-9e63-5fcc05f8bca7 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:48:13 user nova-compute[75100]: DEBUG nova.compute.manager [req-d039003f-afc2-43a0-95e6-693b6f5f3e7c req-7da68551-9e3d-47ac-b4c6-1114b380880a service nova] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] Refreshing instance network info cache due to event network-changed-27667bd1-cc0b-47d7-9e63-5fcc05f8bca7. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 17:48:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d039003f-afc2-43a0-95e6-693b6f5f3e7c req-7da68551-9e3d-47ac-b4c6-1114b380880a service nova] Acquiring lock "refresh_cache-d61d3862-5be7-45cc-95a0-88124ac1725d" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:48:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d039003f-afc2-43a0-95e6-693b6f5f3e7c req-7da68551-9e3d-47ac-b4c6-1114b380880a service nova] Acquired lock "refresh_cache-d61d3862-5be7-45cc-95a0-88124ac1725d" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:48:13 user nova-compute[75100]: DEBUG nova.network.neutron [req-d039003f-afc2-43a0-95e6-693b6f5f3e7c req-7da68551-9e3d-47ac-b4c6-1114b380880a service nova] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] Refreshing network info cache for port 27667bd1-cc0b-47d7-9e63-5fcc05f8bca7 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 17:48:13 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] Start _get_guest_xml network_info=[{"id": "27667bd1-cc0b-47d7-9e63-5fcc05f8bca7", "address": "fa:16:3e:2e:83:6b", "network": {"id": "f240fae3-3d7b-4b6e-b04f-18550ab4d0a3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1007355777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c970a503d74d32a1e2b71f086649fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27667bd1-cc", "ovs_interfaceid": "27667bd1-cc0b-47d7-9e63-5fcc05f8bca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'e3cc5321-4d40-49ee-885c-700e14741732'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 17:48:13 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:48:13 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:48:13 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 17:48:13 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 17:48:13 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 17:48:13 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 17:48:13 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 17:48:13 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T17:40:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 17:48:13 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 17:48:13 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 17:48:13 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 17:48:13 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 17:48:13 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 17:48:13 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 17:48:13 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 17:48:13 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 17:48:13 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 17:48:13 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 17:48:13 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:48:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2109608051',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2109608051',id=14,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72c970a503d74d32a1e2b71f086649fd',ramdisk_id='',reservation_id='r-l39eqerz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2001759307',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:48:11Z,user_data=None,user_id='b79cb22ab5774ce8991f237bd2204555',uuid=d61d3862-5be7-45cc-95a0-88124ac1725d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27667bd1-cc0b-47d7-9e63-5fcc05f8bca7", "address": "fa:16:3e:2e:83:6b", "network": {"id": "f240fae3-3d7b-4b6e-b04f-18550ab4d0a3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1007355777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c970a503d74d32a1e2b71f086649fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27667bd1-cc", "ovs_interfaceid": "27667bd1-cc0b-47d7-9e63-5fcc05f8bca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 17:48:13 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Converting VIF {"id": "27667bd1-cc0b-47d7-9e63-5fcc05f8bca7", "address": "fa:16:3e:2e:83:6b", "network": {"id": "f240fae3-3d7b-4b6e-b04f-18550ab4d0a3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1007355777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c970a503d74d32a1e2b71f086649fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27667bd1-cc", "ovs_interfaceid": "27667bd1-cc0b-47d7-9e63-5fcc05f8bca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:48:13 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:83:6b,bridge_name='br-int',has_traffic_filtering=True,id=27667bd1-cc0b-47d7-9e63-5fcc05f8bca7,network=Network(f240fae3-3d7b-4b6e-b04f-18550ab4d0a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27667bd1-cc') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:48:13 user nova-compute[75100]: DEBUG nova.objects.instance [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lazy-loading 'pci_devices' on Instance uuid d61d3862-5be7-45cc-95a0-88124ac1725d {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.volume.cinder [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] Update attachment failed for attachment 8c1ef3a7-38de-44ca-98ea-fd8b6ef31348. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2ed1d016-94ee-466a-937e-eb1d109a3c55) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2ed1d016-94ee-466a-937e-eb1d109a3c55)
Nov 10 17:48:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5ec5d3-fa6f-43de-b786-8c423064fe7a/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:48:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5ec5d3-fa6f-43de-b786-8c423064fe7a/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:48:13 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] End _get_guest_xml xml=<domain type="kvm">
Nov 10 17:48:13 user nova-compute[75100]:   <uuid>d61d3862-5be7-45cc-95a0-88124ac1725d</uuid>
Nov 10 17:48:13 user nova-compute[75100]:   <name>instance-0000000e</name>
Nov 10 17:48:13 user nova-compute[75100]:   <memory>524288</memory>
Nov 10 17:48:13 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 10 17:48:13 user nova-compute[75100]:   <metadata>
Nov 10 17:48:13 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 17:48:13 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 10 17:48:13 user nova-compute[75100]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2109608051</nova:name>
Nov 10 17:48:13 user nova-compute[75100]:       <nova:creationTime>2023-11-10 17:48:13</nova:creationTime>
Nov 10 17:48:13 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 10 17:48:13 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 10 17:48:13 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 10 17:48:13 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 10 17:48:13 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 17:48:13 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 10 17:48:13 user nova-compute[75100]:       </nova:flavor>
Nov 10 17:48:13 user nova-compute[75100]:       <nova:owner>
Nov 10 17:48:13 user nova-compute[75100]:         <nova:user uuid="b79cb22ab5774ce8991f237bd2204555">tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member</nova:user>
Nov 10 17:48:13 user nova-compute[75100]:         <nova:project uuid="72c970a503d74d32a1e2b71f086649fd">tempest-ServerBootFromVolumeStableRescueTest-2001759307</nova:project>
Nov 10 17:48:13 user nova-compute[75100]:       </nova:owner>
Nov 10 17:48:13 user nova-compute[75100]:       <nova:root type="image" uuid="e3cc5321-4d40-49ee-885c-700e14741732"/>
Nov 10 17:48:13 user nova-compute[75100]:       <nova:ports>
Nov 10 17:48:13 user nova-compute[75100]:         <nova:port uuid="27667bd1-cc0b-47d7-9e63-5fcc05f8bca7">
Nov 10 17:48:13 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 10 17:48:13 user nova-compute[75100]:         </nova:port>
Nov 10 17:48:13 user nova-compute[75100]:       </nova:ports>
Nov 10 17:48:13 user nova-compute[75100]:     </nova:instance>
Nov 10 17:48:13 user nova-compute[75100]:   </metadata>
Nov 10 17:48:13 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 10 17:48:13 user nova-compute[75100]:     <system>
Nov 10 17:48:13 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 17:48:13 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 10 17:48:13 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 10 17:48:13 user nova-compute[75100]:       <entry name="serial">d61d3862-5be7-45cc-95a0-88124ac1725d</entry>
Nov 10 17:48:13 user nova-compute[75100]:       <entry name="uuid">d61d3862-5be7-45cc-95a0-88124ac1725d</entry>
Nov 10 17:48:13 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 10 17:48:13 user nova-compute[75100]:     </system>
Nov 10 17:48:13 user nova-compute[75100]:   </sysinfo>
Nov 10 17:48:13 user nova-compute[75100]:   <os>
Nov 10 17:48:13 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 17:48:13 user nova-compute[75100]:     <boot dev="hd"/>
Nov 10 17:48:13 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 10 17:48:13 user nova-compute[75100]:   </os>
Nov 10 17:48:13 user nova-compute[75100]:   <features>
Nov 10 17:48:13 user nova-compute[75100]:     <acpi/>
Nov 10 17:48:13 user nova-compute[75100]:     <apic/>
Nov 10 17:48:13 user nova-compute[75100]:     <vmcoreinfo/>
Nov 10 17:48:13 user nova-compute[75100]:   </features>
Nov 10 17:48:13 user nova-compute[75100]:   <clock offset="utc">
Nov 10 17:48:13 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 17:48:13 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 17:48:13 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 10 17:48:13 user nova-compute[75100]:   </clock>
Nov 10 17:48:13 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 10 17:48:13 user nova-compute[75100]:     <model>Nehalem</model>
Nov 10 17:48:13 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 17:48:13 user nova-compute[75100]:   </cpu>
Nov 10 17:48:13 user nova-compute[75100]:   <devices>
Nov 10 17:48:13 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 10 17:48:13 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 17:48:13 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/d61d3862-5be7-45cc-95a0-88124ac1725d/disk"/>
Nov 10 17:48:13 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 10 17:48:13 user nova-compute[75100]:     </disk>
Nov 10 17:48:13 user nova-compute[75100]:     <interface type="ethernet">
Nov 10 17:48:13 user nova-compute[75100]:       <mac address="fa:16:3e:2e:83:6b"/>
Nov 10 17:48:13 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:48:13 user nova-compute[75100]:       <mtu size="1442"/>
Nov 10 17:48:13 user nova-compute[75100]:       <target dev="tap27667bd1-cc"/>
Nov 10 17:48:13 user nova-compute[75100]:     </interface>
Nov 10 17:48:13 user nova-compute[75100]:     <serial type="pty">
Nov 10 17:48:13 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/d61d3862-5be7-45cc-95a0-88124ac1725d/console.log" append="off"/>
Nov 10 17:48:13 user nova-compute[75100]:     </serial>
Nov 10 17:48:13 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 17:48:13 user nova-compute[75100]:     <video>
Nov 10 17:48:13 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:48:13 user nova-compute[75100]:     </video>
Nov 10 17:48:13 user nova-compute[75100]:     <rng model="virtio">
Nov 10 17:48:13 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 10 17:48:13 user nova-compute[75100]:     </rng>
Nov 10 17:48:13 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 10 17:48:13 user nova-compute[75100]:     <memballoon model="virtio">
Nov 10 17:48:13 user nova-compute[75100]:       <stats period="10"/>
Nov 10 17:48:13 user nova-compute[75100]:     </memballoon>
Nov 10 17:48:13 user nova-compute[75100]:   </devices>
Nov 10 17:48:13 user nova-compute[75100]: </domain>
Nov 10 17:48:13 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 17:48:13 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:48:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2109608051',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2109608051',id=14,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72c970a503d74d32a1e2b71f086649fd',ramdisk_id='',reservation_id='r-l39eqerz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2001759307',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:48:11Z,user_data=None,user_id='b79cb22ab5774ce8991f237bd2204555',uuid=d61d3862-5be7-45cc-95a0-88124ac1725d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27667bd1-cc0b-47d7-9e63-5fcc05f8bca7", "address": "fa:16:3e:2e:83:6b", "network": {"id": "f240fae3-3d7b-4b6e-b04f-18550ab4d0a3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1007355777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c970a503d74d32a1e2b71f086649fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27667bd1-cc", "ovs_interfaceid": "27667bd1-cc0b-47d7-9e63-5fcc05f8bca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 17:48:13 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Converting VIF {"id": "27667bd1-cc0b-47d7-9e63-5fcc05f8bca7", "address": "fa:16:3e:2e:83:6b", "network": {"id": "f240fae3-3d7b-4b6e-b04f-18550ab4d0a3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1007355777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c970a503d74d32a1e2b71f086649fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27667bd1-cc", "ovs_interfaceid": "27667bd1-cc0b-47d7-9e63-5fcc05f8bca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:48:13 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:83:6b,bridge_name='br-int',has_traffic_filtering=True,id=27667bd1-cc0b-47d7-9e63-5fcc05f8bca7,network=Network(f240fae3-3d7b-4b6e-b04f-18550ab4d0a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27667bd1-cc') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:48:13 user nova-compute[75100]: DEBUG os_vif [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:83:6b,bridge_name='br-int',has_traffic_filtering=True,id=27667bd1-cc0b-47d7-9e63-5fcc05f8bca7,network=Network(f240fae3-3d7b-4b6e-b04f-18550ab4d0a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27667bd1-cc') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2ed1d016-94ee-466a-937e-eb1d109a3c55)
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Traceback (most recent call last):
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: 78d2732a-9eff-480e-b844-d216537c5d91]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: 78d2732a-9eff-480e-b844-d216537c5d91]     driver_block_device.attach_block_devices(
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: 78d2732a-9eff-480e-b844-d216537c5d91]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: 78d2732a-9eff-480e-b844-d216537c5d91]     _log_and_attach(device)
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: 78d2732a-9eff-480e-b844-d216537c5d91]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: 78d2732a-9eff-480e-b844-d216537c5d91]     bdm.attach(*attach_args, **attach_kwargs)
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: 78d2732a-9eff-480e-b844-d216537c5d91]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: 78d2732a-9eff-480e-b844-d216537c5d91]     ret_val = method(obj, context, *args, **kwargs)
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: 78d2732a-9eff-480e-b844-d216537c5d91]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: 78d2732a-9eff-480e-b844-d216537c5d91]     self._do_attach(context, instance, volume, volume_api,
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: 78d2732a-9eff-480e-b844-d216537c5d91]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: 78d2732a-9eff-480e-b844-d216537c5d91]     self._volume_attach(context, volume, connector, instance,
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: 78d2732a-9eff-480e-b844-d216537c5d91]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: 78d2732a-9eff-480e-b844-d216537c5d91]     connection_info = volume_api.attachment_update(
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: 78d2732a-9eff-480e-b844-d216537c5d91]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: 78d2732a-9eff-480e-b844-d216537c5d91]     res = method(self, ctx, *args, **kwargs)
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: 78d2732a-9eff-480e-b844-d216537c5d91]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: 78d2732a-9eff-480e-b844-d216537c5d91]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: 78d2732a-9eff-480e-b844-d216537c5d91]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: 78d2732a-9eff-480e-b844-d216537c5d91]     with excutils.save_and_reraise_exception():
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: 78d2732a-9eff-480e-b844-d216537c5d91]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: 78d2732a-9eff-480e-b844-d216537c5d91]     self.force_reraise()
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: 78d2732a-9eff-480e-b844-d216537c5d91]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: 78d2732a-9eff-480e-b844-d216537c5d91]     raise self.value
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: 78d2732a-9eff-480e-b844-d216537c5d91]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: 78d2732a-9eff-480e-b844-d216537c5d91]     context, '3.44', skip_version_check=True).attachments.update(
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: 78d2732a-9eff-480e-b844-d216537c5d91]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: 78d2732a-9eff-480e-b844-d216537c5d91]     return method.func(obj, *args, **kwargs)
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: 78d2732a-9eff-480e-b844-d216537c5d91]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: 78d2732a-9eff-480e-b844-d216537c5d91]     resp = self._update('/attachments/%s' % id, body)
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: 78d2732a-9eff-480e-b844-d216537c5d91]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: 78d2732a-9eff-480e-b844-d216537c5d91]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: 78d2732a-9eff-480e-b844-d216537c5d91]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: 78d2732a-9eff-480e-b844-d216537c5d91]     return self._cs_request(url, 'PUT', **kwargs)
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: 78d2732a-9eff-480e-b844-d216537c5d91]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: 78d2732a-9eff-480e-b844-d216537c5d91]     return self.request(url, method, **kwargs)
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: 78d2732a-9eff-480e-b844-d216537c5d91]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: 78d2732a-9eff-480e-b844-d216537c5d91]     raise exceptions.from_response(resp, body)
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: 78d2732a-9eff-480e-b844-d216537c5d91] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2ed1d016-94ee-466a-937e-eb1d109a3c55)
Nov 10 17:48:13 user nova-compute[75100]: ERROR nova.compute.manager [instance: 78d2732a-9eff-480e-b844-d216537c5d91] 
Nov 10 17:48:13 user nova-compute[75100]: DEBUG nova.compute.claims [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Aborting claim: <nova.compute.claims.Claim object at 0x7fa3d4269900> {{(pid=75100) abort /opt/stack/nova/nova/compute/claims.py:84}}
Nov 10 17:48:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:48:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:48:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 17:48:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c2faedc8-382d-4c29-b5d9-ff7839e9f847 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Acquiring lock "5b5ec5d3-fa6f-43de-b786-8c423064fe7a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:48:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c2faedc8-382d-4c29-b5d9-ff7839e9f847 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Lock "5b5ec5d3-fa6f-43de-b786-8c423064fe7a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:48:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c2faedc8-382d-4c29-b5d9-ff7839e9f847 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Acquiring lock "5b5ec5d3-fa6f-43de-b786-8c423064fe7a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:48:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c2faedc8-382d-4c29-b5d9-ff7839e9f847 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Lock "5b5ec5d3-fa6f-43de-b786-8c423064fe7a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:48:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c2faedc8-382d-4c29-b5d9-ff7839e9f847 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Lock "5b5ec5d3-fa6f-43de-b786-8c423064fe7a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:48:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8aababb5-a161-5f85-896d-4791f81f2b3c', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:48:13 user nova-compute[75100]: INFO nova.compute.manager [None req-c2faedc8-382d-4c29-b5d9-ff7839e9f847 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Terminating instance
Nov 10 17:48:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:13 user nova-compute[75100]: DEBUG nova.compute.manager [None req-c2faedc8-382d-4c29-b5d9-ff7839e9f847 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 17:48:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5ec5d3-fa6f-43de-b786-8c423064fe7a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:48:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:48:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap27667bd1-cc, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:48:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap27667bd1-cc, col_values=(('qos', UUID('62f6e962-5abc-4075-8765-f6d9b7ee3cb9')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:48:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap27667bd1-cc, col_values=(('external_ids', {'iface-id': '27667bd1-cc0b-47d7-9e63-5fcc05f8bca7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:83:6b', 'vm-uuid': 'd61d3862-5be7-45cc-95a0-88124ac1725d'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:48:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:48:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c790b5c3-b255-430f-8654-f0ff5d54d48c/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:48:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:14 user nova-compute[75100]: INFO os_vif [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:83:6b,bridge_name='br-int',has_traffic_filtering=True,id=27667bd1-cc0b-47d7-9e63-5fcc05f8bca7,network=Network(f240fae3-3d7b-4b6e-b04f-18550ab4d0a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27667bd1-cc')
Nov 10 17:48:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:14 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 17:48:14 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] No VIF found with MAC fa:16:3e:2e:83:6b, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 17:48:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c790b5c3-b255-430f-8654-f0ff5d54d48c/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:48:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c790b5c3-b255-430f-8654-f0ff5d54d48c/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:48:14 user nova-compute[75100]: DEBUG nova.network.neutron [req-d039003f-afc2-43a0-95e6-693b6f5f3e7c req-7da68551-9e3d-47ac-b4c6-1114b380880a service nova] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] Updated VIF entry in instance network info cache for port 27667bd1-cc0b-47d7-9e63-5fcc05f8bca7. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 17:48:14 user nova-compute[75100]: DEBUG nova.network.neutron [req-d039003f-afc2-43a0-95e6-693b6f5f3e7c req-7da68551-9e3d-47ac-b4c6-1114b380880a service nova] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] Updating instance_info_cache with network_info: [{"id": "27667bd1-cc0b-47d7-9e63-5fcc05f8bca7", "address": "fa:16:3e:2e:83:6b", "network": {"id": "f240fae3-3d7b-4b6e-b04f-18550ab4d0a3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1007355777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c970a503d74d32a1e2b71f086649fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27667bd1-cc", "ovs_interfaceid": "27667bd1-cc0b-47d7-9e63-5fcc05f8bca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:48:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d039003f-afc2-43a0-95e6-693b6f5f3e7c req-7da68551-9e3d-47ac-b4c6-1114b380880a service nova] Releasing lock "refresh_cache-d61d3862-5be7-45cc-95a0-88124ac1725d" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:48:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c790b5c3-b255-430f-8654-f0ff5d54d48c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:48:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:48:14 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:48:14 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:48:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.950s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:48:14 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Build of instance ed8fb592-b4c8-4634-a618-0405d70a1acc aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-0dd77a96-7897-4218-903d-0cccfac0359a) {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2660}}
Nov 10 17:48:14 user nova-compute[75100]: DEBUG nova.compute.utils [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Build of instance ed8fb592-b4c8-4634-a618-0405d70a1acc aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: {{(pid=75100) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Nov 10 17:48:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.663s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:48:14 user nova-compute[75100]: ERROR nova.compute.manager [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Build of instance ed8fb592-b4c8-4634-a618-0405d70a1acc aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-0dd77a96-7897-4218-903d-0cccfac0359a): nova.exception.BuildAbortException: Build of instance ed8fb592-b4c8-4634-a618-0405d70a1acc aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-0dd77a96-7897-4218-903d-0cccfac0359a)
Nov 10 17:48:14 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Unplugging VIFs for instance {{(pid=75100) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2996}}
Nov 10 17:48:14 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T17:47:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1267561589',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1267561589',id=13,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIuinQqqn/Bldykv+OxEC0tGLslTML9sXzZIEgF8w6OYif67h5WAIh92bUcoSS7J0Z7njaEmhT/V2CDYI+sKZ4jbdz7y3UZZYjakWqVu1wemsIJ+aCOrd3fxubt/5HnXqA==',key_name='tempest-keypair-21579646',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a98ad0aacb594a5cb077b7dbb783e2a5',ramdisk_id='',reservation_id='r-qdyc4olv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-139734456',owner_user_name='tempest-TaggedBootDevicesTest-139734456-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:47:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='558a504dcf6d4fd0898ace7e7d44b7d4',uuid=ed8fb592-b4c8-4634-a618-0405d70a1acc,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "390c843a-5638-4ddb-aa25-622a55b1e89e", "address": "fa:16:3e:91:9b:34", "network": {"id": "492646a3-e87c-4e73-b830-5b82236e10bc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1282598664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a98ad0aacb594a5cb077b7dbb783e2a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap390c843a-56", "ovs_interfaceid": "390c843a-5638-4ddb-aa25-622a55b1e89e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 17:48:14 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] Converting VIF {"id": "390c843a-5638-4ddb-aa25-622a55b1e89e", "address": "fa:16:3e:91:9b:34", "network": {"id": "492646a3-e87c-4e73-b830-5b82236e10bc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1282598664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a98ad0aacb594a5cb077b7dbb783e2a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap390c843a-56", "ovs_interfaceid": "390c843a-5638-4ddb-aa25-622a55b1e89e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:48:14 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:9b:34,bridge_name='br-int',has_traffic_filtering=True,id=390c843a-5638-4ddb-aa25-622a55b1e89e,network=Network(492646a3-e87c-4e73-b830-5b82236e10bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap390c843a-56') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:48:14 user nova-compute[75100]: DEBUG os_vif [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:9b:34,bridge_name='br-int',has_traffic_filtering=True,id=390c843a-5638-4ddb-aa25-622a55b1e89e,network=Network(492646a3-e87c-4e73-b830-5b82236e10bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap390c843a-56') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 17:48:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap390c843a-56, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:48:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 17:48:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:48:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:48:14 user nova-compute[75100]: INFO os_vif [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:9b:34,bridge_name='br-int',has_traffic_filtering=True,id=390c843a-5638-4ddb-aa25-622a55b1e89e,network=Network(492646a3-e87c-4e73-b830-5b82236e10bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap390c843a-56')
Nov 10 17:48:14 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T17:47:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1267561589',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1267561589',id=13,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIuinQqqn/Bldykv+OxEC0tGLslTML9sXzZIEgF8w6OYif67h5WAIh92bUcoSS7J0Z7njaEmhT/V2CDYI+sKZ4jbdz7y3UZZYjakWqVu1wemsIJ+aCOrd3fxubt/5HnXqA==',key_name='tempest-keypair-21579646',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a98ad0aacb594a5cb077b7dbb783e2a5',ramdisk_id='',reservation_id='r-qdyc4olv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-139734456',owner_user_name='tempest-TaggedBootDevicesTest-139734456-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:47:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='558a504dcf6d4fd0898ace7e7d44b7d4',uuid=ed8fb592-b4c8-4634-a618-0405d70a1acc,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95359730-5a6b-462b-bd0f-68ea44304d5a", "address": "fa:16:3e:d5:cc:0b", "network": {"id": "e586a8bc-f76f-47af-8a8e-18f0303b0f48", "bridge": "br-int", "label": "tempest-device-tagging-net1-16513699", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a98ad0aacb594a5cb077b7dbb783e2a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95359730-5a", "ovs_interfaceid": "95359730-5a6b-462b-bd0f-68ea44304d5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 17:48:14 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] Converting VIF {"id": "95359730-5a6b-462b-bd0f-68ea44304d5a", "address": "fa:16:3e:d5:cc:0b", "network": {"id": "e586a8bc-f76f-47af-8a8e-18f0303b0f48", "bridge": "br-int", "label": "tempest-device-tagging-net1-16513699", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a98ad0aacb594a5cb077b7dbb783e2a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95359730-5a", "ovs_interfaceid": "95359730-5a6b-462b-bd0f-68ea44304d5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:48:14 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:cc:0b,bridge_name='br-int',has_traffic_filtering=True,id=95359730-5a6b-462b-bd0f-68ea44304d5a,network=Network(e586a8bc-f76f-47af-8a8e-18f0303b0f48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap95359730-5a') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:48:14 user nova-compute[75100]: DEBUG os_vif [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:cc:0b,bridge_name='br-int',has_traffic_filtering=True,id=95359730-5a6b-462b-bd0f-68ea44304d5a,network=Network(e586a8bc-f76f-47af-8a8e-18f0303b0f48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap95359730-5a') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 17:48:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap95359730-5a, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:48:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 17:48:14 user nova-compute[75100]: INFO os_vif [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:cc:0b,bridge_name='br-int',has_traffic_filtering=True,id=95359730-5a6b-462b-bd0f-68ea44304d5a,network=Network(e586a8bc-f76f-47af-8a8e-18f0303b0f48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap95359730-5a')
Nov 10 17:48:14 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T17:47:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1267561589',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1267561589',id=13,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIuinQqqn/Bldykv+OxEC0tGLslTML9sXzZIEgF8w6OYif67h5WAIh92bUcoSS7J0Z7njaEmhT/V2CDYI+sKZ4jbdz7y3UZZYjakWqVu1wemsIJ+aCOrd3fxubt/5HnXqA==',key_name='tempest-keypair-21579646',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a98ad0aacb594a5cb077b7dbb783e2a5',ramdisk_id='',reservation_id='r-qdyc4olv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-139734456',owner_user_name='tempest-TaggedBootDevicesTest-139734456-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:47:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='558a504dcf6d4fd0898ace7e7d44b7d4',uuid=ed8fb592-b4c8-4634-a618-0405d70a1acc,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "610eef6d-c52f-4f14-9b7c-09739a395ecb", "address": "fa:16:3e:63:43:5a", "network": {"id": "e586a8bc-f76f-47af-8a8e-18f0303b0f48", "bridge": "br-int", "label": "tempest-device-tagging-net1-16513699", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a98ad0aacb594a5cb077b7dbb783e2a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap610eef6d-c5", "ovs_interfaceid": "610eef6d-c52f-4f14-9b7c-09739a395ecb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 17:48:14 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] Converting VIF {"id": "610eef6d-c52f-4f14-9b7c-09739a395ecb", "address": "fa:16:3e:63:43:5a", "network": {"id": "e586a8bc-f76f-47af-8a8e-18f0303b0f48", "bridge": "br-int", "label": "tempest-device-tagging-net1-16513699", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a98ad0aacb594a5cb077b7dbb783e2a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap610eef6d-c5", "ovs_interfaceid": "610eef6d-c52f-4f14-9b7c-09739a395ecb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:48:14 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:43:5a,bridge_name='br-int',has_traffic_filtering=True,id=610eef6d-c52f-4f14-9b7c-09739a395ecb,network=Network(e586a8bc-f76f-47af-8a8e-18f0303b0f48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap610eef6d-c5') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:48:14 user nova-compute[75100]: DEBUG os_vif [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:43:5a,bridge_name='br-int',has_traffic_filtering=True,id=610eef6d-c52f-4f14-9b7c-09739a395ecb,network=Network(e586a8bc-f76f-47af-8a8e-18f0303b0f48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap610eef6d-c5') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 17:48:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap610eef6d-c5, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:48:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 17:48:14 user nova-compute[75100]: INFO os_vif [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:43:5a,bridge_name='br-int',has_traffic_filtering=True,id=610eef6d-c52f-4f14-9b7c-09739a395ecb,network=Network(e586a8bc-f76f-47af-8a8e-18f0303b0f48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap610eef6d-c5')
Nov 10 17:48:14 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T17:47:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1267561589',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1267561589',id=13,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIuinQqqn/Bldykv+OxEC0tGLslTML9sXzZIEgF8w6OYif67h5WAIh92bUcoSS7J0Z7njaEmhT/V2CDYI+sKZ4jbdz7y3UZZYjakWqVu1wemsIJ+aCOrd3fxubt/5HnXqA==',key_name='tempest-keypair-21579646',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a98ad0aacb594a5cb077b7dbb783e2a5',ramdisk_id='',reservation_id='r-qdyc4olv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-139734456',owner_user_name='tempest-TaggedBootDevicesTest-139734456-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:47:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='558a504dcf6d4fd0898ace7e7d44b7d4',uuid=ed8fb592-b4c8-4634-a618-0405d70a1acc,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dccf5548-9267-43d7-93e8-10cf08624d0c", "address": "fa:16:3e:cf:75:47", "network": {"id": "e586a8bc-f76f-47af-8a8e-18f0303b0f48", "bridge": "br-int", "label": "tempest-device-tagging-net1-16513699", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a98ad0aacb594a5cb077b7dbb783e2a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdccf5548-92", "ovs_interfaceid": "dccf5548-9267-43d7-93e8-10cf08624d0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 17:48:14 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] Converting VIF {"id": "dccf5548-9267-43d7-93e8-10cf08624d0c", "address": "fa:16:3e:cf:75:47", "network": {"id": "e586a8bc-f76f-47af-8a8e-18f0303b0f48", "bridge": "br-int", "label": "tempest-device-tagging-net1-16513699", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a98ad0aacb594a5cb077b7dbb783e2a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdccf5548-92", "ovs_interfaceid": "dccf5548-9267-43d7-93e8-10cf08624d0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:48:14 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:75:47,bridge_name='br-int',has_traffic_filtering=True,id=dccf5548-9267-43d7-93e8-10cf08624d0c,network=Network(e586a8bc-f76f-47af-8a8e-18f0303b0f48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdccf5548-92') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:48:14 user nova-compute[75100]: DEBUG os_vif [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:75:47,bridge_name='br-int',has_traffic_filtering=True,id=dccf5548-9267-43d7-93e8-10cf08624d0c,network=Network(e586a8bc-f76f-47af-8a8e-18f0303b0f48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdccf5548-92') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 17:48:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdccf5548-92, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:48:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 17:48:14 user nova-compute[75100]: INFO os_vif [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:75:47,bridge_name='br-int',has_traffic_filtering=True,id=dccf5548-9267-43d7-93e8-10cf08624d0c,network=Network(e586a8bc-f76f-47af-8a8e-18f0303b0f48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdccf5548-92')
Nov 10 17:48:14 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T17:47:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1267561589',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1267561589',id=13,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIuinQqqn/Bldykv+OxEC0tGLslTML9sXzZIEgF8w6OYif67h5WAIh92bUcoSS7J0Z7njaEmhT/V2CDYI+sKZ4jbdz7y3UZZYjakWqVu1wemsIJ+aCOrd3fxubt/5HnXqA==',key_name='tempest-keypair-21579646',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a98ad0aacb594a5cb077b7dbb783e2a5',ramdisk_id='',reservation_id='r-qdyc4olv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-139734456',owner_user_name='tempest-TaggedBootDevicesTest-139734456-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:47:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='558a504dcf6d4fd0898ace7e7d44b7d4',uuid=ed8fb592-b4c8-4634-a618-0405d70a1acc,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aaf512fe-ddb0-4593-81ab-48c0bf0239b9", "address": "fa:16:3e:ef:47:43", "network": {"id": "e586a8bc-f76f-47af-8a8e-18f0303b0f48", "bridge": "br-int", "label": "tempest-device-tagging-net1-16513699", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a98ad0aacb594a5cb077b7dbb783e2a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaf512fe-dd", "ovs_interfaceid": "aaf512fe-ddb0-4593-81ab-48c0bf0239b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 17:48:14 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] Converting VIF {"id": "aaf512fe-ddb0-4593-81ab-48c0bf0239b9", "address": "fa:16:3e:ef:47:43", "network": {"id": "e586a8bc-f76f-47af-8a8e-18f0303b0f48", "bridge": "br-int", "label": "tempest-device-tagging-net1-16513699", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a98ad0aacb594a5cb077b7dbb783e2a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaf512fe-dd", "ovs_interfaceid": "aaf512fe-ddb0-4593-81ab-48c0bf0239b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:48:14 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:47:43,bridge_name='br-int',has_traffic_filtering=True,id=aaf512fe-ddb0-4593-81ab-48c0bf0239b9,network=Network(e586a8bc-f76f-47af-8a8e-18f0303b0f48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaaf512fe-dd') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:48:14 user nova-compute[75100]: DEBUG os_vif [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:47:43,bridge_name='br-int',has_traffic_filtering=True,id=aaf512fe-ddb0-4593-81ab-48c0bf0239b9,network=Network(e586a8bc-f76f-47af-8a8e-18f0303b0f48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaaf512fe-dd') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 17:48:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaaf512fe-dd, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:48:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 17:48:14 user nova-compute[75100]: INFO os_vif [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:47:43,bridge_name='br-int',has_traffic_filtering=True,id=aaf512fe-ddb0-4593-81ab-48c0bf0239b9,network=Network(e586a8bc-f76f-47af-8a8e-18f0303b0f48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaaf512fe-dd')
Nov 10 17:48:14 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T17:47:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1267561589',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1267561589',id=13,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIuinQqqn/Bldykv+OxEC0tGLslTML9sXzZIEgF8w6OYif67h5WAIh92bUcoSS7J0Z7njaEmhT/V2CDYI+sKZ4jbdz7y3UZZYjakWqVu1wemsIJ+aCOrd3fxubt/5HnXqA==',key_name='tempest-keypair-21579646',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a98ad0aacb594a5cb077b7dbb783e2a5',ramdisk_id='',reservation_id='r-qdyc4olv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-139734456',owner_user_name='tempest-TaggedBootDevicesTest-139734456-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:47:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='558a504dcf6d4fd0898ace7e7d44b7d4',uuid=ed8fb592-b4c8-4634-a618-0405d70a1acc,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c33e37de-48ac-423f-93a4-311fb1fdfc0d", "address": "fa:16:3e:71:cb:fd", "network": {"id": "da135c9a-a62d-4b7f-95b1-c61665b4eb92", "bridge": "br-int", "label": "tempest-device-tagging-net2-346127362", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a98ad0aacb594a5cb077b7dbb783e2a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc33e37de-48", "ovs_interfaceid": "c33e37de-48ac-423f-93a4-311fb1fdfc0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 17:48:14 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] Converting VIF {"id": "c33e37de-48ac-423f-93a4-311fb1fdfc0d", "address": "fa:16:3e:71:cb:fd", "network": {"id": "da135c9a-a62d-4b7f-95b1-c61665b4eb92", "bridge": "br-int", "label": "tempest-device-tagging-net2-346127362", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a98ad0aacb594a5cb077b7dbb783e2a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc33e37de-48", "ovs_interfaceid": "c33e37de-48ac-423f-93a4-311fb1fdfc0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:48:14 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:cb:fd,bridge_name='br-int',has_traffic_filtering=True,id=c33e37de-48ac-423f-93a4-311fb1fdfc0d,network=Network(da135c9a-a62d-4b7f-95b1-c61665b4eb92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc33e37de-48') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:48:14 user nova-compute[75100]: DEBUG os_vif [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:cb:fd,bridge_name='br-int',has_traffic_filtering=True,id=c33e37de-48ac-423f-93a4-311fb1fdfc0d,network=Network(da135c9a-a62d-4b7f-95b1-c61665b4eb92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc33e37de-48') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 17:48:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc33e37de-48, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:48:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 17:48:14 user nova-compute[75100]: INFO os_vif [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:cb:fd,bridge_name='br-int',has_traffic_filtering=True,id=c33e37de-48ac-423f-93a4-311fb1fdfc0d,network=Network(da135c9a-a62d-4b7f-95b1-c61665b4eb92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc33e37de-48')
Nov 10 17:48:14 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T17:47:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1267561589',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1267561589',id=13,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIuinQqqn/Bldykv+OxEC0tGLslTML9sXzZIEgF8w6OYif67h5WAIh92bUcoSS7J0Z7njaEmhT/V2CDYI+sKZ4jbdz7y3UZZYjakWqVu1wemsIJ+aCOrd3fxubt/5HnXqA==',key_name='tempest-keypair-21579646',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a98ad0aacb594a5cb077b7dbb783e2a5',ramdisk_id='',reservation_id='r-qdyc4olv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-139734456',owner_user_name='tempest-TaggedBootDevicesTest-139734456-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:47:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='558a504dcf6d4fd0898ace7e7d44b7d4',uuid=ed8fb592-b4c8-4634-a618-0405d70a1acc,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f6738e49-d2d2-48d8-b355-3bbbe262ca20", "address": "fa:16:3e:06:8c:c5", "network": {"id": "da135c9a-a62d-4b7f-95b1-c61665b4eb92", "bridge": "br-int", "label": "tempest-device-tagging-net2-346127362", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a98ad0aacb594a5cb077b7dbb783e2a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6738e49-d2", "ovs_interfaceid": "f6738e49-d2d2-48d8-b355-3bbbe262ca20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 17:48:14 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] Converting VIF {"id": "f6738e49-d2d2-48d8-b355-3bbbe262ca20", "address": "fa:16:3e:06:8c:c5", "network": {"id": "da135c9a-a62d-4b7f-95b1-c61665b4eb92", "bridge": "br-int", "label": "tempest-device-tagging-net2-346127362", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a98ad0aacb594a5cb077b7dbb783e2a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6738e49-d2", "ovs_interfaceid": "f6738e49-d2d2-48d8-b355-3bbbe262ca20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:48:14 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:8c:c5,bridge_name='br-int',has_traffic_filtering=True,id=f6738e49-d2d2-48d8-b355-3bbbe262ca20,network=Network(da135c9a-a62d-4b7f-95b1-c61665b4eb92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6738e49-d2') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:48:14 user nova-compute[75100]: DEBUG os_vif [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:8c:c5,bridge_name='br-int',has_traffic_filtering=True,id=f6738e49-d2d2-48d8-b355-3bbbe262ca20,network=Network(da135c9a-a62d-4b7f-95b1-c61665b4eb92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6738e49-d2') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 17:48:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf6738e49-d2, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:48:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 17:48:14 user nova-compute[75100]: INFO os_vif [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:8c:c5,bridge_name='br-int',has_traffic_filtering=True,id=f6738e49-d2d2-48d8-b355-3bbbe262ca20,network=Network(da135c9a-a62d-4b7f-95b1-c61665b4eb92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6738e49-d2')
Nov 10 17:48:14 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Unplugged VIFs for instance {{(pid=75100) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:3032}}
Nov 10 17:48:14 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 17:48:14 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 17:48:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:48:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:48:15 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Instance destroyed successfully.
Nov 10 17:48:15 user nova-compute[75100]: DEBUG nova.objects.instance [None req-c2faedc8-382d-4c29-b5d9-ff7839e9f847 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Lazy-loading 'resources' on Instance uuid 5b5ec5d3-fa6f-43de-b786-8c423064fe7a {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-c2faedc8-382d-4c29-b5d9-ff7839e9f847 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T17:44:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-2092187117',display_name='tempest-AttachSCSIVolumeTestJSON-server-2092187117',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-2092187117',id=6,image_ref='62afa448-a474-4519-a8f3-297ecbc104bf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOP54VPtzNvqZrc+sFdJF7Njv1b4DMYzwD5qdJXA6wpAKXbe3gnYZYV1ZcxW2TsdvxcfzvIpf7Z2qwbIdNI6fduBbgK5hh89KHYygNnM4d9bJfAcpUIdHp1RvNgxYO7taQ==',key_name='tempest-keypair-881731324',keypairs=<?>,launch_index=0,launched_at=2023-11-10T17:44:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7e7974315cb54b07a47f3d59fc12ae02',ramdisk_id='',reservation_id='r-9xnnu22n',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='62afa448-a474-4519-a8f3-297ecbc104bf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-2125795715',owner_user_name='tempest-AttachSCSIVolumeTestJSON-2125795715-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T17:44:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dafadcfe7db24ff285a0622e6d1ced58',uuid=5b5ec5d3-fa6f-43de-b786-8c423064fe7a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b2adca0-0004-4df3-b8c8-03febbdc56ed", "address": "fa:16:3e:4d:09:82", "network": {"id": "80d66f5d-7270-4848-992f-d7d1dd0f9d3d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1394179581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e7974315cb54b07a47f3d59fc12ae02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b2adca0-00", "ovs_interfaceid": "2b2adca0-0004-4df3-b8c8-03febbdc56ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-c2faedc8-382d-4c29-b5d9-ff7839e9f847 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Converting VIF {"id": "2b2adca0-0004-4df3-b8c8-03febbdc56ed", "address": "fa:16:3e:4d:09:82", "network": {"id": "80d66f5d-7270-4848-992f-d7d1dd0f9d3d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1394179581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e7974315cb54b07a47f3d59fc12ae02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b2adca0-00", "ovs_interfaceid": "2b2adca0-0004-4df3-b8c8-03febbdc56ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-c2faedc8-382d-4c29-b5d9-ff7839e9f847 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:09:82,bridge_name='br-int',has_traffic_filtering=True,id=2b2adca0-0004-4df3-b8c8-03febbdc56ed,network=Network(80d66f5d-7270-4848-992f-d7d1dd0f9d3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b2adca0-00') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG os_vif [None req-c2faedc8-382d-4c29-b5d9-ff7839e9f847 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:09:82,bridge_name='br-int',has_traffic_filtering=True,id=2b2adca0-0004-4df3-b8c8-03febbdc56ed,network=Network(80d66f5d-7270-4848-992f-d7d1dd0f9d3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b2adca0-00') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.615s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG nova.compute.manager [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Build of instance 78d2732a-9eff-480e-b844-d216537c5d91 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2ed1d016-94ee-466a-937e-eb1d109a3c55) {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2660}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG nova.compute.utils [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Build of instance 78d2732a-9eff-480e-b844-d216537c5d91 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: {{(pid=75100) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2b2adca0-00, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:48:15 user nova-compute[75100]: ERROR nova.compute.manager [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Build of instance 78d2732a-9eff-480e-b844-d216537c5d91 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2ed1d016-94ee-466a-937e-eb1d109a3c55): nova.exception.BuildAbortException: Build of instance 78d2732a-9eff-480e-b844-d216537c5d91 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2ed1d016-94ee-466a-937e-eb1d109a3c55)
Nov 10 17:48:15 user nova-compute[75100]: DEBUG nova.compute.manager [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Unplugging VIFs for instance {{(pid=75100) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2996}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T17:47:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1933352582',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1933352582',id=12,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNA8brmJvwvA92JW8Nw6bp3sAD7I5cSPOpSaLmOQgZuPNbBp1YMzDg0BGkMDTCGxKnlLX9gdXGSRBjl7DYC6tq7XzBh1FlT1CkCImmpoTrFpRff1wyA2JfLJeJh0cE0KQQ==',key_name='tempest-keypair-2081984490',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27a7b57245324938a0f28dbf22654838',ramdisk_id='',reservation_id='r-ja1bon3j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-898948100',owner_user_name='tempest-TaggedBootDevicesTest_v242-898948100-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:47:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='105a4e4b920a47e4993736766132ab73',uuid=78d2732a-9eff-480e-b844-d216537c5d91,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28207b6f-d154-47a5-9b82-24cda17c04ee", "address": "fa:16:3e:87:da:93", "network": {"id": "0ab6fffb-433e-4e11-adcf-d028af23e504", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1202459467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27a7b57245324938a0f28dbf22654838", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28207b6f-d1", "ovs_interfaceid": "28207b6f-d154-47a5-9b82-24cda17c04ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] Converting VIF {"id": "28207b6f-d154-47a5-9b82-24cda17c04ee", "address": "fa:16:3e:87:da:93", "network": {"id": "0ab6fffb-433e-4e11-adcf-d028af23e504", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1202459467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27a7b57245324938a0f28dbf22654838", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28207b6f-d1", "ovs_interfaceid": "28207b6f-d154-47a5-9b82-24cda17c04ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:da:93,bridge_name='br-int',has_traffic_filtering=True,id=28207b6f-d154-47a5-9b82-24cda17c04ee,network=Network(0ab6fffb-433e-4e11-adcf-d028af23e504),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28207b6f-d1') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG os_vif [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:da:93,bridge_name='br-int',has_traffic_filtering=True,id=28207b6f-d154-47a5-9b82-24cda17c04ee,network=Network(0ab6fffb-433e-4e11-adcf-d028af23e504),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28207b6f-d1') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap28207b6f-d1, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2d5bcc9f-d39b-4e0d-82d1-754cc0553528) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:15 user nova-compute[75100]: INFO os_vif [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:da:93,bridge_name='br-int',has_traffic_filtering=True,id=28207b6f-d154-47a5-9b82-24cda17c04ee,network=Network(0ab6fffb-433e-4e11-adcf-d028af23e504),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28207b6f-d1')
Nov 10 17:48:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T17:47:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1933352582',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1933352582',id=12,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNA8brmJvwvA92JW8Nw6bp3sAD7I5cSPOpSaLmOQgZuPNbBp1YMzDg0BGkMDTCGxKnlLX9gdXGSRBjl7DYC6tq7XzBh1FlT1CkCImmpoTrFpRff1wyA2JfLJeJh0cE0KQQ==',key_name='tempest-keypair-2081984490',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27a7b57245324938a0f28dbf22654838',ramdisk_id='',reservation_id='r-ja1bon3j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-898948100',owner_user_name='tempest-TaggedBootDevicesTest_v242-898948100-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:47:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='105a4e4b920a47e4993736766132ab73',uuid=78d2732a-9eff-480e-b844-d216537c5d91,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60b2fd6c-b917-4212-bbc0-3b240bfc8cca", "address": "fa:16:3e:e1:52:2a", "network": {"id": "bda18aa0-61d4-45b8-8c06-9533d9d94ccc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1082967403", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27a7b57245324938a0f28dbf22654838", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60b2fd6c-b9", "ovs_interfaceid": "60b2fd6c-b917-4212-bbc0-3b240bfc8cca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] Converting VIF {"id": "60b2fd6c-b917-4212-bbc0-3b240bfc8cca", "address": "fa:16:3e:e1:52:2a", "network": {"id": "bda18aa0-61d4-45b8-8c06-9533d9d94ccc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1082967403", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27a7b57245324938a0f28dbf22654838", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60b2fd6c-b9", "ovs_interfaceid": "60b2fd6c-b917-4212-bbc0-3b240bfc8cca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:52:2a,bridge_name='br-int',has_traffic_filtering=True,id=60b2fd6c-b917-4212-bbc0-3b240bfc8cca,network=Network(bda18aa0-61d4-45b8-8c06-9533d9d94ccc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap60b2fd6c-b9') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG os_vif [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:52:2a,bridge_name='br-int',has_traffic_filtering=True,id=60b2fd6c-b917-4212-bbc0-3b240bfc8cca,network=Network(bda18aa0-61d4-45b8-8c06-9533d9d94ccc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap60b2fd6c-b9') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap60b2fd6c-b9, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 17:48:15 user nova-compute[75100]: INFO os_vif [None req-c2faedc8-382d-4c29-b5d9-ff7839e9f847 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:09:82,bridge_name='br-int',has_traffic_filtering=True,id=2b2adca0-0004-4df3-b8c8-03febbdc56ed,network=Network(80d66f5d-7270-4848-992f-d7d1dd0f9d3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b2adca0-00')
Nov 10 17:48:15 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-c2faedc8-382d-4c29-b5d9-ff7839e9f847 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Deleting instance files /opt/stack/data/nova/instances/5b5ec5d3-fa6f-43de-b786-8c423064fe7a_del
Nov 10 17:48:15 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-c2faedc8-382d-4c29-b5d9-ff7839e9f847 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Deletion of /opt/stack/data/nova/instances/5b5ec5d3-fa6f-43de-b786-8c423064fe7a_del complete
Nov 10 17:48:15 user nova-compute[75100]: INFO os_vif [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:52:2a,bridge_name='br-int',has_traffic_filtering=True,id=60b2fd6c-b917-4212-bbc0-3b240bfc8cca,network=Network(bda18aa0-61d4-45b8-8c06-9533d9d94ccc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap60b2fd6c-b9')
Nov 10 17:48:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T17:47:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1933352582',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1933352582',id=12,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNA8brmJvwvA92JW8Nw6bp3sAD7I5cSPOpSaLmOQgZuPNbBp1YMzDg0BGkMDTCGxKnlLX9gdXGSRBjl7DYC6tq7XzBh1FlT1CkCImmpoTrFpRff1wyA2JfLJeJh0cE0KQQ==',key_name='tempest-keypair-2081984490',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27a7b57245324938a0f28dbf22654838',ramdisk_id='',reservation_id='r-ja1bon3j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-898948100',owner_user_name='tempest-TaggedBootDevicesTest_v242-898948100-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:47:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='105a4e4b920a47e4993736766132ab73',uuid=78d2732a-9eff-480e-b844-d216537c5d91,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9c17c97-703b-42e1-8c85-36b37435fe47", "address": "fa:16:3e:b6:7c:21", "network": {"id": "bda18aa0-61d4-45b8-8c06-9533d9d94ccc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1082967403", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27a7b57245324938a0f28dbf22654838", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9c17c97-70", "ovs_interfaceid": "e9c17c97-703b-42e1-8c85-36b37435fe47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] Converting VIF {"id": "e9c17c97-703b-42e1-8c85-36b37435fe47", "address": "fa:16:3e:b6:7c:21", "network": {"id": "bda18aa0-61d4-45b8-8c06-9533d9d94ccc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1082967403", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27a7b57245324938a0f28dbf22654838", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9c17c97-70", "ovs_interfaceid": "e9c17c97-703b-42e1-8c85-36b37435fe47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:7c:21,bridge_name='br-int',has_traffic_filtering=True,id=e9c17c97-703b-42e1-8c85-36b37435fe47,network=Network(bda18aa0-61d4-45b8-8c06-9533d9d94ccc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape9c17c97-70') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG os_vif [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:7c:21,bridge_name='br-int',has_traffic_filtering=True,id=e9c17c97-703b-42e1-8c85-36b37435fe47,network=Network(bda18aa0-61d4-45b8-8c06-9533d9d94ccc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape9c17c97-70') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape9c17c97-70, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 17:48:15 user nova-compute[75100]: INFO os_vif [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:7c:21,bridge_name='br-int',has_traffic_filtering=True,id=e9c17c97-703b-42e1-8c85-36b37435fe47,network=Network(bda18aa0-61d4-45b8-8c06-9533d9d94ccc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape9c17c97-70')
Nov 10 17:48:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T17:47:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1933352582',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1933352582',id=12,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNA8brmJvwvA92JW8Nw6bp3sAD7I5cSPOpSaLmOQgZuPNbBp1YMzDg0BGkMDTCGxKnlLX9gdXGSRBjl7DYC6tq7XzBh1FlT1CkCImmpoTrFpRff1wyA2JfLJeJh0cE0KQQ==',key_name='tempest-keypair-2081984490',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27a7b57245324938a0f28dbf22654838',ramdisk_id='',reservation_id='r-ja1bon3j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-898948100',owner_user_name='tempest-TaggedBootDevicesTest_v242-898948100-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:47:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='105a4e4b920a47e4993736766132ab73',uuid=78d2732a-9eff-480e-b844-d216537c5d91,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df32706a-68b5-4554-bbe3-220b4311c054", "address": "fa:16:3e:98:8d:63", "network": {"id": "bda18aa0-61d4-45b8-8c06-9533d9d94ccc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1082967403", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27a7b57245324938a0f28dbf22654838", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf32706a-68", "ovs_interfaceid": "df32706a-68b5-4554-bbe3-220b4311c054", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] Converting VIF {"id": "df32706a-68b5-4554-bbe3-220b4311c054", "address": "fa:16:3e:98:8d:63", "network": {"id": "bda18aa0-61d4-45b8-8c06-9533d9d94ccc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1082967403", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27a7b57245324938a0f28dbf22654838", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf32706a-68", "ovs_interfaceid": "df32706a-68b5-4554-bbe3-220b4311c054", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:8d:63,bridge_name='br-int',has_traffic_filtering=True,id=df32706a-68b5-4554-bbe3-220b4311c054,network=Network(bda18aa0-61d4-45b8-8c06-9533d9d94ccc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf32706a-68') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG os_vif [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:8d:63,bridge_name='br-int',has_traffic_filtering=True,id=df32706a-68b5-4554-bbe3-220b4311c054,network=Network(bda18aa0-61d4-45b8-8c06-9533d9d94ccc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf32706a-68') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdf32706a-68, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91238923-a64c-4f41-a046-be243eff880d/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:48:15 user nova-compute[75100]: INFO os_vif [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:8d:63,bridge_name='br-int',has_traffic_filtering=True,id=df32706a-68b5-4554-bbe3-220b4311c054,network=Network(bda18aa0-61d4-45b8-8c06-9533d9d94ccc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf32706a-68')
Nov 10 17:48:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T17:47:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1933352582',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1933352582',id=12,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNA8brmJvwvA92JW8Nw6bp3sAD7I5cSPOpSaLmOQgZuPNbBp1YMzDg0BGkMDTCGxKnlLX9gdXGSRBjl7DYC6tq7XzBh1FlT1CkCImmpoTrFpRff1wyA2JfLJeJh0cE0KQQ==',key_name='tempest-keypair-2081984490',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27a7b57245324938a0f28dbf22654838',ramdisk_id='',reservation_id='r-ja1bon3j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-898948100',owner_user_name='tempest-TaggedBootDevicesTest_v242-898948100-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:47:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='105a4e4b920a47e4993736766132ab73',uuid=78d2732a-9eff-480e-b844-d216537c5d91,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0c5fcaa-e79c-41a5-8f36-18ac282f103a", "address": "fa:16:3e:5d:54:19", "network": {"id": "bda18aa0-61d4-45b8-8c06-9533d9d94ccc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1082967403", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27a7b57245324938a0f28dbf22654838", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0c5fcaa-e7", "ovs_interfaceid": "d0c5fcaa-e79c-41a5-8f36-18ac282f103a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] Converting VIF {"id": "d0c5fcaa-e79c-41a5-8f36-18ac282f103a", "address": "fa:16:3e:5d:54:19", "network": {"id": "bda18aa0-61d4-45b8-8c06-9533d9d94ccc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1082967403", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "27a7b57245324938a0f28dbf22654838", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0c5fcaa-e7", "ovs_interfaceid": "d0c5fcaa-e79c-41a5-8f36-18ac282f103a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:54:19,bridge_name='br-int',has_traffic_filtering=True,id=d0c5fcaa-e79c-41a5-8f36-18ac282f103a,network=Network(bda18aa0-61d4-45b8-8c06-9533d9d94ccc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0c5fcaa-e7') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG os_vif [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:54:19,bridge_name='br-int',has_traffic_filtering=True,id=d0c5fcaa-e79c-41a5-8f36-18ac282f103a,network=Network(bda18aa0-61d4-45b8-8c06-9533d9d94ccc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0c5fcaa-e7') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd0c5fcaa-e7, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 17:48:15 user nova-compute[75100]: INFO os_vif [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:54:19,bridge_name='br-int',has_traffic_filtering=True,id=d0c5fcaa-e79c-41a5-8f36-18ac282f103a,network=Network(bda18aa0-61d4-45b8-8c06-9533d9d94ccc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0c5fcaa-e7')
Nov 10 17:48:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T17:47:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1933352582',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1933352582',id=12,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNA8brmJvwvA92JW8Nw6bp3sAD7I5cSPOpSaLmOQgZuPNbBp1YMzDg0BGkMDTCGxKnlLX9gdXGSRBjl7DYC6tq7XzBh1FlT1CkCImmpoTrFpRff1wyA2JfLJeJh0cE0KQQ==',key_name='tempest-keypair-2081984490',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27a7b57245324938a0f28dbf22654838',ramdisk_id='',reservation_id='r-ja1bon3j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-898948100',owner_user_name='tempest-TaggedBootDevicesTest_v242-898948100-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:47:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='105a4e4b920a47e4993736766132ab73',uuid=78d2732a-9eff-480e-b844-d216537c5d91,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c63180df-c18f-473e-b3be-7b5bc22eccfa", "address": "fa:16:3e:01:e5:39", "network": {"id": "dc736961-0336-4b20-ae04-9d9e0b69a208", "bridge": "br-int", "label": "tempest-device-tagging-net2-396395134", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "27a7b57245324938a0f28dbf22654838", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63180df-c1", "ovs_interfaceid": "c63180df-c18f-473e-b3be-7b5bc22eccfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] Converting VIF {"id": "c63180df-c18f-473e-b3be-7b5bc22eccfa", "address": "fa:16:3e:01:e5:39", "network": {"id": "dc736961-0336-4b20-ae04-9d9e0b69a208", "bridge": "br-int", "label": "tempest-device-tagging-net2-396395134", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "27a7b57245324938a0f28dbf22654838", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63180df-c1", "ovs_interfaceid": "c63180df-c18f-473e-b3be-7b5bc22eccfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:e5:39,bridge_name='br-int',has_traffic_filtering=True,id=c63180df-c18f-473e-b3be-7b5bc22eccfa,network=Network(dc736961-0336-4b20-ae04-9d9e0b69a208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63180df-c1') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG os_vif [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:e5:39,bridge_name='br-int',has_traffic_filtering=True,id=c63180df-c18f-473e-b3be-7b5bc22eccfa,network=Network(dc736961-0336-4b20-ae04-9d9e0b69a208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63180df-c1') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 17:48:15 user nova-compute[75100]: INFO nova.compute.manager [None req-c2faedc8-382d-4c29-b5d9-ff7839e9f847 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Took 1.39 seconds to destroy the instance on the hypervisor.
Nov 10 17:48:15 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-c2faedc8-382d-4c29-b5d9-ff7839e9f847 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc63180df-c1, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 17:48:15 user nova-compute[75100]: INFO os_vif [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:e5:39,bridge_name='br-int',has_traffic_filtering=True,id=c63180df-c18f-473e-b3be-7b5bc22eccfa,network=Network(dc736961-0336-4b20-ae04-9d9e0b69a208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63180df-c1')
Nov 10 17:48:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T17:47:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1933352582',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1933352582',id=12,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNA8brmJvwvA92JW8Nw6bp3sAD7I5cSPOpSaLmOQgZuPNbBp1YMzDg0BGkMDTCGxKnlLX9gdXGSRBjl7DYC6tq7XzBh1FlT1CkCImmpoTrFpRff1wyA2JfLJeJh0cE0KQQ==',key_name='tempest-keypair-2081984490',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27a7b57245324938a0f28dbf22654838',ramdisk_id='',reservation_id='r-ja1bon3j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-898948100',owner_user_name='tempest-TaggedBootDevicesTest_v242-898948100-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:47:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='105a4e4b920a47e4993736766132ab73',uuid=78d2732a-9eff-480e-b844-d216537c5d91,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c6999453-6b72-4e2d-8fa2-d77386b95791", "address": "fa:16:3e:05:31:e2", "network": {"id": "dc736961-0336-4b20-ae04-9d9e0b69a208", "bridge": "br-int", "label": "tempest-device-tagging-net2-396395134", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "27a7b57245324938a0f28dbf22654838", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6999453-6b", "ovs_interfaceid": "c6999453-6b72-4e2d-8fa2-d77386b95791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] Converting VIF {"id": "c6999453-6b72-4e2d-8fa2-d77386b95791", "address": "fa:16:3e:05:31:e2", "network": {"id": "dc736961-0336-4b20-ae04-9d9e0b69a208", "bridge": "br-int", "label": "tempest-device-tagging-net2-396395134", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "27a7b57245324938a0f28dbf22654838", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6999453-6b", "ovs_interfaceid": "c6999453-6b72-4e2d-8fa2-d77386b95791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:31:e2,bridge_name='br-int',has_traffic_filtering=True,id=c6999453-6b72-4e2d-8fa2-d77386b95791,network=Network(dc736961-0336-4b20-ae04-9d9e0b69a208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6999453-6b') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG os_vif [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:31:e2,bridge_name='br-int',has_traffic_filtering=True,id=c6999453-6b72-4e2d-8fa2-d77386b95791,network=Network(dc736961-0336-4b20-ae04-9d9e0b69a208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6999453-6b') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc6999453-6b, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 17:48:15 user nova-compute[75100]: INFO os_vif [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:31:e2,bridge_name='br-int',has_traffic_filtering=True,id=c6999453-6b72-4e2d-8fa2-d77386b95791,network=Network(dc736961-0336-4b20-ae04-9d9e0b69a208),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6999453-6b')
Nov 10 17:48:15 user nova-compute[75100]: DEBUG nova.compute.manager [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Unplugged VIFs for instance {{(pid=75100) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:3032}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG nova.compute.manager [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG nova.network.neutron [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91238923-a64c-4f41-a046-be243eff880d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91238923-a64c-4f41-a046-be243eff880d/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91238923-a64c-4f41-a046-be243eff880d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db3f69df-51b2-464c-921e-33171e29f46d/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG nova.compute.manager [req-40bbef7f-8058-449d-b734-fc1b85328cfb req-f886a6c9-0655-4de6-9405-b73003905999 service nova] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Received event network-vif-unplugged-2b2adca0-0004-4df3-b8c8-03febbdc56ed {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-40bbef7f-8058-449d-b734-fc1b85328cfb req-f886a6c9-0655-4de6-9405-b73003905999 service nova] Acquiring lock "5b5ec5d3-fa6f-43de-b786-8c423064fe7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-40bbef7f-8058-449d-b734-fc1b85328cfb req-f886a6c9-0655-4de6-9405-b73003905999 service nova] Lock "5b5ec5d3-fa6f-43de-b786-8c423064fe7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-40bbef7f-8058-449d-b734-fc1b85328cfb req-f886a6c9-0655-4de6-9405-b73003905999 service nova] Lock "5b5ec5d3-fa6f-43de-b786-8c423064fe7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG nova.compute.manager [req-40bbef7f-8058-449d-b734-fc1b85328cfb req-f886a6c9-0655-4de6-9405-b73003905999 service nova] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] No waiting events found dispatching network-vif-unplugged-2b2adca0-0004-4df3-b8c8-03febbdc56ed {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG nova.compute.manager [req-40bbef7f-8058-449d-b734-fc1b85328cfb req-f886a6c9-0655-4de6-9405-b73003905999 service nova] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Received event network-vif-unplugged-2b2adca0-0004-4df3-b8c8-03febbdc56ed for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG nova.compute.manager [req-40bbef7f-8058-449d-b734-fc1b85328cfb req-f886a6c9-0655-4de6-9405-b73003905999 service nova] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Received event network-vif-plugged-2b2adca0-0004-4df3-b8c8-03febbdc56ed {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-40bbef7f-8058-449d-b734-fc1b85328cfb req-f886a6c9-0655-4de6-9405-b73003905999 service nova] Acquiring lock "5b5ec5d3-fa6f-43de-b786-8c423064fe7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-40bbef7f-8058-449d-b734-fc1b85328cfb req-f886a6c9-0655-4de6-9405-b73003905999 service nova] Lock "5b5ec5d3-fa6f-43de-b786-8c423064fe7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-40bbef7f-8058-449d-b734-fc1b85328cfb req-f886a6c9-0655-4de6-9405-b73003905999 service nova] Lock "5b5ec5d3-fa6f-43de-b786-8c423064fe7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG nova.compute.manager [req-40bbef7f-8058-449d-b734-fc1b85328cfb req-f886a6c9-0655-4de6-9405-b73003905999 service nova] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] No waiting events found dispatching network-vif-plugged-2b2adca0-0004-4df3-b8c8-03febbdc56ed {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:48:15 user nova-compute[75100]: WARNING nova.compute.manager [req-40bbef7f-8058-449d-b734-fc1b85328cfb req-f886a6c9-0655-4de6-9405-b73003905999 service nova] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Received unexpected event network-vif-plugged-2b2adca0-0004-4df3-b8c8-03febbdc56ed for instance with vm_state active and task_state deleting.
Nov 10 17:48:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db3f69df-51b2-464c-921e-33171e29f46d/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:48:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db3f69df-51b2-464c-921e-33171e29f46d/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:48:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db3f69df-51b2-464c-921e-33171e29f46d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:48:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ead532eb-c8be-45fa-a8b7-0b4c4f884a90/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:48:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Acquiring lock "71ff860c-f094-4885-bf69-cd6236ebc875" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:48:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Lock "71ff860c-f094-4885-bf69-cd6236ebc875" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:48:16 user nova-compute[75100]: DEBUG nova.compute.manager [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: 71ff860c-f094-4885-bf69-cd6236ebc875] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 17:48:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ead532eb-c8be-45fa-a8b7-0b4c4f884a90/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:48:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ead532eb-c8be-45fa-a8b7-0b4c4f884a90/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:48:16 user nova-compute[75100]: DEBUG nova.compute.manager [req-9134a0b4-44ed-4db0-bcb3-dcb59b4e3e62 req-a1e1b6b4-cd26-4b7e-823b-9d8f8f739be6 service nova] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] Received event network-vif-plugged-27667bd1-cc0b-47d7-9e63-5fcc05f8bca7 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:48:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9134a0b4-44ed-4db0-bcb3-dcb59b4e3e62 req-a1e1b6b4-cd26-4b7e-823b-9d8f8f739be6 service nova] Acquiring lock "d61d3862-5be7-45cc-95a0-88124ac1725d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:48:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9134a0b4-44ed-4db0-bcb3-dcb59b4e3e62 req-a1e1b6b4-cd26-4b7e-823b-9d8f8f739be6 service nova] Lock "d61d3862-5be7-45cc-95a0-88124ac1725d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:48:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9134a0b4-44ed-4db0-bcb3-dcb59b4e3e62 req-a1e1b6b4-cd26-4b7e-823b-9d8f8f739be6 service nova] Lock "d61d3862-5be7-45cc-95a0-88124ac1725d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:48:16 user nova-compute[75100]: DEBUG nova.compute.manager [req-9134a0b4-44ed-4db0-bcb3-dcb59b4e3e62 req-a1e1b6b4-cd26-4b7e-823b-9d8f8f739be6 service nova] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] No waiting events found dispatching network-vif-plugged-27667bd1-cc0b-47d7-9e63-5fcc05f8bca7 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:48:16 user nova-compute[75100]: WARNING nova.compute.manager [req-9134a0b4-44ed-4db0-bcb3-dcb59b4e3e62 req-a1e1b6b4-cd26-4b7e-823b-9d8f8f739be6 service nova] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] Received unexpected event network-vif-plugged-27667bd1-cc0b-47d7-9e63-5fcc05f8bca7 for instance with vm_state building and task_state spawning.
Nov 10 17:48:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:48:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:48:16 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 17:48:16 user nova-compute[75100]: INFO nova.compute.claims [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: 71ff860c-f094-4885-bf69-cd6236ebc875] Claim successful on node user
Nov 10 17:48:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ead532eb-c8be-45fa-a8b7-0b4c4f884a90/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:48:18 user nova-compute[75100]: DEBUG nova.compute.manager [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 17:48:18 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 17:48:18 user nova-compute[75100]: DEBUG nova.compute.manager [req-0010b35c-2d10-481e-a9ae-578b675a0c59 req-e65a0647-3561-41bc-b0b9-10b4df1881a8 service nova] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Received event network-vif-deleted-2b2adca0-0004-4df3-b8c8-03febbdc56ed {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:48:18 user nova-compute[75100]: INFO nova.compute.manager [req-0010b35c-2d10-481e-a9ae-578b675a0c59 req-e65a0647-3561-41bc-b0b9-10b4df1881a8 service nova] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Neutron deleted interface 2b2adca0-0004-4df3-b8c8-03febbdc56ed; detaching it from the instance and deleting it from the info cache
Nov 10 17:48:18 user nova-compute[75100]: DEBUG nova.network.neutron [req-0010b35c-2d10-481e-a9ae-578b675a0c59 req-e65a0647-3561-41bc-b0b9-10b4df1881a8 service nova] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:48:18 user nova-compute[75100]: DEBUG nova.compute.manager [req-9537dafc-de45-45aa-9acf-87246c863d23 req-1e0f0c0b-bf06-4afa-be46-1016edca1ecf service nova] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] Received event network-vif-plugged-27667bd1-cc0b-47d7-9e63-5fcc05f8bca7 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:48:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9537dafc-de45-45aa-9acf-87246c863d23 req-1e0f0c0b-bf06-4afa-be46-1016edca1ecf service nova] Acquiring lock "d61d3862-5be7-45cc-95a0-88124ac1725d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:48:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9537dafc-de45-45aa-9acf-87246c863d23 req-1e0f0c0b-bf06-4afa-be46-1016edca1ecf service nova] Lock "d61d3862-5be7-45cc-95a0-88124ac1725d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:48:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9537dafc-de45-45aa-9acf-87246c863d23 req-1e0f0c0b-bf06-4afa-be46-1016edca1ecf service nova] Lock "d61d3862-5be7-45cc-95a0-88124ac1725d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:48:18 user nova-compute[75100]: DEBUG nova.compute.manager [req-9537dafc-de45-45aa-9acf-87246c863d23 req-1e0f0c0b-bf06-4afa-be46-1016edca1ecf service nova] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] No waiting events found dispatching network-vif-plugged-27667bd1-cc0b-47d7-9e63-5fcc05f8bca7 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:48:18 user nova-compute[75100]: WARNING nova.compute.manager [req-9537dafc-de45-45aa-9acf-87246c863d23 req-1e0f0c0b-bf06-4afa-be46-1016edca1ecf service nova] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] Received unexpected event network-vif-plugged-27667bd1-cc0b-47d7-9e63-5fcc05f8bca7 for instance with vm_state building and task_state spawning.
Nov 10 17:48:18 user nova-compute[75100]: DEBUG nova.compute.manager [req-9537dafc-de45-45aa-9acf-87246c863d23 req-1e0f0c0b-bf06-4afa-be46-1016edca1ecf service nova] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Received event network-changed-26f643d1-0961-49af-bde1-32d1a6b0941d {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:48:18 user nova-compute[75100]: DEBUG nova.compute.manager [req-9537dafc-de45-45aa-9acf-87246c863d23 req-1e0f0c0b-bf06-4afa-be46-1016edca1ecf service nova] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Refreshing instance network info cache due to event network-changed-26f643d1-0961-49af-bde1-32d1a6b0941d. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 17:48:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9537dafc-de45-45aa-9acf-87246c863d23 req-1e0f0c0b-bf06-4afa-be46-1016edca1ecf service nova] Acquiring lock "refresh_cache-111bd74e-2943-4f12-9514-b564cf26dadb" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:48:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9537dafc-de45-45aa-9acf-87246c863d23 req-1e0f0c0b-bf06-4afa-be46-1016edca1ecf service nova] Acquired lock "refresh_cache-111bd74e-2943-4f12-9514-b564cf26dadb" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:48:18 user nova-compute[75100]: DEBUG nova.network.neutron [req-9537dafc-de45-45aa-9acf-87246c863d23 req-1e0f0c0b-bf06-4afa-be46-1016edca1ecf service nova] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Refreshing network info cache for port 26f643d1-0961-49af-bde1-32d1a6b0941d {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 17:48:18 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:48:18 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:48:18 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:48:18 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Hypervisor/Node resource view: name=user free_ram=7710MB free_disk=24.76287078857422GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 17:48:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:48:18 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Took 3.42 seconds to deallocate network for instance.
Nov 10 17:48:18 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] Instance spawned successfully.
Nov 10 17:48:18 user nova-compute[75100]: DEBUG nova.compute.manager [req-0010b35c-2d10-481e-a9ae-578b675a0c59 req-e65a0647-3561-41bc-b0b9-10b4df1881a8 service nova] [instance: 5b5ec5d3-fa6f-43de-b786-8c423064fe7a] Detach interface failed, port_id=2b2adca0-0004-4df3-b8c8-03febbdc56ed, reason: Instance 5b5ec5d3-fa6f-43de-b786-8c423064fe7a could not be found. {{(pid=75100) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 17:48:18 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 17:48:18 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:48:18 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:48:18 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:48:18 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:48:18 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:48:18 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:48:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c2faedc8-382d-4c29-b5d9-ff7839e9f847 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:48:18 user nova-compute[75100]: INFO nova.compute.manager [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] Took 7.78 seconds to spawn the instance on the hypervisor.
Nov 10 17:48:18 user nova-compute[75100]: DEBUG nova.compute.manager [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 17:48:19 user nova-compute[75100]: INFO nova.compute.manager [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] Took 8.73 seconds to build instance.
Nov 10 17:48:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4404e3fd-bce4-4edd-8aa5-b4237b107a79 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lock "d61d3862-5be7-45cc-95a0-88124ac1725d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.908s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:48:19 user nova-compute[75100]: INFO nova.compute.manager [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Rebuilding instance
Nov 10 17:48:19 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:48:19 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:48:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.864s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:48:19 user nova-compute[75100]: DEBUG nova.compute.manager [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: 71ff860c-f094-4885-bf69-cd6236ebc875] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 17:48:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.550s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:48:19 user nova-compute[75100]: DEBUG nova.compute.manager [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 17:48:19 user nova-compute[75100]: DEBUG nova.compute.manager [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: 71ff860c-f094-4885-bf69-cd6236ebc875] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 17:48:19 user nova-compute[75100]: DEBUG nova.network.neutron [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: 71ff860c-f094-4885-bf69-cd6236ebc875] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 17:48:19 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: 71ff860c-f094-4885-bf69-cd6236ebc875] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 17:48:19 user nova-compute[75100]: DEBUG nova.compute.manager [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: 71ff860c-f094-4885-bf69-cd6236ebc875] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 17:48:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:19 user nova-compute[75100]: DEBUG nova.policy [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7994564d536446e38002847db1668157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8460c83146a64640ba7e549d159275c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 17:48:19 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 78d2732a-9eff-480e-b844-d216537c5d91 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 10 17:48:19 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 3e14de19-540d-4dc2-a058-6874d8d14478 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:48:19 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:48:19 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance c19fc271-a248-4631-a11f-89b7ed73bf85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:48:19 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance d61d3862-5be7-45cc-95a0-88124ac1725d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:48:19 user nova-compute[75100]: WARNING nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 5b5ec5d3-fa6f-43de-b786-8c423064fe7a is not being actively managed by this compute host but has allocations referencing this compute host: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocation because we do not know what to do.
Nov 10 17:48:19 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 71ff860c-f094-4885-bf69-cd6236ebc875 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:48:19 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance ead532eb-c8be-45fa-a8b7-0b4c4f884a90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:48:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:19 user nova-compute[75100]: DEBUG nova.compute.manager [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: 71ff860c-f094-4885-bf69-cd6236ebc875] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 17:48:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: 71ff860c-f094-4885-bf69-cd6236ebc875] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 17:48:19 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: 71ff860c-f094-4885-bf69-cd6236ebc875] Creating image(s)
Nov 10 17:48:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Acquiring lock "/opt/stack/data/nova/instances/71ff860c-f094-4885-bf69-cd6236ebc875/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:48:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Lock "/opt/stack/data/nova/instances/71ff860c-f094-4885-bf69-cd6236ebc875/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:48:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Lock "/opt/stack/data/nova/instances/71ff860c-f094-4885-bf69-cd6236ebc875/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:48:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:48:19 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance ed8fb592-b4c8-4634-a618-0405d70a1acc has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 10 17:48:19 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 91238923-a64c-4f41-a046-be243eff880d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:48:19 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 111bd74e-2943-4f12-9514-b564cf26dadb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:48:19 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance c790b5c3-b255-430f-8654-f0ff5d54d48c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:48:19 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance db3f69df-51b2-464c-921e-33171e29f46d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:48:19 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 17:48:19 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 17:48:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.322s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:48:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Acquiring lock "818b9e28e061d41a38d903968b229be2ed9ba520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:48:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:48:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG nova.network.neutron [req-9537dafc-de45-45aa-9acf-87246c863d23 req-1e0f0c0b-bf06-4afa-be46-1016edca1ecf service nova] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Updated VIF entry in instance network info cache for port 26f643d1-0961-49af-bde1-32d1a6b0941d. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG nova.network.neutron [req-9537dafc-de45-45aa-9acf-87246c863d23 req-1e0f0c0b-bf06-4afa-be46-1016edca1ecf service nova] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Updating instance_info_cache with network_info: [{"id": "26f643d1-0961-49af-bde1-32d1a6b0941d", "address": "fa:16:3e:45:39:04", "network": {"id": "2fcf93f6-0be9-4c44-8caa-e5e556d88de8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1797631123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69fe121924d471abc0e62a4a32e4a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26f643d1-09", "ovs_interfaceid": "26f643d1-0961-49af-bde1-32d1a6b0941d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG nova.network.neutron [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: 71ff860c-f094-4885-bf69-cd6236ebc875] Successfully created port: 406f990a-ae7a-4d1d-9045-ccfe829faa61 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9537dafc-de45-45aa-9acf-87246c863d23 req-1e0f0c0b-bf06-4afa-be46-1016edca1ecf service nova] Releasing lock "refresh_cache-111bd74e-2943-4f12-9514-b564cf26dadb" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.246s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/71ff860c-f094-4885-bf69-cd6236ebc875/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/71ff860c-f094-4885-bf69-cd6236ebc875/disk 1073741824" returned: 0 in 0.079s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.332s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:48:20 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Instance destroyed successfully.
Nov 10 17:48:20 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Instance destroyed successfully.
Nov 10 17:48:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:46:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-483449440',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-51640417',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrKIMtk4kEwRtjbNDdESYG/eisyJknH+FhllMfNkzOhc8u5uNZOhOKf+vnV4PIFkkxSuZX7HodgT53XzLo5dAjQLzj42zR+o2Z9UiOkxsnJ+ZOoOQHi2OVpW8H5WpdMew==',key_name='tempest-keypair-1759515291',keypairs=<?>,launch_index=0,launched_at=2023-11-10T17:46:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d69fe121924d471abc0e62a4a32e4a75',ramdisk_id='',reservation_id='r-m3nm1elv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-2085671475',owner_user_name='tempest-ServerActionsV293TestJSON-2085671475-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:48:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bad2868941f0446f8674b47a316fa757',uuid=111bd74e-2943-4f12-9514-b564cf26dadb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26f643d1-0961-49af-bde1-32d1a6b0941d", "address": "fa:16:3e:45:39:04", "network": {"id": "2fcf93f6-0be9-4c44-8caa-e5e556d88de8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1797631123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69fe121924d471abc0e62a4a32e4a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26f643d1-09", "ovs_interfaceid": "26f643d1-0961-49af-bde1-32d1a6b0941d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Converting VIF {"id": "26f643d1-0961-49af-bde1-32d1a6b0941d", "address": "fa:16:3e:45:39:04", "network": {"id": "2fcf93f6-0be9-4c44-8caa-e5e556d88de8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1797631123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69fe121924d471abc0e62a4a32e4a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26f643d1-09", "ovs_interfaceid": "26f643d1-0961-49af-bde1-32d1a6b0941d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:39:04,bridge_name='br-int',has_traffic_filtering=True,id=26f643d1-0961-49af-bde1-32d1a6b0941d,network=Network(2fcf93f6-0be9-4c44-8caa-e5e556d88de8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26f643d1-09') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG os_vif [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:39:04,bridge_name='br-int',has_traffic_filtering=True,id=26f643d1-0961-49af-bde1-32d1a6b0941d,network=Network(2fcf93f6-0be9-4c44-8caa-e5e556d88de8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26f643d1-09') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap26f643d1-09, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=432bd680-4d7d-4102-b213-025836606ed9) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG nova.compute.manager [req-a59605e4-b0e0-436c-81f5-b95771a7c19d req-b360153a-0962-481d-888f-c6b2094f9511 service nova] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Received event network-vif-unplugged-26f643d1-0961-49af-bde1-32d1a6b0941d {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a59605e4-b0e0-436c-81f5-b95771a7c19d req-b360153a-0962-481d-888f-c6b2094f9511 service nova] Acquiring lock "111bd74e-2943-4f12-9514-b564cf26dadb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a59605e4-b0e0-436c-81f5-b95771a7c19d req-b360153a-0962-481d-888f-c6b2094f9511 service nova] Lock "111bd74e-2943-4f12-9514-b564cf26dadb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a59605e4-b0e0-436c-81f5-b95771a7c19d req-b360153a-0962-481d-888f-c6b2094f9511 service nova] Lock "111bd74e-2943-4f12-9514-b564cf26dadb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG nova.compute.manager [req-a59605e4-b0e0-436c-81f5-b95771a7c19d req-b360153a-0962-481d-888f-c6b2094f9511 service nova] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] No waiting events found dispatching network-vif-unplugged-26f643d1-0961-49af-bde1-32d1a6b0941d {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:48:20 user nova-compute[75100]: WARNING nova.compute.manager [req-a59605e4-b0e0-436c-81f5-b95771a7c19d req-b360153a-0962-481d-888f-c6b2094f9511 service nova] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Received unexpected event network-vif-unplugged-26f643d1-0961-49af-bde1-32d1a6b0941d for instance with vm_state active and task_state rebuilding.
Nov 10 17:48:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:48:20 user nova-compute[75100]: INFO os_vif [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:39:04,bridge_name='br-int',has_traffic_filtering=True,id=26f643d1-0961-49af-bde1-32d1a6b0941d,network=Network(2fcf93f6-0be9-4c44-8caa-e5e556d88de8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26f643d1-09')
Nov 10 17:48:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, {'target_iqn': 'iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Yhtwynlz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 17:48:20 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 10 17:48:20 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8813ac6a-682a-4d40-b216-f37a731fd546]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 17:48:20 user nova-compute[75100]: No targets found.
Nov 10 17:48:20 user nova-compute[75100]: iSNS:
Nov 10 17:48:20 user nova-compute[75100]: No targets found.
Nov 10 17:48:20 user nova-compute[75100]: STATIC:
Nov 10 17:48:20 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb
Nov 10 17:48:20 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 17:48:20 user nova-compute[75100]:                 Iface Name: default
Nov 10 17:48:20 user nova-compute[75100]: FIRMWARE:
Nov 10 17:48:20 user nova-compute[75100]: No targets found.
Nov 10 17:48:20 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 17:48:20 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 17:48:20 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.275s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Checking if we can resize image /opt/stack/data/nova/instances/71ff860c-f094-4885-bf69-cd6236ebc875/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71ff860c-f094-4885-bf69-cd6236ebc875/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c09fe09-5b03-4fa1-8226-d34b01bab184]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b22a5b8-56ce-4403-929b-549a1568488f]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb (non-flash)
Nov 10 17:48:20 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb (non-flash)
Nov 10 17:48:20 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3d42c2290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb'): ({'sdc'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Removing single pathed devices sdc {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1df407-849a-40a3-bed6-bc4a17f06209]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.029s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab73e193-71c2-4ef6-bac5-1153926fc60c]: (4, ('ok\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Flushing IO for device /dev/sdc {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3cabff9-74a8-4c70-82be-e0acb873121c]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71ff860c-f094-4885-bf69-cd6236ebc875/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Cannot resize image /opt/stack/data/nova/instances/71ff860c-f094-4885-bf69-cd6236ebc875/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: 71ff860c-f094-4885-bf69-cd6236ebc875] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: 71ff860c-f094-4885-bf69-cd6236ebc875] Ensure instance console log exists: /opt/stack/data/nova/instances/71ff860c-f094-4885-bf69-cd6236ebc875/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.491s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c2faedc8-382d-4c29-b5d9-ff7839e9f847 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.934s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[70877895-fec4-4048-a823-4cc9892d2390]: (4, ('1', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] SCSI volumes sdc have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c2faedc8-382d-4c29-b5d9-ff7839e9f847 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.015s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[593df44c-c78c-4283-bf31-74b32d461359]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb -p 172.16.0.220:3260 --logout {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:48:20 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-c2faedc8-382d-4c29-b5d9-ff7839e9f847 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Deleted allocations for instance 5b5ec5d3-fa6f-43de-b786-8c423064fe7a
Nov 10 17:48:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e45f8a5-b57a-4685-8d1c-88d7cf487f75]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb, portal: 172.16.0.220,3260]
Nov 10 17:48:20 user nova-compute[75100]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb, portal: 172.16.0.220,3260] successful.
Nov 10 17:48:20 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb -p 172.16.0.220:3260 --op delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1322fdfc-38a9-4b35-8499-9f24fd617c36]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.423s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] <== disconnect_volume: return (425ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 17:48:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 17:48:20 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Deleting instance files /opt/stack/data/nova/instances/111bd74e-2943-4f12-9514-b564cf26dadb_del
Nov 10 17:48:20 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Deletion of /opt/stack/data/nova/instances/111bd74e-2943-4f12-9514-b564cf26dadb_del complete
Nov 10 17:48:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c2faedc8-382d-4c29-b5d9-ff7839e9f847 tempest-AttachSCSIVolumeTestJSON-2125795715 tempest-AttachSCSIVolumeTestJSON-2125795715-project-member] Lock "5b5ec5d3-fa6f-43de-b786-8c423064fe7a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.065s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:48:21 user nova-compute[75100]: DEBUG nova.network.neutron [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: 71ff860c-f094-4885-bf69-cd6236ebc875] Successfully updated port: 406f990a-ae7a-4d1d-9045-ccfe829faa61 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 17:48:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Acquiring lock "refresh_cache-71ff860c-f094-4885-bf69-cd6236ebc875" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:48:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Acquired lock "refresh_cache-71ff860c-f094-4885-bf69-cd6236ebc875" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:48:21 user nova-compute[75100]: DEBUG nova.network.neutron [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: 71ff860c-f094-4885-bf69-cd6236ebc875] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 17:48:21 user nova-compute[75100]: DEBUG nova.compute.manager [req-d5d33d51-a1d9-4ed5-8338-911a6b90d1c1 req-99b06c73-869f-48f7-9ca4-b5c75cf5283f service nova] [instance: 71ff860c-f094-4885-bf69-cd6236ebc875] Received event network-changed-406f990a-ae7a-4d1d-9045-ccfe829faa61 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:48:21 user nova-compute[75100]: DEBUG nova.compute.manager [req-d5d33d51-a1d9-4ed5-8338-911a6b90d1c1 req-99b06c73-869f-48f7-9ca4-b5c75cf5283f service nova] [instance: 71ff860c-f094-4885-bf69-cd6236ebc875] Refreshing instance network info cache due to event network-changed-406f990a-ae7a-4d1d-9045-ccfe829faa61. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 17:48:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d5d33d51-a1d9-4ed5-8338-911a6b90d1c1 req-99b06c73-869f-48f7-9ca4-b5c75cf5283f service nova] Acquiring lock "refresh_cache-71ff860c-f094-4885-bf69-cd6236ebc875" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:48:21 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 111bd74e-2943-4f12-9514-b564cf26dadb could not be found.
Nov 10 17:48:21 user nova-compute[75100]: DEBUG nova.network.neutron [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: 71ff860c-f094-4885-bf69-cd6236ebc875] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 17:48:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 17:48:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, {'target_iqn': 'iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Yhtwynlz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 17:48:21 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 10 17:48:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 17:48:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 17:48:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:48:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:48:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 17:48:21 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[9ac71c3b-37eb-4f67-acca-c7e295bbe218]: Unexpected error while running command.
Nov 10 17:48:21 user nova-compute[75100]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 10 17:48:21 user nova-compute[75100]: Exit code: 21
Nov 10 17:48:21 user nova-compute[75100]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 10 17:48:21 user nova-compute[75100]: Stderr: '' {{(pid=86608) _process_cmd /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:477}}
Nov 10 17:48:21 user nova-compute[75100]: Traceback (most recent call last):
Nov 10 17:48:21 user nova-compute[75100]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 474, in _process_cmd
Nov 10 17:48:21 user nova-compute[75100]:     ret = func(*f_args, **f_kwargs)
Nov 10 17:48:21 user nova-compute[75100]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Nov 10 17:48:21 user nova-compute[75100]:     return func(*args, **kwargs)
Nov 10 17:48:21 user nova-compute[75100]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Nov 10 17:48:21 user nova-compute[75100]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Nov 10 17:48:21 user nova-compute[75100]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Nov 10 17:48:21 user nova-compute[75100]:     return putils.execute(on_execute=on_execute,
Nov 10 17:48:21 user nova-compute[75100]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py", line 438, in execute
Nov 10 17:48:21 user nova-compute[75100]:     raise ProcessExecutionError(exit_code=_returncode,
Nov 10 17:48:21 user nova-compute[75100]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 10 17:48:21 user nova-compute[75100]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 10 17:48:21 user nova-compute[75100]: Exit code: 21
Nov 10 17:48:21 user nova-compute[75100]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 10 17:48:21 user nova-compute[75100]: Stderr: ''
Nov 10 17:48:21 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac71c3b-37eb-4f67-acca-c7e295bbe218]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:48:21 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 10 17:48:21 user nova-compute[75100]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 10 17:48:21 user nova-compute[75100]: Exit code: 21
Nov 10 17:48:21 user nova-compute[75100]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 10 17:48:21 user nova-compute[75100]: Stderr: ''
Nov 10 17:48:21 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Nov 10 17:48:21 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/nova/nova/compute/manager.py", line 4132, in _do_rebuild_instance
Nov 10 17:48:21 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi     self.driver.rebuild(**kwargs)
Nov 10 17:48:21 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/nova/nova/virt/driver.py", line 384, in rebuild
Nov 10 17:48:21 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi     raise NotImplementedError()
Nov 10 17:48:21 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi NotImplementedError
Nov 10 17:48:21 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi 
Nov 10 17:48:21 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi During handling of the above exception, another exception occurred:
Nov 10 17:48:21 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi 
Nov 10 17:48:21 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Nov 10 17:48:21 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 217, in _get_ips_iqns_luns
Nov 10 17:48:21 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Nov 10 17:48:21 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 376, in _get_discoverydb_portals
Nov 10 17:48:21 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Nov 10 17:48:21 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1188, in _run_iscsiadm_bare
Nov 10 17:48:21 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Nov 10 17:48:21 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/executor.py", line 55, in _execute
Nov 10 17:48:21 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Nov 10 17:48:21 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Nov 10 17:48:21 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Nov 10 17:48:21 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Nov 10 17:48:21 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Nov 10 17:48:21 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 215, in remote_call
Nov 10 17:48:21 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Nov 10 17:48:21 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 10 17:48:21 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Nov 10 17:48:21 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Nov 10 17:48:21 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 10 17:48:21 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Nov 10 17:48:21 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi 
Nov 10 17:48:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=75100) _cleanup_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:934}}
Nov 10 17:48:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.041s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 17:48:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] <== disconnect_volume: return (44ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 17:48:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 17:48:21 user nova-compute[75100]: DEBUG nova.network.neutron [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: 71ff860c-f094-4885-bf69-cd6236ebc875] Updating instance_info_cache with network_info: [{"id": "406f990a-ae7a-4d1d-9045-ccfe829faa61", "address": "fa:16:3e:26:b9:f2", "network": {"id": "7b0728f9-3997-4fbd-9583-81a235e0b690", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1553690854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8460c83146a64640ba7e549d159275c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap406f990a-ae", "ovs_interfaceid": "406f990a-ae7a-4d1d-9045-ccfe829faa61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:48:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Releasing lock "refresh_cache-71ff860c-f094-4885-bf69-cd6236ebc875" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:48:21 user nova-compute[75100]: DEBUG nova.compute.manager [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: 71ff860c-f094-4885-bf69-cd6236ebc875] Instance network_info: |[{"id": "406f990a-ae7a-4d1d-9045-ccfe829faa61", "address": "fa:16:3e:26:b9:f2", "network": {"id": "7b0728f9-3997-4fbd-9583-81a235e0b690", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1553690854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8460c83146a64640ba7e549d159275c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap406f990a-ae", "ovs_interfaceid": "406f990a-ae7a-4d1d-9045-ccfe829faa61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 17:48:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d5d33d51-a1d9-4ed5-8338-911a6b90d1c1 req-99b06c73-869f-48f7-9ca4-b5c75cf5283f service nova] Acquired lock "refresh_cache-71ff860c-f094-4885-bf69-cd6236ebc875" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:48:21 user nova-compute[75100]: DEBUG nova.network.neutron [req-d5d33d51-a1d9-4ed5-8338-911a6b90d1c1 req-99b06c73-869f-48f7-9ca4-b5c75cf5283f service nova] [instance: 71ff860c-f094-4885-bf69-cd6236ebc875] Refreshing network info cache for port 406f990a-ae7a-4d1d-9045-ccfe829faa61 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 17:48:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: 71ff860c-f094-4885-bf69-cd6236ebc875] Start _get_guest_xml network_info=[{"id": "406f990a-ae7a-4d1d-9045-ccfe829faa61", "address": "fa:16:3e:26:b9:f2", "network": {"id": "7b0728f9-3997-4fbd-9583-81a235e0b690", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1553690854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8460c83146a64640ba7e549d159275c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap406f990a-ae", "ovs_interfaceid": "406f990a-ae7a-4d1d-9045-ccfe829faa61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'e3cc5321-4d40-49ee-885c-700e14741732'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 17:48:21 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:48:21 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:48:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 17:48:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 17:48:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 17:48:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 17:48:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 17:48:21 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T17:40:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 17:48:21 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 17:48:21 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 17:48:21 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 17:48:21 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 17:48:21 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 17:48:21 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 17:48:21 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 17:48:21 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 17:48:21 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 17:48:21 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 17:48:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:48:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1148227792',display_name='tempest-VolumesAdminNegativeTest-server-1148227792',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1148227792',id=15,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8460c83146a64640ba7e549d159275c2',ramdisk_id='',reservation_id='r-h0coi6k1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1957922837',owner_user_name='tempest-VolumesAdminNegativeTest-1957922837-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:48:19Z,user_data=None,user_id='7994564d536446e38002847db1668157',uuid=71ff860c-f094-4885-bf69-cd6236ebc875,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "406f990a-ae7a-4d1d-9045-ccfe829faa61", "address": "fa:16:3e:26:b9:f2", "network": {"id": "7b0728f9-3997-4fbd-9583-81a235e0b690", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1553690854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8460c83146a64640ba7e549d159275c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap406f990a-ae", "ovs_interfaceid": "406f990a-ae7a-4d1d-9045-ccfe829faa61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 17:48:21 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Converting VIF {"id": "406f990a-ae7a-4d1d-9045-ccfe829faa61", "address": "fa:16:3e:26:b9:f2", "network": {"id": "7b0728f9-3997-4fbd-9583-81a235e0b690", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1553690854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8460c83146a64640ba7e549d159275c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap406f990a-ae", "ovs_interfaceid": "406f990a-ae7a-4d1d-9045-ccfe829faa61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:48:21 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:b9:f2,bridge_name='br-int',has_traffic_filtering=True,id=406f990a-ae7a-4d1d-9045-ccfe829faa61,network=Network(7b0728f9-3997-4fbd-9583-81a235e0b690),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap406f990a-ae') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:48:21 user nova-compute[75100]: DEBUG nova.objects.instance [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Lazy-loading 'pci_devices' on Instance uuid 71ff860c-f094-4885-bf69-cd6236ebc875 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:48:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: 71ff860c-f094-4885-bf69-cd6236ebc875] End _get_guest_xml xml=<domain type="kvm">
Nov 10 17:48:21 user nova-compute[75100]:   <uuid>71ff860c-f094-4885-bf69-cd6236ebc875</uuid>
Nov 10 17:48:21 user nova-compute[75100]:   <name>instance-0000000f</name>
Nov 10 17:48:21 user nova-compute[75100]:   <memory>524288</memory>
Nov 10 17:48:21 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 10 17:48:21 user nova-compute[75100]:   <metadata>
Nov 10 17:48:21 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 17:48:21 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 10 17:48:21 user nova-compute[75100]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1148227792</nova:name>
Nov 10 17:48:21 user nova-compute[75100]:       <nova:creationTime>2023-11-10 17:48:21</nova:creationTime>
Nov 10 17:48:21 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 10 17:48:21 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 10 17:48:21 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 10 17:48:21 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 10 17:48:21 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 17:48:21 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 10 17:48:21 user nova-compute[75100]:       </nova:flavor>
Nov 10 17:48:21 user nova-compute[75100]:       <nova:owner>
Nov 10 17:48:21 user nova-compute[75100]:         <nova:user uuid="7994564d536446e38002847db1668157">tempest-VolumesAdminNegativeTest-1957922837-project-member</nova:user>
Nov 10 17:48:21 user nova-compute[75100]:         <nova:project uuid="8460c83146a64640ba7e549d159275c2">tempest-VolumesAdminNegativeTest-1957922837</nova:project>
Nov 10 17:48:21 user nova-compute[75100]:       </nova:owner>
Nov 10 17:48:21 user nova-compute[75100]:       <nova:root type="image" uuid="e3cc5321-4d40-49ee-885c-700e14741732"/>
Nov 10 17:48:21 user nova-compute[75100]:       <nova:ports>
Nov 10 17:48:21 user nova-compute[75100]:         <nova:port uuid="406f990a-ae7a-4d1d-9045-ccfe829faa61">
Nov 10 17:48:21 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 10 17:48:21 user nova-compute[75100]:         </nova:port>
Nov 10 17:48:21 user nova-compute[75100]:       </nova:ports>
Nov 10 17:48:21 user nova-compute[75100]:     </nova:instance>
Nov 10 17:48:21 user nova-compute[75100]:   </metadata>
Nov 10 17:48:21 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 10 17:48:21 user nova-compute[75100]:     <system>
Nov 10 17:48:21 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 17:48:21 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 10 17:48:21 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 10 17:48:21 user nova-compute[75100]:       <entry name="serial">71ff860c-f094-4885-bf69-cd6236ebc875</entry>
Nov 10 17:48:21 user nova-compute[75100]:       <entry name="uuid">71ff860c-f094-4885-bf69-cd6236ebc875</entry>
Nov 10 17:48:21 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 10 17:48:21 user nova-compute[75100]:     </system>
Nov 10 17:48:21 user nova-compute[75100]:   </sysinfo>
Nov 10 17:48:21 user nova-compute[75100]:   <os>
Nov 10 17:48:21 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 17:48:21 user nova-compute[75100]:     <boot dev="hd"/>
Nov 10 17:48:21 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 10 17:48:21 user nova-compute[75100]:   </os>
Nov 10 17:48:21 user nova-compute[75100]:   <features>
Nov 10 17:48:21 user nova-compute[75100]:     <acpi/>
Nov 10 17:48:21 user nova-compute[75100]:     <apic/>
Nov 10 17:48:21 user nova-compute[75100]:     <vmcoreinfo/>
Nov 10 17:48:21 user nova-compute[75100]:   </features>
Nov 10 17:48:21 user nova-compute[75100]:   <clock offset="utc">
Nov 10 17:48:21 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 17:48:21 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 17:48:21 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 10 17:48:21 user nova-compute[75100]:   </clock>
Nov 10 17:48:21 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 10 17:48:21 user nova-compute[75100]:     <model>Nehalem</model>
Nov 10 17:48:21 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 17:48:21 user nova-compute[75100]:   </cpu>
Nov 10 17:48:21 user nova-compute[75100]:   <devices>
Nov 10 17:48:21 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 10 17:48:21 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 17:48:21 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/71ff860c-f094-4885-bf69-cd6236ebc875/disk"/>
Nov 10 17:48:21 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 10 17:48:21 user nova-compute[75100]:     </disk>
Nov 10 17:48:21 user nova-compute[75100]:     <interface type="ethernet">
Nov 10 17:48:21 user nova-compute[75100]:       <mac address="fa:16:3e:26:b9:f2"/>
Nov 10 17:48:21 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:48:21 user nova-compute[75100]:       <mtu size="1442"/>
Nov 10 17:48:21 user nova-compute[75100]:       <target dev="tap406f990a-ae"/>
Nov 10 17:48:21 user nova-compute[75100]:     </interface>
Nov 10 17:48:21 user nova-compute[75100]:     <serial type="pty">
Nov 10 17:48:21 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/71ff860c-f094-4885-bf69-cd6236ebc875/console.log" append="off"/>
Nov 10 17:48:21 user nova-compute[75100]:     </serial>
Nov 10 17:48:21 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 17:48:21 user nova-compute[75100]:     <video>
Nov 10 17:48:21 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:48:21 user nova-compute[75100]:     </video>
Nov 10 17:48:21 user nova-compute[75100]:     <rng model="virtio">
Nov 10 17:48:21 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 10 17:48:21 user nova-compute[75100]:     </rng>
Nov 10 17:48:21 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 10 17:48:21 user nova-compute[75100]:     <memballoon model="virtio">
Nov 10 17:48:21 user nova-compute[75100]:       <stats period="10"/>
Nov 10 17:48:21 user nova-compute[75100]:     </memballoon>
Nov 10 17:48:21 user nova-compute[75100]:   </devices>
Nov 10 17:48:21 user nova-compute[75100]: </domain>
Nov 10 17:48:21 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 17:48:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:48:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1148227792',display_name='tempest-VolumesAdminNegativeTest-server-1148227792',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1148227792',id=15,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8460c83146a64640ba7e549d159275c2',ramdisk_id='',reservation_id='r-h0coi6k1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1957922837',owner_user_name='tempest-VolumesAdminNegativeTest-1957922837-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:48:19Z,user_data=None,user_id='7994564d536446e38002847db1668157',uuid=71ff860c-f094-4885-bf69-cd6236ebc875,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "406f990a-ae7a-4d1d-9045-ccfe829faa61", "address": "fa:16:3e:26:b9:f2", "network": {"id": "7b0728f9-3997-4fbd-9583-81a235e0b690", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1553690854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8460c83146a64640ba7e549d159275c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap406f990a-ae", "ovs_interfaceid": "406f990a-ae7a-4d1d-9045-ccfe829faa61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 17:48:21 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Converting VIF {"id": "406f990a-ae7a-4d1d-9045-ccfe829faa61", "address": "fa:16:3e:26:b9:f2", "network": {"id": "7b0728f9-3997-4fbd-9583-81a235e0b690", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1553690854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8460c83146a64640ba7e549d159275c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap406f990a-ae", "ovs_interfaceid": "406f990a-ae7a-4d1d-9045-ccfe829faa61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:48:21 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:b9:f2,bridge_name='br-int',has_traffic_filtering=True,id=406f990a-ae7a-4d1d-9045-ccfe829faa61,network=Network(7b0728f9-3997-4fbd-9583-81a235e0b690),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap406f990a-ae') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:48:21 user nova-compute[75100]: DEBUG os_vif [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:b9:f2,bridge_name='br-int',has_traffic_filtering=True,id=406f990a-ae7a-4d1d-9045-ccfe829faa61,network=Network(7b0728f9-3997-4fbd-9583-81a235e0b690),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap406f990a-ae') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 17:48:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:48:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 17:48:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f3c38381-5c0e-5398-a260-41ff29f8db2f', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:48:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap406f990a-ae, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:48:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap406f990a-ae, col_values=(('qos', UUID('dd245494-90c2-43bc-9e0b-1756bd6fef72')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:48:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap406f990a-ae, col_values=(('external_ids', {'iface-id': '406f990a-ae7a-4d1d-9045-ccfe829faa61', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:b9:f2', 'vm-uuid': '71ff860c-f094-4885-bf69-cd6236ebc875'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:48:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:21 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:48:21 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:48:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:48:21 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:48:21 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 17:48:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:21 user nova-compute[75100]: INFO os_vif [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:b9:f2,bridge_name='br-int',has_traffic_filtering=True,id=406f990a-ae7a-4d1d-9045-ccfe829faa61,network=Network(7b0728f9-3997-4fbd-9583-81a235e0b690),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap406f990a-ae')
Nov 10 17:48:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 17:48:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] No VIF found with MAC fa:16:3e:26:b9:f2, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 17:48:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "refresh_cache-ead532eb-c8be-45fa-a8b7-0b4c4f884a90" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:48:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquired lock "refresh_cache-ead532eb-c8be-45fa-a8b7-0b4c4f884a90" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:48:22 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 17:48:22 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:48:22 user nova-compute[75100]: INFO nova.compute.manager [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Took 7.47 seconds to deallocate network for instance.
Nov 10 17:48:22 user nova-compute[75100]: DEBUG nova.network.neutron [req-d5d33d51-a1d9-4ed5-8338-911a6b90d1c1 req-99b06c73-869f-48f7-9ca4-b5c75cf5283f service nova] [instance: 71ff860c-f094-4885-bf69-cd6236ebc875] Updated VIF entry in instance network info cache for port 406f990a-ae7a-4d1d-9045-ccfe829faa61. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 17:48:22 user nova-compute[75100]: DEBUG nova.network.neutron [req-d5d33d51-a1d9-4ed5-8338-911a6b90d1c1 req-99b06c73-869f-48f7-9ca4-b5c75cf5283f service nova] [instance: 71ff860c-f094-4885-bf69-cd6236ebc875] Updating instance_info_cache with network_info: [{"id": "406f990a-ae7a-4d1d-9045-ccfe829faa61", "address": "fa:16:3e:26:b9:f2", "network": {"id": "7b0728f9-3997-4fbd-9583-81a235e0b690", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1553690854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8460c83146a64640ba7e549d159275c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap406f990a-ae", "ovs_interfaceid": "406f990a-ae7a-4d1d-9045-ccfe829faa61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:48:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d5d33d51-a1d9-4ed5-8338-911a6b90d1c1 req-99b06c73-869f-48f7-9ca4-b5c75cf5283f service nova] Releasing lock "refresh_cache-71ff860c-f094-4885-bf69-cd6236ebc875" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:48:22 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Detaching volume: fe1ea42d-7d7a-4a58-ab63-7f831350e780 {{(pid=75100) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 10 17:48:22 user nova-compute[75100]: INFO nova.compute.manager [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Detaching volume fe1ea42d-7d7a-4a58-ab63-7f831350e780
Nov 10 17:48:22 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Skipping driver_detach during remote rebuild. {{(pid=75100) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Nov 10 17:48:22 user nova-compute[75100]: WARNING nova.compute.manager [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] Failed to detach volume: fe1ea42d-7d7a-4a58-ab63-7f831350e780 due to 'NoneType' object has no attribute 'devices'
Nov 10 17:48:22 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Detaching volume: 8de0eb31-0493-4497-9a03-45bedddd72be {{(pid=75100) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 10 17:48:22 user nova-compute[75100]: INFO nova.compute.manager [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Detaching volume 8de0eb31-0493-4497-9a03-45bedddd72be
Nov 10 17:48:22 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Skipping driver_detach during remote rebuild. {{(pid=75100) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Nov 10 17:48:22 user nova-compute[75100]: DEBUG nova.compute.manager [req-dd0e8f5e-c802-4c96-9410-bc80b72fc649 req-ab1ebe2f-2fcc-485f-bf3a-4ec1e6daf131 service nova] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Received event network-vif-plugged-26f643d1-0961-49af-bde1-32d1a6b0941d {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:48:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-dd0e8f5e-c802-4c96-9410-bc80b72fc649 req-ab1ebe2f-2fcc-485f-bf3a-4ec1e6daf131 service nova] Acquiring lock "111bd74e-2943-4f12-9514-b564cf26dadb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:48:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-dd0e8f5e-c802-4c96-9410-bc80b72fc649 req-ab1ebe2f-2fcc-485f-bf3a-4ec1e6daf131 service nova] Lock "111bd74e-2943-4f12-9514-b564cf26dadb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:48:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-dd0e8f5e-c802-4c96-9410-bc80b72fc649 req-ab1ebe2f-2fcc-485f-bf3a-4ec1e6daf131 service nova] Lock "111bd74e-2943-4f12-9514-b564cf26dadb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:48:22 user nova-compute[75100]: DEBUG nova.compute.manager [req-dd0e8f5e-c802-4c96-9410-bc80b72fc649 req-ab1ebe2f-2fcc-485f-bf3a-4ec1e6daf131 service nova] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] No waiting events found dispatching network-vif-plugged-26f643d1-0961-49af-bde1-32d1a6b0941d {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:48:22 user nova-compute[75100]: WARNING nova.compute.manager [req-dd0e8f5e-c802-4c96-9410-bc80b72fc649 req-ab1ebe2f-2fcc-485f-bf3a-4ec1e6daf131 service nova] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Received unexpected event network-vif-plugged-26f643d1-0961-49af-bde1-32d1a6b0941d for instance with vm_state active and task_state rebuilding.
Nov 10 17:48:22 user nova-compute[75100]: WARNING nova.compute.manager [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] Failed to detach volume: 8de0eb31-0493-4497-9a03-45bedddd72be due to 'NoneType' object has no attribute 'devices'
Nov 10 17:48:22 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Detaching volume: b87fd5e8-e1b5-49bb-a86f-736c59347083 {{(pid=75100) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 10 17:48:22 user nova-compute[75100]: INFO nova.compute.manager [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Detaching volume b87fd5e8-e1b5-49bb-a86f-736c59347083
Nov 10 17:48:22 user nova-compute[75100]: DEBUG nova.network.neutron [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:48:22 user nova-compute[75100]: INFO nova.compute.manager [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Took 7.41 seconds to deallocate network for instance.
Nov 10 17:48:22 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] [instance: ed8fb592-b4c8-4634-a618-0405d70a1acc] Skipping driver_detach during remote rebuild. {{(pid=75100) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Nov 10 17:48:22 user nova-compute[75100]: DEBUG nova.compute.manager [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Detaching volume: ae380714-1745-40c8-9c64-1204499b902a {{(pid=75100) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 10 17:48:22 user nova-compute[75100]: INFO nova.compute.manager [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Detaching volume ae380714-1745-40c8-9c64-1204499b902a
Nov 10 17:48:22 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Updating instance_info_cache with network_info: [{"id": "bdf312ed-cce0-4d35-9257-f6a5a80cc0d2", "address": "fa:16:3e:55:c2:62", "network": {"id": "7b0728f9-3997-4fbd-9583-81a235e0b690", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1553690854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8460c83146a64640ba7e549d159275c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdf312ed-cc", "ovs_interfaceid": "bdf312ed-cce0-4d35-9257-f6a5a80cc0d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:48:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Releasing lock "refresh_cache-ead532eb-c8be-45fa-a8b7-0b4c4f884a90" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:48:22 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 17:48:22 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:48:22 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:48:22 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:48:22 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:48:22 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 17:48:23 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Skipping driver_detach during remote rebuild. {{(pid=75100) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Nov 10 17:48:23 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] Deleted allocations for instance ed8fb592-b4c8-4634-a618-0405d70a1acc
Nov 10 17:48:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ae1a8568-e4e7-4751-9a94-df01550844ae tempest-TaggedBootDevicesTest-139734456 tempest-TaggedBootDevicesTest-139734456-project-member] Lock "ed8fb592-b4c8-4634-a618-0405d70a1acc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 36.268s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:48:23 user nova-compute[75100]: WARNING nova.compute.manager [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] Failed to detach volume: ae380714-1745-40c8-9c64-1204499b902a due to 'NoneType' object has no attribute 'devices'
Nov 10 17:48:23 user nova-compute[75100]: DEBUG nova.compute.manager [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Detaching volume: eee2cb6f-d725-4300-a9b2-6a98778bf8d3 {{(pid=75100) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 10 17:48:23 user nova-compute[75100]: INFO nova.compute.manager [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Detaching volume eee2cb6f-d725-4300-a9b2-6a98778bf8d3
Nov 10 17:48:23 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Skipping driver_detach during remote rebuild. {{(pid=75100) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Nov 10 17:48:23 user nova-compute[75100]: WARNING nova.compute.manager [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] Failed to detach volume: eee2cb6f-d725-4300-a9b2-6a98778bf8d3 due to 'NoneType' object has no attribute 'devices'
Nov 10 17:48:23 user nova-compute[75100]: DEBUG nova.compute.manager [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Detaching volume: aa54891a-1f86-4487-8d23-3039fcb58e1a {{(pid=75100) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 10 17:48:23 user nova-compute[75100]: INFO nova.compute.manager [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Detaching volume aa54891a-1f86-4487-8d23-3039fcb58e1a
Nov 10 17:48:23 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] [instance: 78d2732a-9eff-480e-b844-d216537c5d91] Skipping driver_detach during remote rebuild. {{(pid=75100) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Nov 10 17:48:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:23 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] Deleted allocations for instance 78d2732a-9eff-480e-b844-d216537c5d91
Nov 10 17:48:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2654891a-c57e-4d7f-8dae-70952ec9a5bf tempest-TaggedBootDevicesTest_v242-898948100 tempest-TaggedBootDevicesTest_v242-898948100-project-member] Lock "78d2732a-9eff-480e-b844-d216537c5d91" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 36.907s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:48:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:23 user nova-compute[75100]: DEBUG nova.compute.manager [req-ec8299dd-b1ec-415a-8db4-9829ead73731 req-c78ee2dc-1d8b-4280-86f8-4ecc07f92b2a service nova] [instance: 71ff860c-f094-4885-bf69-cd6236ebc875] Received event network-vif-plugged-406f990a-ae7a-4d1d-9045-ccfe829faa61 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:48:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ec8299dd-b1ec-415a-8db4-9829ead73731 req-c78ee2dc-1d8b-4280-86f8-4ecc07f92b2a service nova] Acquiring lock "71ff860c-f094-4885-bf69-cd6236ebc875-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:48:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ec8299dd-b1ec-415a-8db4-9829ead73731 req-c78ee2dc-1d8b-4280-86f8-4ecc07f92b2a service nova] Lock "71ff860c-f094-4885-bf69-cd6236ebc875-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:48:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ec8299dd-b1ec-415a-8db4-9829ead73731 req-c78ee2dc-1d8b-4280-86f8-4ecc07f92b2a service nova] Lock "71ff860c-f094-4885-bf69-cd6236ebc875-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:48:23 user nova-compute[75100]: DEBUG nova.compute.manager [req-ec8299dd-b1ec-415a-8db4-9829ead73731 req-c78ee2dc-1d8b-4280-86f8-4ecc07f92b2a service nova] [instance: 71ff860c-f094-4885-bf69-cd6236ebc875] No waiting events found dispatching network-vif-plugged-406f990a-ae7a-4d1d-9045-ccfe829faa61 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:48:23 user nova-compute[75100]: WARNING nova.compute.manager [req-ec8299dd-b1ec-415a-8db4-9829ead73731 req-c78ee2dc-1d8b-4280-86f8-4ecc07f92b2a service nova] [instance: 71ff860c-f094-4885-bf69-cd6236ebc875] Received unexpected event network-vif-plugged-406f990a-ae7a-4d1d-9045-ccfe829faa61 for instance with vm_state building and task_state spawning.
Nov 10 17:48:25 user nova-compute[75100]: DEBUG nova.compute.manager [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: 71ff860c-f094-4885-bf69-cd6236ebc875] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 17:48:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: 71ff860c-f094-4885-bf69-cd6236ebc875] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 17:48:25 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 71ff860c-f094-4885-bf69-cd6236ebc875] Instance spawned successfully.
Nov 10 17:48:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: 71ff860c-f094-4885-bf69-cd6236ebc875] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 17:48:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: 71ff860c-f094-4885-bf69-cd6236ebc875] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:48:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: 71ff860c-f094-4885-bf69-cd6236ebc875] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:48:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: 71ff860c-f094-4885-bf69-cd6236ebc875] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:48:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: 71ff860c-f094-4885-bf69-cd6236ebc875] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:48:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: 71ff860c-f094-4885-bf69-cd6236ebc875] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:48:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: 71ff860c-f094-4885-bf69-cd6236ebc875] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:48:26 user nova-compute[75100]: DEBUG nova.compute.manager [req-303c2774-401b-421b-b0ac-422289d36cec req-d4848aa6-0d2d-4f5a-b32b-a35d28d1e574 service nova] [instance: 71ff860c-f094-4885-bf69-cd6236ebc875] Received event network-vif-plugged-406f990a-ae7a-4d1d-9045-ccfe829faa61 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:48:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-303c2774-401b-421b-b0ac-422289d36cec req-d4848aa6-0d2d-4f5a-b32b-a35d28d1e574 service nova] Acquiring lock "71ff860c-f094-4885-bf69-cd6236ebc875-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:48:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-303c2774-401b-421b-b0ac-422289d36cec req-d4848aa6-0d2d-4f5a-b32b-a35d28d1e574 service nova] Lock "71ff860c-f094-4885-bf69-cd6236ebc875-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:48:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-303c2774-401b-421b-b0ac-422289d36cec req-d4848aa6-0d2d-4f5a-b32b-a35d28d1e574 service nova] Lock "71ff860c-f094-4885-bf69-cd6236ebc875-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:48:26 user nova-compute[75100]: DEBUG nova.compute.manager [req-303c2774-401b-421b-b0ac-422289d36cec req-d4848aa6-0d2d-4f5a-b32b-a35d28d1e574 service nova] [instance: 71ff860c-f094-4885-bf69-cd6236ebc875] No waiting events found dispatching network-vif-plugged-406f990a-ae7a-4d1d-9045-ccfe829faa61 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:48:26 user nova-compute[75100]: WARNING nova.compute.manager [req-303c2774-401b-421b-b0ac-422289d36cec req-d4848aa6-0d2d-4f5a-b32b-a35d28d1e574 service nova] [instance: 71ff860c-f094-4885-bf69-cd6236ebc875] Received unexpected event network-vif-plugged-406f990a-ae7a-4d1d-9045-ccfe829faa61 for instance with vm_state building and task_state spawning.
Nov 10 17:48:26 user nova-compute[75100]: INFO nova.compute.manager [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: 71ff860c-f094-4885-bf69-cd6236ebc875] Took 6.51 seconds to spawn the instance on the hypervisor.
Nov 10 17:48:26 user nova-compute[75100]: DEBUG nova.compute.manager [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: 71ff860c-f094-4885-bf69-cd6236ebc875] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 17:48:26 user nova-compute[75100]: INFO nova.compute.manager [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: 71ff860c-f094-4885-bf69-cd6236ebc875] Took 9.82 seconds to build instance.
Nov 10 17:48:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-69875655-caf7-4984-9f87-8a4dcb064327 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Lock "71ff860c-f094-4885-bf69-cd6236ebc875" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.062s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:48:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:27 user nova-compute[75100]: DEBUG nova.compute.manager [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Preparing to wait for external event volume-reimaged-23131533-b27f-4598-84b7-44ed1d8878cb {{(pid=75100) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 10 17:48:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Acquiring lock "111bd74e-2943-4f12-9514-b564cf26dadb-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:48:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Lock "111bd74e-2943-4f12-9514-b564cf26dadb-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:48:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Lock "111bd74e-2943-4f12-9514-b564cf26dadb-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:48:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e98a821c-c7d5-4071-9400-6ac0df9fd196 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] Acquiring lock "c790b5c3-b255-430f-8654-f0ff5d54d48c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:48:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e98a821c-c7d5-4071-9400-6ac0df9fd196 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] Lock "c790b5c3-b255-430f-8654-f0ff5d54d48c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:48:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e98a821c-c7d5-4071-9400-6ac0df9fd196 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] Acquiring lock "c790b5c3-b255-430f-8654-f0ff5d54d48c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:48:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e98a821c-c7d5-4071-9400-6ac0df9fd196 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] Lock "c790b5c3-b255-430f-8654-f0ff5d54d48c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:48:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e98a821c-c7d5-4071-9400-6ac0df9fd196 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] Lock "c790b5c3-b255-430f-8654-f0ff5d54d48c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:48:31 user nova-compute[75100]: INFO nova.compute.manager [None req-e98a821c-c7d5-4071-9400-6ac0df9fd196 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Terminating instance
Nov 10 17:48:31 user nova-compute[75100]: DEBUG nova.compute.manager [None req-e98a821c-c7d5-4071-9400-6ac0df9fd196 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 17:48:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:32 user nova-compute[75100]: DEBUG nova.compute.manager [req-e504921f-0952-48af-a176-b6e42c2897f6 req-46bc4a56-42cc-4356-b096-decc6ff045dc service nova] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Received event network-vif-unplugged-43c197c7-a030-40dd-809c-a6bfebfa1c12 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:48:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-e504921f-0952-48af-a176-b6e42c2897f6 req-46bc4a56-42cc-4356-b096-decc6ff045dc service nova] Acquiring lock "c790b5c3-b255-430f-8654-f0ff5d54d48c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:48:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-e504921f-0952-48af-a176-b6e42c2897f6 req-46bc4a56-42cc-4356-b096-decc6ff045dc service nova] Lock "c790b5c3-b255-430f-8654-f0ff5d54d48c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:48:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-e504921f-0952-48af-a176-b6e42c2897f6 req-46bc4a56-42cc-4356-b096-decc6ff045dc service nova] Lock "c790b5c3-b255-430f-8654-f0ff5d54d48c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:48:32 user nova-compute[75100]: DEBUG nova.compute.manager [req-e504921f-0952-48af-a176-b6e42c2897f6 req-46bc4a56-42cc-4356-b096-decc6ff045dc service nova] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] No waiting events found dispatching network-vif-unplugged-43c197c7-a030-40dd-809c-a6bfebfa1c12 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:48:32 user nova-compute[75100]: DEBUG nova.compute.manager [req-e504921f-0952-48af-a176-b6e42c2897f6 req-46bc4a56-42cc-4356-b096-decc6ff045dc service nova] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Received event network-vif-unplugged-43c197c7-a030-40dd-809c-a6bfebfa1c12 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 17:48:32 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Instance destroyed successfully.
Nov 10 17:48:32 user nova-compute[75100]: DEBUG nova.objects.instance [None req-e98a821c-c7d5-4071-9400-6ac0df9fd196 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] Lazy-loading 'resources' on Instance uuid c790b5c3-b255-430f-8654-f0ff5d54d48c {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:48:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-e98a821c-c7d5-4071-9400-6ac0df9fd196 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:45:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-142317285',display_name='tempest-VolumesAssistedSnapshotsTest-server-142317285',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-142317285',id=8,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrSM5rHIx+tKy/K5+9mjC9yrU6pMJAYMs2e/i7vKfUkYfuamBG9oEK8qK9hExhWd+aX6+KyvAZFFCTgbGMic88HLIgfBjLk7V5Os2s4WmFU19NX0cUI8EkopT7GJSiwFA==',key_name='tempest-keypair-856708127',keypairs=<?>,launch_index=0,launched_at=2023-11-10T17:45:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dbee21b8d0b5480da833126fd57cc1ce',ramdisk_id='',reservation_id='r-ct2s05vr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-392066261',owner_user_name='tempest-VolumesAssistedSnapshotsTest-392066261-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T17:45:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b8071e00cc85457cad6d9b407d3096e2',uuid=c790b5c3-b255-430f-8654-f0ff5d54d48c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "43c197c7-a030-40dd-809c-a6bfebfa1c12", "address": "fa:16:3e:e4:af:16", "network": {"id": "b646ed0c-9af2-495b-afc3-81a58b5c1203", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1923503231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbee21b8d0b5480da833126fd57cc1ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43c197c7-a0", "ovs_interfaceid": "43c197c7-a030-40dd-809c-a6bfebfa1c12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 17:48:32 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-e98a821c-c7d5-4071-9400-6ac0df9fd196 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] Converting VIF {"id": "43c197c7-a030-40dd-809c-a6bfebfa1c12", "address": "fa:16:3e:e4:af:16", "network": {"id": "b646ed0c-9af2-495b-afc3-81a58b5c1203", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1923503231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbee21b8d0b5480da833126fd57cc1ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43c197c7-a0", "ovs_interfaceid": "43c197c7-a030-40dd-809c-a6bfebfa1c12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:48:32 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-e98a821c-c7d5-4071-9400-6ac0df9fd196 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:af:16,bridge_name='br-int',has_traffic_filtering=True,id=43c197c7-a030-40dd-809c-a6bfebfa1c12,network=Network(b646ed0c-9af2-495b-afc3-81a58b5c1203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43c197c7-a0') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:48:32 user nova-compute[75100]: DEBUG os_vif [None req-e98a821c-c7d5-4071-9400-6ac0df9fd196 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:af:16,bridge_name='br-int',has_traffic_filtering=True,id=43c197c7-a030-40dd-809c-a6bfebfa1c12,network=Network(b646ed0c-9af2-495b-afc3-81a58b5c1203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43c197c7-a0') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 17:48:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap43c197c7-a0, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:48:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:48:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=52415f9b-4ccd-452b-b33d-b35eb06034ce) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:48:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:48:32 user nova-compute[75100]: INFO os_vif [None req-e98a821c-c7d5-4071-9400-6ac0df9fd196 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:af:16,bridge_name='br-int',has_traffic_filtering=True,id=43c197c7-a030-40dd-809c-a6bfebfa1c12,network=Network(b646ed0c-9af2-495b-afc3-81a58b5c1203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43c197c7-a0')
Nov 10 17:48:32 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-e98a821c-c7d5-4071-9400-6ac0df9fd196 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Deleting instance files /opt/stack/data/nova/instances/c790b5c3-b255-430f-8654-f0ff5d54d48c_del
Nov 10 17:48:32 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-e98a821c-c7d5-4071-9400-6ac0df9fd196 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Deletion of /opt/stack/data/nova/instances/c790b5c3-b255-430f-8654-f0ff5d54d48c_del complete
Nov 10 17:48:32 user nova-compute[75100]: INFO nova.compute.manager [None req-e98a821c-c7d5-4071-9400-6ac0df9fd196 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 10 17:48:32 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-e98a821c-c7d5-4071-9400-6ac0df9fd196 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 17:48:32 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 17:48:32 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 17:48:33 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:48:33 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Took 0.81 seconds to deallocate network for instance.
Nov 10 17:48:33 user nova-compute[75100]: DEBUG nova.compute.manager [req-f357de4d-0293-4cb2-a56a-5b2f7fd638d2 req-3d6fa00e-2d2d-492a-b29e-d980f219f102 service nova] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Received event network-vif-deleted-43c197c7-a030-40dd-809c-a6bfebfa1c12 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:48:33 user nova-compute[75100]: INFO nova.compute.manager [req-f357de4d-0293-4cb2-a56a-5b2f7fd638d2 req-3d6fa00e-2d2d-492a-b29e-d980f219f102 service nova] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Neutron deleted interface 43c197c7-a030-40dd-809c-a6bfebfa1c12; detaching it from the instance and deleting it from the info cache
Nov 10 17:48:33 user nova-compute[75100]: DEBUG nova.network.neutron [req-f357de4d-0293-4cb2-a56a-5b2f7fd638d2 req-3d6fa00e-2d2d-492a-b29e-d980f219f102 service nova] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:48:33 user nova-compute[75100]: DEBUG nova.compute.manager [req-f357de4d-0293-4cb2-a56a-5b2f7fd638d2 req-3d6fa00e-2d2d-492a-b29e-d980f219f102 service nova] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Detach interface failed, port_id=43c197c7-a030-40dd-809c-a6bfebfa1c12, reason: Instance c790b5c3-b255-430f-8654-f0ff5d54d48c could not be found. {{(pid=75100) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 17:48:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e98a821c-c7d5-4071-9400-6ac0df9fd196 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:48:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e98a821c-c7d5-4071-9400-6ac0df9fd196 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:48:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:34 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-e98a821c-c7d5-4071-9400-6ac0df9fd196 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:48:34 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-e98a821c-c7d5-4071-9400-6ac0df9fd196 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:48:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e98a821c-c7d5-4071-9400-6ac0df9fd196 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.363s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:48:34 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-e98a821c-c7d5-4071-9400-6ac0df9fd196 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] Deleted allocations for instance c790b5c3-b255-430f-8654-f0ff5d54d48c
Nov 10 17:48:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e98a821c-c7d5-4071-9400-6ac0df9fd196 tempest-VolumesAssistedSnapshotsTest-392066261 tempest-VolumesAssistedSnapshotsTest-392066261-project-member] Lock "c790b5c3-b255-430f-8654-f0ff5d54d48c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.413s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:48:34 user nova-compute[75100]: DEBUG nova.compute.manager [req-b3ec0828-601c-44e2-9b8e-80118fe4097a req-f3e908b7-8699-4084-8266-ab6b20d477bd service nova] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Received event network-vif-plugged-43c197c7-a030-40dd-809c-a6bfebfa1c12 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:48:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b3ec0828-601c-44e2-9b8e-80118fe4097a req-f3e908b7-8699-4084-8266-ab6b20d477bd service nova] Acquiring lock "c790b5c3-b255-430f-8654-f0ff5d54d48c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:48:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b3ec0828-601c-44e2-9b8e-80118fe4097a req-f3e908b7-8699-4084-8266-ab6b20d477bd service nova] Lock "c790b5c3-b255-430f-8654-f0ff5d54d48c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:48:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b3ec0828-601c-44e2-9b8e-80118fe4097a req-f3e908b7-8699-4084-8266-ab6b20d477bd service nova] Lock "c790b5c3-b255-430f-8654-f0ff5d54d48c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:48:34 user nova-compute[75100]: DEBUG nova.compute.manager [req-b3ec0828-601c-44e2-9b8e-80118fe4097a req-f3e908b7-8699-4084-8266-ab6b20d477bd service nova] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] No waiting events found dispatching network-vif-plugged-43c197c7-a030-40dd-809c-a6bfebfa1c12 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:48:34 user nova-compute[75100]: WARNING nova.compute.manager [req-b3ec0828-601c-44e2-9b8e-80118fe4097a req-f3e908b7-8699-4084-8266-ab6b20d477bd service nova] [instance: c790b5c3-b255-430f-8654-f0ff5d54d48c] Received unexpected event network-vif-plugged-43c197c7-a030-40dd-809c-a6bfebfa1c12 for instance with vm_state deleted and task_state None.
Nov 10 17:48:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-77049c28-373c-4f58-b03f-dc1c412f34b3 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Acquiring lock "91238923-a64c-4f41-a046-be243eff880d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:48:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-77049c28-373c-4f58-b03f-dc1c412f34b3 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Lock "91238923-a64c-4f41-a046-be243eff880d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:48:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-77049c28-373c-4f58-b03f-dc1c412f34b3 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Acquiring lock "91238923-a64c-4f41-a046-be243eff880d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:48:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-77049c28-373c-4f58-b03f-dc1c412f34b3 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Lock "91238923-a64c-4f41-a046-be243eff880d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:48:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-77049c28-373c-4f58-b03f-dc1c412f34b3 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Lock "91238923-a64c-4f41-a046-be243eff880d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:48:41 user nova-compute[75100]: INFO nova.compute.manager [None req-77049c28-373c-4f58-b03f-dc1c412f34b3 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] [instance: 91238923-a64c-4f41-a046-be243eff880d] Terminating instance
Nov 10 17:48:41 user nova-compute[75100]: DEBUG nova.compute.manager [None req-77049c28-373c-4f58-b03f-dc1c412f34b3 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] [instance: 91238923-a64c-4f41-a046-be243eff880d] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 17:48:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:42 user nova-compute[75100]: DEBUG nova.compute.manager [req-e7260b5e-c4f6-4467-8191-93b791417810 req-370ff92a-0a40-47a6-bfdf-7e81339e8431 service nova] [instance: 91238923-a64c-4f41-a046-be243eff880d] Received event network-vif-unplugged-4d2871cf-d6d9-4edb-9a0d-bc275ee11e13 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:48:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-e7260b5e-c4f6-4467-8191-93b791417810 req-370ff92a-0a40-47a6-bfdf-7e81339e8431 service nova] Acquiring lock "91238923-a64c-4f41-a046-be243eff880d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:48:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-e7260b5e-c4f6-4467-8191-93b791417810 req-370ff92a-0a40-47a6-bfdf-7e81339e8431 service nova] Lock "91238923-a64c-4f41-a046-be243eff880d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:48:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-e7260b5e-c4f6-4467-8191-93b791417810 req-370ff92a-0a40-47a6-bfdf-7e81339e8431 service nova] Lock "91238923-a64c-4f41-a046-be243eff880d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:48:42 user nova-compute[75100]: DEBUG nova.compute.manager [req-e7260b5e-c4f6-4467-8191-93b791417810 req-370ff92a-0a40-47a6-bfdf-7e81339e8431 service nova] [instance: 91238923-a64c-4f41-a046-be243eff880d] No waiting events found dispatching network-vif-unplugged-4d2871cf-d6d9-4edb-9a0d-bc275ee11e13 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:48:42 user nova-compute[75100]: DEBUG nova.compute.manager [req-e7260b5e-c4f6-4467-8191-93b791417810 req-370ff92a-0a40-47a6-bfdf-7e81339e8431 service nova] [instance: 91238923-a64c-4f41-a046-be243eff880d] Received event network-vif-unplugged-4d2871cf-d6d9-4edb-9a0d-bc275ee11e13 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 17:48:42 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 91238923-a64c-4f41-a046-be243eff880d] Instance destroyed successfully.
Nov 10 17:48:42 user nova-compute[75100]: DEBUG nova.objects.instance [None req-77049c28-373c-4f58-b03f-dc1c412f34b3 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Lazy-loading 'resources' on Instance uuid 91238923-a64c-4f41-a046-be243eff880d {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:48:42 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-77049c28-373c-4f58-b03f-dc1c412f34b3 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T17:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1217309978',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1217309978',id=7,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDg6Whui6h8FFFZnFwQnZiCuU3HjskJ2h5m1lP5l89/I6dnqvQ2dx39WpWkClYX9LsxzEk1B3cwB2sN+VxVpaZakTcKBRQUFmNH6ntC81O0eJh0TTBqxIPcr2Favd3KjTw==',key_name='tempest-keypair-326242402',keypairs=<?>,launch_index=0,launched_at=2023-11-10T17:45:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c38f5a70dae74e3cb19dd6ddade72581',ramdisk_id='',reservation_id='r-v9u7eycj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1600859769',owner_user_name='tempest-TaggedAttachmentsTest-1600859769-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T17:45:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83545cded878478a8c823e5614376f18',uuid=91238923-a64c-4f41-a046-be243eff880d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d2871cf-d6d9-4edb-9a0d-bc275ee11e13", "address": "fa:16:3e:8e:18:ef", "network": {"id": "304fddab-4cec-47aa-afab-f32de11ec897", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-288924842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c38f5a70dae74e3cb19dd6ddade72581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d2871cf-d6", "ovs_interfaceid": "4d2871cf-d6d9-4edb-9a0d-bc275ee11e13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 17:48:42 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-77049c28-373c-4f58-b03f-dc1c412f34b3 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Converting VIF {"id": "4d2871cf-d6d9-4edb-9a0d-bc275ee11e13", "address": "fa:16:3e:8e:18:ef", "network": {"id": "304fddab-4cec-47aa-afab-f32de11ec897", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-288924842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c38f5a70dae74e3cb19dd6ddade72581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d2871cf-d6", "ovs_interfaceid": "4d2871cf-d6d9-4edb-9a0d-bc275ee11e13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:48:42 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-77049c28-373c-4f58-b03f-dc1c412f34b3 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:18:ef,bridge_name='br-int',has_traffic_filtering=True,id=4d2871cf-d6d9-4edb-9a0d-bc275ee11e13,network=Network(304fddab-4cec-47aa-afab-f32de11ec897),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d2871cf-d6') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:48:42 user nova-compute[75100]: DEBUG os_vif [None req-77049c28-373c-4f58-b03f-dc1c412f34b3 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:18:ef,bridge_name='br-int',has_traffic_filtering=True,id=4d2871cf-d6d9-4edb-9a0d-bc275ee11e13,network=Network(304fddab-4cec-47aa-afab-f32de11ec897),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d2871cf-d6') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 17:48:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d2871cf-d6, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:48:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:48:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ddcecfb0-9e4f-495e-a203-6619a4864f54) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:48:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:48:42 user nova-compute[75100]: INFO os_vif [None req-77049c28-373c-4f58-b03f-dc1c412f34b3 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:18:ef,bridge_name='br-int',has_traffic_filtering=True,id=4d2871cf-d6d9-4edb-9a0d-bc275ee11e13,network=Network(304fddab-4cec-47aa-afab-f32de11ec897),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d2871cf-d6')
Nov 10 17:48:42 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-77049c28-373c-4f58-b03f-dc1c412f34b3 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] [instance: 91238923-a64c-4f41-a046-be243eff880d] Deleting instance files /opt/stack/data/nova/instances/91238923-a64c-4f41-a046-be243eff880d_del
Nov 10 17:48:42 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-77049c28-373c-4f58-b03f-dc1c412f34b3 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] [instance: 91238923-a64c-4f41-a046-be243eff880d] Deletion of /opt/stack/data/nova/instances/91238923-a64c-4f41-a046-be243eff880d_del complete
Nov 10 17:48:42 user nova-compute[75100]: INFO nova.compute.manager [None req-77049c28-373c-4f58-b03f-dc1c412f34b3 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] [instance: 91238923-a64c-4f41-a046-be243eff880d] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 10 17:48:42 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-77049c28-373c-4f58-b03f-dc1c412f34b3 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 17:48:42 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: 91238923-a64c-4f41-a046-be243eff880d] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 17:48:42 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 91238923-a64c-4f41-a046-be243eff880d] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 17:48:43 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 91238923-a64c-4f41-a046-be243eff880d] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:48:43 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: 91238923-a64c-4f41-a046-be243eff880d] Took 0.79 seconds to deallocate network for instance.
Nov 10 17:48:43 user nova-compute[75100]: DEBUG nova.compute.manager [req-a5765ac2-d7df-45a1-af45-495cdf6d24dc req-4291152c-df0e-40cc-9966-c1d33e454ddf service nova] [instance: 91238923-a64c-4f41-a046-be243eff880d] Received event network-vif-deleted-4d2871cf-d6d9-4edb-9a0d-bc275ee11e13 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:48:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-77049c28-373c-4f58-b03f-dc1c412f34b3 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:48:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-77049c28-373c-4f58-b03f-dc1c412f34b3 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:48:43 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-77049c28-373c-4f58-b03f-dc1c412f34b3 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:48:43 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-77049c28-373c-4f58-b03f-dc1c412f34b3 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:48:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-77049c28-373c-4f58-b03f-dc1c412f34b3 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.414s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:48:43 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-77049c28-373c-4f58-b03f-dc1c412f34b3 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Deleted allocations for instance 91238923-a64c-4f41-a046-be243eff880d
Nov 10 17:48:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-77049c28-373c-4f58-b03f-dc1c412f34b3 tempest-TaggedAttachmentsTest-1600859769 tempest-TaggedAttachmentsTest-1600859769-project-member] Lock "91238923-a64c-4f41-a046-be243eff880d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.292s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:48:44 user nova-compute[75100]: DEBUG nova.compute.manager [req-6a358db6-8fcc-4246-a04e-12fda1617adc req-5c14f12b-f0f4-4524-a83e-2a860f9f9cb4 service nova] [instance: 91238923-a64c-4f41-a046-be243eff880d] Received event network-vif-plugged-4d2871cf-d6d9-4edb-9a0d-bc275ee11e13 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:48:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6a358db6-8fcc-4246-a04e-12fda1617adc req-5c14f12b-f0f4-4524-a83e-2a860f9f9cb4 service nova] Acquiring lock "91238923-a64c-4f41-a046-be243eff880d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:48:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6a358db6-8fcc-4246-a04e-12fda1617adc req-5c14f12b-f0f4-4524-a83e-2a860f9f9cb4 service nova] Lock "91238923-a64c-4f41-a046-be243eff880d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:48:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6a358db6-8fcc-4246-a04e-12fda1617adc req-5c14f12b-f0f4-4524-a83e-2a860f9f9cb4 service nova] Lock "91238923-a64c-4f41-a046-be243eff880d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:48:44 user nova-compute[75100]: DEBUG nova.compute.manager [req-6a358db6-8fcc-4246-a04e-12fda1617adc req-5c14f12b-f0f4-4524-a83e-2a860f9f9cb4 service nova] [instance: 91238923-a64c-4f41-a046-be243eff880d] No waiting events found dispatching network-vif-plugged-4d2871cf-d6d9-4edb-9a0d-bc275ee11e13 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:48:44 user nova-compute[75100]: WARNING nova.compute.manager [req-6a358db6-8fcc-4246-a04e-12fda1617adc req-5c14f12b-f0f4-4524-a83e-2a860f9f9cb4 service nova] [instance: 91238923-a64c-4f41-a046-be243eff880d] Received unexpected event network-vif-plugged-4d2871cf-d6d9-4edb-9a0d-bc275ee11e13 for instance with vm_state deleted and task_state None.
Nov 10 17:48:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:48:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:49:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:49:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:49:10 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:49:12 user nova-compute[75100]: INFO nova.compute.manager [None req-2bba8c9c-dee1-4afb-bb2c-ae2c74e1e740 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Rescuing
Nov 10 17:49:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2bba8c9c-dee1-4afb-bb2c-ae2c74e1e740 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Acquiring lock "refresh_cache-b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:49:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2bba8c9c-dee1-4afb-bb2c-ae2c74e1e740 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Acquired lock "refresh_cache-b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:49:12 user nova-compute[75100]: DEBUG nova.network.neutron [None req-2bba8c9c-dee1-4afb-bb2c-ae2c74e1e740 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 17:49:12 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:49:12 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:49:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:49:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:49:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:49:12 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 17:49:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:49:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:49:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:49:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:49:12 user nova-compute[75100]: DEBUG nova.network.neutron [None req-2bba8c9c-dee1-4afb-bb2c-ae2c74e1e740 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Updating instance_info_cache with network_info: [{"id": "be620d2e-a2ea-49fe-9205-68101009027b", "address": "fa:16:3e:2d:37:4e", "network": {"id": "26a554fe-9a5e-40c0-9981-5ac084c9ea73", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-269663495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19755f3e634fdfbd562c33fbfa2a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe620d2e-a2", "ovs_interfaceid": "be620d2e-a2ea-49fe-9205-68101009027b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:49:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2bba8c9c-dee1-4afb-bb2c-ae2c74e1e740 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Releasing lock "refresh_cache-b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:49:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:49:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:49:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:49:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:49:13 user nova-compute[75100]: DEBUG nova.compute.manager [req-df970851-db9e-440b-80dc-b5fc0f5517a2 req-2948db5f-c93b-4fd9-9535-9fc9b9654327 service nova] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Received event network-vif-unplugged-be620d2e-a2ea-49fe-9205-68101009027b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:49:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-df970851-db9e-440b-80dc-b5fc0f5517a2 req-2948db5f-c93b-4fd9-9535-9fc9b9654327 service nova] Acquiring lock "b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:49:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-df970851-db9e-440b-80dc-b5fc0f5517a2 req-2948db5f-c93b-4fd9-9535-9fc9b9654327 service nova] Lock "b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:49:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-df970851-db9e-440b-80dc-b5fc0f5517a2 req-2948db5f-c93b-4fd9-9535-9fc9b9654327 service nova] Lock "b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:49:13 user nova-compute[75100]: DEBUG nova.compute.manager [req-df970851-db9e-440b-80dc-b5fc0f5517a2 req-2948db5f-c93b-4fd9-9535-9fc9b9654327 service nova] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] No waiting events found dispatching network-vif-unplugged-be620d2e-a2ea-49fe-9205-68101009027b {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:49:13 user nova-compute[75100]: WARNING nova.compute.manager [req-df970851-db9e-440b-80dc-b5fc0f5517a2 req-2948db5f-c93b-4fd9-9535-9fc9b9654327 service nova] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Received unexpected event network-vif-unplugged-be620d2e-a2ea-49fe-9205-68101009027b for instance with vm_state active and task_state rescuing.
Nov 10 17:49:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:49:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:49:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:49:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:49:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:49:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:49:13 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Instance destroyed successfully.
Nov 10 17:49:13 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-2bba8c9c-dee1-4afb-bb2c-ae2c74e1e740 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Attempting rescue
Nov 10 17:49:13 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-2bba8c9c-dee1-4afb-bb2c-ae2c74e1e740 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75100) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 10 17:49:13 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-2bba8c9c-dee1-4afb-bb2c-ae2c74e1e740 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Instance directory exists: not creating {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 10 17:49:13 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-2bba8c9c-dee1-4afb-bb2c-ae2c74e1e740 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Creating image(s)
Nov 10 17:49:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2bba8c9c-dee1-4afb-bb2c-ae2c74e1e740 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Acquiring lock "/opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:49:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2bba8c9c-dee1-4afb-bb2c-ae2c74e1e740 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "/opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:49:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2bba8c9c-dee1-4afb-bb2c-ae2c74e1e740 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "/opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:49:13 user nova-compute[75100]: DEBUG nova.objects.instance [None req-2bba8c9c-dee1-4afb-bb2c-ae2c74e1e740 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lazy-loading 'trusted_certs' on Instance uuid b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:49:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2bba8c9c-dee1-4afb-bb2c-ae2c74e1e740 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Acquiring lock "818b9e28e061d41a38d903968b229be2ed9ba520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:49:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2bba8c9c-dee1-4afb-bb2c-ae2c74e1e740 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:49:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-2bba8c9c-dee1-4afb-bb2c-ae2c74e1e740 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:49:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk.rescue --force-share --output=json" returned: 0 in 0.228s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:49:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:49:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-2bba8c9c-dee1-4afb-bb2c-ae2c74e1e740 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.195s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:49:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-2bba8c9c-dee1-4afb-bb2c-ae2c74e1e740 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk.rescue {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:49:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-2bba8c9c-dee1-4afb-bb2c-ae2c74e1e740 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk.rescue" returned: 0 in 0.060s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:49:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2bba8c9c-dee1-4afb-bb2c-ae2c74e1e740 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:49:13 user nova-compute[75100]: DEBUG nova.objects.instance [None req-2bba8c9c-dee1-4afb-bb2c-ae2c74e1e740 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lazy-loading 'migration_context' on Instance uuid b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:49:13 user nova-compute[75100]: DEBUG nova.objects.base [None req-2bba8c9c-dee1-4afb-bb2c-ae2c74e1e740 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Object Instance<b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 17:49:13 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-2bba8c9c-dee1-4afb-bb2c-ae2c74e1e740 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 17:49:13 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-2bba8c9c-dee1-4afb-bb2c-ae2c74e1e740 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Start _get_guest_xml network_info=[{"id": "be620d2e-a2ea-49fe-9205-68101009027b", "address": "fa:16:3e:2d:37:4e", "network": {"id": "26a554fe-9a5e-40c0-9981-5ac084c9ea73", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-269663495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-269663495-network", "vif_mac": "fa:16:3e:2d:37:4e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19755f3e634fdfbd562c33fbfa2a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe620d2e-a2", "ovs_interfaceid": "be620d2e-a2ea-49fe-9205-68101009027b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e3cc5321-4d40-49ee-885c-700e14741732', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 17:49:13 user nova-compute[75100]: DEBUG nova.objects.instance [None req-2bba8c9c-dee1-4afb-bb2c-ae2c74e1e740 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lazy-loading 'resources' on Instance uuid b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:49:13 user nova-compute[75100]: DEBUG nova.objects.base [None req-2bba8c9c-dee1-4afb-bb2c-ae2c74e1e740 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Object Instance<b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 17:49:13 user nova-compute[75100]: DEBUG nova.objects.instance [None req-2bba8c9c-dee1-4afb-bb2c-ae2c74e1e740 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lazy-loading 'numa_topology' on Instance uuid b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:49:13 user nova-compute[75100]: DEBUG nova.objects.base [None req-2bba8c9c-dee1-4afb-bb2c-ae2c74e1e740 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Object Instance<b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 17:49:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk.rescue --force-share --output=json" returned: 0 in 0.215s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:49:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:49:14 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-2bba8c9c-dee1-4afb-bb2c-ae2c74e1e740 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:49:14 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-2bba8c9c-dee1-4afb-bb2c-ae2c74e1e740 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:49:14 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-2bba8c9c-dee1-4afb-bb2c-ae2c74e1e740 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 17:49:14 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-2bba8c9c-dee1-4afb-bb2c-ae2c74e1e740 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 17:49:14 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-2bba8c9c-dee1-4afb-bb2c-ae2c74e1e740 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 17:49:14 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-2bba8c9c-dee1-4afb-bb2c-ae2c74e1e740 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 17:49:14 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-2bba8c9c-dee1-4afb-bb2c-ae2c74e1e740 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 17:49:14 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-2bba8c9c-dee1-4afb-bb2c-ae2c74e1e740 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T17:40:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 17:49:14 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-2bba8c9c-dee1-4afb-bb2c-ae2c74e1e740 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 17:49:14 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-2bba8c9c-dee1-4afb-bb2c-ae2c74e1e740 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 17:49:14 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-2bba8c9c-dee1-4afb-bb2c-ae2c74e1e740 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 17:49:14 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-2bba8c9c-dee1-4afb-bb2c-ae2c74e1e740 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 17:49:14 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-2bba8c9c-dee1-4afb-bb2c-ae2c74e1e740 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 17:49:14 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-2bba8c9c-dee1-4afb-bb2c-ae2c74e1e740 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 17:49:14 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-2bba8c9c-dee1-4afb-bb2c-ae2c74e1e740 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 17:49:14 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-2bba8c9c-dee1-4afb-bb2c-ae2c74e1e740 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 17:49:14 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-2bba8c9c-dee1-4afb-bb2c-ae2c74e1e740 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 17:49:14 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-2bba8c9c-dee1-4afb-bb2c-ae2c74e1e740 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 17:49:14 user nova-compute[75100]: DEBUG nova.objects.instance [None req-2bba8c9c-dee1-4afb-bb2c-ae2c74e1e740 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lazy-loading 'vcpu_model' on Instance uuid b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:49:14 user nova-compute[75100]: DEBUG nova.objects.base [None req-2bba8c9c-dee1-4afb-bb2c-ae2c74e1e740 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Object Instance<b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 17:49:14 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-2bba8c9c-dee1-4afb-bb2c-ae2c74e1e740 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:44:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-81379937',display_name='tempest-ServerRescueNegativeTestJSON-server-81379937',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-81379937',id=2,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T17:44:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6b19755f3e634fdfbd562c33fbfa2a88',ramdisk_id='',reservation_id='r-sqwzcrjg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-783763036',owner_user_name='tempest-ServerRescueNegativeTestJSON-783763036-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:44:39Z,user_data=None,user_id='8cdb9250e6c7459587e429a0aea577c6',uuid=b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "be620d2e-a2ea-49fe-9205-68101009027b", "address": "fa:16:3e:2d:37:4e", "network": {"id": "26a554fe-9a5e-40c0-9981-5ac084c9ea73", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-269663495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-269663495-network", "vif_mac": "fa:16:3e:2d:37:4e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19755f3e634fdfbd562c33fbfa2a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe620d2e-a2", "ovs_interfaceid": "be620d2e-a2ea-49fe-9205-68101009027b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 17:49:14 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-2bba8c9c-dee1-4afb-bb2c-ae2c74e1e740 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Converting VIF {"id": "be620d2e-a2ea-49fe-9205-68101009027b", "address": "fa:16:3e:2d:37:4e", "network": {"id": "26a554fe-9a5e-40c0-9981-5ac084c9ea73", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-269663495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-269663495-network", "vif_mac": "fa:16:3e:2d:37:4e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19755f3e634fdfbd562c33fbfa2a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe620d2e-a2", "ovs_interfaceid": "be620d2e-a2ea-49fe-9205-68101009027b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:49:14 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-2bba8c9c-dee1-4afb-bb2c-ae2c74e1e740 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2d:37:4e,bridge_name='br-int',has_traffic_filtering=True,id=be620d2e-a2ea-49fe-9205-68101009027b,network=Network(26a554fe-9a5e-40c0-9981-5ac084c9ea73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe620d2e-a2') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:49:14 user nova-compute[75100]: DEBUG nova.objects.instance [None req-2bba8c9c-dee1-4afb-bb2c-ae2c74e1e740 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lazy-loading 'pci_devices' on Instance uuid b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:49:14 user nova-compute[75100]: DEBUG nova.objects.base [None req-2bba8c9c-dee1-4afb-bb2c-ae2c74e1e740 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Object Instance<b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 17:49:14 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-2bba8c9c-dee1-4afb-bb2c-ae2c74e1e740 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] End _get_guest_xml xml=<domain type="kvm">
Nov 10 17:49:14 user nova-compute[75100]:   <uuid>b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b</uuid>
Nov 10 17:49:14 user nova-compute[75100]:   <name>instance-00000002</name>
Nov 10 17:49:14 user nova-compute[75100]:   <memory>524288</memory>
Nov 10 17:49:14 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 10 17:49:14 user nova-compute[75100]:   <metadata>
Nov 10 17:49:14 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 17:49:14 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 10 17:49:14 user nova-compute[75100]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-81379937</nova:name>
Nov 10 17:49:14 user nova-compute[75100]:       <nova:creationTime>2023-11-10 17:49:14</nova:creationTime>
Nov 10 17:49:14 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 10 17:49:14 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 10 17:49:14 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 10 17:49:14 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 10 17:49:14 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 17:49:14 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 10 17:49:14 user nova-compute[75100]:       </nova:flavor>
Nov 10 17:49:14 user nova-compute[75100]:       <nova:owner>
Nov 10 17:49:14 user nova-compute[75100]:         <nova:user uuid="8cdb9250e6c7459587e429a0aea577c6">tempest-ServerRescueNegativeTestJSON-783763036-project-member</nova:user>
Nov 10 17:49:14 user nova-compute[75100]:         <nova:project uuid="6b19755f3e634fdfbd562c33fbfa2a88">tempest-ServerRescueNegativeTestJSON-783763036</nova:project>
Nov 10 17:49:14 user nova-compute[75100]:       </nova:owner>
Nov 10 17:49:14 user nova-compute[75100]:       <nova:root type="image" uuid="e3cc5321-4d40-49ee-885c-700e14741732"/>
Nov 10 17:49:14 user nova-compute[75100]:       <nova:ports>
Nov 10 17:49:14 user nova-compute[75100]:         <nova:port uuid="be620d2e-a2ea-49fe-9205-68101009027b">
Nov 10 17:49:14 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 10 17:49:14 user nova-compute[75100]:         </nova:port>
Nov 10 17:49:14 user nova-compute[75100]:       </nova:ports>
Nov 10 17:49:14 user nova-compute[75100]:     </nova:instance>
Nov 10 17:49:14 user nova-compute[75100]:   </metadata>
Nov 10 17:49:14 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 10 17:49:14 user nova-compute[75100]:     <system>
Nov 10 17:49:14 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 17:49:14 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 10 17:49:14 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 10 17:49:14 user nova-compute[75100]:       <entry name="serial">b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b</entry>
Nov 10 17:49:14 user nova-compute[75100]:       <entry name="uuid">b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b</entry>
Nov 10 17:49:14 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 10 17:49:14 user nova-compute[75100]:     </system>
Nov 10 17:49:14 user nova-compute[75100]:   </sysinfo>
Nov 10 17:49:14 user nova-compute[75100]:   <os>
Nov 10 17:49:14 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 17:49:14 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 10 17:49:14 user nova-compute[75100]:   </os>
Nov 10 17:49:14 user nova-compute[75100]:   <features>
Nov 10 17:49:14 user nova-compute[75100]:     <acpi/>
Nov 10 17:49:14 user nova-compute[75100]:     <apic/>
Nov 10 17:49:14 user nova-compute[75100]:     <vmcoreinfo/>
Nov 10 17:49:14 user nova-compute[75100]:   </features>
Nov 10 17:49:14 user nova-compute[75100]:   <clock offset="utc">
Nov 10 17:49:14 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 17:49:14 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 17:49:14 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 10 17:49:14 user nova-compute[75100]:   </clock>
Nov 10 17:49:14 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 10 17:49:14 user nova-compute[75100]:     <model>Nehalem</model>
Nov 10 17:49:14 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 17:49:14 user nova-compute[75100]:   </cpu>
Nov 10 17:49:14 user nova-compute[75100]:   <devices>
Nov 10 17:49:14 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 10 17:49:14 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 17:49:14 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk.rescue"/>
Nov 10 17:49:14 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 10 17:49:14 user nova-compute[75100]:     </disk>
Nov 10 17:49:14 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 10 17:49:14 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 17:49:14 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk"/>
Nov 10 17:49:14 user nova-compute[75100]:       <target dev="vdb" bus="virtio"/>
Nov 10 17:49:14 user nova-compute[75100]:     </disk>
Nov 10 17:49:14 user nova-compute[75100]:     <interface type="ethernet">
Nov 10 17:49:14 user nova-compute[75100]:       <mac address="fa:16:3e:2d:37:4e"/>
Nov 10 17:49:14 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:49:14 user nova-compute[75100]:       <mtu size="1442"/>
Nov 10 17:49:14 user nova-compute[75100]:       <target dev="tapbe620d2e-a2"/>
Nov 10 17:49:14 user nova-compute[75100]:     </interface>
Nov 10 17:49:14 user nova-compute[75100]:     <serial type="pty">
Nov 10 17:49:14 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/console.log" append="off"/>
Nov 10 17:49:14 user nova-compute[75100]:     </serial>
Nov 10 17:49:14 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 17:49:14 user nova-compute[75100]:     <video>
Nov 10 17:49:14 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:49:14 user nova-compute[75100]:     </video>
Nov 10 17:49:14 user nova-compute[75100]:     <rng model="virtio">
Nov 10 17:49:14 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 10 17:49:14 user nova-compute[75100]:     </rng>
Nov 10 17:49:14 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 10 17:49:14 user nova-compute[75100]:     <memballoon model="virtio">
Nov 10 17:49:14 user nova-compute[75100]:       <stats period="10"/>
Nov 10 17:49:14 user nova-compute[75100]:     </memballoon>
Nov 10 17:49:14 user nova-compute[75100]:   </devices>
Nov 10 17:49:14 user nova-compute[75100]: </domain>
Nov 10 17:49:14 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 17:49:14 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Instance destroyed successfully.
Nov 10 17:49:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:49:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:49:14 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-2bba8c9c-dee1-4afb-bb2c-ae2c74e1e740 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 17:49:14 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-2bba8c9c-dee1-4afb-bb2c-ae2c74e1e740 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 17:49:14 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-2bba8c9c-dee1-4afb-bb2c-ae2c74e1e740 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] No VIF found with MAC fa:16:3e:2d:37:4e, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 17:49:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:49:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db3f69df-51b2-464c-921e-33171e29f46d/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:49:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db3f69df-51b2-464c-921e-33171e29f46d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:49:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db3f69df-51b2-464c-921e-33171e29f46d/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:49:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db3f69df-51b2-464c-921e-33171e29f46d/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:49:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61d3862-5be7-45cc-95a0-88124ac1725d/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:49:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61d3862-5be7-45cc-95a0-88124ac1725d/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:49:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61d3862-5be7-45cc-95a0-88124ac1725d/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:49:15 user nova-compute[75100]: DEBUG nova.compute.manager [req-5d9cfe91-e190-4dd2-acbe-b2a0fba12b42 req-9ec82a5e-9659-4070-afe9-30339d47ba7f service nova] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Received event network-vif-plugged-be620d2e-a2ea-49fe-9205-68101009027b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:49:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5d9cfe91-e190-4dd2-acbe-b2a0fba12b42 req-9ec82a5e-9659-4070-afe9-30339d47ba7f service nova] Acquiring lock "b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:49:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5d9cfe91-e190-4dd2-acbe-b2a0fba12b42 req-9ec82a5e-9659-4070-afe9-30339d47ba7f service nova] Lock "b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:49:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5d9cfe91-e190-4dd2-acbe-b2a0fba12b42 req-9ec82a5e-9659-4070-afe9-30339d47ba7f service nova] Lock "b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:49:15 user nova-compute[75100]: DEBUG nova.compute.manager [req-5d9cfe91-e190-4dd2-acbe-b2a0fba12b42 req-9ec82a5e-9659-4070-afe9-30339d47ba7f service nova] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] No waiting events found dispatching network-vif-plugged-be620d2e-a2ea-49fe-9205-68101009027b {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:49:15 user nova-compute[75100]: WARNING nova.compute.manager [req-5d9cfe91-e190-4dd2-acbe-b2a0fba12b42 req-9ec82a5e-9659-4070-afe9-30339d47ba7f service nova] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Received unexpected event network-vif-plugged-be620d2e-a2ea-49fe-9205-68101009027b for instance with vm_state active and task_state rescuing.
Nov 10 17:49:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61d3862-5be7-45cc-95a0-88124ac1725d/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:49:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ead532eb-c8be-45fa-a8b7-0b4c4f884a90/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:49:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ead532eb-c8be-45fa-a8b7-0b4c4f884a90/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:49:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ead532eb-c8be-45fa-a8b7-0b4c4f884a90/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:49:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:49:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ead532eb-c8be-45fa-a8b7-0b4c4f884a90/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:49:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:49:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71ff860c-f094-4885-bf69-cd6236ebc875/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:49:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:49:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71ff860c-f094-4885-bf69-cd6236ebc875/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:49:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71ff860c-f094-4885-bf69-cd6236ebc875/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:49:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:49:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71ff860c-f094-4885-bf69-cd6236ebc875/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:49:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:49:18 user nova-compute[75100]: DEBUG nova.compute.manager [req-bb26df12-0d5a-4cca-bac5-3150accca080 req-f3e3c134-388c-46f7-b52b-7576af767126 service nova] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Received event network-vif-plugged-be620d2e-a2ea-49fe-9205-68101009027b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:49:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-bb26df12-0d5a-4cca-bac5-3150accca080 req-f3e3c134-388c-46f7-b52b-7576af767126 service nova] Acquiring lock "b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:49:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-bb26df12-0d5a-4cca-bac5-3150accca080 req-f3e3c134-388c-46f7-b52b-7576af767126 service nova] Lock "b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:49:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-bb26df12-0d5a-4cca-bac5-3150accca080 req-f3e3c134-388c-46f7-b52b-7576af767126 service nova] Lock "b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:49:18 user nova-compute[75100]: DEBUG nova.compute.manager [req-bb26df12-0d5a-4cca-bac5-3150accca080 req-f3e3c134-388c-46f7-b52b-7576af767126 service nova] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] No waiting events found dispatching network-vif-plugged-be620d2e-a2ea-49fe-9205-68101009027b {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:49:18 user nova-compute[75100]: WARNING nova.compute.manager [req-bb26df12-0d5a-4cca-bac5-3150accca080 req-f3e3c134-388c-46f7-b52b-7576af767126 service nova] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Received unexpected event network-vif-plugged-be620d2e-a2ea-49fe-9205-68101009027b for instance with vm_state active and task_state rescuing.
Nov 10 17:49:18 user nova-compute[75100]: DEBUG nova.compute.manager [req-bb26df12-0d5a-4cca-bac5-3150accca080 req-f3e3c134-388c-46f7-b52b-7576af767126 service nova] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Received event network-vif-plugged-be620d2e-a2ea-49fe-9205-68101009027b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:49:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-bb26df12-0d5a-4cca-bac5-3150accca080 req-f3e3c134-388c-46f7-b52b-7576af767126 service nova] Acquiring lock "b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:49:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-bb26df12-0d5a-4cca-bac5-3150accca080 req-f3e3c134-388c-46f7-b52b-7576af767126 service nova] Lock "b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:49:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-bb26df12-0d5a-4cca-bac5-3150accca080 req-f3e3c134-388c-46f7-b52b-7576af767126 service nova] Lock "b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:49:18 user nova-compute[75100]: DEBUG nova.compute.manager [req-bb26df12-0d5a-4cca-bac5-3150accca080 req-f3e3c134-388c-46f7-b52b-7576af767126 service nova] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] No waiting events found dispatching network-vif-plugged-be620d2e-a2ea-49fe-9205-68101009027b {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:49:18 user nova-compute[75100]: WARNING nova.compute.manager [req-bb26df12-0d5a-4cca-bac5-3150accca080 req-f3e3c134-388c-46f7-b52b-7576af767126 service nova] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Received unexpected event network-vif-plugged-be620d2e-a2ea-49fe-9205-68101009027b for instance with vm_state active and task_state rescuing.
Nov 10 17:49:18 user nova-compute[75100]: DEBUG nova.compute.manager [None req-2bba8c9c-dee1-4afb-bb2c-ae2c74e1e740 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 17:49:18 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:49:18 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:49:18 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Hypervisor/Node resource view: name=user free_ram=7872MB free_disk=24.8145751953125GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 17:49:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:49:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:49:18 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance c19fc271-a248-4631-a11f-89b7ed73bf85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:49:18 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:49:18 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 3e14de19-540d-4dc2-a058-6874d8d14478 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:49:18 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance ead532eb-c8be-45fa-a8b7-0b4c4f884a90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:49:18 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance db3f69df-51b2-464c-921e-33171e29f46d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:49:18 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 111bd74e-2943-4f12-9514-b564cf26dadb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:49:18 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance d61d3862-5be7-45cc-95a0-88124ac1725d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:49:18 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 71ff860c-f094-4885-bf69-cd6236ebc875 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:49:18 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 17:49:18 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 17:49:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:49:18 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:49:19 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:49:19 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 17:49:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.579s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:49:21 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:49:21 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:49:21 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 17:49:21 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Didn't find any instances for network info cache update. {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 17:49:21 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:49:21 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:49:21 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:49:21 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:49:21 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 17:49:22 user nova-compute[75100]: DEBUG nova.compute.manager [req-82bd241e-df7d-41c1-8204-02872bf749f1 req-9b82352e-5328-46fb-8c02-fc8ee3a66e5b service nova] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Received event volume-reimaged-23131533-b27f-4598-84b7-44ed1d8878cb {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:49:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-82bd241e-df7d-41c1-8204-02872bf749f1 req-9b82352e-5328-46fb-8c02-fc8ee3a66e5b service nova] Acquiring lock "111bd74e-2943-4f12-9514-b564cf26dadb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:49:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-82bd241e-df7d-41c1-8204-02872bf749f1 req-9b82352e-5328-46fb-8c02-fc8ee3a66e5b service nova] Lock "111bd74e-2943-4f12-9514-b564cf26dadb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:49:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-82bd241e-df7d-41c1-8204-02872bf749f1 req-9b82352e-5328-46fb-8c02-fc8ee3a66e5b service nova] Lock "111bd74e-2943-4f12-9514-b564cf26dadb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:49:22 user nova-compute[75100]: DEBUG nova.compute.manager [req-82bd241e-df7d-41c1-8204-02872bf749f1 req-9b82352e-5328-46fb-8c02-fc8ee3a66e5b service nova] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Processing event volume-reimaged-23131533-b27f-4598-84b7-44ed1d8878cb {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 10 17:49:22 user nova-compute[75100]: DEBUG nova.compute.manager [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Instance event wait completed in 54 seconds for volume-reimaged {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 17:49:22 user nova-compute[75100]: INFO nova.virt.block_device [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Booting with volume 23131533-b27f-4598-84b7-44ed1d8878cb at /dev/vda
Nov 10 17:49:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:49:22 user nova-compute[75100]: DEBUG os_brick.utils [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 17:49:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:49:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:49:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b62fdf01-1e90-4046-85c0-cc739f6567f8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90b1a229568f\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:49:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:49:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:49:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c11a2af-cefa-459d-bdb0-e4190d64b898]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:49:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:49:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:49:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a65ddb4-6148-4d25-a0fe-dde373875623]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:49:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[894f6caa-4d75-4438-9c91-e4a414055b9f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:49:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:49:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 17:49:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 17:49:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:49:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 17:49:22 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 17:49:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba283426-7891-4990-a4a3-d81c2bc9fa95]: (4, '') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:49:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 17:49:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 17:49:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 17:49:22 user nova-compute[75100]: DEBUG os_brick.utils [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90b1a229568f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 17:49:22 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Updating existing volume attachment record: 96eadaaa-9cc7-47e8-80dd-18e807c3be2c {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 17:49:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:49:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:49:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:49:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:49:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:49:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:49:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:49:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:49:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:49:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:49:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:49:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:49:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:49:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:49:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:49:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:49:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:49:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Acquiring lock "eb430407-f836-4510-899f-a5f5d60c73f3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:49:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Lock "eb430407-f836-4510-899f-a5f5d60c73f3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:49:43 user nova-compute[75100]: DEBUG nova.compute.manager [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 17:49:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:49:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:49:43 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 17:49:43 user nova-compute[75100]: INFO nova.compute.claims [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Claim successful on node user
Nov 10 17:49:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:49:43 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:49:43 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:49:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.546s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:49:43 user nova-compute[75100]: DEBUG nova.compute.manager [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 17:49:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:49:43 user nova-compute[75100]: DEBUG nova.compute.manager [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 17:49:43 user nova-compute[75100]: DEBUG nova.network.neutron [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 17:49:44 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 17:49:44 user nova-compute[75100]: DEBUG nova.compute.manager [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 17:49:44 user nova-compute[75100]: DEBUG nova.policy [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'da45741ccb5d4b00a0784d7ef9063243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e95560897fb46258db0ecd7dc7b9294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 17:49:44 user nova-compute[75100]: DEBUG nova.compute.manager [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 17:49:44 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 17:49:44 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Creating image(s)
Nov 10 17:49:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Acquiring lock "/opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:49:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Lock "/opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:49:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Lock "/opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:49:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:49:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.226s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:49:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Acquiring lock "818b9e28e061d41a38d903968b229be2ed9ba520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:49:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:49:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:49:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.263s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:49:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:49:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3/disk 1073741824" returned: 0 in 0.071s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:49:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.342s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:49:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:49:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.253s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:49:45 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 17:49:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:49:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:49:45 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Cannot resize image /opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 17:49:45 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 17:49:45 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Ensure instance console log exists: /opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 17:49:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:49:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:49:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:49:45 user nova-compute[75100]: DEBUG nova.network.neutron [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Successfully created port: 6e9b2058-6104-4f6c-8c72-f5f15d0d116b {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 17:49:47 user nova-compute[75100]: DEBUG nova.network.neutron [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Successfully updated port: 6e9b2058-6104-4f6c-8c72-f5f15d0d116b {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 17:49:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Acquiring lock "refresh_cache-eb430407-f836-4510-899f-a5f5d60c73f3" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:49:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Acquired lock "refresh_cache-eb430407-f836-4510-899f-a5f5d60c73f3" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:49:47 user nova-compute[75100]: DEBUG nova.network.neutron [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 17:49:47 user nova-compute[75100]: DEBUG nova.network.neutron [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 17:49:47 user nova-compute[75100]: DEBUG nova.compute.manager [req-41ad5754-52da-4232-8127-6d360181d179 req-13f78145-76ad-4402-b9c2-b00c0b00291a service nova] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Received event network-changed-6e9b2058-6104-4f6c-8c72-f5f15d0d116b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:49:47 user nova-compute[75100]: DEBUG nova.compute.manager [req-41ad5754-52da-4232-8127-6d360181d179 req-13f78145-76ad-4402-b9c2-b00c0b00291a service nova] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Refreshing instance network info cache due to event network-changed-6e9b2058-6104-4f6c-8c72-f5f15d0d116b. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 17:49:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-41ad5754-52da-4232-8127-6d360181d179 req-13f78145-76ad-4402-b9c2-b00c0b00291a service nova] Acquiring lock "refresh_cache-eb430407-f836-4510-899f-a5f5d60c73f3" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:49:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:49:48 user nova-compute[75100]: DEBUG nova.network.neutron [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Updating instance_info_cache with network_info: [{"id": "6e9b2058-6104-4f6c-8c72-f5f15d0d116b", "address": "fa:16:3e:2f:11:f6", "network": {"id": "f67bc940-2f01-4255-b12e-427ffcd7e4e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-977195248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e95560897fb46258db0ecd7dc7b9294", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9b2058-61", "ovs_interfaceid": "6e9b2058-6104-4f6c-8c72-f5f15d0d116b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:49:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Releasing lock "refresh_cache-eb430407-f836-4510-899f-a5f5d60c73f3" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:49:48 user nova-compute[75100]: DEBUG nova.compute.manager [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Instance network_info: |[{"id": "6e9b2058-6104-4f6c-8c72-f5f15d0d116b", "address": "fa:16:3e:2f:11:f6", "network": {"id": "f67bc940-2f01-4255-b12e-427ffcd7e4e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-977195248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e95560897fb46258db0ecd7dc7b9294", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9b2058-61", "ovs_interfaceid": "6e9b2058-6104-4f6c-8c72-f5f15d0d116b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 17:49:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-41ad5754-52da-4232-8127-6d360181d179 req-13f78145-76ad-4402-b9c2-b00c0b00291a service nova] Acquired lock "refresh_cache-eb430407-f836-4510-899f-a5f5d60c73f3" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:49:48 user nova-compute[75100]: DEBUG nova.network.neutron [req-41ad5754-52da-4232-8127-6d360181d179 req-13f78145-76ad-4402-b9c2-b00c0b00291a service nova] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Refreshing network info cache for port 6e9b2058-6104-4f6c-8c72-f5f15d0d116b {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 17:49:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Start _get_guest_xml network_info=[{"id": "6e9b2058-6104-4f6c-8c72-f5f15d0d116b", "address": "fa:16:3e:2f:11:f6", "network": {"id": "f67bc940-2f01-4255-b12e-427ffcd7e4e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-977195248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e95560897fb46258db0ecd7dc7b9294", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9b2058-61", "ovs_interfaceid": "6e9b2058-6104-4f6c-8c72-f5f15d0d116b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'e3cc5321-4d40-49ee-885c-700e14741732'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 17:49:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:49:48 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:49:48 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:49:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 17:49:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 17:49:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 17:49:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 17:49:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 17:49:48 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T17:40:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 17:49:48 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 17:49:48 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 17:49:48 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 17:49:48 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 17:49:48 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 17:49:48 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 17:49:48 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 17:49:48 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 17:49:48 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 17:49:48 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 17:49:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:49:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1267762012',display_name='tempest-ServerActionsTestOtherB-server-1267762012',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1267762012',id=16,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDPSiJ0FfbNgNhKoheve47DT1uQV1oaC9CdV5NhlB12KyXHFwXlJCN0xOr09naWU21Nb1dG7o7w/ZzPU0YohVQI5ip5k2vJ5Db3SiA/LtLwk+OdOmsxEc+IoKJ74LTBECw==',key_name='tempest-keypair-1684715830',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e95560897fb46258db0ecd7dc7b9294',ramdisk_id='',reservation_id='r-55f5hxbc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1027676823',owner_user_name='tempest-ServerActionsTestOtherB-1027676823-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:49:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da45741ccb5d4b00a0784d7ef9063243',uuid=eb430407-f836-4510-899f-a5f5d60c73f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e9b2058-6104-4f6c-8c72-f5f15d0d116b", "address": "fa:16:3e:2f:11:f6", "network": {"id": "f67bc940-2f01-4255-b12e-427ffcd7e4e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-977195248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e95560897fb46258db0ecd7dc7b9294", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9b2058-61", "ovs_interfaceid": "6e9b2058-6104-4f6c-8c72-f5f15d0d116b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 17:49:48 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Converting VIF {"id": "6e9b2058-6104-4f6c-8c72-f5f15d0d116b", "address": "fa:16:3e:2f:11:f6", "network": {"id": "f67bc940-2f01-4255-b12e-427ffcd7e4e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-977195248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e95560897fb46258db0ecd7dc7b9294", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9b2058-61", "ovs_interfaceid": "6e9b2058-6104-4f6c-8c72-f5f15d0d116b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:49:48 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:11:f6,bridge_name='br-int',has_traffic_filtering=True,id=6e9b2058-6104-4f6c-8c72-f5f15d0d116b,network=Network(f67bc940-2f01-4255-b12e-427ffcd7e4e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e9b2058-61') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:49:48 user nova-compute[75100]: DEBUG nova.objects.instance [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Lazy-loading 'pci_devices' on Instance uuid eb430407-f836-4510-899f-a5f5d60c73f3 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:49:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] End _get_guest_xml xml=<domain type="kvm">
Nov 10 17:49:48 user nova-compute[75100]:   <uuid>eb430407-f836-4510-899f-a5f5d60c73f3</uuid>
Nov 10 17:49:48 user nova-compute[75100]:   <name>instance-00000010</name>
Nov 10 17:49:48 user nova-compute[75100]:   <memory>524288</memory>
Nov 10 17:49:48 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 10 17:49:48 user nova-compute[75100]:   <metadata>
Nov 10 17:49:48 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 17:49:48 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 10 17:49:48 user nova-compute[75100]:       <nova:name>tempest-ServerActionsTestOtherB-server-1267762012</nova:name>
Nov 10 17:49:48 user nova-compute[75100]:       <nova:creationTime>2023-11-10 17:49:48</nova:creationTime>
Nov 10 17:49:48 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 10 17:49:48 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 10 17:49:48 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 10 17:49:48 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 10 17:49:48 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 17:49:48 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 10 17:49:48 user nova-compute[75100]:       </nova:flavor>
Nov 10 17:49:48 user nova-compute[75100]:       <nova:owner>
Nov 10 17:49:48 user nova-compute[75100]:         <nova:user uuid="da45741ccb5d4b00a0784d7ef9063243">tempest-ServerActionsTestOtherB-1027676823-project-member</nova:user>
Nov 10 17:49:48 user nova-compute[75100]:         <nova:project uuid="1e95560897fb46258db0ecd7dc7b9294">tempest-ServerActionsTestOtherB-1027676823</nova:project>
Nov 10 17:49:48 user nova-compute[75100]:       </nova:owner>
Nov 10 17:49:48 user nova-compute[75100]:       <nova:root type="image" uuid="e3cc5321-4d40-49ee-885c-700e14741732"/>
Nov 10 17:49:48 user nova-compute[75100]:       <nova:ports>
Nov 10 17:49:48 user nova-compute[75100]:         <nova:port uuid="6e9b2058-6104-4f6c-8c72-f5f15d0d116b">
Nov 10 17:49:48 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 10 17:49:48 user nova-compute[75100]:         </nova:port>
Nov 10 17:49:48 user nova-compute[75100]:       </nova:ports>
Nov 10 17:49:48 user nova-compute[75100]:     </nova:instance>
Nov 10 17:49:48 user nova-compute[75100]:   </metadata>
Nov 10 17:49:48 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 10 17:49:48 user nova-compute[75100]:     <system>
Nov 10 17:49:48 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 17:49:48 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 10 17:49:48 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 10 17:49:48 user nova-compute[75100]:       <entry name="serial">eb430407-f836-4510-899f-a5f5d60c73f3</entry>
Nov 10 17:49:48 user nova-compute[75100]:       <entry name="uuid">eb430407-f836-4510-899f-a5f5d60c73f3</entry>
Nov 10 17:49:48 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 10 17:49:48 user nova-compute[75100]:     </system>
Nov 10 17:49:48 user nova-compute[75100]:   </sysinfo>
Nov 10 17:49:48 user nova-compute[75100]:   <os>
Nov 10 17:49:48 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 17:49:48 user nova-compute[75100]:     <boot dev="hd"/>
Nov 10 17:49:48 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 10 17:49:48 user nova-compute[75100]:   </os>
Nov 10 17:49:48 user nova-compute[75100]:   <features>
Nov 10 17:49:48 user nova-compute[75100]:     <acpi/>
Nov 10 17:49:48 user nova-compute[75100]:     <apic/>
Nov 10 17:49:48 user nova-compute[75100]:     <vmcoreinfo/>
Nov 10 17:49:48 user nova-compute[75100]:   </features>
Nov 10 17:49:48 user nova-compute[75100]:   <clock offset="utc">
Nov 10 17:49:48 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 17:49:48 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 17:49:48 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 10 17:49:48 user nova-compute[75100]:   </clock>
Nov 10 17:49:48 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 10 17:49:48 user nova-compute[75100]:     <model>Nehalem</model>
Nov 10 17:49:48 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 17:49:48 user nova-compute[75100]:   </cpu>
Nov 10 17:49:48 user nova-compute[75100]:   <devices>
Nov 10 17:49:48 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 10 17:49:48 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 17:49:48 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3/disk"/>
Nov 10 17:49:48 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 10 17:49:48 user nova-compute[75100]:     </disk>
Nov 10 17:49:48 user nova-compute[75100]:     <interface type="ethernet">
Nov 10 17:49:48 user nova-compute[75100]:       <mac address="fa:16:3e:2f:11:f6"/>
Nov 10 17:49:48 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:49:48 user nova-compute[75100]:       <mtu size="1442"/>
Nov 10 17:49:48 user nova-compute[75100]:       <target dev="tap6e9b2058-61"/>
Nov 10 17:49:48 user nova-compute[75100]:     </interface>
Nov 10 17:49:48 user nova-compute[75100]:     <serial type="pty">
Nov 10 17:49:48 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3/console.log" append="off"/>
Nov 10 17:49:48 user nova-compute[75100]:     </serial>
Nov 10 17:49:48 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 17:49:48 user nova-compute[75100]:     <video>
Nov 10 17:49:48 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:49:48 user nova-compute[75100]:     </video>
Nov 10 17:49:48 user nova-compute[75100]:     <rng model="virtio">
Nov 10 17:49:48 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 10 17:49:48 user nova-compute[75100]:     </rng>
Nov 10 17:49:48 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 10 17:49:48 user nova-compute[75100]:     <memballoon model="virtio">
Nov 10 17:49:48 user nova-compute[75100]:       <stats period="10"/>
Nov 10 17:49:48 user nova-compute[75100]:     </memballoon>
Nov 10 17:49:48 user nova-compute[75100]:   </devices>
Nov 10 17:49:48 user nova-compute[75100]: </domain>
Nov 10 17:49:48 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 17:49:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:49:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1267762012',display_name='tempest-ServerActionsTestOtherB-server-1267762012',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1267762012',id=16,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDPSiJ0FfbNgNhKoheve47DT1uQV1oaC9CdV5NhlB12KyXHFwXlJCN0xOr09naWU21Nb1dG7o7w/ZzPU0YohVQI5ip5k2vJ5Db3SiA/LtLwk+OdOmsxEc+IoKJ74LTBECw==',key_name='tempest-keypair-1684715830',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e95560897fb46258db0ecd7dc7b9294',ramdisk_id='',reservation_id='r-55f5hxbc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1027676823',owner_user_name='tempest-ServerActionsTestOtherB-1027676823-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:49:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da45741ccb5d4b00a0784d7ef9063243',uuid=eb430407-f836-4510-899f-a5f5d60c73f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e9b2058-6104-4f6c-8c72-f5f15d0d116b", "address": "fa:16:3e:2f:11:f6", "network": {"id": "f67bc940-2f01-4255-b12e-427ffcd7e4e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-977195248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e95560897fb46258db0ecd7dc7b9294", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9b2058-61", "ovs_interfaceid": "6e9b2058-6104-4f6c-8c72-f5f15d0d116b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 17:49:48 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Converting VIF {"id": "6e9b2058-6104-4f6c-8c72-f5f15d0d116b", "address": "fa:16:3e:2f:11:f6", "network": {"id": "f67bc940-2f01-4255-b12e-427ffcd7e4e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-977195248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e95560897fb46258db0ecd7dc7b9294", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9b2058-61", "ovs_interfaceid": "6e9b2058-6104-4f6c-8c72-f5f15d0d116b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:49:48 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:11:f6,bridge_name='br-int',has_traffic_filtering=True,id=6e9b2058-6104-4f6c-8c72-f5f15d0d116b,network=Network(f67bc940-2f01-4255-b12e-427ffcd7e4e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e9b2058-61') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:49:48 user nova-compute[75100]: DEBUG os_vif [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:11:f6,bridge_name='br-int',has_traffic_filtering=True,id=6e9b2058-6104-4f6c-8c72-f5f15d0d116b,network=Network(f67bc940-2f01-4255-b12e-427ffcd7e4e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e9b2058-61') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 17:49:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:49:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:49:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 17:49:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:49:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8bc5a11a-5e00-5489-bc6d-6e57a02476e3', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:49:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:49:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:49:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:49:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6e9b2058-61, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:49:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6e9b2058-61, col_values=(('qos', UUID('cc4b7d6e-d7f1-4361-aacd-30ff9d66fa68')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:49:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6e9b2058-61, col_values=(('external_ids', {'iface-id': '6e9b2058-6104-4f6c-8c72-f5f15d0d116b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:11:f6', 'vm-uuid': 'eb430407-f836-4510-899f-a5f5d60c73f3'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:49:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:49:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:49:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:49:48 user nova-compute[75100]: INFO os_vif [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:11:f6,bridge_name='br-int',has_traffic_filtering=True,id=6e9b2058-6104-4f6c-8c72-f5f15d0d116b,network=Network(f67bc940-2f01-4255-b12e-427ffcd7e4e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e9b2058-61')
Nov 10 17:49:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 17:49:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] No VIF found with MAC fa:16:3e:2f:11:f6, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 17:49:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:49:49 user nova-compute[75100]: DEBUG nova.network.neutron [req-41ad5754-52da-4232-8127-6d360181d179 req-13f78145-76ad-4402-b9c2-b00c0b00291a service nova] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Updated VIF entry in instance network info cache for port 6e9b2058-6104-4f6c-8c72-f5f15d0d116b. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 17:49:49 user nova-compute[75100]: DEBUG nova.network.neutron [req-41ad5754-52da-4232-8127-6d360181d179 req-13f78145-76ad-4402-b9c2-b00c0b00291a service nova] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Updating instance_info_cache with network_info: [{"id": "6e9b2058-6104-4f6c-8c72-f5f15d0d116b", "address": "fa:16:3e:2f:11:f6", "network": {"id": "f67bc940-2f01-4255-b12e-427ffcd7e4e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-977195248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e95560897fb46258db0ecd7dc7b9294", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9b2058-61", "ovs_interfaceid": "6e9b2058-6104-4f6c-8c72-f5f15d0d116b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:49:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-41ad5754-52da-4232-8127-6d360181d179 req-13f78145-76ad-4402-b9c2-b00c0b00291a service nova] Releasing lock "refresh_cache-eb430407-f836-4510-899f-a5f5d60c73f3" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:49:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:49:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:49:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:49:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:49:50 user nova-compute[75100]: DEBUG nova.compute.manager [req-736fd25b-060b-4c9a-9df6-4d745e1e237f req-3ce0021a-3376-4c62-929f-eedb2d39fac0 service nova] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Received event network-vif-plugged-6e9b2058-6104-4f6c-8c72-f5f15d0d116b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:49:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-736fd25b-060b-4c9a-9df6-4d745e1e237f req-3ce0021a-3376-4c62-929f-eedb2d39fac0 service nova] Acquiring lock "eb430407-f836-4510-899f-a5f5d60c73f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:49:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-736fd25b-060b-4c9a-9df6-4d745e1e237f req-3ce0021a-3376-4c62-929f-eedb2d39fac0 service nova] Lock "eb430407-f836-4510-899f-a5f5d60c73f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:49:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-736fd25b-060b-4c9a-9df6-4d745e1e237f req-3ce0021a-3376-4c62-929f-eedb2d39fac0 service nova] Lock "eb430407-f836-4510-899f-a5f5d60c73f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:49:50 user nova-compute[75100]: DEBUG nova.compute.manager [req-736fd25b-060b-4c9a-9df6-4d745e1e237f req-3ce0021a-3376-4c62-929f-eedb2d39fac0 service nova] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] No waiting events found dispatching network-vif-plugged-6e9b2058-6104-4f6c-8c72-f5f15d0d116b {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:49:50 user nova-compute[75100]: WARNING nova.compute.manager [req-736fd25b-060b-4c9a-9df6-4d745e1e237f req-3ce0021a-3376-4c62-929f-eedb2d39fac0 service nova] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Received unexpected event network-vif-plugged-6e9b2058-6104-4f6c-8c72-f5f15d0d116b for instance with vm_state building and task_state spawning.
Nov 10 17:49:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:49:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:49:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:49:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:49:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 17:49:52 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Creating image(s)
Nov 10 17:49:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Did not create local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 17:49:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Ensure instance console log exists: /opt/stack/data/nova/instances/111bd74e-2943-4f12-9514-b564cf26dadb/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 17:49:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:49:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:49:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:49:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Start _get_guest_xml network_info=[{"id": "26f643d1-0961-49af-bde1-32d1a6b0941d", "address": "fa:16:3e:45:39:04", "network": {"id": "2fcf93f6-0be9-4c44-8caa-e5e556d88de8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1797631123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69fe121924d471abc0e62a4a32e4a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26f643d1-09", "ovs_interfaceid": "26f643d1-0961-49af-bde1-32d1a6b0941d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Yhtwynlz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '111bd74e-2943-4f12-9514-b564cf26dadb', 'attached_at': '', 'detached_at': '', 'volume_id': '23131533-b27f-4598-84b7-44ed1d8878cb', 'serial': '23131533-b27f-4598-84b7-44ed1d8878cb'}, 'mount_device': '/dev/vda', 'attachment_id': '96eadaaa-9cc7-47e8-80dd-18e807c3be2c', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 17:49:52 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 10 17:49:52 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 10 17:49:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 17:49:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 17:49:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 17:49:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 17:49:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 17:49:52 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T17:40:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 17:49:52 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 17:49:52 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 17:49:52 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 17:49:52 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 17:49:52 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 17:49:52 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 17:49:52 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 17:49:52 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 17:49:52 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 17:49:52 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 17:49:52 user nova-compute[75100]: DEBUG nova.objects.instance [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Lazy-loading 'vcpu_model' on Instance uuid 111bd74e-2943-4f12-9514-b564cf26dadb {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:49:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 17:49:52 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Yhtwynlz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 17:49:52 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 10 17:49:52 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 17:49:52 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.008s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 17:49:52 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 10 17:49:52 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 17:49:52 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 17:49:52 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 17:49:52 user nova-compute[75100]: DEBUG nova.compute.manager [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 17:49:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 17:49:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb -p 172.16.0.220:3260 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:49:52 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Instance spawned successfully.
Nov 10 17:49:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 17:49:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:49:52 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e886b5c4-6508-46bc-9aa8-1a2bb87a5070]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:49:52 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 17:49:52 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:49:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb -p 172.16.0.220:3260 --interface default --op new {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:49:52 user nova-compute[75100]: DEBUG nova.compute.manager [req-49a51e4b-6774-47ae-b874-c39692df5315 req-1aaa1c84-f603-41a5-b494-216b9db31d7e service nova] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Received event network-vif-plugged-6e9b2058-6104-4f6c-8c72-f5f15d0d116b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:49:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-49a51e4b-6774-47ae-b874-c39692df5315 req-1aaa1c84-f603-41a5-b494-216b9db31d7e service nova] Acquiring lock "eb430407-f836-4510-899f-a5f5d60c73f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:49:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-49a51e4b-6774-47ae-b874-c39692df5315 req-1aaa1c84-f603-41a5-b494-216b9db31d7e service nova] Lock "eb430407-f836-4510-899f-a5f5d60c73f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:49:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-49a51e4b-6774-47ae-b874-c39692df5315 req-1aaa1c84-f603-41a5-b494-216b9db31d7e service nova] Lock "eb430407-f836-4510-899f-a5f5d60c73f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:49:52 user nova-compute[75100]: DEBUG nova.compute.manager [req-49a51e4b-6774-47ae-b874-c39692df5315 req-1aaa1c84-f603-41a5-b494-216b9db31d7e service nova] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] No waiting events found dispatching network-vif-plugged-6e9b2058-6104-4f6c-8c72-f5f15d0d116b {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:49:52 user nova-compute[75100]: WARNING nova.compute.manager [req-49a51e4b-6774-47ae-b874-c39692df5315 req-1aaa1c84-f603-41a5-b494-216b9db31d7e service nova] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Received unexpected event network-vif-plugged-6e9b2058-6104-4f6c-8c72-f5f15d0d116b for instance with vm_state building and task_state spawning.
Nov 10 17:49:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:49:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:49:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:49:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:49:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:49:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:49:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:49:52 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec965e8-b3b7-463e-befb-5ceba4bf8bac]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb] added\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:49:52 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb] added
Nov 10 17:49:52 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:49:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:49:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:49:52 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8faa95e0-0166-4a04-8301-e4b2057ed008]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:49:52 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:49:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:49:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:49:52 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[23380b85-7eac-461d-9b56-6a13fd63c7a2]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:49:52 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:49:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Yhtwynlz {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:49:52 user nova-compute[75100]: INFO nova.compute.manager [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Took 8.56 seconds to spawn the instance on the hypervisor.
Nov 10 17:49:52 user nova-compute[75100]: DEBUG nova.compute.manager [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 17:49:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Yhtwynlz" returned: 0 in 0.025s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:49:52 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ea4074-8f4b-4cca-b95d-a1f101d316a8]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:49:52 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'Yhtwynlz'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:49:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:49:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:49:52 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ead216-a978-46d1-bee2-ee4e5d44c92e]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:49:52 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:49:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:49:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.023s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:49:52 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4172dbe3-a9f1-49b5-a267-1fa003aeb70a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:49:52 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 10 17:49:52 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:49:52 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 10 17:49:52 user nova-compute[75100]:  {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 17:49:52 user nova-compute[75100]: WARNING os_brick.initiator.connectors.iscsi [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 10 17:49:52 user nova-compute[75100]: : NotImplementedError
Nov 10 17:49:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb -p 172.16.0.220:3260 --login {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:49:52 user nova-compute[75100]: INFO nova.compute.manager [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Took 9.63 seconds to build instance.
Nov 10 17:49:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-55d462ca-1b23-48ed-85c5-44d3da9f7d25 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Lock "eb430407-f836-4510-899f-a5f5d60c73f3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.798s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:49:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:49:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:49:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:49:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:49:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb -p 172.16.0.220:3260 --login" returned: 0 in 1.063s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:49:53 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1da1644-bf53-4d77-bb83-3b1c8301fafb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:49:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb, portal: 172.16.0.220,3260]
Nov 10 17:49:53 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb, portal: 172.16.0.220,3260] successful.
Nov 10 17:49:53 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:49:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:49:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:49:53 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a9fc98-34b1-4cca-a270-0f78ad877dc1]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:49:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:49:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:49:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:49:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4146385-d096-492d-9e1b-967796dd6eea]: (4, ('tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:49:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb (non-flash)
Nov 10 17:49:54 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:49:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] iscsi session list stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb (non-flash)
Nov 10 17:49:54 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 17:49:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.375s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 17:49:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 17:49:54 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] HCTL ('33', '-', '-', 0) found on session 9 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 17:49:54 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 17:49:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:49:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:49:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[947dc9e6-b9db-467e-96e6-ab7f72c97b7f]: (4, ('- - 0', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:49:54 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Searching for a device in session 9 and hctl ['33', '*', '*', 0] yield: None {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 17:49:55 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Searching for a device in session 9 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 17:49:55 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Yhtwynlz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 17:49:55 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.418s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 17:49:55 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] <== connect_volume: return (2427ms) {'type': 'block', 'scsi_wwn': '23665616436363238', 'path': '/dev/sdb'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 17:49:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665616436363238', 'path': '/dev/sdb'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 17:49:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T17:46:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-483449440',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-51640417',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrKIMtk4kEwRtjbNDdESYG/eisyJknH+FhllMfNkzOhc8u5uNZOhOKf+vnV4PIFkkxSuZX7HodgT53XzLo5dAjQLzj42zR+o2Z9UiOkxsnJ+ZOoOQHi2OVpW8H5WpdMew==',key_name='tempest-keypair-1759515291',keypairs=<?>,launch_index=0,launched_at=2023-11-10T17:46:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d69fe121924d471abc0e62a4a32e4a75',ramdisk_id='',reservation_id='r-m3nm1elv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-2085671475',owner_user_name='tempest-ServerActionsV293TestJSON-2085671475-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:49:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bad2868941f0446f8674b47a316fa757',uuid=111bd74e-2943-4f12-9514-b564cf26dadb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26f643d1-0961-49af-bde1-32d1a6b0941d", "address": "fa:16:3e:45:39:04", "network": {"id": "2fcf93f6-0be9-4c44-8caa-e5e556d88de8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1797631123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69fe121924d471abc0e62a4a32e4a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26f643d1-09", "ovs_interfaceid": "26f643d1-0961-49af-bde1-32d1a6b0941d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 17:49:55 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Converting VIF {"id": "26f643d1-0961-49af-bde1-32d1a6b0941d", "address": "fa:16:3e:45:39:04", "network": {"id": "2fcf93f6-0be9-4c44-8caa-e5e556d88de8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1797631123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69fe121924d471abc0e62a4a32e4a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26f643d1-09", "ovs_interfaceid": "26f643d1-0961-49af-bde1-32d1a6b0941d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:49:55 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:39:04,bridge_name='br-int',has_traffic_filtering=True,id=26f643d1-0961-49af-bde1-32d1a6b0941d,network=Network(2fcf93f6-0be9-4c44-8caa-e5e556d88de8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26f643d1-09') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:49:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] End _get_guest_xml xml=<domain type="kvm">
Nov 10 17:49:55 user nova-compute[75100]:   <uuid>111bd74e-2943-4f12-9514-b564cf26dadb</uuid>
Nov 10 17:49:55 user nova-compute[75100]:   <name>instance-0000000a</name>
Nov 10 17:49:55 user nova-compute[75100]:   <memory>524288</memory>
Nov 10 17:49:55 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 10 17:49:55 user nova-compute[75100]:   <metadata>
Nov 10 17:49:55 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 17:49:55 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 10 17:49:55 user nova-compute[75100]:       <nova:name>tempest-ServerActionsV293TestJSON-server-483449440</nova:name>
Nov 10 17:49:55 user nova-compute[75100]:       <nova:creationTime>2023-11-10 17:49:52</nova:creationTime>
Nov 10 17:49:55 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 10 17:49:55 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 10 17:49:55 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 10 17:49:55 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 10 17:49:55 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 17:49:55 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 10 17:49:55 user nova-compute[75100]:       </nova:flavor>
Nov 10 17:49:55 user nova-compute[75100]:       <nova:owner>
Nov 10 17:49:55 user nova-compute[75100]:         <nova:user uuid="bad2868941f0446f8674b47a316fa757">tempest-ServerActionsV293TestJSON-2085671475-project-member</nova:user>
Nov 10 17:49:55 user nova-compute[75100]:         <nova:project uuid="d69fe121924d471abc0e62a4a32e4a75">tempest-ServerActionsV293TestJSON-2085671475</nova:project>
Nov 10 17:49:55 user nova-compute[75100]:       </nova:owner>
Nov 10 17:49:55 user nova-compute[75100]:       <nova:ports>
Nov 10 17:49:55 user nova-compute[75100]:         <nova:port uuid="26f643d1-0961-49af-bde1-32d1a6b0941d">
Nov 10 17:49:55 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 10 17:49:55 user nova-compute[75100]:         </nova:port>
Nov 10 17:49:55 user nova-compute[75100]:       </nova:ports>
Nov 10 17:49:55 user nova-compute[75100]:     </nova:instance>
Nov 10 17:49:55 user nova-compute[75100]:   </metadata>
Nov 10 17:49:55 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 10 17:49:55 user nova-compute[75100]:     <system>
Nov 10 17:49:55 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 17:49:55 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 10 17:49:55 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 10 17:49:55 user nova-compute[75100]:       <entry name="serial">111bd74e-2943-4f12-9514-b564cf26dadb</entry>
Nov 10 17:49:55 user nova-compute[75100]:       <entry name="uuid">111bd74e-2943-4f12-9514-b564cf26dadb</entry>
Nov 10 17:49:55 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 10 17:49:55 user nova-compute[75100]:     </system>
Nov 10 17:49:55 user nova-compute[75100]:   </sysinfo>
Nov 10 17:49:55 user nova-compute[75100]:   <os>
Nov 10 17:49:55 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 17:49:55 user nova-compute[75100]:     <boot dev="hd"/>
Nov 10 17:49:55 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 10 17:49:55 user nova-compute[75100]:   </os>
Nov 10 17:49:55 user nova-compute[75100]:   <features>
Nov 10 17:49:55 user nova-compute[75100]:     <acpi/>
Nov 10 17:49:55 user nova-compute[75100]:     <apic/>
Nov 10 17:49:55 user nova-compute[75100]:     <vmcoreinfo/>
Nov 10 17:49:55 user nova-compute[75100]:   </features>
Nov 10 17:49:55 user nova-compute[75100]:   <clock offset="utc">
Nov 10 17:49:55 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 17:49:55 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 17:49:55 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 10 17:49:55 user nova-compute[75100]:   </clock>
Nov 10 17:49:55 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 10 17:49:55 user nova-compute[75100]:     <model>Nehalem</model>
Nov 10 17:49:55 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 17:49:55 user nova-compute[75100]:   </cpu>
Nov 10 17:49:55 user nova-compute[75100]:   <devices>
Nov 10 17:49:55 user nova-compute[75100]:     <disk type="block" device="disk">
Nov 10 17:49:55 user nova-compute[75100]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 17:49:55 user nova-compute[75100]:       <source dev="/dev/sdb"/>
Nov 10 17:49:55 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 10 17:49:55 user nova-compute[75100]:       <serial>23131533-b27f-4598-84b7-44ed1d8878cb</serial>
Nov 10 17:49:55 user nova-compute[75100]:     </disk>
Nov 10 17:49:55 user nova-compute[75100]:     <interface type="ethernet">
Nov 10 17:49:55 user nova-compute[75100]:       <mac address="fa:16:3e:45:39:04"/>
Nov 10 17:49:55 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:49:55 user nova-compute[75100]:       <mtu size="1442"/>
Nov 10 17:49:55 user nova-compute[75100]:       <target dev="tap26f643d1-09"/>
Nov 10 17:49:55 user nova-compute[75100]:     </interface>
Nov 10 17:49:55 user nova-compute[75100]:     <serial type="pty">
Nov 10 17:49:55 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/111bd74e-2943-4f12-9514-b564cf26dadb/console.log" append="off"/>
Nov 10 17:49:55 user nova-compute[75100]:     </serial>
Nov 10 17:49:55 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 17:49:55 user nova-compute[75100]:     <video>
Nov 10 17:49:55 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:49:55 user nova-compute[75100]:     </video>
Nov 10 17:49:55 user nova-compute[75100]:     <rng model="virtio">
Nov 10 17:49:55 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 10 17:49:55 user nova-compute[75100]:     </rng>
Nov 10 17:49:55 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 10 17:49:55 user nova-compute[75100]:     <memballoon model="virtio">
Nov 10 17:49:55 user nova-compute[75100]:       <stats period="10"/>
Nov 10 17:49:55 user nova-compute[75100]:     </memballoon>
Nov 10 17:49:55 user nova-compute[75100]:   </devices>
Nov 10 17:49:55 user nova-compute[75100]: </domain>
Nov 10 17:49:55 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 17:49:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T17:46:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-483449440',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-51640417',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrKIMtk4kEwRtjbNDdESYG/eisyJknH+FhllMfNkzOhc8u5uNZOhOKf+vnV4PIFkkxSuZX7HodgT53XzLo5dAjQLzj42zR+o2Z9UiOkxsnJ+ZOoOQHi2OVpW8H5WpdMew==',key_name='tempest-keypair-1759515291',keypairs=<?>,launch_index=0,launched_at=2023-11-10T17:46:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d69fe121924d471abc0e62a4a32e4a75',ramdisk_id='',reservation_id='r-m3nm1elv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-2085671475',owner_user_name='tempest-ServerActionsV293TestJSON-2085671475-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:49:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bad2868941f0446f8674b47a316fa757',uuid=111bd74e-2943-4f12-9514-b564cf26dadb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26f643d1-0961-49af-bde1-32d1a6b0941d", "address": "fa:16:3e:45:39:04", "network": {"id": "2fcf93f6-0be9-4c44-8caa-e5e556d88de8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1797631123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69fe121924d471abc0e62a4a32e4a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26f643d1-09", "ovs_interfaceid": "26f643d1-0961-49af-bde1-32d1a6b0941d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 17:49:55 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Converting VIF {"id": "26f643d1-0961-49af-bde1-32d1a6b0941d", "address": "fa:16:3e:45:39:04", "network": {"id": "2fcf93f6-0be9-4c44-8caa-e5e556d88de8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1797631123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69fe121924d471abc0e62a4a32e4a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26f643d1-09", "ovs_interfaceid": "26f643d1-0961-49af-bde1-32d1a6b0941d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:49:55 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:39:04,bridge_name='br-int',has_traffic_filtering=True,id=26f643d1-0961-49af-bde1-32d1a6b0941d,network=Network(2fcf93f6-0be9-4c44-8caa-e5e556d88de8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26f643d1-09') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:49:55 user nova-compute[75100]: DEBUG os_vif [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:39:04,bridge_name='br-int',has_traffic_filtering=True,id=26f643d1-0961-49af-bde1-32d1a6b0941d,network=Network(2fcf93f6-0be9-4c44-8caa-e5e556d88de8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26f643d1-09') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 17:49:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:49:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:49:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 17:49:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:49:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f9fa2aab-b070-5227-a192-3feafb3d8f31', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:49:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:49:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:49:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:49:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap26f643d1-09, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:49:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap26f643d1-09, col_values=(('qos', UUID('e6b17cbd-072a-4fa0-a5e2-77a9f180c8d1')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:49:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap26f643d1-09, col_values=(('external_ids', {'iface-id': '26f643d1-0961-49af-bde1-32d1a6b0941d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:39:04', 'vm-uuid': '111bd74e-2943-4f12-9514-b564cf26dadb'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:49:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:49:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:49:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:49:55 user nova-compute[75100]: INFO os_vif [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:39:04,bridge_name='br-int',has_traffic_filtering=True,id=26f643d1-0961-49af-bde1-32d1a6b0941d,network=Network(2fcf93f6-0be9-4c44-8caa-e5e556d88de8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26f643d1-09')
Nov 10 17:49:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 17:49:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] No VIF found with MAC fa:16:3e:45:39:04, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 17:49:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] Acquiring lock "b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:49:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] Lock "b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:49:55 user nova-compute[75100]: DEBUG nova.compute.manager [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] [instance: b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 17:49:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:49:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:49:55 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 17:49:55 user nova-compute[75100]: INFO nova.compute.claims [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] [instance: b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9] Claim successful on node user
Nov 10 17:49:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:49:56 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:49:56 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:49:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.567s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:49:56 user nova-compute[75100]: DEBUG nova.compute.manager [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] [instance: b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 17:49:56 user nova-compute[75100]: DEBUG nova.compute.manager [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] [instance: b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 17:49:56 user nova-compute[75100]: DEBUG nova.network.neutron [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] [instance: b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 17:49:56 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] [instance: b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 17:49:56 user nova-compute[75100]: DEBUG nova.compute.manager [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] [instance: b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 17:49:56 user nova-compute[75100]: DEBUG nova.policy [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '039410b87e754d8d9a5de124c7e74d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66facb836f9404c81dcae56f826a4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 17:49:56 user nova-compute[75100]: DEBUG nova.compute.manager [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] [instance: b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 17:49:56 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] [instance: b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 17:49:56 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] [instance: b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9] Creating image(s)
Nov 10 17:49:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] Acquiring lock "/opt/stack/data/nova/instances/b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:49:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] Lock "/opt/stack/data/nova/instances/b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.015s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:49:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] Lock "/opt/stack/data/nova/instances/b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:49:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:49:56 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:49:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:49:56 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.246s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:49:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] Acquiring lock "818b9e28e061d41a38d903968b229be2ed9ba520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:49:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:49:56 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:49:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.326s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:49:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:49:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9/disk 1073741824" returned: 0 in 0.069s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:49:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.403s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:49:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:49:57 user nova-compute[75100]: DEBUG nova.compute.manager [req-325b3e84-5196-4a08-8d2c-eb385cdea260 req-f668ac30-d961-4549-8da5-2d4fc5b49b04 service nova] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Received event network-vif-plugged-26f643d1-0961-49af-bde1-32d1a6b0941d {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:49:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-325b3e84-5196-4a08-8d2c-eb385cdea260 req-f668ac30-d961-4549-8da5-2d4fc5b49b04 service nova] Acquiring lock "111bd74e-2943-4f12-9514-b564cf26dadb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:49:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-325b3e84-5196-4a08-8d2c-eb385cdea260 req-f668ac30-d961-4549-8da5-2d4fc5b49b04 service nova] Lock "111bd74e-2943-4f12-9514-b564cf26dadb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:49:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-325b3e84-5196-4a08-8d2c-eb385cdea260 req-f668ac30-d961-4549-8da5-2d4fc5b49b04 service nova] Lock "111bd74e-2943-4f12-9514-b564cf26dadb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:49:57 user nova-compute[75100]: DEBUG nova.compute.manager [req-325b3e84-5196-4a08-8d2c-eb385cdea260 req-f668ac30-d961-4549-8da5-2d4fc5b49b04 service nova] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] No waiting events found dispatching network-vif-plugged-26f643d1-0961-49af-bde1-32d1a6b0941d {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:49:57 user nova-compute[75100]: WARNING nova.compute.manager [req-325b3e84-5196-4a08-8d2c-eb385cdea260 req-f668ac30-d961-4549-8da5-2d4fc5b49b04 service nova] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Received unexpected event network-vif-plugged-26f643d1-0961-49af-bde1-32d1a6b0941d for instance with vm_state active and task_state rebuild_spawning.
Nov 10 17:49:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:49:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:49:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.243s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:49:57 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 17:49:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:49:57 user nova-compute[75100]: DEBUG nova.network.neutron [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] [instance: b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9] Successfully created port: 51f4f44b-6b18-417e-b33c-49fbfe8c4563 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 17:49:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:49:57 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] Cannot resize image /opt/stack/data/nova/instances/b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 17:49:57 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] [instance: b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 17:49:57 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] [instance: b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9] Ensure instance console log exists: /opt/stack/data/nova/instances/b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 17:49:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:49:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:49:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:49:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Acquiring lock "22c021d9-c8e4-455d-8e2a-a9cdfbb38f75" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:49:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "22c021d9-c8e4-455d-8e2a-a9cdfbb38f75" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:49:58 user nova-compute[75100]: DEBUG nova.compute.manager [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 17:49:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:49:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:49:58 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 17:49:58 user nova-compute[75100]: INFO nova.compute.claims [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Claim successful on node user
Nov 10 17:49:58 user nova-compute[75100]: DEBUG nova.network.neutron [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] [instance: b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9] Successfully updated port: 51f4f44b-6b18-417e-b33c-49fbfe8c4563 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 17:49:58 user nova-compute[75100]: DEBUG nova.compute.manager [req-543afbee-871f-4b78-acf0-b189745bea4c req-91ca887d-94eb-4ee4-9ad8-569910ba8e4f service nova] [instance: b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9] Received event network-changed-51f4f44b-6b18-417e-b33c-49fbfe8c4563 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:49:58 user nova-compute[75100]: DEBUG nova.compute.manager [req-543afbee-871f-4b78-acf0-b189745bea4c req-91ca887d-94eb-4ee4-9ad8-569910ba8e4f service nova] [instance: b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9] Refreshing instance network info cache due to event network-changed-51f4f44b-6b18-417e-b33c-49fbfe8c4563. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 17:49:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-543afbee-871f-4b78-acf0-b189745bea4c req-91ca887d-94eb-4ee4-9ad8-569910ba8e4f service nova] Acquiring lock "refresh_cache-b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:49:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-543afbee-871f-4b78-acf0-b189745bea4c req-91ca887d-94eb-4ee4-9ad8-569910ba8e4f service nova] Acquired lock "refresh_cache-b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:49:58 user nova-compute[75100]: DEBUG nova.network.neutron [req-543afbee-871f-4b78-acf0-b189745bea4c req-91ca887d-94eb-4ee4-9ad8-569910ba8e4f service nova] [instance: b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9] Refreshing network info cache for port 51f4f44b-6b18-417e-b33c-49fbfe8c4563 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 17:49:58 user nova-compute[75100]: DEBUG nova.network.neutron [req-543afbee-871f-4b78-acf0-b189745bea4c req-91ca887d-94eb-4ee4-9ad8-569910ba8e4f service nova] [instance: b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 17:49:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:49:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] Acquiring lock "refresh_cache-b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:49:59 user nova-compute[75100]: DEBUG nova.network.neutron [req-543afbee-871f-4b78-acf0-b189745bea4c req-91ca887d-94eb-4ee4-9ad8-569910ba8e4f service nova] [instance: b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:49:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-543afbee-871f-4b78-acf0-b189745bea4c req-91ca887d-94eb-4ee4-9ad8-569910ba8e4f service nova] Releasing lock "refresh_cache-b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:49:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] Acquired lock "refresh_cache-b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:49:59 user nova-compute[75100]: DEBUG nova.network.neutron [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] [instance: b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 17:49:59 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:49:59 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:49:59 user nova-compute[75100]: DEBUG nova.network.neutron [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] [instance: b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 17:49:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.702s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:49:59 user nova-compute[75100]: DEBUG nova.compute.manager [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 17:49:59 user nova-compute[75100]: DEBUG nova.compute.manager [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 17:49:59 user nova-compute[75100]: DEBUG nova.network.neutron [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 17:49:59 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 17:49:59 user nova-compute[75100]: DEBUG nova.compute.manager [req-3931a0f1-20bb-41b9-b610-d2645d759fa4 req-ee69fb1f-27d7-4ca2-bcbe-ffef638b37f8 service nova] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Received event network-vif-plugged-26f643d1-0961-49af-bde1-32d1a6b0941d {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:49:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3931a0f1-20bb-41b9-b610-d2645d759fa4 req-ee69fb1f-27d7-4ca2-bcbe-ffef638b37f8 service nova] Acquiring lock "111bd74e-2943-4f12-9514-b564cf26dadb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:49:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3931a0f1-20bb-41b9-b610-d2645d759fa4 req-ee69fb1f-27d7-4ca2-bcbe-ffef638b37f8 service nova] Lock "111bd74e-2943-4f12-9514-b564cf26dadb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:49:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3931a0f1-20bb-41b9-b610-d2645d759fa4 req-ee69fb1f-27d7-4ca2-bcbe-ffef638b37f8 service nova] Lock "111bd74e-2943-4f12-9514-b564cf26dadb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:49:59 user nova-compute[75100]: DEBUG nova.compute.manager [req-3931a0f1-20bb-41b9-b610-d2645d759fa4 req-ee69fb1f-27d7-4ca2-bcbe-ffef638b37f8 service nova] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] No waiting events found dispatching network-vif-plugged-26f643d1-0961-49af-bde1-32d1a6b0941d {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:49:59 user nova-compute[75100]: WARNING nova.compute.manager [req-3931a0f1-20bb-41b9-b610-d2645d759fa4 req-ee69fb1f-27d7-4ca2-bcbe-ffef638b37f8 service nova] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Received unexpected event network-vif-plugged-26f643d1-0961-49af-bde1-32d1a6b0941d for instance with vm_state active and task_state rebuild_spawning.
Nov 10 17:49:59 user nova-compute[75100]: DEBUG nova.compute.manager [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 17:49:59 user nova-compute[75100]: DEBUG nova.policy [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9f4df424af2343a2a27e869502651216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7bb141ef59487dbb2ce6243c5002af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 17:49:59 user nova-compute[75100]: DEBUG nova.compute.manager [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 17:49:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 17:49:59 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Instance spawned successfully.
Nov 10 17:49:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 17:49:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:49:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:49:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:49:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:49:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:49:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:49:59 user nova-compute[75100]: DEBUG nova.compute.manager [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 17:49:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 17:49:59 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Creating image(s)
Nov 10 17:49:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Acquiring lock "/opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:49:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "/opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:49:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "/opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:49:59 user nova-compute[75100]: DEBUG nova.compute.manager [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 17:49:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:49:59 user nova-compute[75100]: DEBUG nova.network.neutron [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] [instance: b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9] Updating instance_info_cache with network_info: [{"id": "51f4f44b-6b18-417e-b33c-49fbfe8c4563", "address": "fa:16:3e:2e:66:3b", "network": {"id": "2ff6ad81-8918-48ea-85e6-54f44265bc4a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1097138698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b66facb836f9404c81dcae56f826a4ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51f4f44b-6b", "ovs_interfaceid": "51f4f44b-6b18-417e-b33c-49fbfe8c4563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:49:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] Releasing lock "refresh_cache-b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:49:59 user nova-compute[75100]: DEBUG nova.compute.manager [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] [instance: b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9] Instance network_info: |[{"id": "51f4f44b-6b18-417e-b33c-49fbfe8c4563", "address": "fa:16:3e:2e:66:3b", "network": {"id": "2ff6ad81-8918-48ea-85e6-54f44265bc4a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1097138698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b66facb836f9404c81dcae56f826a4ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51f4f44b-6b", "ovs_interfaceid": "51f4f44b-6b18-417e-b33c-49fbfe8c4563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 17:49:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] [instance: b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9] Start _get_guest_xml network_info=[{"id": "51f4f44b-6b18-417e-b33c-49fbfe8c4563", "address": "fa:16:3e:2e:66:3b", "network": {"id": "2ff6ad81-8918-48ea-85e6-54f44265bc4a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1097138698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b66facb836f9404c81dcae56f826a4ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51f4f44b-6b", "ovs_interfaceid": "51f4f44b-6b18-417e-b33c-49fbfe8c4563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'e3cc5321-4d40-49ee-885c-700e14741732'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 17:49:59 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:49:59 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:49:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 17:49:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 17:49:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 17:49:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 17:49:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 17:49:59 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T17:40:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 17:49:59 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 17:49:59 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 17:49:59 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 17:49:59 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 17:49:59 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 17:49:59 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 17:49:59 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 17:49:59 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 17:49:59 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 17:49:59 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 17:49:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:49:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1630873709',display_name='tempest-VolumesActionsTest-instance-1630873709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1630873709',id=17,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b66facb836f9404c81dcae56f826a4ab',ramdisk_id='',reservation_id='r-103e3my5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-888970826',owner_user_name='tempest-VolumesActionsTest-888970826-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:49:56Z,user_data=None,user_id='039410b87e754d8d9a5de124c7e74d3b',uuid=b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51f4f44b-6b18-417e-b33c-49fbfe8c4563", "address": "fa:16:3e:2e:66:3b", "network": {"id": "2ff6ad81-8918-48ea-85e6-54f44265bc4a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1097138698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b66facb836f9404c81dcae56f826a4ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51f4f44b-6b", "ovs_interfaceid": "51f4f44b-6b18-417e-b33c-49fbfe8c4563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 17:49:59 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] Converting VIF {"id": "51f4f44b-6b18-417e-b33c-49fbfe8c4563", "address": "fa:16:3e:2e:66:3b", "network": {"id": "2ff6ad81-8918-48ea-85e6-54f44265bc4a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1097138698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b66facb836f9404c81dcae56f826a4ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51f4f44b-6b", "ovs_interfaceid": "51f4f44b-6b18-417e-b33c-49fbfe8c4563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:49:59 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:66:3b,bridge_name='br-int',has_traffic_filtering=True,id=51f4f44b-6b18-417e-b33c-49fbfe8c4563,network=Network(2ff6ad81-8918-48ea-85e6-54f44265bc4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51f4f44b-6b') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:49:59 user nova-compute[75100]: DEBUG nova.objects.instance [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] Lazy-loading 'pci_devices' on Instance uuid b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:49:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:49:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:49:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:49:59 user nova-compute[75100]: DEBUG nova.objects.instance [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75100) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 10 17:50:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] [instance: b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9] End _get_guest_xml xml=<domain type="kvm">
Nov 10 17:50:00 user nova-compute[75100]:   <uuid>b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9</uuid>
Nov 10 17:50:00 user nova-compute[75100]:   <name>instance-00000011</name>
Nov 10 17:50:00 user nova-compute[75100]:   <memory>524288</memory>
Nov 10 17:50:00 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 10 17:50:00 user nova-compute[75100]:   <metadata>
Nov 10 17:50:00 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 17:50:00 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 10 17:50:00 user nova-compute[75100]:       <nova:name>tempest-VolumesActionsTest-instance-1630873709</nova:name>
Nov 10 17:50:00 user nova-compute[75100]:       <nova:creationTime>2023-11-10 17:49:59</nova:creationTime>
Nov 10 17:50:00 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 10 17:50:00 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 10 17:50:00 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 10 17:50:00 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 10 17:50:00 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 17:50:00 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 10 17:50:00 user nova-compute[75100]:       </nova:flavor>
Nov 10 17:50:00 user nova-compute[75100]:       <nova:owner>
Nov 10 17:50:00 user nova-compute[75100]:         <nova:user uuid="039410b87e754d8d9a5de124c7e74d3b">tempest-VolumesActionsTest-888970826-project-member</nova:user>
Nov 10 17:50:00 user nova-compute[75100]:         <nova:project uuid="b66facb836f9404c81dcae56f826a4ab">tempest-VolumesActionsTest-888970826</nova:project>
Nov 10 17:50:00 user nova-compute[75100]:       </nova:owner>
Nov 10 17:50:00 user nova-compute[75100]:       <nova:root type="image" uuid="e3cc5321-4d40-49ee-885c-700e14741732"/>
Nov 10 17:50:00 user nova-compute[75100]:       <nova:ports>
Nov 10 17:50:00 user nova-compute[75100]:         <nova:port uuid="51f4f44b-6b18-417e-b33c-49fbfe8c4563">
Nov 10 17:50:00 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 10 17:50:00 user nova-compute[75100]:         </nova:port>
Nov 10 17:50:00 user nova-compute[75100]:       </nova:ports>
Nov 10 17:50:00 user nova-compute[75100]:     </nova:instance>
Nov 10 17:50:00 user nova-compute[75100]:   </metadata>
Nov 10 17:50:00 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 10 17:50:00 user nova-compute[75100]:     <system>
Nov 10 17:50:00 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 17:50:00 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 10 17:50:00 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 10 17:50:00 user nova-compute[75100]:       <entry name="serial">b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9</entry>
Nov 10 17:50:00 user nova-compute[75100]:       <entry name="uuid">b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9</entry>
Nov 10 17:50:00 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 10 17:50:00 user nova-compute[75100]:     </system>
Nov 10 17:50:00 user nova-compute[75100]:   </sysinfo>
Nov 10 17:50:00 user nova-compute[75100]:   <os>
Nov 10 17:50:00 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 17:50:00 user nova-compute[75100]:     <boot dev="hd"/>
Nov 10 17:50:00 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 10 17:50:00 user nova-compute[75100]:   </os>
Nov 10 17:50:00 user nova-compute[75100]:   <features>
Nov 10 17:50:00 user nova-compute[75100]:     <acpi/>
Nov 10 17:50:00 user nova-compute[75100]:     <apic/>
Nov 10 17:50:00 user nova-compute[75100]:     <vmcoreinfo/>
Nov 10 17:50:00 user nova-compute[75100]:   </features>
Nov 10 17:50:00 user nova-compute[75100]:   <clock offset="utc">
Nov 10 17:50:00 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 17:50:00 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 17:50:00 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 10 17:50:00 user nova-compute[75100]:   </clock>
Nov 10 17:50:00 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 10 17:50:00 user nova-compute[75100]:     <model>Nehalem</model>
Nov 10 17:50:00 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 17:50:00 user nova-compute[75100]:   </cpu>
Nov 10 17:50:00 user nova-compute[75100]:   <devices>
Nov 10 17:50:00 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 10 17:50:00 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 17:50:00 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9/disk"/>
Nov 10 17:50:00 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 10 17:50:00 user nova-compute[75100]:     </disk>
Nov 10 17:50:00 user nova-compute[75100]:     <interface type="ethernet">
Nov 10 17:50:00 user nova-compute[75100]:       <mac address="fa:16:3e:2e:66:3b"/>
Nov 10 17:50:00 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:50:00 user nova-compute[75100]:       <mtu size="1442"/>
Nov 10 17:50:00 user nova-compute[75100]:       <target dev="tap51f4f44b-6b"/>
Nov 10 17:50:00 user nova-compute[75100]:     </interface>
Nov 10 17:50:00 user nova-compute[75100]:     <serial type="pty">
Nov 10 17:50:00 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9/console.log" append="off"/>
Nov 10 17:50:00 user nova-compute[75100]:     </serial>
Nov 10 17:50:00 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 17:50:00 user nova-compute[75100]:     <video>
Nov 10 17:50:00 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:50:00 user nova-compute[75100]:     </video>
Nov 10 17:50:00 user nova-compute[75100]:     <rng model="virtio">
Nov 10 17:50:00 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 10 17:50:00 user nova-compute[75100]:     </rng>
Nov 10 17:50:00 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 10 17:50:00 user nova-compute[75100]:     <memballoon model="virtio">
Nov 10 17:50:00 user nova-compute[75100]:       <stats period="10"/>
Nov 10 17:50:00 user nova-compute[75100]:     </memballoon>
Nov 10 17:50:00 user nova-compute[75100]:   </devices>
Nov 10 17:50:00 user nova-compute[75100]: </domain>
Nov 10 17:50:00 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 17:50:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:49:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1630873709',display_name='tempest-VolumesActionsTest-instance-1630873709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1630873709',id=17,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b66facb836f9404c81dcae56f826a4ab',ramdisk_id='',reservation_id='r-103e3my5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-888970826',owner_user_name='tempest-VolumesActionsTest-888970826-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:49:56Z,user_data=None,user_id='039410b87e754d8d9a5de124c7e74d3b',uuid=b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51f4f44b-6b18-417e-b33c-49fbfe8c4563", "address": "fa:16:3e:2e:66:3b", "network": {"id": "2ff6ad81-8918-48ea-85e6-54f44265bc4a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1097138698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b66facb836f9404c81dcae56f826a4ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51f4f44b-6b", "ovs_interfaceid": "51f4f44b-6b18-417e-b33c-49fbfe8c4563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 17:50:00 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] Converting VIF {"id": "51f4f44b-6b18-417e-b33c-49fbfe8c4563", "address": "fa:16:3e:2e:66:3b", "network": {"id": "2ff6ad81-8918-48ea-85e6-54f44265bc4a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1097138698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b66facb836f9404c81dcae56f826a4ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51f4f44b-6b", "ovs_interfaceid": "51f4f44b-6b18-417e-b33c-49fbfe8c4563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:50:00 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:66:3b,bridge_name='br-int',has_traffic_filtering=True,id=51f4f44b-6b18-417e-b33c-49fbfe8c4563,network=Network(2ff6ad81-8918-48ea-85e6-54f44265bc4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51f4f44b-6b') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:50:00 user nova-compute[75100]: DEBUG os_vif [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:66:3b,bridge_name='br-int',has_traffic_filtering=True,id=51f4f44b-6b18-417e-b33c-49fbfe8c4563,network=Network(2ff6ad81-8918-48ea-85e6-54f44265bc4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51f4f44b-6b') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 17:50:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.254s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:50:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:50:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:50:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 17:50:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Acquiring lock "818b9e28e061d41a38d903968b229be2ed9ba520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:50:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:50:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:50:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:50:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a7ae6b85-ec2d-558b-9fee-47b111ec5780', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:50:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:50:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:50:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:50:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap51f4f44b-6b, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:50:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap51f4f44b-6b, col_values=(('qos', UUID('93a964ee-0557-4fa1-93ad-e676f18e4d79')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:50:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap51f4f44b-6b, col_values=(('external_ids', {'iface-id': '51f4f44b-6b18-417e-b33c-49fbfe8c4563', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:66:3b', 'vm-uuid': 'b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:50:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-82bd241e-df7d-41c1-8204-02872bf749f1 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.108s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:50:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:50:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:50:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:50:00 user nova-compute[75100]: INFO os_vif [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:66:3b,bridge_name='br-int',has_traffic_filtering=True,id=51f4f44b-6b18-417e-b33c-49fbfe8c4563,network=Network(2ff6ad81-8918-48ea-85e6-54f44265bc4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51f4f44b-6b')
Nov 10 17:50:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 17:50:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] No VIF found with MAC fa:16:3e:2e:66:3b, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 17:50:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.232s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:50:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:50:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk 1073741824" returned: 0 in 0.064s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:50:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.302s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:50:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:50:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.184s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:50:00 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Checking if we can resize image /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 17:50:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:50:00 user nova-compute[75100]: DEBUG nova.network.neutron [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Successfully created port: 9855a14c-55c7-4a35-a4cc-7085dfbda684 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 17:50:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:50:00 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Cannot resize image /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 17:50:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 17:50:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Ensure instance console log exists: /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 17:50:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:50:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:50:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:50:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:50:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:50:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:50:01 user nova-compute[75100]: DEBUG nova.network.neutron [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Successfully updated port: 9855a14c-55c7-4a35-a4cc-7085dfbda684 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 17:50:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:50:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Acquiring lock "refresh_cache-22c021d9-c8e4-455d-8e2a-a9cdfbb38f75" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:50:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Acquired lock "refresh_cache-22c021d9-c8e4-455d-8e2a-a9cdfbb38f75" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:50:01 user nova-compute[75100]: DEBUG nova.network.neutron [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 17:50:01 user nova-compute[75100]: DEBUG nova.compute.manager [req-6b82d8f2-bab4-4970-8fa0-2ab8281122e2 req-159c4d74-e6c5-44f2-b58e-b3a72eb879b4 service nova] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Received event network-changed-9855a14c-55c7-4a35-a4cc-7085dfbda684 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:50:01 user nova-compute[75100]: DEBUG nova.compute.manager [req-6b82d8f2-bab4-4970-8fa0-2ab8281122e2 req-159c4d74-e6c5-44f2-b58e-b3a72eb879b4 service nova] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Refreshing instance network info cache due to event network-changed-9855a14c-55c7-4a35-a4cc-7085dfbda684. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 17:50:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6b82d8f2-bab4-4970-8fa0-2ab8281122e2 req-159c4d74-e6c5-44f2-b58e-b3a72eb879b4 service nova] Acquiring lock "refresh_cache-22c021d9-c8e4-455d-8e2a-a9cdfbb38f75" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:50:02 user nova-compute[75100]: DEBUG nova.network.neutron [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 17:50:02 user nova-compute[75100]: DEBUG nova.compute.manager [None req-29e09d5f-6f1d-413a-8ee8-662001b210b3 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 17:50:02 user nova-compute[75100]: INFO nova.compute.manager [None req-29e09d5f-6f1d-413a-8ee8-662001b210b3 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] instance snapshotting
Nov 10 17:50:02 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-29e09d5f-6f1d-413a-8ee8-662001b210b3 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] Beginning live snapshot process
Nov 10 17:50:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:50:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:50:02 user nova-compute[75100]: DEBUG nova.network.neutron [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Updating instance_info_cache with network_info: [{"id": "9855a14c-55c7-4a35-a4cc-7085dfbda684", "address": "fa:16:3e:02:b1:a1", "network": {"id": "bf1edb58-ef26-40ca-8ec9-853fa05de13d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1416469583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7bb141ef59487dbb2ce6243c5002af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9855a14c-55", "ovs_interfaceid": "9855a14c-55c7-4a35-a4cc-7085dfbda684", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:50:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:50:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Releasing lock "refresh_cache-22c021d9-c8e4-455d-8e2a-a9cdfbb38f75" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:50:02 user nova-compute[75100]: DEBUG nova.compute.manager [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Instance network_info: |[{"id": "9855a14c-55c7-4a35-a4cc-7085dfbda684", "address": "fa:16:3e:02:b1:a1", "network": {"id": "bf1edb58-ef26-40ca-8ec9-853fa05de13d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1416469583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7bb141ef59487dbb2ce6243c5002af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9855a14c-55", "ovs_interfaceid": "9855a14c-55c7-4a35-a4cc-7085dfbda684", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 17:50:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6b82d8f2-bab4-4970-8fa0-2ab8281122e2 req-159c4d74-e6c5-44f2-b58e-b3a72eb879b4 service nova] Acquired lock "refresh_cache-22c021d9-c8e4-455d-8e2a-a9cdfbb38f75" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:50:02 user nova-compute[75100]: DEBUG nova.network.neutron [req-6b82d8f2-bab4-4970-8fa0-2ab8281122e2 req-159c4d74-e6c5-44f2-b58e-b3a72eb879b4 service nova] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Refreshing network info cache for port 9855a14c-55c7-4a35-a4cc-7085dfbda684 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 17:50:02 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Start _get_guest_xml network_info=[{"id": "9855a14c-55c7-4a35-a4cc-7085dfbda684", "address": "fa:16:3e:02:b1:a1", "network": {"id": "bf1edb58-ef26-40ca-8ec9-853fa05de13d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1416469583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7bb141ef59487dbb2ce6243c5002af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9855a14c-55", "ovs_interfaceid": "9855a14c-55c7-4a35-a4cc-7085dfbda684", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'e3cc5321-4d40-49ee-885c-700e14741732'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 17:50:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:50:02 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:50:02 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:50:02 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 17:50:02 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 17:50:02 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 17:50:02 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 17:50:02 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 17:50:02 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T17:40:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 17:50:02 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 17:50:02 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 17:50:02 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 17:50:02 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 17:50:02 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 17:50:02 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 17:50:02 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 17:50:02 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 17:50:02 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 17:50:02 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 17:50:02 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:49:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-221928721',display_name='tempest-ServerActionsTestOtherA-server-221928721',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-221928721',id=18,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJad9dm/VlgxkcoctzSOteh4UYTuKPNeJ9f0qso9IjuH6DpxTyWo1Jqw77DQ9s/VWyRmakd0roi/G14M/XBa/3VT72t8942zFgmm3ckvSnycGMTUzmFZ+zGnWexds7KMSQ==',key_name='tempest-keypair-1062541421',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce7bb141ef59487dbb2ce6243c5002af',ramdisk_id='',reservation_id='r-smju6rlp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1364670684',owner_user_name='tempest-ServerActionsTestOtherA-1364670684-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:50:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f4df424af2343a2a27e869502651216',uuid=22c021d9-c8e4-455d-8e2a-a9cdfbb38f75,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9855a14c-55c7-4a35-a4cc-7085dfbda684", "address": "fa:16:3e:02:b1:a1", "network": {"id": "bf1edb58-ef26-40ca-8ec9-853fa05de13d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1416469583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7bb141ef59487dbb2ce6243c5002af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9855a14c-55", "ovs_interfaceid": "9855a14c-55c7-4a35-a4cc-7085dfbda684", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 17:50:02 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Converting VIF {"id": "9855a14c-55c7-4a35-a4cc-7085dfbda684", "address": "fa:16:3e:02:b1:a1", "network": {"id": "bf1edb58-ef26-40ca-8ec9-853fa05de13d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1416469583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7bb141ef59487dbb2ce6243c5002af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9855a14c-55", "ovs_interfaceid": "9855a14c-55c7-4a35-a4cc-7085dfbda684", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:50:02 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:b1:a1,bridge_name='br-int',has_traffic_filtering=True,id=9855a14c-55c7-4a35-a4cc-7085dfbda684,network=Network(bf1edb58-ef26-40ca-8ec9-853fa05de13d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9855a14c-55') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:50:02 user nova-compute[75100]: DEBUG nova.objects.instance [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lazy-loading 'pci_devices' on Instance uuid 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:50:03 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] End _get_guest_xml xml=<domain type="kvm">
Nov 10 17:50:03 user nova-compute[75100]:   <uuid>22c021d9-c8e4-455d-8e2a-a9cdfbb38f75</uuid>
Nov 10 17:50:03 user nova-compute[75100]:   <name>instance-00000012</name>
Nov 10 17:50:03 user nova-compute[75100]:   <memory>524288</memory>
Nov 10 17:50:03 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 10 17:50:03 user nova-compute[75100]:   <metadata>
Nov 10 17:50:03 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 17:50:03 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 10 17:50:03 user nova-compute[75100]:       <nova:name>tempest-ServerActionsTestOtherA-server-221928721</nova:name>
Nov 10 17:50:03 user nova-compute[75100]:       <nova:creationTime>2023-11-10 17:50:02</nova:creationTime>
Nov 10 17:50:03 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 10 17:50:03 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 10 17:50:03 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 10 17:50:03 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 10 17:50:03 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 17:50:03 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 10 17:50:03 user nova-compute[75100]:       </nova:flavor>
Nov 10 17:50:03 user nova-compute[75100]:       <nova:owner>
Nov 10 17:50:03 user nova-compute[75100]:         <nova:user uuid="9f4df424af2343a2a27e869502651216">tempest-ServerActionsTestOtherA-1364670684-project-member</nova:user>
Nov 10 17:50:03 user nova-compute[75100]:         <nova:project uuid="ce7bb141ef59487dbb2ce6243c5002af">tempest-ServerActionsTestOtherA-1364670684</nova:project>
Nov 10 17:50:03 user nova-compute[75100]:       </nova:owner>
Nov 10 17:50:03 user nova-compute[75100]:       <nova:root type="image" uuid="e3cc5321-4d40-49ee-885c-700e14741732"/>
Nov 10 17:50:03 user nova-compute[75100]:       <nova:ports>
Nov 10 17:50:03 user nova-compute[75100]:         <nova:port uuid="9855a14c-55c7-4a35-a4cc-7085dfbda684">
Nov 10 17:50:03 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 10 17:50:03 user nova-compute[75100]:         </nova:port>
Nov 10 17:50:03 user nova-compute[75100]:       </nova:ports>
Nov 10 17:50:03 user nova-compute[75100]:     </nova:instance>
Nov 10 17:50:03 user nova-compute[75100]:   </metadata>
Nov 10 17:50:03 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 10 17:50:03 user nova-compute[75100]:     <system>
Nov 10 17:50:03 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 17:50:03 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 10 17:50:03 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 10 17:50:03 user nova-compute[75100]:       <entry name="serial">22c021d9-c8e4-455d-8e2a-a9cdfbb38f75</entry>
Nov 10 17:50:03 user nova-compute[75100]:       <entry name="uuid">22c021d9-c8e4-455d-8e2a-a9cdfbb38f75</entry>
Nov 10 17:50:03 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 10 17:50:03 user nova-compute[75100]:     </system>
Nov 10 17:50:03 user nova-compute[75100]:   </sysinfo>
Nov 10 17:50:03 user nova-compute[75100]:   <os>
Nov 10 17:50:03 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 17:50:03 user nova-compute[75100]:     <boot dev="hd"/>
Nov 10 17:50:03 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 10 17:50:03 user nova-compute[75100]:   </os>
Nov 10 17:50:03 user nova-compute[75100]:   <features>
Nov 10 17:50:03 user nova-compute[75100]:     <acpi/>
Nov 10 17:50:03 user nova-compute[75100]:     <apic/>
Nov 10 17:50:03 user nova-compute[75100]:     <vmcoreinfo/>
Nov 10 17:50:03 user nova-compute[75100]:   </features>
Nov 10 17:50:03 user nova-compute[75100]:   <clock offset="utc">
Nov 10 17:50:03 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 17:50:03 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 17:50:03 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 10 17:50:03 user nova-compute[75100]:   </clock>
Nov 10 17:50:03 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 10 17:50:03 user nova-compute[75100]:     <model>Nehalem</model>
Nov 10 17:50:03 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 17:50:03 user nova-compute[75100]:   </cpu>
Nov 10 17:50:03 user nova-compute[75100]:   <devices>
Nov 10 17:50:03 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 10 17:50:03 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 17:50:03 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk"/>
Nov 10 17:50:03 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 10 17:50:03 user nova-compute[75100]:     </disk>
Nov 10 17:50:03 user nova-compute[75100]:     <interface type="ethernet">
Nov 10 17:50:03 user nova-compute[75100]:       <mac address="fa:16:3e:02:b1:a1"/>
Nov 10 17:50:03 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:50:03 user nova-compute[75100]:       <mtu size="1442"/>
Nov 10 17:50:03 user nova-compute[75100]:       <target dev="tap9855a14c-55"/>
Nov 10 17:50:03 user nova-compute[75100]:     </interface>
Nov 10 17:50:03 user nova-compute[75100]:     <serial type="pty">
Nov 10 17:50:03 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/console.log" append="off"/>
Nov 10 17:50:03 user nova-compute[75100]:     </serial>
Nov 10 17:50:03 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 17:50:03 user nova-compute[75100]:     <video>
Nov 10 17:50:03 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:50:03 user nova-compute[75100]:     </video>
Nov 10 17:50:03 user nova-compute[75100]:     <rng model="virtio">
Nov 10 17:50:03 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 10 17:50:03 user nova-compute[75100]:     </rng>
Nov 10 17:50:03 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 10 17:50:03 user nova-compute[75100]:     <memballoon model="virtio">
Nov 10 17:50:03 user nova-compute[75100]:       <stats period="10"/>
Nov 10 17:50:03 user nova-compute[75100]:     </memballoon>
Nov 10 17:50:03 user nova-compute[75100]:   </devices>
Nov 10 17:50:03 user nova-compute[75100]: </domain>
Nov 10 17:50:03 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 17:50:03 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:49:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-221928721',display_name='tempest-ServerActionsTestOtherA-server-221928721',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-221928721',id=18,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJad9dm/VlgxkcoctzSOteh4UYTuKPNeJ9f0qso9IjuH6DpxTyWo1Jqw77DQ9s/VWyRmakd0roi/G14M/XBa/3VT72t8942zFgmm3ckvSnycGMTUzmFZ+zGnWexds7KMSQ==',key_name='tempest-keypair-1062541421',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce7bb141ef59487dbb2ce6243c5002af',ramdisk_id='',reservation_id='r-smju6rlp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1364670684',owner_user_name='tempest-ServerActionsTestOtherA-1364670684-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:50:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f4df424af2343a2a27e869502651216',uuid=22c021d9-c8e4-455d-8e2a-a9cdfbb38f75,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9855a14c-55c7-4a35-a4cc-7085dfbda684", "address": "fa:16:3e:02:b1:a1", "network": {"id": "bf1edb58-ef26-40ca-8ec9-853fa05de13d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1416469583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7bb141ef59487dbb2ce6243c5002af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9855a14c-55", "ovs_interfaceid": "9855a14c-55c7-4a35-a4cc-7085dfbda684", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 17:50:03 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Converting VIF {"id": "9855a14c-55c7-4a35-a4cc-7085dfbda684", "address": "fa:16:3e:02:b1:a1", "network": {"id": "bf1edb58-ef26-40ca-8ec9-853fa05de13d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1416469583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7bb141ef59487dbb2ce6243c5002af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9855a14c-55", "ovs_interfaceid": "9855a14c-55c7-4a35-a4cc-7085dfbda684", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:50:03 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:b1:a1,bridge_name='br-int',has_traffic_filtering=True,id=9855a14c-55c7-4a35-a4cc-7085dfbda684,network=Network(bf1edb58-ef26-40ca-8ec9-853fa05de13d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9855a14c-55') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:50:03 user nova-compute[75100]: DEBUG os_vif [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:b1:a1,bridge_name='br-int',has_traffic_filtering=True,id=9855a14c-55c7-4a35-a4cc-7085dfbda684,network=Network(bf1edb58-ef26-40ca-8ec9-853fa05de13d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9855a14c-55') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 17:50:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:50:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:50:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 17:50:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:50:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0fd7fe70-9d06-5d4e-8137-3ccb1792d03f', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:50:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:50:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:50:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:50:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9855a14c-55, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:50:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9855a14c-55, col_values=(('qos', UUID('f8c5a397-81bb-4c2c-b22f-74abaa2dd1be')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:50:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9855a14c-55, col_values=(('external_ids', {'iface-id': '9855a14c-55c7-4a35-a4cc-7085dfbda684', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:b1:a1', 'vm-uuid': '22c021d9-c8e4-455d-8e2a-a9cdfbb38f75'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:50:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:50:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:50:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:50:03 user nova-compute[75100]: INFO os_vif [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:b1:a1,bridge_name='br-int',has_traffic_filtering=True,id=9855a14c-55c7-4a35-a4cc-7085dfbda684,network=Network(bf1edb58-ef26-40ca-8ec9-853fa05de13d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9855a14c-55')
Nov 10 17:50:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-29e09d5f-6f1d-413a-8ee8-662001b210b3 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61d3862-5be7-45cc-95a0-88124ac1725d/disk --force-share --output=json -f qcow2 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:50:03 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 17:50:03 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] No VIF found with MAC fa:16:3e:02:b1:a1, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 17:50:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-29e09d5f-6f1d-413a-8ee8-662001b210b3 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61d3862-5be7-45cc-95a0-88124ac1725d/disk --force-share --output=json -f qcow2" returned: 0 in 0.274s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:50:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-29e09d5f-6f1d-413a-8ee8-662001b210b3 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61d3862-5be7-45cc-95a0-88124ac1725d/disk --force-share --output=json -f qcow2 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:50:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-29e09d5f-6f1d-413a-8ee8-662001b210b3 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61d3862-5be7-45cc-95a0-88124ac1725d/disk --force-share --output=json -f qcow2" returned: 0 in 0.203s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:50:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-29e09d5f-6f1d-413a-8ee8-662001b210b3 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:50:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-29e09d5f-6f1d-413a-8ee8-662001b210b3 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.279s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:50:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-29e09d5f-6f1d-413a-8ee8-662001b210b3 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpz1wjmiw0/65c2a0f58c7e4f1c9b28c9e0febf990c.delta 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:50:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:50:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-29e09d5f-6f1d-413a-8ee8-662001b210b3 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpz1wjmiw0/65c2a0f58c7e4f1c9b28c9e0febf990c.delta 1073741824" returned: 0 in 0.064s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:50:03 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-29e09d5f-6f1d-413a-8ee8-662001b210b3 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 10 17:50:04 user nova-compute[75100]: DEBUG nova.network.neutron [req-6b82d8f2-bab4-4970-8fa0-2ab8281122e2 req-159c4d74-e6c5-44f2-b58e-b3a72eb879b4 service nova] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Updated VIF entry in instance network info cache for port 9855a14c-55c7-4a35-a4cc-7085dfbda684. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 17:50:04 user nova-compute[75100]: DEBUG nova.network.neutron [req-6b82d8f2-bab4-4970-8fa0-2ab8281122e2 req-159c4d74-e6c5-44f2-b58e-b3a72eb879b4 service nova] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Updating instance_info_cache with network_info: [{"id": "9855a14c-55c7-4a35-a4cc-7085dfbda684", "address": "fa:16:3e:02:b1:a1", "network": {"id": "bf1edb58-ef26-40ca-8ec9-853fa05de13d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1416469583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7bb141ef59487dbb2ce6243c5002af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9855a14c-55", "ovs_interfaceid": "9855a14c-55c7-4a35-a4cc-7085dfbda684", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:50:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6b82d8f2-bab4-4970-8fa0-2ab8281122e2 req-159c4d74-e6c5-44f2-b58e-b3a72eb879b4 service nova] Releasing lock "refresh_cache-22c021d9-c8e4-455d-8e2a-a9cdfbb38f75" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:50:04 user nova-compute[75100]: DEBUG nova.compute.manager [req-e42f34b4-75da-4be1-bd52-ecfadbacd5db req-aa030fa7-1226-456a-9e85-76deb82f75c2 service nova] [instance: b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9] Received event network-vif-plugged-51f4f44b-6b18-417e-b33c-49fbfe8c4563 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:50:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-e42f34b4-75da-4be1-bd52-ecfadbacd5db req-aa030fa7-1226-456a-9e85-76deb82f75c2 service nova] Acquiring lock "b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:50:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-e42f34b4-75da-4be1-bd52-ecfadbacd5db req-aa030fa7-1226-456a-9e85-76deb82f75c2 service nova] Lock "b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:50:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-e42f34b4-75da-4be1-bd52-ecfadbacd5db req-aa030fa7-1226-456a-9e85-76deb82f75c2 service nova] Lock "b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:50:04 user nova-compute[75100]: DEBUG nova.compute.manager [req-e42f34b4-75da-4be1-bd52-ecfadbacd5db req-aa030fa7-1226-456a-9e85-76deb82f75c2 service nova] [instance: b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9] No waiting events found dispatching network-vif-plugged-51f4f44b-6b18-417e-b33c-49fbfe8c4563 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:50:04 user nova-compute[75100]: WARNING nova.compute.manager [req-e42f34b4-75da-4be1-bd52-ecfadbacd5db req-aa030fa7-1226-456a-9e85-76deb82f75c2 service nova] [instance: b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9] Received unexpected event network-vif-plugged-51f4f44b-6b18-417e-b33c-49fbfe8c4563 for instance with vm_state building and task_state spawning.
Nov 10 17:50:04 user nova-compute[75100]: DEBUG nova.compute.manager [req-e42f34b4-75da-4be1-bd52-ecfadbacd5db req-aa030fa7-1226-456a-9e85-76deb82f75c2 service nova] [instance: b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9] Received event network-vif-plugged-51f4f44b-6b18-417e-b33c-49fbfe8c4563 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:50:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-e42f34b4-75da-4be1-bd52-ecfadbacd5db req-aa030fa7-1226-456a-9e85-76deb82f75c2 service nova] Acquiring lock "b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:50:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-e42f34b4-75da-4be1-bd52-ecfadbacd5db req-aa030fa7-1226-456a-9e85-76deb82f75c2 service nova] Lock "b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:50:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-e42f34b4-75da-4be1-bd52-ecfadbacd5db req-aa030fa7-1226-456a-9e85-76deb82f75c2 service nova] Lock "b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:50:04 user nova-compute[75100]: DEBUG nova.compute.manager [req-e42f34b4-75da-4be1-bd52-ecfadbacd5db req-aa030fa7-1226-456a-9e85-76deb82f75c2 service nova] [instance: b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9] No waiting events found dispatching network-vif-plugged-51f4f44b-6b18-417e-b33c-49fbfe8c4563 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:50:04 user nova-compute[75100]: WARNING nova.compute.manager [req-e42f34b4-75da-4be1-bd52-ecfadbacd5db req-aa030fa7-1226-456a-9e85-76deb82f75c2 service nova] [instance: b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9] Received unexpected event network-vif-plugged-51f4f44b-6b18-417e-b33c-49fbfe8c4563 for instance with vm_state building and task_state spawning.
Nov 10 17:50:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-29e09d5f-6f1d-413a-8ee8-662001b210b3 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75100) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 17:50:05 user nova-compute[75100]: DEBUG nova.compute.manager [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] [instance: b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 17:50:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] [instance: b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 17:50:05 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9] Instance spawned successfully.
Nov 10 17:50:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] [instance: b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 17:50:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] [instance: b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:50:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] [instance: b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:50:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] [instance: b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:50:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] [instance: b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:50:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] [instance: b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:50:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] [instance: b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:50:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-29e09d5f-6f1d-413a-8ee8-662001b210b3 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] COPY block job progress, current cursor: 26869760 final cursor: 75497472 {{(pid=75100) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 17:50:05 user nova-compute[75100]: INFO nova.compute.manager [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] [instance: b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9] Took 9.04 seconds to spawn the instance on the hypervisor.
Nov 10 17:50:05 user nova-compute[75100]: DEBUG nova.compute.manager [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] [instance: b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 17:50:05 user nova-compute[75100]: INFO nova.compute.manager [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] [instance: b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9] Took 10.22 seconds to build instance.
Nov 10 17:50:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f75a8838-8bfc-41c0-9204-7156848157bf tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] Lock "b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.354s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:50:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:50:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:50:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:50:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:50:06 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-29e09d5f-6f1d-413a-8ee8-662001b210b3 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75100) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 17:50:06 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-29e09d5f-6f1d-413a-8ee8-662001b210b3 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 10 17:50:06 user nova-compute[75100]: DEBUG nova.privsep.utils [None req-29e09d5f-6f1d-413a-8ee8-662001b210b3 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75100) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 17:50:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-29e09d5f-6f1d-413a-8ee8-662001b210b3 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpz1wjmiw0/65c2a0f58c7e4f1c9b28c9e0febf990c.delta /opt/stack/data/nova/instances/snapshots/tmpz1wjmiw0/65c2a0f58c7e4f1c9b28c9e0febf990c {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:50:06 user nova-compute[75100]: DEBUG nova.compute.manager [req-366df0f8-b674-4077-9f7a-aa63889351ec req-26c252ab-c2b2-40b3-a557-d4df0e3de698 service nova] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Received event network-vif-plugged-9855a14c-55c7-4a35-a4cc-7085dfbda684 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:50:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-366df0f8-b674-4077-9f7a-aa63889351ec req-26c252ab-c2b2-40b3-a557-d4df0e3de698 service nova] Acquiring lock "22c021d9-c8e4-455d-8e2a-a9cdfbb38f75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:50:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-366df0f8-b674-4077-9f7a-aa63889351ec req-26c252ab-c2b2-40b3-a557-d4df0e3de698 service nova] Lock "22c021d9-c8e4-455d-8e2a-a9cdfbb38f75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:50:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-366df0f8-b674-4077-9f7a-aa63889351ec req-26c252ab-c2b2-40b3-a557-d4df0e3de698 service nova] Lock "22c021d9-c8e4-455d-8e2a-a9cdfbb38f75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:50:06 user nova-compute[75100]: DEBUG nova.compute.manager [req-366df0f8-b674-4077-9f7a-aa63889351ec req-26c252ab-c2b2-40b3-a557-d4df0e3de698 service nova] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] No waiting events found dispatching network-vif-plugged-9855a14c-55c7-4a35-a4cc-7085dfbda684 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:50:06 user nova-compute[75100]: WARNING nova.compute.manager [req-366df0f8-b674-4077-9f7a-aa63889351ec req-26c252ab-c2b2-40b3-a557-d4df0e3de698 service nova] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Received unexpected event network-vif-plugged-9855a14c-55c7-4a35-a4cc-7085dfbda684 for instance with vm_state building and task_state spawning.
Nov 10 17:50:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:50:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:50:07 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-29e09d5f-6f1d-413a-8ee8-662001b210b3 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpz1wjmiw0/65c2a0f58c7e4f1c9b28c9e0febf990c.delta /opt/stack/data/nova/instances/snapshots/tmpz1wjmiw0/65c2a0f58c7e4f1c9b28c9e0febf990c" returned: 0 in 0.989s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:50:07 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-29e09d5f-6f1d-413a-8ee8-662001b210b3 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] Snapshot extracted, beginning image upload
Nov 10 17:50:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:50:08 user nova-compute[75100]: DEBUG nova.compute.manager [req-84548933-a1a0-46df-b922-c7ca9715b61a req-553afb26-093e-4622-95e8-d3774aec22a4 service nova] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Received event network-vif-plugged-9855a14c-55c7-4a35-a4cc-7085dfbda684 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:50:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-84548933-a1a0-46df-b922-c7ca9715b61a req-553afb26-093e-4622-95e8-d3774aec22a4 service nova] Acquiring lock "22c021d9-c8e4-455d-8e2a-a9cdfbb38f75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:50:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-84548933-a1a0-46df-b922-c7ca9715b61a req-553afb26-093e-4622-95e8-d3774aec22a4 service nova] Lock "22c021d9-c8e4-455d-8e2a-a9cdfbb38f75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:50:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-84548933-a1a0-46df-b922-c7ca9715b61a req-553afb26-093e-4622-95e8-d3774aec22a4 service nova] Lock "22c021d9-c8e4-455d-8e2a-a9cdfbb38f75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:50:08 user nova-compute[75100]: DEBUG nova.compute.manager [req-84548933-a1a0-46df-b922-c7ca9715b61a req-553afb26-093e-4622-95e8-d3774aec22a4 service nova] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] No waiting events found dispatching network-vif-plugged-9855a14c-55c7-4a35-a4cc-7085dfbda684 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:50:08 user nova-compute[75100]: WARNING nova.compute.manager [req-84548933-a1a0-46df-b922-c7ca9715b61a req-553afb26-093e-4622-95e8-d3774aec22a4 service nova] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Received unexpected event network-vif-plugged-9855a14c-55c7-4a35-a4cc-7085dfbda684 for instance with vm_state building and task_state spawning.
Nov 10 17:50:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:50:09 user nova-compute[75100]: DEBUG nova.compute.manager [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 17:50:09 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 17:50:09 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Instance spawned successfully.
Nov 10 17:50:09 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 17:50:09 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:50:09 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:50:09 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:50:09 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:50:09 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:50:09 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:50:09 user nova-compute[75100]: INFO nova.compute.manager [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Took 9.74 seconds to spawn the instance on the hypervisor.
Nov 10 17:50:09 user nova-compute[75100]: DEBUG nova.compute.manager [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 17:50:09 user nova-compute[75100]: INFO nova.compute.manager [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Took 11.16 seconds to build instance.
Nov 10 17:50:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-061a33a4-f429-4bca-b21f-3edf53fcd9a0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "22c021d9-c8e4-455d-8e2a-a9cdfbb38f75" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.298s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:50:10 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:50:11 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-29e09d5f-6f1d-413a-8ee8-662001b210b3 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] Snapshot image upload complete
Nov 10 17:50:11 user nova-compute[75100]: INFO nova.compute.manager [None req-29e09d5f-6f1d-413a-8ee8-662001b210b3 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] Took 8.88 seconds to snapshot the instance on the hypervisor.
Nov 10 17:50:12 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:50:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:50:13 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:50:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:50:14 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:50:14 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:50:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:50:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:50:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:50:14 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 17:50:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:50:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:50:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:50:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:50:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:50:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:50:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:50:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:50:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:50:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:50:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:50:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:50:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:50:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:50:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:50:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:50:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:50:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:50:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:50:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:50:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:50:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:50:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:50:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk.rescue --force-share --output=json" returned: 0 in 0.212s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:50:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:50:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:50:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:50:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:50:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:50:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:50:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:50:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:50:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:50:18 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 17:50:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db3f69df-51b2-464c-921e-33171e29f46d/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:50:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db3f69df-51b2-464c-921e-33171e29f46d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:50:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db3f69df-51b2-464c-921e-33171e29f46d/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:50:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db3f69df-51b2-464c-921e-33171e29f46d/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:50:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61d3862-5be7-45cc-95a0-88124ac1725d/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:50:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61d3862-5be7-45cc-95a0-88124ac1725d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:50:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61d3862-5be7-45cc-95a0-88124ac1725d/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:50:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61d3862-5be7-45cc-95a0-88124ac1725d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:50:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ead532eb-c8be-45fa-a8b7-0b4c4f884a90/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:50:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:50:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ead532eb-c8be-45fa-a8b7-0b4c4f884a90/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:50:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ead532eb-c8be-45fa-a8b7-0b4c4f884a90/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:50:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ead532eb-c8be-45fa-a8b7-0b4c4f884a90/disk --force-share --output=json" returned: 0 in 0.296s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:50:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71ff860c-f094-4885-bf69-cd6236ebc875/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:50:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71ff860c-f094-4885-bf69-cd6236ebc875/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:50:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71ff860c-f094-4885-bf69-cd6236ebc875/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:50:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71ff860c-f094-4885-bf69-cd6236ebc875/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:50:20 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:50:20 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:50:20 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Hypervisor/Node resource view: name=user free_ram=7265MB free_disk=24.710861206054688GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 17:50:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:50:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:50:20 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance c19fc271-a248-4631-a11f-89b7ed73bf85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:50:20 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:50:20 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 3e14de19-540d-4dc2-a058-6874d8d14478 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:50:20 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance ead532eb-c8be-45fa-a8b7-0b4c4f884a90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:50:20 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance db3f69df-51b2-464c-921e-33171e29f46d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:50:20 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 111bd74e-2943-4f12-9514-b564cf26dadb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:50:20 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance d61d3862-5be7-45cc-95a0-88124ac1725d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:50:20 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 71ff860c-f094-4885-bf69-cd6236ebc875 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:50:20 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance eb430407-f836-4510-899f-a5f5d60c73f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:50:20 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:50:20 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:50:20 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 17:50:20 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 17:50:21 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:50:21 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:50:21 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 17:50:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.878s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:50:21 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:50:21 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Cleaning up deleted instances {{(pid=75100) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 17:50:21 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] There are 0 instances to clean {{(pid=75100) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 17:50:21 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:50:21 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75100) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 17:50:22 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:50:22 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:50:22 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 17:50:22 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Rebuilding the list of instances to heal {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 17:50:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "refresh_cache-c19fc271-a248-4631-a11f-89b7ed73bf85" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:50:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquired lock "refresh_cache-c19fc271-a248-4631-a11f-89b7ed73bf85" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:50:22 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 17:50:22 user nova-compute[75100]: DEBUG nova.objects.instance [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lazy-loading 'info_cache' on Instance uuid c19fc271-a248-4631-a11f-89b7ed73bf85 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:50:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:50:23 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Updating instance_info_cache with network_info: [{"id": "eedb3d8e-5619-4df9-aef9-bbc44db1dba9", "address": "fa:16:3e:ee:f9:3d", "network": {"id": "f240fae3-3d7b-4b6e-b04f-18550ab4d0a3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1007355777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c970a503d74d32a1e2b71f086649fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeedb3d8e-56", "ovs_interfaceid": "eedb3d8e-5619-4df9-aef9-bbc44db1dba9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:50:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Releasing lock "refresh_cache-c19fc271-a248-4631-a11f-89b7ed73bf85" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:50:23 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 17:50:23 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:50:23 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:50:23 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:50:23 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 17:50:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:50:24 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:50:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:50:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-80b02659-eae2-4aa6-9ae6-b5f43efe8f10 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Acquiring lock "71ff860c-f094-4885-bf69-cd6236ebc875" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:50:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-80b02659-eae2-4aa6-9ae6-b5f43efe8f10 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Lock "71ff860c-f094-4885-bf69-cd6236ebc875" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:50:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-80b02659-eae2-4aa6-9ae6-b5f43efe8f10 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Acquiring lock "71ff860c-f094-4885-bf69-cd6236ebc875-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:50:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-80b02659-eae2-4aa6-9ae6-b5f43efe8f10 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Lock "71ff860c-f094-4885-bf69-cd6236ebc875-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:50:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-80b02659-eae2-4aa6-9ae6-b5f43efe8f10 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Lock "71ff860c-f094-4885-bf69-cd6236ebc875-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:50:28 user nova-compute[75100]: INFO nova.compute.manager [None req-80b02659-eae2-4aa6-9ae6-b5f43efe8f10 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: 71ff860c-f094-4885-bf69-cd6236ebc875] Terminating instance
Nov 10 17:50:28 user nova-compute[75100]: DEBUG nova.compute.manager [None req-80b02659-eae2-4aa6-9ae6-b5f43efe8f10 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: 71ff860c-f094-4885-bf69-cd6236ebc875] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 17:50:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:50:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:50:28 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:50:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:50:28 user nova-compute[75100]: DEBUG nova.compute.manager [req-57c5777a-8526-4404-9c53-9015dcec8b58 req-61eefaf3-b9bf-4138-aa9c-12851749d1d5 service nova] [instance: 71ff860c-f094-4885-bf69-cd6236ebc875] Received event network-vif-unplugged-406f990a-ae7a-4d1d-9045-ccfe829faa61 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:50:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-57c5777a-8526-4404-9c53-9015dcec8b58 req-61eefaf3-b9bf-4138-aa9c-12851749d1d5 service nova] Acquiring lock "71ff860c-f094-4885-bf69-cd6236ebc875-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:50:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-57c5777a-8526-4404-9c53-9015dcec8b58 req-61eefaf3-b9bf-4138-aa9c-12851749d1d5 service nova] Lock "71ff860c-f094-4885-bf69-cd6236ebc875-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:50:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-57c5777a-8526-4404-9c53-9015dcec8b58 req-61eefaf3-b9bf-4138-aa9c-12851749d1d5 service nova] Lock "71ff860c-f094-4885-bf69-cd6236ebc875-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:50:28 user nova-compute[75100]: DEBUG nova.compute.manager [req-57c5777a-8526-4404-9c53-9015dcec8b58 req-61eefaf3-b9bf-4138-aa9c-12851749d1d5 service nova] [instance: 71ff860c-f094-4885-bf69-cd6236ebc875] No waiting events found dispatching network-vif-unplugged-406f990a-ae7a-4d1d-9045-ccfe829faa61 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:50:28 user nova-compute[75100]: DEBUG nova.compute.manager [req-57c5777a-8526-4404-9c53-9015dcec8b58 req-61eefaf3-b9bf-4138-aa9c-12851749d1d5 service nova] [instance: 71ff860c-f094-4885-bf69-cd6236ebc875] Received event network-vif-unplugged-406f990a-ae7a-4d1d-9045-ccfe829faa61 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 17:50:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:50:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:50:29 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 71ff860c-f094-4885-bf69-cd6236ebc875] Instance destroyed successfully.
Nov 10 17:50:29 user nova-compute[75100]: DEBUG nova.objects.instance [None req-80b02659-eae2-4aa6-9ae6-b5f43efe8f10 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Lazy-loading 'resources' on Instance uuid 71ff860c-f094-4885-bf69-cd6236ebc875 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:50:29 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Triggering sync for uuid c19fc271-a248-4631-a11f-89b7ed73bf85 {{(pid=75100) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 17:50:29 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Triggering sync for uuid b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b {{(pid=75100) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 17:50:29 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Triggering sync for uuid 3e14de19-540d-4dc2-a058-6874d8d14478 {{(pid=75100) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 17:50:29 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Triggering sync for uuid ead532eb-c8be-45fa-a8b7-0b4c4f884a90 {{(pid=75100) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 17:50:29 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Triggering sync for uuid db3f69df-51b2-464c-921e-33171e29f46d {{(pid=75100) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 17:50:29 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Triggering sync for uuid 111bd74e-2943-4f12-9514-b564cf26dadb {{(pid=75100) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 17:50:29 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Triggering sync for uuid d61d3862-5be7-45cc-95a0-88124ac1725d {{(pid=75100) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 17:50:29 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Triggering sync for uuid 71ff860c-f094-4885-bf69-cd6236ebc875 {{(pid=75100) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 17:50:29 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Triggering sync for uuid eb430407-f836-4510-899f-a5f5d60c73f3 {{(pid=75100) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 17:50:29 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Triggering sync for uuid b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9 {{(pid=75100) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 17:50:29 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Triggering sync for uuid 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75 {{(pid=75100) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 17:50:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "c19fc271-a248-4631-a11f-89b7ed73bf85" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:50:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "c19fc271-a248-4631-a11f-89b7ed73bf85" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:50:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:50:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:50:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "3e14de19-540d-4dc2-a058-6874d8d14478" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:50:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "3e14de19-540d-4dc2-a058-6874d8d14478" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:50:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "ead532eb-c8be-45fa-a8b7-0b4c4f884a90" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:50:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "ead532eb-c8be-45fa-a8b7-0b4c4f884a90" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:50:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "db3f69df-51b2-464c-921e-33171e29f46d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:50:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "db3f69df-51b2-464c-921e-33171e29f46d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:50:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "111bd74e-2943-4f12-9514-b564cf26dadb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:50:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "111bd74e-2943-4f12-9514-b564cf26dadb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:50:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "d61d3862-5be7-45cc-95a0-88124ac1725d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:50:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "d61d3862-5be7-45cc-95a0-88124ac1725d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:50:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "71ff860c-f094-4885-bf69-cd6236ebc875" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:50:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "eb430407-f836-4510-899f-a5f5d60c73f3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:50:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "eb430407-f836-4510-899f-a5f5d60c73f3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:50:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:50:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:50:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "22c021d9-c8e4-455d-8e2a-a9cdfbb38f75" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:50:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "22c021d9-c8e4-455d-8e2a-a9cdfbb38f75" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:50:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-80b02659-eae2-4aa6-9ae6-b5f43efe8f10 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:48:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1148227792',display_name='tempest-VolumesAdminNegativeTest-server-1148227792',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1148227792',id=15,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T17:48:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8460c83146a64640ba7e549d159275c2',ramdisk_id='',reservation_id='r-h0coi6k1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1957922837',owner_user_name='tempest-VolumesAdminNegativeTest-1957922837-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T17:48:26Z,user_data=None,user_id='7994564d536446e38002847db1668157',uuid=71ff860c-f094-4885-bf69-cd6236ebc875,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "406f990a-ae7a-4d1d-9045-ccfe829faa61", "address": "fa:16:3e:26:b9:f2", "network": {"id": "7b0728f9-3997-4fbd-9583-81a235e0b690", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1553690854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8460c83146a64640ba7e549d159275c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap406f990a-ae", "ovs_interfaceid": "406f990a-ae7a-4d1d-9045-ccfe829faa61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 17:50:29 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-80b02659-eae2-4aa6-9ae6-b5f43efe8f10 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Converting VIF {"id": "406f990a-ae7a-4d1d-9045-ccfe829faa61", "address": "fa:16:3e:26:b9:f2", "network": {"id": "7b0728f9-3997-4fbd-9583-81a235e0b690", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1553690854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8460c83146a64640ba7e549d159275c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap406f990a-ae", "ovs_interfaceid": "406f990a-ae7a-4d1d-9045-ccfe829faa61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:50:29 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-80b02659-eae2-4aa6-9ae6-b5f43efe8f10 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:b9:f2,bridge_name='br-int',has_traffic_filtering=True,id=406f990a-ae7a-4d1d-9045-ccfe829faa61,network=Network(7b0728f9-3997-4fbd-9583-81a235e0b690),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap406f990a-ae') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:50:29 user nova-compute[75100]: DEBUG os_vif [None req-80b02659-eae2-4aa6-9ae6-b5f43efe8f10 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:b9:f2,bridge_name='br-int',has_traffic_filtering=True,id=406f990a-ae7a-4d1d-9045-ccfe829faa61,network=Network(7b0728f9-3997-4fbd-9583-81a235e0b690),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap406f990a-ae') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 17:50:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:50:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap406f990a-ae, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:50:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:50:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:50:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:50:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:50:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dd245494-90c2-43bc-9e0b-1756bd6fef72) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:50:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:50:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:50:29 user nova-compute[75100]: INFO os_vif [None req-80b02659-eae2-4aa6-9ae6-b5f43efe8f10 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:b9:f2,bridge_name='br-int',has_traffic_filtering=True,id=406f990a-ae7a-4d1d-9045-ccfe829faa61,network=Network(7b0728f9-3997-4fbd-9583-81a235e0b690),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap406f990a-ae')
Nov 10 17:50:29 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-80b02659-eae2-4aa6-9ae6-b5f43efe8f10 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: 71ff860c-f094-4885-bf69-cd6236ebc875] Deleting instance files /opt/stack/data/nova/instances/71ff860c-f094-4885-bf69-cd6236ebc875_del
Nov 10 17:50:29 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-80b02659-eae2-4aa6-9ae6-b5f43efe8f10 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: 71ff860c-f094-4885-bf69-cd6236ebc875] Deletion of /opt/stack/data/nova/instances/71ff860c-f094-4885-bf69-cd6236ebc875_del complete
Nov 10 17:50:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "c19fc271-a248-4631-a11f-89b7ed73bf85" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.098s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:50:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "111bd74e-2943-4f12-9514-b564cf26dadb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.139s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:50:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "3e14de19-540d-4dc2-a058-6874d8d14478" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.154s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:50:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.150s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:50:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "db3f69df-51b2-464c-921e-33171e29f46d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.158s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:50:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.164s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:50:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "ead532eb-c8be-45fa-a8b7-0b4c4f884a90" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.166s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:50:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "eb430407-f836-4510-899f-a5f5d60c73f3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.176s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:50:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "d61d3862-5be7-45cc-95a0-88124ac1725d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.180s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:50:29 user nova-compute[75100]: INFO nova.compute.manager [None req-80b02659-eae2-4aa6-9ae6-b5f43efe8f10 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: 71ff860c-f094-4885-bf69-cd6236ebc875] Took 1.11 seconds to destroy the instance on the hypervisor.
Nov 10 17:50:29 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-80b02659-eae2-4aa6-9ae6-b5f43efe8f10 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 17:50:29 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: 71ff860c-f094-4885-bf69-cd6236ebc875] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 17:50:29 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 71ff860c-f094-4885-bf69-cd6236ebc875] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 17:50:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "22c021d9-c8e4-455d-8e2a-a9cdfbb38f75" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.188s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:50:29 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 71ff860c-f094-4885-bf69-cd6236ebc875] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:50:29 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: 71ff860c-f094-4885-bf69-cd6236ebc875] Took 0.66 seconds to deallocate network for instance.
Nov 10 17:50:29 user nova-compute[75100]: DEBUG nova.compute.manager [req-79dab37d-2f29-4753-af4c-271456c732cc req-f313e589-70d4-4979-a3d6-81a537c681cb service nova] [instance: 71ff860c-f094-4885-bf69-cd6236ebc875] Received event network-vif-deleted-406f990a-ae7a-4d1d-9045-ccfe829faa61 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:50:29 user nova-compute[75100]: INFO nova.compute.manager [req-79dab37d-2f29-4753-af4c-271456c732cc req-f313e589-70d4-4979-a3d6-81a537c681cb service nova] [instance: 71ff860c-f094-4885-bf69-cd6236ebc875] Neutron deleted interface 406f990a-ae7a-4d1d-9045-ccfe829faa61; detaching it from the instance and deleting it from the info cache
Nov 10 17:50:29 user nova-compute[75100]: DEBUG nova.network.neutron [req-79dab37d-2f29-4753-af4c-271456c732cc req-f313e589-70d4-4979-a3d6-81a537c681cb service nova] [instance: 71ff860c-f094-4885-bf69-cd6236ebc875] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:50:29 user nova-compute[75100]: DEBUG nova.compute.manager [req-79dab37d-2f29-4753-af4c-271456c732cc req-f313e589-70d4-4979-a3d6-81a537c681cb service nova] [instance: 71ff860c-f094-4885-bf69-cd6236ebc875] Detach interface failed, port_id=406f990a-ae7a-4d1d-9045-ccfe829faa61, reason: Instance 71ff860c-f094-4885-bf69-cd6236ebc875 could not be found. {{(pid=75100) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 17:50:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-80b02659-eae2-4aa6-9ae6-b5f43efe8f10 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:50:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-80b02659-eae2-4aa6-9ae6-b5f43efe8f10 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:50:30 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-80b02659-eae2-4aa6-9ae6-b5f43efe8f10 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:50:30 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-80b02659-eae2-4aa6-9ae6-b5f43efe8f10 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:50:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-80b02659-eae2-4aa6-9ae6-b5f43efe8f10 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.448s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:50:30 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-80b02659-eae2-4aa6-9ae6-b5f43efe8f10 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Deleted allocations for instance 71ff860c-f094-4885-bf69-cd6236ebc875
Nov 10 17:50:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-80b02659-eae2-4aa6-9ae6-b5f43efe8f10 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Lock "71ff860c-f094-4885-bf69-cd6236ebc875" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.484s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:50:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "71ff860c-f094-4885-bf69-cd6236ebc875" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.536s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:50:30 user nova-compute[75100]: INFO nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 71ff860c-f094-4885-bf69-cd6236ebc875] During sync_power_state the instance has a pending task (deleting). Skip.
Nov 10 17:50:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "71ff860c-f094-4885-bf69-cd6236ebc875" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:50:30 user nova-compute[75100]: DEBUG nova.compute.manager [req-7c545154-4ada-41ed-baaf-f4c3d76901ab req-16a46690-4c22-4f4e-8980-003c7e33c34b service nova] [instance: 71ff860c-f094-4885-bf69-cd6236ebc875] Received event network-vif-plugged-406f990a-ae7a-4d1d-9045-ccfe829faa61 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:50:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7c545154-4ada-41ed-baaf-f4c3d76901ab req-16a46690-4c22-4f4e-8980-003c7e33c34b service nova] Acquiring lock "71ff860c-f094-4885-bf69-cd6236ebc875-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:50:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7c545154-4ada-41ed-baaf-f4c3d76901ab req-16a46690-4c22-4f4e-8980-003c7e33c34b service nova] Lock "71ff860c-f094-4885-bf69-cd6236ebc875-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:50:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7c545154-4ada-41ed-baaf-f4c3d76901ab req-16a46690-4c22-4f4e-8980-003c7e33c34b service nova] Lock "71ff860c-f094-4885-bf69-cd6236ebc875-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:50:30 user nova-compute[75100]: DEBUG nova.compute.manager [req-7c545154-4ada-41ed-baaf-f4c3d76901ab req-16a46690-4c22-4f4e-8980-003c7e33c34b service nova] [instance: 71ff860c-f094-4885-bf69-cd6236ebc875] No waiting events found dispatching network-vif-plugged-406f990a-ae7a-4d1d-9045-ccfe829faa61 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:50:30 user nova-compute[75100]: WARNING nova.compute.manager [req-7c545154-4ada-41ed-baaf-f4c3d76901ab req-16a46690-4c22-4f4e-8980-003c7e33c34b service nova] [instance: 71ff860c-f094-4885-bf69-cd6236ebc875] Received unexpected event network-vif-plugged-406f990a-ae7a-4d1d-9045-ccfe829faa61 for instance with vm_state deleted and task_state None.
Nov 10 17:50:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:50:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:50:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:50:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:50:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:50:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:50:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:50:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:50:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3c4d8e09-edcc-4316-b47b-0eb41ecca439 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Acquiring lock "db3f69df-51b2-464c-921e-33171e29f46d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:50:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3c4d8e09-edcc-4316-b47b-0eb41ecca439 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Lock "db3f69df-51b2-464c-921e-33171e29f46d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:50:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3c4d8e09-edcc-4316-b47b-0eb41ecca439 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Acquiring lock "db3f69df-51b2-464c-921e-33171e29f46d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:50:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3c4d8e09-edcc-4316-b47b-0eb41ecca439 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Lock "db3f69df-51b2-464c-921e-33171e29f46d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:50:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3c4d8e09-edcc-4316-b47b-0eb41ecca439 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Lock "db3f69df-51b2-464c-921e-33171e29f46d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:50:41 user nova-compute[75100]: INFO nova.compute.manager [None req-3c4d8e09-edcc-4316-b47b-0eb41ecca439 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] [instance: db3f69df-51b2-464c-921e-33171e29f46d] Terminating instance
Nov 10 17:50:41 user nova-compute[75100]: DEBUG nova.compute.manager [None req-3c4d8e09-edcc-4316-b47b-0eb41ecca439 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] [instance: db3f69df-51b2-464c-921e-33171e29f46d] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 17:50:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:50:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:50:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:50:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:50:41 user nova-compute[75100]: DEBUG nova.compute.manager [req-83fa6ce4-3a83-4455-92a8-f4df89633bb1 req-0df3572e-5102-41d3-bf1d-4ca8055a0478 service nova] [instance: db3f69df-51b2-464c-921e-33171e29f46d] Received event network-vif-unplugged-6dee04b2-6df4-439f-93de-f474b077cd60 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:50:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-83fa6ce4-3a83-4455-92a8-f4df89633bb1 req-0df3572e-5102-41d3-bf1d-4ca8055a0478 service nova] Acquiring lock "db3f69df-51b2-464c-921e-33171e29f46d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:50:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-83fa6ce4-3a83-4455-92a8-f4df89633bb1 req-0df3572e-5102-41d3-bf1d-4ca8055a0478 service nova] Lock "db3f69df-51b2-464c-921e-33171e29f46d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:50:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-83fa6ce4-3a83-4455-92a8-f4df89633bb1 req-0df3572e-5102-41d3-bf1d-4ca8055a0478 service nova] Lock "db3f69df-51b2-464c-921e-33171e29f46d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:50:41 user nova-compute[75100]: DEBUG nova.compute.manager [req-83fa6ce4-3a83-4455-92a8-f4df89633bb1 req-0df3572e-5102-41d3-bf1d-4ca8055a0478 service nova] [instance: db3f69df-51b2-464c-921e-33171e29f46d] No waiting events found dispatching network-vif-unplugged-6dee04b2-6df4-439f-93de-f474b077cd60 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:50:41 user nova-compute[75100]: DEBUG nova.compute.manager [req-83fa6ce4-3a83-4455-92a8-f4df89633bb1 req-0df3572e-5102-41d3-bf1d-4ca8055a0478 service nova] [instance: db3f69df-51b2-464c-921e-33171e29f46d] Received event network-vif-unplugged-6dee04b2-6df4-439f-93de-f474b077cd60 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 17:50:41 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: db3f69df-51b2-464c-921e-33171e29f46d] Instance destroyed successfully.
Nov 10 17:50:41 user nova-compute[75100]: DEBUG nova.objects.instance [None req-3c4d8e09-edcc-4316-b47b-0eb41ecca439 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Lazy-loading 'resources' on Instance uuid db3f69df-51b2-464c-921e-33171e29f46d {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:50:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-3c4d8e09-edcc-4316-b47b-0eb41ecca439 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:45:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-474483029',display_name='tempest-TestVolumeSwap-server-474483029',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-474483029',id=9,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1lLDNBgtx3q+PkD3TYvWLxFqpJI1OpVsikhMhqcZbJFFGq1rafwqwihbfVoPyMgTqb8CusBU1nzG7CgDThJvrxeNRTprDwC3j3w7x8/LkG0MFYW67Ue2HZAsAhf0ZkrA==',key_name='tempest-keypair-1000540697',keypairs=<?>,launch_index=0,launched_at=2023-11-10T17:45:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e29209a67b9d48bd8067be38d95ea656',ramdisk_id='',reservation_id='r-1aluadj6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-487928490',owner_user_name='tempest-TestVolumeSwap-487928490-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T17:45:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aebb4562848f44268afd12b033060561',uuid=db3f69df-51b2-464c-921e-33171e29f46d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6dee04b2-6df4-439f-93de-f474b077cd60", "address": "fa:16:3e:0c:f1:29", "network": {"id": "d5116328-c56e-407f-8316-5ebbd31e8e64", "bridge": "br-int", "label": "tempest-TestVolumeSwap-528250751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e29209a67b9d48bd8067be38d95ea656", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dee04b2-6d", "ovs_interfaceid": "6dee04b2-6df4-439f-93de-f474b077cd60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 17:50:41 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-3c4d8e09-edcc-4316-b47b-0eb41ecca439 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Converting VIF {"id": "6dee04b2-6df4-439f-93de-f474b077cd60", "address": "fa:16:3e:0c:f1:29", "network": {"id": "d5116328-c56e-407f-8316-5ebbd31e8e64", "bridge": "br-int", "label": "tempest-TestVolumeSwap-528250751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e29209a67b9d48bd8067be38d95ea656", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dee04b2-6d", "ovs_interfaceid": "6dee04b2-6df4-439f-93de-f474b077cd60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:50:41 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-3c4d8e09-edcc-4316-b47b-0eb41ecca439 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:f1:29,bridge_name='br-int',has_traffic_filtering=True,id=6dee04b2-6df4-439f-93de-f474b077cd60,network=Network(d5116328-c56e-407f-8316-5ebbd31e8e64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6dee04b2-6d') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:50:41 user nova-compute[75100]: DEBUG os_vif [None req-3c4d8e09-edcc-4316-b47b-0eb41ecca439 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:f1:29,bridge_name='br-int',has_traffic_filtering=True,id=6dee04b2-6df4-439f-93de-f474b077cd60,network=Network(d5116328-c56e-407f-8316-5ebbd31e8e64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6dee04b2-6d') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 17:50:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:50:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6dee04b2-6d, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:50:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:50:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:50:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:50:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fe19e779-7bcf-408e-8ef4-a310d456769d) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:50:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:50:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:50:41 user nova-compute[75100]: INFO os_vif [None req-3c4d8e09-edcc-4316-b47b-0eb41ecca439 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:f1:29,bridge_name='br-int',has_traffic_filtering=True,id=6dee04b2-6df4-439f-93de-f474b077cd60,network=Network(d5116328-c56e-407f-8316-5ebbd31e8e64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6dee04b2-6d')
Nov 10 17:50:41 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-3c4d8e09-edcc-4316-b47b-0eb41ecca439 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] [instance: db3f69df-51b2-464c-921e-33171e29f46d] Deleting instance files /opt/stack/data/nova/instances/db3f69df-51b2-464c-921e-33171e29f46d_del
Nov 10 17:50:41 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-3c4d8e09-edcc-4316-b47b-0eb41ecca439 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] [instance: db3f69df-51b2-464c-921e-33171e29f46d] Deletion of /opt/stack/data/nova/instances/db3f69df-51b2-464c-921e-33171e29f46d_del complete
Nov 10 17:50:41 user nova-compute[75100]: INFO nova.compute.manager [None req-3c4d8e09-edcc-4316-b47b-0eb41ecca439 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] [instance: db3f69df-51b2-464c-921e-33171e29f46d] Took 0.75 seconds to destroy the instance on the hypervisor.
Nov 10 17:50:41 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-3c4d8e09-edcc-4316-b47b-0eb41ecca439 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 17:50:41 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: db3f69df-51b2-464c-921e-33171e29f46d] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 17:50:41 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: db3f69df-51b2-464c-921e-33171e29f46d] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 17:50:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:50:43 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: db3f69df-51b2-464c-921e-33171e29f46d] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:50:43 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: db3f69df-51b2-464c-921e-33171e29f46d] Took 1.38 seconds to deallocate network for instance.
Nov 10 17:50:43 user nova-compute[75100]: DEBUG nova.compute.manager [req-1c7cac4e-a793-4564-8e0b-aa4b540f16a5 req-b6b97f2c-d16d-43f5-95a8-d94879600d8f service nova] [instance: db3f69df-51b2-464c-921e-33171e29f46d] Received event network-vif-deleted-6dee04b2-6df4-439f-93de-f474b077cd60 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:50:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3c4d8e09-edcc-4316-b47b-0eb41ecca439 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:50:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3c4d8e09-edcc-4316-b47b-0eb41ecca439 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:50:43 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-3c4d8e09-edcc-4316-b47b-0eb41ecca439 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Refreshing inventories for resource provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 17:50:43 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-3c4d8e09-edcc-4316-b47b-0eb41ecca439 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Updating ProviderTree inventory for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 17:50:43 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-3c4d8e09-edcc-4316-b47b-0eb41ecca439 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Updating inventory in ProviderTree for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 17:50:43 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-3c4d8e09-edcc-4316-b47b-0eb41ecca439 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Refreshing aggregate associations for resource provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64, aggregates: None {{(pid=75100) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 17:50:43 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-3c4d8e09-edcc-4316-b47b-0eb41ecca439 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Refreshing trait associations for resource provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2 {{(pid=75100) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 17:50:43 user nova-compute[75100]: DEBUG nova.compute.manager [req-a7c55955-bf58-4817-8be6-bf71d210aca5 req-52a166b7-6501-49bc-8605-88535442d7b8 service nova] [instance: db3f69df-51b2-464c-921e-33171e29f46d] Received event network-vif-plugged-6dee04b2-6df4-439f-93de-f474b077cd60 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:50:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a7c55955-bf58-4817-8be6-bf71d210aca5 req-52a166b7-6501-49bc-8605-88535442d7b8 service nova] Acquiring lock "db3f69df-51b2-464c-921e-33171e29f46d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:50:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a7c55955-bf58-4817-8be6-bf71d210aca5 req-52a166b7-6501-49bc-8605-88535442d7b8 service nova] Lock "db3f69df-51b2-464c-921e-33171e29f46d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:50:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a7c55955-bf58-4817-8be6-bf71d210aca5 req-52a166b7-6501-49bc-8605-88535442d7b8 service nova] Lock "db3f69df-51b2-464c-921e-33171e29f46d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:50:43 user nova-compute[75100]: DEBUG nova.compute.manager [req-a7c55955-bf58-4817-8be6-bf71d210aca5 req-52a166b7-6501-49bc-8605-88535442d7b8 service nova] [instance: db3f69df-51b2-464c-921e-33171e29f46d] No waiting events found dispatching network-vif-plugged-6dee04b2-6df4-439f-93de-f474b077cd60 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:50:43 user nova-compute[75100]: WARNING nova.compute.manager [req-a7c55955-bf58-4817-8be6-bf71d210aca5 req-52a166b7-6501-49bc-8605-88535442d7b8 service nova] [instance: db3f69df-51b2-464c-921e-33171e29f46d] Received unexpected event network-vif-plugged-6dee04b2-6df4-439f-93de-f474b077cd60 for instance with vm_state deleted and task_state None.
Nov 10 17:50:43 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-3c4d8e09-edcc-4316-b47b-0eb41ecca439 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:50:43 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-3c4d8e09-edcc-4316-b47b-0eb41ecca439 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:50:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3c4d8e09-edcc-4316-b47b-0eb41ecca439 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.502s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:50:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:50:43 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-3c4d8e09-edcc-4316-b47b-0eb41ecca439 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Deleted allocations for instance db3f69df-51b2-464c-921e-33171e29f46d
Nov 10 17:50:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3c4d8e09-edcc-4316-b47b-0eb41ecca439 tempest-TestVolumeSwap-487928490 tempest-TestVolumeSwap-487928490-project-member] Lock "db3f69df-51b2-464c-921e-33171e29f46d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.860s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:50:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:50:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:50:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:50:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:50:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:51:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:51:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-161200b9-d2c8-4fdd-a140-f849fa26dbb9 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Acquiring lock "111bd74e-2943-4f12-9514-b564cf26dadb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:51:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-161200b9-d2c8-4fdd-a140-f849fa26dbb9 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Lock "111bd74e-2943-4f12-9514-b564cf26dadb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:51:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-161200b9-d2c8-4fdd-a140-f849fa26dbb9 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Acquiring lock "111bd74e-2943-4f12-9514-b564cf26dadb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:51:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-161200b9-d2c8-4fdd-a140-f849fa26dbb9 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Lock "111bd74e-2943-4f12-9514-b564cf26dadb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:51:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-161200b9-d2c8-4fdd-a140-f849fa26dbb9 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Lock "111bd74e-2943-4f12-9514-b564cf26dadb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:51:02 user nova-compute[75100]: INFO nova.compute.manager [None req-161200b9-d2c8-4fdd-a140-f849fa26dbb9 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Terminating instance
Nov 10 17:51:02 user nova-compute[75100]: DEBUG nova.compute.manager [None req-161200b9-d2c8-4fdd-a140-f849fa26dbb9 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 17:51:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:51:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:51:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:51:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:51:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:51:02 user nova-compute[75100]: DEBUG nova.compute.manager [req-23ef399f-3284-4ff0-955f-5963390cb7f8 req-c7a1e8f0-04d4-4a66-a748-166f7ab81f6c service nova] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Received event network-vif-unplugged-26f643d1-0961-49af-bde1-32d1a6b0941d {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:51:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-23ef399f-3284-4ff0-955f-5963390cb7f8 req-c7a1e8f0-04d4-4a66-a748-166f7ab81f6c service nova] Acquiring lock "111bd74e-2943-4f12-9514-b564cf26dadb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:51:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-23ef399f-3284-4ff0-955f-5963390cb7f8 req-c7a1e8f0-04d4-4a66-a748-166f7ab81f6c service nova] Lock "111bd74e-2943-4f12-9514-b564cf26dadb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:51:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-23ef399f-3284-4ff0-955f-5963390cb7f8 req-c7a1e8f0-04d4-4a66-a748-166f7ab81f6c service nova] Lock "111bd74e-2943-4f12-9514-b564cf26dadb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:51:02 user nova-compute[75100]: DEBUG nova.compute.manager [req-23ef399f-3284-4ff0-955f-5963390cb7f8 req-c7a1e8f0-04d4-4a66-a748-166f7ab81f6c service nova] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] No waiting events found dispatching network-vif-unplugged-26f643d1-0961-49af-bde1-32d1a6b0941d {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:51:02 user nova-compute[75100]: DEBUG nova.compute.manager [req-23ef399f-3284-4ff0-955f-5963390cb7f8 req-c7a1e8f0-04d4-4a66-a748-166f7ab81f6c service nova] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Received event network-vif-unplugged-26f643d1-0961-49af-bde1-32d1a6b0941d for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 17:51:02 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Instance destroyed successfully.
Nov 10 17:51:02 user nova-compute[75100]: DEBUG nova.objects.instance [None req-161200b9-d2c8-4fdd-a140-f849fa26dbb9 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Lazy-loading 'resources' on Instance uuid 111bd74e-2943-4f12-9514-b564cf26dadb {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:51:02 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-161200b9-d2c8-4fdd-a140-f849fa26dbb9 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T17:46:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-483449440',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-51640417',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrKIMtk4kEwRtjbNDdESYG/eisyJknH+FhllMfNkzOhc8u5uNZOhOKf+vnV4PIFkkxSuZX7HodgT53XzLo5dAjQLzj42zR+o2Z9UiOkxsnJ+ZOoOQHi2OVpW8H5WpdMew==',key_name='tempest-keypair-1759515291',keypairs=<?>,launch_index=0,launched_at=2023-11-10T17:49:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d69fe121924d471abc0e62a4a32e4a75',ramdisk_id='',reservation_id='r-m3nm1elv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-2085671475',owner_user_name='tempest-ServerActionsV293TestJSON-2085671475-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T17:50:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bad2868941f0446f8674b47a316fa757',uuid=111bd74e-2943-4f12-9514-b564cf26dadb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26f643d1-0961-49af-bde1-32d1a6b0941d", "address": "fa:16:3e:45:39:04", "network": {"id": "2fcf93f6-0be9-4c44-8caa-e5e556d88de8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1797631123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69fe121924d471abc0e62a4a32e4a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26f643d1-09", "ovs_interfaceid": "26f643d1-0961-49af-bde1-32d1a6b0941d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 17:51:02 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-161200b9-d2c8-4fdd-a140-f849fa26dbb9 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Converting VIF {"id": "26f643d1-0961-49af-bde1-32d1a6b0941d", "address": "fa:16:3e:45:39:04", "network": {"id": "2fcf93f6-0be9-4c44-8caa-e5e556d88de8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1797631123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69fe121924d471abc0e62a4a32e4a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26f643d1-09", "ovs_interfaceid": "26f643d1-0961-49af-bde1-32d1a6b0941d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:51:02 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-161200b9-d2c8-4fdd-a140-f849fa26dbb9 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:45:39:04,bridge_name='br-int',has_traffic_filtering=True,id=26f643d1-0961-49af-bde1-32d1a6b0941d,network=Network(2fcf93f6-0be9-4c44-8caa-e5e556d88de8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26f643d1-09') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:51:02 user nova-compute[75100]: DEBUG os_vif [None req-161200b9-d2c8-4fdd-a140-f849fa26dbb9 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:39:04,bridge_name='br-int',has_traffic_filtering=True,id=26f643d1-0961-49af-bde1-32d1a6b0941d,network=Network(2fcf93f6-0be9-4c44-8caa-e5e556d88de8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26f643d1-09') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 17:51:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:51:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap26f643d1-09, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:51:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:51:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:51:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:51:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e6b17cbd-072a-4fa0-a5e2-77a9f180c8d1) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:51:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:51:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:51:02 user nova-compute[75100]: INFO os_vif [None req-161200b9-d2c8-4fdd-a140-f849fa26dbb9 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:39:04,bridge_name='br-int',has_traffic_filtering=True,id=26f643d1-0961-49af-bde1-32d1a6b0941d,network=Network(2fcf93f6-0be9-4c44-8caa-e5e556d88de8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26f643d1-09')
Nov 10 17:51:02 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-161200b9-d2c8-4fdd-a140-f849fa26dbb9 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 17:51:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-161200b9-d2c8-4fdd-a140-f849fa26dbb9 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, {'target_iqn': 'iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Yhtwynlz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 17:51:02 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-161200b9-d2c8-4fdd-a140-f849fa26dbb9 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 17:51:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-161200b9-d2c8-4fdd-a140-f849fa26dbb9 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 17:51:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-161200b9-d2c8-4fdd-a140-f849fa26dbb9 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 17:51:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:51:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:51:03 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47a4994-fd13-4b9e-9565-fa0eb468bdfb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:51:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-161200b9-d2c8-4fdd-a140-f849fa26dbb9 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 17:51:03 user nova-compute[75100]: No targets found.
Nov 10 17:51:03 user nova-compute[75100]: iSNS:
Nov 10 17:51:03 user nova-compute[75100]: No targets found.
Nov 10 17:51:03 user nova-compute[75100]: STATIC:
Nov 10 17:51:03 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb
Nov 10 17:51:03 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 17:51:03 user nova-compute[75100]:                 Iface Name: default
Nov 10 17:51:03 user nova-compute[75100]: FIRMWARE:
Nov 10 17:51:03 user nova-compute[75100]: No targets found.
Nov 10 17:51:03 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:51:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-161200b9-d2c8-4fdd-a140-f849fa26dbb9 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 17:51:03 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 17:51:03 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 17:51:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-161200b9-d2c8-4fdd-a140-f849fa26dbb9 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 17:51:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:51:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:51:03 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f5a751-d2bb-4ac3-aa80-edc64ac967ad]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:51:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:51:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:51:03 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[650585e4-6de5-4168-ae75-0133bb085e08]: (4, ('tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:51:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-161200b9-d2c8-4fdd-a140-f849fa26dbb9 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb (non-flash)
Nov 10 17:51:03 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:51:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-161200b9-d2c8-4fdd-a140-f849fa26dbb9 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] iscsi session list stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb (non-flash)
Nov 10 17:51:03 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 17:51:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-161200b9-d2c8-4fdd-a140-f849fa26dbb9 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3bc78b2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb'): ({'sdb'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 17:51:03 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-161200b9-d2c8-4fdd-a140-f849fa26dbb9 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Removing single pathed devices sdb {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 17:51:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:51:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:51:03 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1e9760-9f6c-42e0-9051-9a8904a5e985]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:51:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:51:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:51:03 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[372f0a6e-01ca-4ba6-85a2-d07dc3236453]: (4, ('ok\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:51:03 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-161200b9-d2c8-4fdd-a140-f849fa26dbb9 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Flushing IO for device /dev/sdb {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 17:51:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:51:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:51:03 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[089995d5-d419-4b8a-a782-c59aa50f584e]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:51:03 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-161200b9-d2c8-4fdd-a140-f849fa26dbb9 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 17:51:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:51:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:51:03 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[58dc5325-96fb-4ef5-ae8a-066e9b45bfc0]: (4, ('1', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:51:03 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-161200b9-d2c8-4fdd-a140-f849fa26dbb9 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 17:51:03 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-161200b9-d2c8-4fdd-a140-f849fa26dbb9 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 17:51:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-161200b9-d2c8-4fdd-a140-f849fa26dbb9 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 17:51:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:51:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:51:03 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5333d5-5da8-43b2-b963-6e67a4d603cc]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:51:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-161200b9-d2c8-4fdd-a140-f849fa26dbb9 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:51:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb -p 172.16.0.220:3260 --logout {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:51:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:51:03 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2176e2-98ec-4582-8e02-95eccd0a16eb]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:51:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-161200b9-d2c8-4fdd-a140-f849fa26dbb9 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb, portal: 172.16.0.220,3260]
Nov 10 17:51:03 user nova-compute[75100]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb, portal: 172.16.0.220,3260] successful.
Nov 10 17:51:03 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:51:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb -p 172.16.0.220:3260 --op delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:51:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23131533-b27f-4598-84b7-44ed1d8878cb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:51:03 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7834cb-ca1f-48b5-a008-73bd4f831388]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:51:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-161200b9-d2c8-4fdd-a140-f849fa26dbb9 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:51:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-161200b9-d2c8-4fdd-a140-f849fa26dbb9 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 17:51:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-161200b9-d2c8-4fdd-a140-f849fa26dbb9 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] <== disconnect_volume: return (332ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 17:51:03 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-161200b9-d2c8-4fdd-a140-f849fa26dbb9 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 17:51:03 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-161200b9-d2c8-4fdd-a140-f849fa26dbb9 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Deleting instance files /opt/stack/data/nova/instances/111bd74e-2943-4f12-9514-b564cf26dadb_del
Nov 10 17:51:03 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-161200b9-d2c8-4fdd-a140-f849fa26dbb9 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Deletion of /opt/stack/data/nova/instances/111bd74e-2943-4f12-9514-b564cf26dadb_del complete
Nov 10 17:51:03 user nova-compute[75100]: INFO nova.compute.manager [None req-161200b9-d2c8-4fdd-a140-f849fa26dbb9 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Took 1.07 seconds to destroy the instance on the hypervisor.
Nov 10 17:51:03 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-161200b9-d2c8-4fdd-a140-f849fa26dbb9 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 17:51:03 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 17:51:03 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 17:51:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:51:04 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:51:04 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Took 0.72 seconds to deallocate network for instance.
Nov 10 17:51:04 user nova-compute[75100]: INFO nova.compute.manager [None req-2135c7ba-ebaa-4964-91e8-2a1ea607ee34 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Unrescuing
Nov 10 17:51:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2135c7ba-ebaa-4964-91e8-2a1ea607ee34 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Acquiring lock "refresh_cache-b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:51:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2135c7ba-ebaa-4964-91e8-2a1ea607ee34 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Acquired lock "refresh_cache-b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:51:04 user nova-compute[75100]: DEBUG nova.network.neutron [None req-2135c7ba-ebaa-4964-91e8-2a1ea607ee34 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 17:51:04 user nova-compute[75100]: DEBUG nova.network.neutron [None req-2135c7ba-ebaa-4964-91e8-2a1ea607ee34 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Updating instance_info_cache with network_info: [{"id": "be620d2e-a2ea-49fe-9205-68101009027b", "address": "fa:16:3e:2d:37:4e", "network": {"id": "26a554fe-9a5e-40c0-9981-5ac084c9ea73", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-269663495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19755f3e634fdfbd562c33fbfa2a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe620d2e-a2", "ovs_interfaceid": "be620d2e-a2ea-49fe-9205-68101009027b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:51:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2135c7ba-ebaa-4964-91e8-2a1ea607ee34 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Releasing lock "refresh_cache-b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:51:04 user nova-compute[75100]: DEBUG nova.objects.instance [None req-2135c7ba-ebaa-4964-91e8-2a1ea607ee34 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lazy-loading 'flavor' on Instance uuid b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:51:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:51:04 user nova-compute[75100]: DEBUG nova.compute.manager [req-461fb7e8-6ab4-4d58-81cf-7da92b5b903b req-83be7c73-02a9-447b-bc5d-b13032af10c3 service nova] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Received event network-vif-plugged-26f643d1-0961-49af-bde1-32d1a6b0941d {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:51:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-461fb7e8-6ab4-4d58-81cf-7da92b5b903b req-83be7c73-02a9-447b-bc5d-b13032af10c3 service nova] Acquiring lock "111bd74e-2943-4f12-9514-b564cf26dadb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:51:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-461fb7e8-6ab4-4d58-81cf-7da92b5b903b req-83be7c73-02a9-447b-bc5d-b13032af10c3 service nova] Lock "111bd74e-2943-4f12-9514-b564cf26dadb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:51:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-461fb7e8-6ab4-4d58-81cf-7da92b5b903b req-83be7c73-02a9-447b-bc5d-b13032af10c3 service nova] Lock "111bd74e-2943-4f12-9514-b564cf26dadb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:51:04 user nova-compute[75100]: DEBUG nova.compute.manager [req-461fb7e8-6ab4-4d58-81cf-7da92b5b903b req-83be7c73-02a9-447b-bc5d-b13032af10c3 service nova] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] No waiting events found dispatching network-vif-plugged-26f643d1-0961-49af-bde1-32d1a6b0941d {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:51:04 user nova-compute[75100]: WARNING nova.compute.manager [req-461fb7e8-6ab4-4d58-81cf-7da92b5b903b req-83be7c73-02a9-447b-bc5d-b13032af10c3 service nova] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Received unexpected event network-vif-plugged-26f643d1-0961-49af-bde1-32d1a6b0941d for instance with vm_state active and task_state deleting.
Nov 10 17:51:04 user nova-compute[75100]: DEBUG nova.compute.manager [req-461fb7e8-6ab4-4d58-81cf-7da92b5b903b req-83be7c73-02a9-447b-bc5d-b13032af10c3 service nova] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Received event network-vif-deleted-26f643d1-0961-49af-bde1-32d1a6b0941d {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:51:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:51:05 user nova-compute[75100]: DEBUG nova.compute.manager [req-eeb253bd-513f-4c7f-be9f-53ffeac8ed23 req-1919dc59-4fa3-4217-96de-276836819259 service nova] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Received event network-vif-unplugged-be620d2e-a2ea-49fe-9205-68101009027b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:51:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-eeb253bd-513f-4c7f-be9f-53ffeac8ed23 req-1919dc59-4fa3-4217-96de-276836819259 service nova] Acquiring lock "b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:51:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-eeb253bd-513f-4c7f-be9f-53ffeac8ed23 req-1919dc59-4fa3-4217-96de-276836819259 service nova] Lock "b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:51:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-eeb253bd-513f-4c7f-be9f-53ffeac8ed23 req-1919dc59-4fa3-4217-96de-276836819259 service nova] Lock "b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:51:05 user nova-compute[75100]: DEBUG nova.compute.manager [req-eeb253bd-513f-4c7f-be9f-53ffeac8ed23 req-1919dc59-4fa3-4217-96de-276836819259 service nova] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] No waiting events found dispatching network-vif-unplugged-be620d2e-a2ea-49fe-9205-68101009027b {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:51:05 user nova-compute[75100]: WARNING nova.compute.manager [req-eeb253bd-513f-4c7f-be9f-53ffeac8ed23 req-1919dc59-4fa3-4217-96de-276836819259 service nova] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Received unexpected event network-vif-unplugged-be620d2e-a2ea-49fe-9205-68101009027b for instance with vm_state rescued and task_state unrescuing.
Nov 10 17:51:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:51:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:51:05 user nova-compute[75100]: INFO nova.compute.manager [None req-161200b9-d2c8-4fdd-a140-f849fa26dbb9 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Took 1.21 seconds to detach 1 volumes for instance.
Nov 10 17:51:05 user nova-compute[75100]: DEBUG nova.compute.manager [None req-161200b9-d2c8-4fdd-a140-f849fa26dbb9 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] [instance: 111bd74e-2943-4f12-9514-b564cf26dadb] Deleting volume: 23131533-b27f-4598-84b7-44ed1d8878cb {{(pid=75100) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 10 17:51:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-161200b9-d2c8-4fdd-a140-f849fa26dbb9 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:51:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-161200b9-d2c8-4fdd-a140-f849fa26dbb9 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:51:05 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Instance destroyed successfully.
Nov 10 17:51:05 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-161200b9-d2c8-4fdd-a140-f849fa26dbb9 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:51:05 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-161200b9-d2c8-4fdd-a140-f849fa26dbb9 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:51:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-161200b9-d2c8-4fdd-a140-f849fa26dbb9 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.437s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:51:05 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-161200b9-d2c8-4fdd-a140-f849fa26dbb9 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Deleted allocations for instance 111bd74e-2943-4f12-9514-b564cf26dadb
Nov 10 17:51:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-161200b9-d2c8-4fdd-a140-f849fa26dbb9 tempest-ServerActionsV293TestJSON-2085671475 tempest-ServerActionsV293TestJSON-2085671475-project-member] Lock "111bd74e-2943-4f12-9514-b564cf26dadb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.786s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:51:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:51:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:51:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:51:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:51:07 user nova-compute[75100]: DEBUG nova.compute.manager [req-6c7ef59e-0c96-4c50-8789-a9b18194aafb req-7601f0b3-ac2e-4f2e-ae16-ae43d868b68d service nova] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Received event network-vif-plugged-be620d2e-a2ea-49fe-9205-68101009027b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:51:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6c7ef59e-0c96-4c50-8789-a9b18194aafb req-7601f0b3-ac2e-4f2e-ae16-ae43d868b68d service nova] Acquiring lock "b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:51:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6c7ef59e-0c96-4c50-8789-a9b18194aafb req-7601f0b3-ac2e-4f2e-ae16-ae43d868b68d service nova] Lock "b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:51:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6c7ef59e-0c96-4c50-8789-a9b18194aafb req-7601f0b3-ac2e-4f2e-ae16-ae43d868b68d service nova] Lock "b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:51:07 user nova-compute[75100]: DEBUG nova.compute.manager [req-6c7ef59e-0c96-4c50-8789-a9b18194aafb req-7601f0b3-ac2e-4f2e-ae16-ae43d868b68d service nova] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] No waiting events found dispatching network-vif-plugged-be620d2e-a2ea-49fe-9205-68101009027b {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:51:07 user nova-compute[75100]: WARNING nova.compute.manager [req-6c7ef59e-0c96-4c50-8789-a9b18194aafb req-7601f0b3-ac2e-4f2e-ae16-ae43d868b68d service nova] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Received unexpected event network-vif-plugged-be620d2e-a2ea-49fe-9205-68101009027b for instance with vm_state rescued and task_state unrescuing.
Nov 10 17:51:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:51:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:51:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:51:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:51:09 user nova-compute[75100]: DEBUG nova.compute.manager [req-972ba38a-f43e-4917-9dc5-1ef9a79f0033 req-155c453b-0b17-4d66-bb34-335909202a9f service nova] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Received event network-vif-plugged-be620d2e-a2ea-49fe-9205-68101009027b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:51:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-972ba38a-f43e-4917-9dc5-1ef9a79f0033 req-155c453b-0b17-4d66-bb34-335909202a9f service nova] Acquiring lock "b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:51:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-972ba38a-f43e-4917-9dc5-1ef9a79f0033 req-155c453b-0b17-4d66-bb34-335909202a9f service nova] Lock "b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:51:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-972ba38a-f43e-4917-9dc5-1ef9a79f0033 req-155c453b-0b17-4d66-bb34-335909202a9f service nova] Lock "b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:51:09 user nova-compute[75100]: DEBUG nova.compute.manager [req-972ba38a-f43e-4917-9dc5-1ef9a79f0033 req-155c453b-0b17-4d66-bb34-335909202a9f service nova] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] No waiting events found dispatching network-vif-plugged-be620d2e-a2ea-49fe-9205-68101009027b {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:51:09 user nova-compute[75100]: WARNING nova.compute.manager [req-972ba38a-f43e-4917-9dc5-1ef9a79f0033 req-155c453b-0b17-4d66-bb34-335909202a9f service nova] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Received unexpected event network-vif-plugged-be620d2e-a2ea-49fe-9205-68101009027b for instance with vm_state rescued and task_state unrescuing.
Nov 10 17:51:09 user nova-compute[75100]: DEBUG nova.compute.manager [req-972ba38a-f43e-4917-9dc5-1ef9a79f0033 req-155c453b-0b17-4d66-bb34-335909202a9f service nova] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Received event network-vif-plugged-be620d2e-a2ea-49fe-9205-68101009027b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:51:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-972ba38a-f43e-4917-9dc5-1ef9a79f0033 req-155c453b-0b17-4d66-bb34-335909202a9f service nova] Acquiring lock "b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:51:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-972ba38a-f43e-4917-9dc5-1ef9a79f0033 req-155c453b-0b17-4d66-bb34-335909202a9f service nova] Lock "b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:51:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-972ba38a-f43e-4917-9dc5-1ef9a79f0033 req-155c453b-0b17-4d66-bb34-335909202a9f service nova] Lock "b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:51:09 user nova-compute[75100]: DEBUG nova.compute.manager [req-972ba38a-f43e-4917-9dc5-1ef9a79f0033 req-155c453b-0b17-4d66-bb34-335909202a9f service nova] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] No waiting events found dispatching network-vif-plugged-be620d2e-a2ea-49fe-9205-68101009027b {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:51:09 user nova-compute[75100]: WARNING nova.compute.manager [req-972ba38a-f43e-4917-9dc5-1ef9a79f0033 req-155c453b-0b17-4d66-bb34-335909202a9f service nova] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Received unexpected event network-vif-plugged-be620d2e-a2ea-49fe-9205-68101009027b for instance with vm_state rescued and task_state unrescuing.
Nov 10 17:51:09 user nova-compute[75100]: DEBUG nova.compute.manager [None req-2135c7ba-ebaa-4964-91e8-2a1ea607ee34 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 17:51:10 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:51:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:51:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:51:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Acquiring lock "e6de4626-f097-43b7-8e56-a08415e7d74a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:51:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lock "e6de4626-f097-43b7-8e56-a08415e7d74a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:51:14 user nova-compute[75100]: DEBUG nova.compute.manager [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 17:51:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:51:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:51:14 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 17:51:14 user nova-compute[75100]: INFO nova.compute.claims [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Claim successful on node user
Nov 10 17:51:14 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:51:14 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:51:14 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:51:14 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:51:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.506s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:51:14 user nova-compute[75100]: DEBUG nova.compute.manager [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 17:51:14 user nova-compute[75100]: DEBUG nova.compute.manager [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 17:51:14 user nova-compute[75100]: DEBUG nova.network.neutron [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 17:51:14 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 17:51:14 user nova-compute[75100]: DEBUG nova.compute.manager [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 17:51:14 user nova-compute[75100]: INFO nova.virt.block_device [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Booting with volume-backed-image e3cc5321-4d40-49ee-885c-700e14741732 at /dev/vda
Nov 10 17:51:15 user nova-compute[75100]: DEBUG nova.policy [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b79cb22ab5774ce8991f237bd2204555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c970a503d74d32a1e2b71f086649fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 17:51:15 user nova-compute[75100]: DEBUG nova.network.neutron [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Successfully created port: d3d11e2e-7099-4c6e-aa65-53f953ce4571 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 17:51:16 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:51:16 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:51:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:51:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:51:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:51:16 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 17:51:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:51:16 user nova-compute[75100]: DEBUG nova.network.neutron [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Successfully updated port: d3d11e2e-7099-4c6e-aa65-53f953ce4571 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 17:51:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Acquiring lock "refresh_cache-e6de4626-f097-43b7-8e56-a08415e7d74a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:51:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Acquired lock "refresh_cache-e6de4626-f097-43b7-8e56-a08415e7d74a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:51:16 user nova-compute[75100]: DEBUG nova.network.neutron [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 17:51:16 user nova-compute[75100]: DEBUG nova.compute.manager [req-51949280-0ac4-4792-a779-0dc4eb916803 req-47c741aa-769b-4559-ae99-b0284f62b492 service nova] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Received event network-changed-d3d11e2e-7099-4c6e-aa65-53f953ce4571 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:51:16 user nova-compute[75100]: DEBUG nova.compute.manager [req-51949280-0ac4-4792-a779-0dc4eb916803 req-47c741aa-769b-4559-ae99-b0284f62b492 service nova] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Refreshing instance network info cache due to event network-changed-d3d11e2e-7099-4c6e-aa65-53f953ce4571. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 17:51:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-51949280-0ac4-4792-a779-0dc4eb916803 req-47c741aa-769b-4559-ae99-b0284f62b492 service nova] Acquiring lock "refresh_cache-e6de4626-f097-43b7-8e56-a08415e7d74a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:51:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:51:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:51:16 user nova-compute[75100]: DEBUG nova.network.neutron [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 17:51:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:51:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:51:17 user nova-compute[75100]: DEBUG nova.network.neutron [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Updating instance_info_cache with network_info: [{"id": "d3d11e2e-7099-4c6e-aa65-53f953ce4571", "address": "fa:16:3e:86:a7:41", "network": {"id": "f240fae3-3d7b-4b6e-b04f-18550ab4d0a3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1007355777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c970a503d74d32a1e2b71f086649fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d11e2e-70", "ovs_interfaceid": "d3d11e2e-7099-4c6e-aa65-53f953ce4571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:51:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Releasing lock "refresh_cache-e6de4626-f097-43b7-8e56-a08415e7d74a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:51:17 user nova-compute[75100]: DEBUG nova.compute.manager [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Instance network_info: |[{"id": "d3d11e2e-7099-4c6e-aa65-53f953ce4571", "address": "fa:16:3e:86:a7:41", "network": {"id": "f240fae3-3d7b-4b6e-b04f-18550ab4d0a3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1007355777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c970a503d74d32a1e2b71f086649fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d11e2e-70", "ovs_interfaceid": "d3d11e2e-7099-4c6e-aa65-53f953ce4571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 17:51:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-51949280-0ac4-4792-a779-0dc4eb916803 req-47c741aa-769b-4559-ae99-b0284f62b492 service nova] Acquired lock "refresh_cache-e6de4626-f097-43b7-8e56-a08415e7d74a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:51:17 user nova-compute[75100]: DEBUG nova.network.neutron [req-51949280-0ac4-4792-a779-0dc4eb916803 req-47c741aa-769b-4559-ae99-b0284f62b492 service nova] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Refreshing network info cache for port d3d11e2e-7099-4c6e-aa65-53f953ce4571 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 17:51:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:51:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:51:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:51:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:51:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:51:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:51:17 user nova-compute[75100]: DEBUG nova.network.neutron [req-51949280-0ac4-4792-a779-0dc4eb916803 req-47c741aa-769b-4559-ae99-b0284f62b492 service nova] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Updated VIF entry in instance network info cache for port d3d11e2e-7099-4c6e-aa65-53f953ce4571. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 17:51:17 user nova-compute[75100]: DEBUG nova.network.neutron [req-51949280-0ac4-4792-a779-0dc4eb916803 req-47c741aa-769b-4559-ae99-b0284f62b492 service nova] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Updating instance_info_cache with network_info: [{"id": "d3d11e2e-7099-4c6e-aa65-53f953ce4571", "address": "fa:16:3e:86:a7:41", "network": {"id": "f240fae3-3d7b-4b6e-b04f-18550ab4d0a3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1007355777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c970a503d74d32a1e2b71f086649fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d11e2e-70", "ovs_interfaceid": "d3d11e2e-7099-4c6e-aa65-53f953ce4571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:51:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-51949280-0ac4-4792-a779-0dc4eb916803 req-47c741aa-769b-4559-ae99-b0284f62b492 service nova] Releasing lock "refresh_cache-e6de4626-f097-43b7-8e56-a08415e7d74a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:51:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:51:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:51:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:51:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:51:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:51:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:51:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:51:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:51:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:51:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk.rescue --force-share --output=json" returned: 0 in 0.245s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:51:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:51:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:51:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:51:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:51:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:51:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:51:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:51:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:51:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61d3862-5be7-45cc-95a0-88124ac1725d/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:51:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61d3862-5be7-45cc-95a0-88124ac1725d/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:51:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61d3862-5be7-45cc-95a0-88124ac1725d/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:51:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61d3862-5be7-45cc-95a0-88124ac1725d/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:51:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ead532eb-c8be-45fa-a8b7-0b4c4f884a90/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:51:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ead532eb-c8be-45fa-a8b7-0b4c4f884a90/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:51:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ead532eb-c8be-45fa-a8b7-0b4c4f884a90/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:51:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ead532eb-c8be-45fa-a8b7-0b4c4f884a90/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:51:20 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:51:20 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:51:20 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Hypervisor/Node resource view: name=user free_ram=7624MB free_disk=24.702438354492188GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 17:51:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:51:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:51:20 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance c19fc271-a248-4631-a11f-89b7ed73bf85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:51:20 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:51:20 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 3e14de19-540d-4dc2-a058-6874d8d14478 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:51:20 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance ead532eb-c8be-45fa-a8b7-0b4c4f884a90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:51:20 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance d61d3862-5be7-45cc-95a0-88124ac1725d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:51:20 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance eb430407-f836-4510-899f-a5f5d60c73f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:51:20 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:51:20 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:51:20 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance e6de4626-f097-43b7-8e56-a08415e7d74a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:51:20 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 17:51:20 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 17:51:21 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:51:21 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:51:21 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 17:51:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.583s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:51:22 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:51:22 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:51:22 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 17:51:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "refresh_cache-b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:51:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquired lock "refresh_cache-b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:51:22 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 17:51:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:51:22 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Updating instance_info_cache with network_info: [{"id": "be620d2e-a2ea-49fe-9205-68101009027b", "address": "fa:16:3e:2d:37:4e", "network": {"id": "26a554fe-9a5e-40c0-9981-5ac084c9ea73", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-269663495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19755f3e634fdfbd562c33fbfa2a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe620d2e-a2", "ovs_interfaceid": "be620d2e-a2ea-49fe-9205-68101009027b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:51:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Releasing lock "refresh_cache-b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:51:23 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 17:51:23 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:51:23 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:51:23 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 17:51:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:51:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:51:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:51:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:51:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:51:34 user nova-compute[75100]: DEBUG nova.compute.manager [req-a3c94ef5-85d3-4086-b9a3-f5f4be00079c req-d9bf3f6a-3ecf-44c0-b88b-716a093f91e8 service nova] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Received event network-changed-6e9b2058-6104-4f6c-8c72-f5f15d0d116b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:51:34 user nova-compute[75100]: DEBUG nova.compute.manager [req-a3c94ef5-85d3-4086-b9a3-f5f4be00079c req-d9bf3f6a-3ecf-44c0-b88b-716a093f91e8 service nova] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Refreshing instance network info cache due to event network-changed-6e9b2058-6104-4f6c-8c72-f5f15d0d116b. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 17:51:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a3c94ef5-85d3-4086-b9a3-f5f4be00079c req-d9bf3f6a-3ecf-44c0-b88b-716a093f91e8 service nova] Acquiring lock "refresh_cache-eb430407-f836-4510-899f-a5f5d60c73f3" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:51:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a3c94ef5-85d3-4086-b9a3-f5f4be00079c req-d9bf3f6a-3ecf-44c0-b88b-716a093f91e8 service nova] Acquired lock "refresh_cache-eb430407-f836-4510-899f-a5f5d60c73f3" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:51:34 user nova-compute[75100]: DEBUG nova.network.neutron [req-a3c94ef5-85d3-4086-b9a3-f5f4be00079c req-d9bf3f6a-3ecf-44c0-b88b-716a093f91e8 service nova] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Refreshing network info cache for port 6e9b2058-6104-4f6c-8c72-f5f15d0d116b {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 17:51:34 user nova-compute[75100]: DEBUG nova.network.neutron [req-a3c94ef5-85d3-4086-b9a3-f5f4be00079c req-d9bf3f6a-3ecf-44c0-b88b-716a093f91e8 service nova] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Updated VIF entry in instance network info cache for port 6e9b2058-6104-4f6c-8c72-f5f15d0d116b. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 17:51:34 user nova-compute[75100]: DEBUG nova.network.neutron [req-a3c94ef5-85d3-4086-b9a3-f5f4be00079c req-d9bf3f6a-3ecf-44c0-b88b-716a093f91e8 service nova] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Updating instance_info_cache with network_info: [{"id": "6e9b2058-6104-4f6c-8c72-f5f15d0d116b", "address": "fa:16:3e:2f:11:f6", "network": {"id": "f67bc940-2f01-4255-b12e-427ffcd7e4e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-977195248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e95560897fb46258db0ecd7dc7b9294", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9b2058-61", "ovs_interfaceid": "6e9b2058-6104-4f6c-8c72-f5f15d0d116b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:51:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a3c94ef5-85d3-4086-b9a3-f5f4be00079c req-d9bf3f6a-3ecf-44c0-b88b-716a093f91e8 service nova] Releasing lock "refresh_cache-eb430407-f836-4510-899f-a5f5d60c73f3" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:51:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Acquiring lock "e1defbdd-4363-49c9-bc9a-a35da42c53bf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:51:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "e1defbdd-4363-49c9-bc9a-a35da42c53bf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:51:34 user nova-compute[75100]: DEBUG nova.compute.manager [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 17:51:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:51:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:51:34 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 17:51:34 user nova-compute[75100]: INFO nova.compute.claims [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] Claim successful on node user
Nov 10 17:51:35 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:51:35 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:51:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.504s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:51:35 user nova-compute[75100]: DEBUG nova.compute.manager [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 17:51:35 user nova-compute[75100]: DEBUG nova.compute.manager [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 17:51:35 user nova-compute[75100]: DEBUG nova.network.neutron [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 17:51:35 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 17:51:35 user nova-compute[75100]: DEBUG nova.compute.manager [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 17:51:35 user nova-compute[75100]: DEBUG nova.policy [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '323c5738ca424a379f666b4ca60825ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd441a46aa4a579feff608d6ff9bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 17:51:35 user nova-compute[75100]: INFO nova.virt.block_device [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] Booting with volume snapshot 6efb402f-c924-4fe5-bf50-41c91cb74dec at /dev/vda
Nov 10 17:51:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:51:36 user nova-compute[75100]: DEBUG nova.network.neutron [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] Successfully created port: 511e58ad-c419-4668-ba70-31049acd2e82 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 17:51:37 user nova-compute[75100]: DEBUG nova.network.neutron [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] Successfully updated port: 511e58ad-c419-4668-ba70-31049acd2e82 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 17:51:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Acquiring lock "refresh_cache-e1defbdd-4363-49c9-bc9a-a35da42c53bf" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:51:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Acquired lock "refresh_cache-e1defbdd-4363-49c9-bc9a-a35da42c53bf" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:51:37 user nova-compute[75100]: DEBUG nova.network.neutron [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 17:51:37 user nova-compute[75100]: DEBUG nova.compute.manager [req-6543948a-5905-45ff-8751-ba83634cc920 req-5bd2abb6-bda3-4a9c-8aaa-50eddb06a3aa service nova] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] Received event network-changed-511e58ad-c419-4668-ba70-31049acd2e82 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:51:37 user nova-compute[75100]: DEBUG nova.compute.manager [req-6543948a-5905-45ff-8751-ba83634cc920 req-5bd2abb6-bda3-4a9c-8aaa-50eddb06a3aa service nova] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] Refreshing instance network info cache due to event network-changed-511e58ad-c419-4668-ba70-31049acd2e82. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 17:51:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6543948a-5905-45ff-8751-ba83634cc920 req-5bd2abb6-bda3-4a9c-8aaa-50eddb06a3aa service nova] Acquiring lock "refresh_cache-e1defbdd-4363-49c9-bc9a-a35da42c53bf" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:51:37 user nova-compute[75100]: DEBUG nova.network.neutron [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 17:51:37 user nova-compute[75100]: DEBUG nova.network.neutron [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] Updating instance_info_cache with network_info: [{"id": "511e58ad-c419-4668-ba70-31049acd2e82", "address": "fa:16:3e:f8:42:9a", "network": {"id": "2a85480b-f67d-4ef1-b967-3e93af57d7c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1717495768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9cd441a46aa4a579feff608d6ff9bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511e58ad-c4", "ovs_interfaceid": "511e58ad-c419-4668-ba70-31049acd2e82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:51:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Releasing lock "refresh_cache-e1defbdd-4363-49c9-bc9a-a35da42c53bf" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:51:37 user nova-compute[75100]: DEBUG nova.compute.manager [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] Instance network_info: |[{"id": "511e58ad-c419-4668-ba70-31049acd2e82", "address": "fa:16:3e:f8:42:9a", "network": {"id": "2a85480b-f67d-4ef1-b967-3e93af57d7c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1717495768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9cd441a46aa4a579feff608d6ff9bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511e58ad-c4", "ovs_interfaceid": "511e58ad-c419-4668-ba70-31049acd2e82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 17:51:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6543948a-5905-45ff-8751-ba83634cc920 req-5bd2abb6-bda3-4a9c-8aaa-50eddb06a3aa service nova] Acquired lock "refresh_cache-e1defbdd-4363-49c9-bc9a-a35da42c53bf" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:51:37 user nova-compute[75100]: DEBUG nova.network.neutron [req-6543948a-5905-45ff-8751-ba83634cc920 req-5bd2abb6-bda3-4a9c-8aaa-50eddb06a3aa service nova] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] Refreshing network info cache for port 511e58ad-c419-4668-ba70-31049acd2e82 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 17:51:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:51:38 user nova-compute[75100]: DEBUG nova.network.neutron [req-6543948a-5905-45ff-8751-ba83634cc920 req-5bd2abb6-bda3-4a9c-8aaa-50eddb06a3aa service nova] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] Updated VIF entry in instance network info cache for port 511e58ad-c419-4668-ba70-31049acd2e82. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 17:51:38 user nova-compute[75100]: DEBUG nova.network.neutron [req-6543948a-5905-45ff-8751-ba83634cc920 req-5bd2abb6-bda3-4a9c-8aaa-50eddb06a3aa service nova] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] Updating instance_info_cache with network_info: [{"id": "511e58ad-c419-4668-ba70-31049acd2e82", "address": "fa:16:3e:f8:42:9a", "network": {"id": "2a85480b-f67d-4ef1-b967-3e93af57d7c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1717495768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9cd441a46aa4a579feff608d6ff9bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511e58ad-c4", "ovs_interfaceid": "511e58ad-c419-4668-ba70-31049acd2e82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:51:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6543948a-5905-45ff-8751-ba83634cc920 req-5bd2abb6-bda3-4a9c-8aaa-50eddb06a3aa service nova] Releasing lock "refresh_cache-e1defbdd-4363-49c9-bc9a-a35da42c53bf" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:51:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:51:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:51:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:51:46 user nova-compute[75100]: DEBUG os_brick.utils [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 17:51:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:51:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:51:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[796f6084-1d3a-4204-895e-ae18e5e704e8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90b1a229568f\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:51:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:51:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:51:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[37fb153b-c273-4caa-9b75-5fc78bcf1467]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:51:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:51:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:51:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12c23d2-382c-4a7d-a5b2-8384eede9087]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:51:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e75ca5f-3a36-4935-a5b2-10367f2004fa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:51:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:51:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 17:51:46 user nova-compute[75100]: DEBUG os_brick.utils [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 17:51:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 17:51:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:51:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:51:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:51:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[956f4ef2-52f3-4f25-a71e-7727eaabe4e4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90b1a229568f\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:51:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:51:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 17:51:46 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 17:51:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82c6c18-c246-409c-95e3-aea1c7710a6b]: (4, '') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:51:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 17:51:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 17:51:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 17:51:46 user nova-compute[75100]: DEBUG os_brick.utils [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90b1a229568f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 17:51:46 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Updating existing volume attachment record: 22d9fc80-8a01-4fcc-a85a-0cdfd8478c8a {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 17:51:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:51:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b60a18c-bd7a-4e84-b986-da08916aa235]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:51:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:51:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:51:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcafb389-2a46-42b6-9302-8352e3bd6b87]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:51:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d8a990c-5414-4b1a-b7c9-1a4e580e73dd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:51:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:51:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 17:51:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 17:51:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:51:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 17:51:46 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 17:51:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce34189-a6cb-4644-8a0a-c2d52130ed5d]: (4, '') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:51:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 17:51:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 17:51:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 17:51:46 user nova-compute[75100]: DEBUG os_brick.utils [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90b1a229568f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 17:51:46 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] Updating existing volume attachment record: 72f43c26-78c6-44f3-9642-ee2ecf8d550d {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 17:51:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:51:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:51:50 user nova-compute[75100]: DEBUG nova.compute.manager [req-38057f64-b4cc-4cb1-8b39-b0727bd2e36b req-fffcd958-823b-46b9-9c82-89830fd01aff service nova] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Received event network-changed-9855a14c-55c7-4a35-a4cc-7085dfbda684 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:51:50 user nova-compute[75100]: DEBUG nova.compute.manager [req-38057f64-b4cc-4cb1-8b39-b0727bd2e36b req-fffcd958-823b-46b9-9c82-89830fd01aff service nova] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Refreshing instance network info cache due to event network-changed-9855a14c-55c7-4a35-a4cc-7085dfbda684. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 17:51:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-38057f64-b4cc-4cb1-8b39-b0727bd2e36b req-fffcd958-823b-46b9-9c82-89830fd01aff service nova] Acquiring lock "refresh_cache-22c021d9-c8e4-455d-8e2a-a9cdfbb38f75" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:51:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-38057f64-b4cc-4cb1-8b39-b0727bd2e36b req-fffcd958-823b-46b9-9c82-89830fd01aff service nova] Acquired lock "refresh_cache-22c021d9-c8e4-455d-8e2a-a9cdfbb38f75" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:51:50 user nova-compute[75100]: DEBUG nova.network.neutron [req-38057f64-b4cc-4cb1-8b39-b0727bd2e36b req-fffcd958-823b-46b9-9c82-89830fd01aff service nova] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Refreshing network info cache for port 9855a14c-55c7-4a35-a4cc-7085dfbda684 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 17:51:50 user nova-compute[75100]: DEBUG nova.network.neutron [req-38057f64-b4cc-4cb1-8b39-b0727bd2e36b req-fffcd958-823b-46b9-9c82-89830fd01aff service nova] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Updated VIF entry in instance network info cache for port 9855a14c-55c7-4a35-a4cc-7085dfbda684. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 17:51:50 user nova-compute[75100]: DEBUG nova.network.neutron [req-38057f64-b4cc-4cb1-8b39-b0727bd2e36b req-fffcd958-823b-46b9-9c82-89830fd01aff service nova] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Updating instance_info_cache with network_info: [{"id": "9855a14c-55c7-4a35-a4cc-7085dfbda684", "address": "fa:16:3e:02:b1:a1", "network": {"id": "bf1edb58-ef26-40ca-8ec9-853fa05de13d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1416469583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7bb141ef59487dbb2ce6243c5002af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9855a14c-55", "ovs_interfaceid": "9855a14c-55c7-4a35-a4cc-7085dfbda684", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:51:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-38057f64-b4cc-4cb1-8b39-b0727bd2e36b req-fffcd958-823b-46b9-9c82-89830fd01aff service nova] Releasing lock "refresh_cache-22c021d9-c8e4-455d-8e2a-a9cdfbb38f75" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:51:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:51:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:51:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:51:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:51:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Acquiring lock "61e73913-30a5-4eaa-9bc0-6e17a0288035" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:52:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "61e73913-30a5-4eaa-9bc0-6e17a0288035" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:52:08 user nova-compute[75100]: DEBUG nova.compute.manager [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 17:52:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:52:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:52:08 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 17:52:08 user nova-compute[75100]: INFO nova.compute.claims [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Claim successful on node user
Nov 10 17:52:08 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:52:08 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:52:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.560s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:52:08 user nova-compute[75100]: DEBUG nova.compute.manager [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 17:52:08 user nova-compute[75100]: DEBUG nova.compute.manager [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 17:52:08 user nova-compute[75100]: DEBUG nova.network.neutron [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 17:52:08 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 17:52:08 user nova-compute[75100]: DEBUG nova.compute.manager [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 17:52:08 user nova-compute[75100]: DEBUG nova.policy [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '805917c846f34264b51388bfd9a8413f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae38bb92c5474a578f3827bdae12cd74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 17:52:08 user nova-compute[75100]: DEBUG nova.compute.manager [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 17:52:08 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 17:52:08 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Creating image(s)
Nov 10 17:52:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Acquiring lock "/opt/stack/data/nova/instances/61e73913-30a5-4eaa-9bc0-6e17a0288035/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:52:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "/opt/stack/data/nova/instances/61e73913-30a5-4eaa-9bc0-6e17a0288035/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:52:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "/opt/stack/data/nova/instances/61e73913-30a5-4eaa-9bc0-6e17a0288035/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:52:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:52:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.190s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:52:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Acquiring lock "818b9e28e061d41a38d903968b229be2ed9ba520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:52:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.006s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:52:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:52:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.214s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:52:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/61e73913-30a5-4eaa-9bc0-6e17a0288035/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:52:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/61e73913-30a5-4eaa-9bc0-6e17a0288035/disk 1073741824" returned: 0 in 0.050s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:52:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:52:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:52:09 user nova-compute[75100]: DEBUG nova.network.neutron [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Successfully created port: 5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 17:52:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.218s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:52:09 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Checking if we can resize image /opt/stack/data/nova/instances/61e73913-30a5-4eaa-9bc0-6e17a0288035/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 17:52:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e73913-30a5-4eaa-9bc0-6e17a0288035/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:52:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e73913-30a5-4eaa-9bc0-6e17a0288035/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:52:09 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Cannot resize image /opt/stack/data/nova/instances/61e73913-30a5-4eaa-9bc0-6e17a0288035/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 17:52:09 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 17:52:09 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Ensure instance console log exists: /opt/stack/data/nova/instances/61e73913-30a5-4eaa-9bc0-6e17a0288035/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 17:52:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:52:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:52:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:52:10 user nova-compute[75100]: DEBUG nova.network.neutron [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Successfully updated port: 5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 17:52:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Acquiring lock "refresh_cache-61e73913-30a5-4eaa-9bc0-6e17a0288035" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:52:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Acquired lock "refresh_cache-61e73913-30a5-4eaa-9bc0-6e17a0288035" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:52:10 user nova-compute[75100]: DEBUG nova.network.neutron [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 17:52:10 user nova-compute[75100]: DEBUG nova.compute.manager [req-5bc7bfc0-1cd2-4e13-a66a-1ba9e676c5ef req-b99b6164-e797-48db-9ae6-7eb7047bb4a1 service nova] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Received event network-changed-5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:52:10 user nova-compute[75100]: DEBUG nova.compute.manager [req-5bc7bfc0-1cd2-4e13-a66a-1ba9e676c5ef req-b99b6164-e797-48db-9ae6-7eb7047bb4a1 service nova] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Refreshing instance network info cache due to event network-changed-5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 17:52:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5bc7bfc0-1cd2-4e13-a66a-1ba9e676c5ef req-b99b6164-e797-48db-9ae6-7eb7047bb4a1 service nova] Acquiring lock "refresh_cache-61e73913-30a5-4eaa-9bc0-6e17a0288035" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:52:10 user nova-compute[75100]: DEBUG nova.network.neutron [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 17:52:10 user nova-compute[75100]: DEBUG nova.network.neutron [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Updating instance_info_cache with network_info: [{"id": "5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c", "address": "fa:16:3e:75:69:61", "network": {"id": "7a78ac5d-8f24-436d-9cb9-05f4efecb101", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-476509015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae38bb92c5474a578f3827bdae12cd74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e7d8cb1-7f", "ovs_interfaceid": "5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:52:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Releasing lock "refresh_cache-61e73913-30a5-4eaa-9bc0-6e17a0288035" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:52:10 user nova-compute[75100]: DEBUG nova.compute.manager [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Instance network_info: |[{"id": "5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c", "address": "fa:16:3e:75:69:61", "network": {"id": "7a78ac5d-8f24-436d-9cb9-05f4efecb101", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-476509015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae38bb92c5474a578f3827bdae12cd74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e7d8cb1-7f", "ovs_interfaceid": "5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 17:52:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5bc7bfc0-1cd2-4e13-a66a-1ba9e676c5ef req-b99b6164-e797-48db-9ae6-7eb7047bb4a1 service nova] Acquired lock "refresh_cache-61e73913-30a5-4eaa-9bc0-6e17a0288035" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:52:10 user nova-compute[75100]: DEBUG nova.network.neutron [req-5bc7bfc0-1cd2-4e13-a66a-1ba9e676c5ef req-b99b6164-e797-48db-9ae6-7eb7047bb4a1 service nova] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Refreshing network info cache for port 5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 17:52:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Start _get_guest_xml network_info=[{"id": "5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c", "address": "fa:16:3e:75:69:61", "network": {"id": "7a78ac5d-8f24-436d-9cb9-05f4efecb101", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-476509015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae38bb92c5474a578f3827bdae12cd74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e7d8cb1-7f", "ovs_interfaceid": "5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'e3cc5321-4d40-49ee-885c-700e14741732'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 17:52:10 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:52:10 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:52:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 17:52:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 17:52:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 17:52:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 17:52:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 17:52:10 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T17:40:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 17:52:10 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 17:52:10 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 17:52:10 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 17:52:10 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 17:52:10 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 17:52:10 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 17:52:10 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 17:52:10 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 17:52:10 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 17:52:10 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 17:52:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:52:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-887105111',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-887105111',id=21,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBt2k7JxeVDSCQYts3sglUNOlb3MEWalyA8Gt0mz8JaQfSywhdMWdKSG8xorXGHO9nRL4EecdmVdPAfYdrz5N1fvzulYNxG/vm6Llz3SnJfNeh1Mc8m59tlOvf70gw1Adw==',key_name='tempest-keypair-1379432359',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae38bb92c5474a578f3827bdae12cd74',ramdisk_id='',reservation_id='r-w7bzktq8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2073508773',owner_user_name='tempest-AttachVolumeShelveTestJSON-2073508773-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:52:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='805917c846f34264b51388bfd9a8413f',uuid=61e73913-30a5-4eaa-9bc0-6e17a0288035,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c", "address": "fa:16:3e:75:69:61", "network": {"id": "7a78ac5d-8f24-436d-9cb9-05f4efecb101", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-476509015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae38bb92c5474a578f3827bdae12cd74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e7d8cb1-7f", "ovs_interfaceid": "5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 17:52:10 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Converting VIF {"id": "5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c", "address": "fa:16:3e:75:69:61", "network": {"id": "7a78ac5d-8f24-436d-9cb9-05f4efecb101", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-476509015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae38bb92c5474a578f3827bdae12cd74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e7d8cb1-7f", "ovs_interfaceid": "5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:52:10 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:69:61,bridge_name='br-int',has_traffic_filtering=True,id=5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c,network=Network(7a78ac5d-8f24-436d-9cb9-05f4efecb101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e7d8cb1-7f') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:52:10 user nova-compute[75100]: DEBUG nova.objects.instance [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lazy-loading 'pci_devices' on Instance uuid 61e73913-30a5-4eaa-9bc0-6e17a0288035 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:52:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] End _get_guest_xml xml=<domain type="kvm">
Nov 10 17:52:10 user nova-compute[75100]:   <uuid>61e73913-30a5-4eaa-9bc0-6e17a0288035</uuid>
Nov 10 17:52:10 user nova-compute[75100]:   <name>instance-00000015</name>
Nov 10 17:52:10 user nova-compute[75100]:   <memory>524288</memory>
Nov 10 17:52:10 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 10 17:52:10 user nova-compute[75100]:   <metadata>
Nov 10 17:52:10 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 17:52:10 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 10 17:52:10 user nova-compute[75100]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-887105111</nova:name>
Nov 10 17:52:10 user nova-compute[75100]:       <nova:creationTime>2023-11-10 17:52:10</nova:creationTime>
Nov 10 17:52:10 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 10 17:52:10 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 10 17:52:10 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 10 17:52:10 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 10 17:52:10 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 17:52:10 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 10 17:52:10 user nova-compute[75100]:       </nova:flavor>
Nov 10 17:52:10 user nova-compute[75100]:       <nova:owner>
Nov 10 17:52:10 user nova-compute[75100]:         <nova:user uuid="805917c846f34264b51388bfd9a8413f">tempest-AttachVolumeShelveTestJSON-2073508773-project-member</nova:user>
Nov 10 17:52:10 user nova-compute[75100]:         <nova:project uuid="ae38bb92c5474a578f3827bdae12cd74">tempest-AttachVolumeShelveTestJSON-2073508773</nova:project>
Nov 10 17:52:10 user nova-compute[75100]:       </nova:owner>
Nov 10 17:52:10 user nova-compute[75100]:       <nova:root type="image" uuid="e3cc5321-4d40-49ee-885c-700e14741732"/>
Nov 10 17:52:10 user nova-compute[75100]:       <nova:ports>
Nov 10 17:52:10 user nova-compute[75100]:         <nova:port uuid="5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c">
Nov 10 17:52:10 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 10 17:52:10 user nova-compute[75100]:         </nova:port>
Nov 10 17:52:10 user nova-compute[75100]:       </nova:ports>
Nov 10 17:52:10 user nova-compute[75100]:     </nova:instance>
Nov 10 17:52:10 user nova-compute[75100]:   </metadata>
Nov 10 17:52:10 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 10 17:52:10 user nova-compute[75100]:     <system>
Nov 10 17:52:10 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 17:52:10 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 10 17:52:10 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 10 17:52:10 user nova-compute[75100]:       <entry name="serial">61e73913-30a5-4eaa-9bc0-6e17a0288035</entry>
Nov 10 17:52:10 user nova-compute[75100]:       <entry name="uuid">61e73913-30a5-4eaa-9bc0-6e17a0288035</entry>
Nov 10 17:52:10 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 10 17:52:10 user nova-compute[75100]:     </system>
Nov 10 17:52:10 user nova-compute[75100]:   </sysinfo>
Nov 10 17:52:10 user nova-compute[75100]:   <os>
Nov 10 17:52:10 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 17:52:10 user nova-compute[75100]:     <boot dev="hd"/>
Nov 10 17:52:10 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 10 17:52:10 user nova-compute[75100]:   </os>
Nov 10 17:52:10 user nova-compute[75100]:   <features>
Nov 10 17:52:10 user nova-compute[75100]:     <acpi/>
Nov 10 17:52:10 user nova-compute[75100]:     <apic/>
Nov 10 17:52:10 user nova-compute[75100]:     <vmcoreinfo/>
Nov 10 17:52:10 user nova-compute[75100]:   </features>
Nov 10 17:52:10 user nova-compute[75100]:   <clock offset="utc">
Nov 10 17:52:10 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 17:52:10 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 17:52:10 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 10 17:52:10 user nova-compute[75100]:   </clock>
Nov 10 17:52:10 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 10 17:52:10 user nova-compute[75100]:     <model>Nehalem</model>
Nov 10 17:52:10 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 17:52:10 user nova-compute[75100]:   </cpu>
Nov 10 17:52:10 user nova-compute[75100]:   <devices>
Nov 10 17:52:10 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 10 17:52:10 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 17:52:10 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/61e73913-30a5-4eaa-9bc0-6e17a0288035/disk"/>
Nov 10 17:52:10 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 10 17:52:10 user nova-compute[75100]:     </disk>
Nov 10 17:52:10 user nova-compute[75100]:     <interface type="ethernet">
Nov 10 17:52:10 user nova-compute[75100]:       <mac address="fa:16:3e:75:69:61"/>
Nov 10 17:52:10 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:52:10 user nova-compute[75100]:       <mtu size="1442"/>
Nov 10 17:52:10 user nova-compute[75100]:       <target dev="tap5e7d8cb1-7f"/>
Nov 10 17:52:10 user nova-compute[75100]:     </interface>
Nov 10 17:52:10 user nova-compute[75100]:     <serial type="pty">
Nov 10 17:52:10 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/61e73913-30a5-4eaa-9bc0-6e17a0288035/console.log" append="off"/>
Nov 10 17:52:10 user nova-compute[75100]:     </serial>
Nov 10 17:52:10 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 17:52:10 user nova-compute[75100]:     <video>
Nov 10 17:52:10 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:52:10 user nova-compute[75100]:     </video>
Nov 10 17:52:10 user nova-compute[75100]:     <rng model="virtio">
Nov 10 17:52:10 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 10 17:52:10 user nova-compute[75100]:     </rng>
Nov 10 17:52:10 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 10 17:52:10 user nova-compute[75100]:     <memballoon model="virtio">
Nov 10 17:52:10 user nova-compute[75100]:       <stats period="10"/>
Nov 10 17:52:10 user nova-compute[75100]:     </memballoon>
Nov 10 17:52:10 user nova-compute[75100]:   </devices>
Nov 10 17:52:10 user nova-compute[75100]: </domain>
Nov 10 17:52:10 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 17:52:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:52:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-887105111',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-887105111',id=21,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBt2k7JxeVDSCQYts3sglUNOlb3MEWalyA8Gt0mz8JaQfSywhdMWdKSG8xorXGHO9nRL4EecdmVdPAfYdrz5N1fvzulYNxG/vm6Llz3SnJfNeh1Mc8m59tlOvf70gw1Adw==',key_name='tempest-keypair-1379432359',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae38bb92c5474a578f3827bdae12cd74',ramdisk_id='',reservation_id='r-w7bzktq8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2073508773',owner_user_name='tempest-AttachVolumeShelveTestJSON-2073508773-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:52:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='805917c846f34264b51388bfd9a8413f',uuid=61e73913-30a5-4eaa-9bc0-6e17a0288035,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c", "address": "fa:16:3e:75:69:61", "network": {"id": "7a78ac5d-8f24-436d-9cb9-05f4efecb101", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-476509015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae38bb92c5474a578f3827bdae12cd74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e7d8cb1-7f", "ovs_interfaceid": "5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 17:52:10 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Converting VIF {"id": "5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c", "address": "fa:16:3e:75:69:61", "network": {"id": "7a78ac5d-8f24-436d-9cb9-05f4efecb101", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-476509015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae38bb92c5474a578f3827bdae12cd74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e7d8cb1-7f", "ovs_interfaceid": "5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:52:10 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:69:61,bridge_name='br-int',has_traffic_filtering=True,id=5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c,network=Network(7a78ac5d-8f24-436d-9cb9-05f4efecb101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e7d8cb1-7f') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:52:10 user nova-compute[75100]: DEBUG os_vif [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:69:61,bridge_name='br-int',has_traffic_filtering=True,id=5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c,network=Network(7a78ac5d-8f24-436d-9cb9-05f4efecb101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e7d8cb1-7f') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 17:52:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:52:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 17:52:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f1205a18-83eb-5e79-94fb-6d63bb89cd0c', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:52:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:52:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5e7d8cb1-7f, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:52:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5e7d8cb1-7f, col_values=(('qos', UUID('d13643ef-d984-4d33-9fea-fe5c2e07dd38')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:52:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5e7d8cb1-7f, col_values=(('external_ids', {'iface-id': '5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:69:61', 'vm-uuid': '61e73913-30a5-4eaa-9bc0-6e17a0288035'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:52:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:52:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:10 user nova-compute[75100]: INFO os_vif [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:69:61,bridge_name='br-int',has_traffic_filtering=True,id=5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c,network=Network(7a78ac5d-8f24-436d-9cb9-05f4efecb101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e7d8cb1-7f')
Nov 10 17:52:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 17:52:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] No VIF found with MAC fa:16:3e:75:69:61, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 17:52:11 user nova-compute[75100]: DEBUG nova.network.neutron [req-5bc7bfc0-1cd2-4e13-a66a-1ba9e676c5ef req-b99b6164-e797-48db-9ae6-7eb7047bb4a1 service nova] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Updated VIF entry in instance network info cache for port 5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 17:52:11 user nova-compute[75100]: DEBUG nova.network.neutron [req-5bc7bfc0-1cd2-4e13-a66a-1ba9e676c5ef req-b99b6164-e797-48db-9ae6-7eb7047bb4a1 service nova] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Updating instance_info_cache with network_info: [{"id": "5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c", "address": "fa:16:3e:75:69:61", "network": {"id": "7a78ac5d-8f24-436d-9cb9-05f4efecb101", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-476509015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae38bb92c5474a578f3827bdae12cd74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e7d8cb1-7f", "ovs_interfaceid": "5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:52:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5bc7bfc0-1cd2-4e13-a66a-1ba9e676c5ef req-b99b6164-e797-48db-9ae6-7eb7047bb4a1 service nova] Releasing lock "refresh_cache-61e73913-30a5-4eaa-9bc0-6e17a0288035" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:52:11 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:52:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:12 user nova-compute[75100]: DEBUG nova.compute.manager [req-eda35330-f2ec-4bd7-a389-5edb63589841 req-9cc806ab-695f-4c55-91ae-4014c9b48693 service nova] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Received event network-vif-plugged-5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:52:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-eda35330-f2ec-4bd7-a389-5edb63589841 req-9cc806ab-695f-4c55-91ae-4014c9b48693 service nova] Acquiring lock "61e73913-30a5-4eaa-9bc0-6e17a0288035-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:52:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-eda35330-f2ec-4bd7-a389-5edb63589841 req-9cc806ab-695f-4c55-91ae-4014c9b48693 service nova] Lock "61e73913-30a5-4eaa-9bc0-6e17a0288035-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:52:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-eda35330-f2ec-4bd7-a389-5edb63589841 req-9cc806ab-695f-4c55-91ae-4014c9b48693 service nova] Lock "61e73913-30a5-4eaa-9bc0-6e17a0288035-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:52:12 user nova-compute[75100]: DEBUG nova.compute.manager [req-eda35330-f2ec-4bd7-a389-5edb63589841 req-9cc806ab-695f-4c55-91ae-4014c9b48693 service nova] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] No waiting events found dispatching network-vif-plugged-5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:52:12 user nova-compute[75100]: WARNING nova.compute.manager [req-eda35330-f2ec-4bd7-a389-5edb63589841 req-9cc806ab-695f-4c55-91ae-4014c9b48693 service nova] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Received unexpected event network-vif-plugged-5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c for instance with vm_state building and task_state spawning.
Nov 10 17:52:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d745a5e3-3d46-43cb-a2df-d91c86d4e4a4 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Acquiring lock "ead532eb-c8be-45fa-a8b7-0b4c4f884a90" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d745a5e3-3d46-43cb-a2df-d91c86d4e4a4 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Lock "ead532eb-c8be-45fa-a8b7-0b4c4f884a90" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d745a5e3-3d46-43cb-a2df-d91c86d4e4a4 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Acquiring lock "ead532eb-c8be-45fa-a8b7-0b4c4f884a90-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d745a5e3-3d46-43cb-a2df-d91c86d4e4a4 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Lock "ead532eb-c8be-45fa-a8b7-0b4c4f884a90-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d745a5e3-3d46-43cb-a2df-d91c86d4e4a4 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Lock "ead532eb-c8be-45fa-a8b7-0b4c4f884a90-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:52:14 user nova-compute[75100]: INFO nova.compute.manager [None req-d745a5e3-3d46-43cb-a2df-d91c86d4e4a4 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Terminating instance
Nov 10 17:52:14 user nova-compute[75100]: DEBUG nova.compute.manager [None req-d745a5e3-3d46-43cb-a2df-d91c86d4e4a4 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG nova.compute.manager [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 17:52:14 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Creating image(s)
Nov 10 17:52:14 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Did not create local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Ensure instance console log exists: /opt/stack/data/nova/instances/e6de4626-f097-43b7-8e56-a08415e7d74a/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Start _get_guest_xml network_info=[{"id": "d3d11e2e-7099-4c6e-aa65-53f953ce4571", "address": "fa:16:3e:86:a7:41", "network": {"id": "f240fae3-3d7b-4b6e-b04f-18550ab4d0a3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1007355777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c970a503d74d32a1e2b71f086649fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d11e2e-70", "ovs_interfaceid": "d3d11e2e-7099-4c6e-aa65-53f953ce4571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wLIchQgb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e6de4626-f097-43b7-8e56-a08415e7d74a', 'attached_at': '', 'detached_at': '', 'volume_id': '16fd9f0d-185d-41af-af44-5f52fbfe3c54', 'serial': '16fd9f0d-185d-41af-af44-5f52fbfe3c54'}, 'mount_device': '/dev/vda', 'attachment_id': '22d9fc80-8a01-4fcc-a85a-0cdfd8478c8a', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 17:52:14 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:52:14 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:52:14 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T17:40:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wLIchQgb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 17:52:14 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 17:52:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 17:52:14 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 17:52:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 17:52:14 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 17:52:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 -p 172.16.0.220:3260 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[212f15ea-6a2e-4a20-b07b-f9afaf8e5ce8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 17:52:14 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 -p 172.16.0.220:3260 --interface default --op new {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG nova.compute.manager [req-31c22442-16b3-45e9-b579-c419815e6797 req-ef17a284-774d-4fe8-885c-12d3a3502fa2 service nova] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Received event network-vif-unplugged-bdf312ed-cce0-4d35-9257-f6a5a80cc0d2 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-31c22442-16b3-45e9-b579-c419815e6797 req-ef17a284-774d-4fe8-885c-12d3a3502fa2 service nova] Acquiring lock "ead532eb-c8be-45fa-a8b7-0b4c4f884a90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-31c22442-16b3-45e9-b579-c419815e6797 req-ef17a284-774d-4fe8-885c-12d3a3502fa2 service nova] Lock "ead532eb-c8be-45fa-a8b7-0b4c4f884a90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-31c22442-16b3-45e9-b579-c419815e6797 req-ef17a284-774d-4fe8-885c-12d3a3502fa2 service nova] Lock "ead532eb-c8be-45fa-a8b7-0b4c4f884a90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG nova.compute.manager [req-31c22442-16b3-45e9-b579-c419815e6797 req-ef17a284-774d-4fe8-885c-12d3a3502fa2 service nova] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] No waiting events found dispatching network-vif-unplugged-bdf312ed-cce0-4d35-9257-f6a5a80cc0d2 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG nova.compute.manager [req-31c22442-16b3-45e9-b579-c419815e6797 req-ef17a284-774d-4fe8-885c-12d3a3502fa2 service nova] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Received event network-vif-unplugged-bdf312ed-cce0-4d35-9257-f6a5a80cc0d2 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bda31a5-53e3-4ef3-b552-7674a8b71f65]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54] added\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54] added
Nov 10 17:52:14 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG nova.compute.manager [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 17:52:14 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Instance spawned successfully.
Nov 10 17:52:14 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b8ce65-862a-48e1-a775-8931f2c0f5bf]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG nova.compute.manager [req-11d42807-435a-463a-bc0d-3a9d2575cb4f req-3994dc09-5926-4a70-97af-8b6a34ddb436 service nova] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Received event network-vif-plugged-5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-11d42807-435a-463a-bc0d-3a9d2575cb4f req-3994dc09-5926-4a70-97af-8b6a34ddb436 service nova] Acquiring lock "61e73913-30a5-4eaa-9bc0-6e17a0288035-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-11d42807-435a-463a-bc0d-3a9d2575cb4f req-3994dc09-5926-4a70-97af-8b6a34ddb436 service nova] Lock "61e73913-30a5-4eaa-9bc0-6e17a0288035-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-11d42807-435a-463a-bc0d-3a9d2575cb4f req-3994dc09-5926-4a70-97af-8b6a34ddb436 service nova] Lock "61e73913-30a5-4eaa-9bc0-6e17a0288035-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG nova.compute.manager [req-11d42807-435a-463a-bc0d-3a9d2575cb4f req-3994dc09-5926-4a70-97af-8b6a34ddb436 service nova] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] No waiting events found dispatching network-vif-plugged-5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:52:14 user nova-compute[75100]: WARNING nova.compute.manager [req-11d42807-435a-463a-bc0d-3a9d2575cb4f req-3994dc09-5926-4a70-97af-8b6a34ddb436 service nova] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Received unexpected event network-vif-plugged-5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c for instance with vm_state building and task_state spawning.
Nov 10 17:52:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e05f7dc-ca17-442c-b4c5-e12b3486f21b]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wLIchQgb {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wLIchQgb" returned: 0 in 0.031s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34bef04-ce31-4736-b848-810f3afb5fba]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wLIchQgb'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[722981af-820b-4a37-af5a-e3c2ef09f67e]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.022s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c448f33a-e90f-4567-b614-775957cb956c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 10 17:52:14 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 10 17:52:14 user nova-compute[75100]:  {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 17:52:14 user nova-compute[75100]: WARNING os_brick.initiator.connectors.iscsi [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 10 17:52:14 user nova-compute[75100]: 
Nov 10 17:52:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 -p 172.16.0.220:3260 --login {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:52:14 user nova-compute[75100]: INFO nova.compute.manager [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Took 5.84 seconds to spawn the instance on the hypervisor.
Nov 10 17:52:14 user nova-compute[75100]: DEBUG nova.compute.manager [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ba1212-f774-492a-a138-c0209ccec136]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54, portal: 172.16.0.220,3260]
Nov 10 17:52:14 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54, portal: 172.16.0.220,3260] successful.
Nov 10 17:52:14 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d396c3-945d-4973-8e7f-3c6119966053]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b293e98-1a07-4d3f-b94b-14652c9a019a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)
Nov 10 17:52:14 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)
Nov 10 17:52:14 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.372s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] HCTL ('33', '-', '-', 0) found on session 10 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4914210d-3864-4611-968b-79ce9c06ad1d]: (4, ('- - 0', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Searching for a device in session 10 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 17:52:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wLIchQgb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 17:52:14 user nova-compute[75100]: INFO nova.compute.manager [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Took 6.86 seconds to build instance.
Nov 10 17:52:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-21d3e46f-3c55-4add-9534-044a762fc4b1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "61e73913-30a5-4eaa-9bc0-6e17a0288035" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.961s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:52:15 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Instance destroyed successfully.
Nov 10 17:52:15 user nova-compute[75100]: DEBUG nova.objects.instance [None req-d745a5e3-3d46-43cb-a2df-d91c86d4e4a4 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Lazy-loading 'resources' on Instance uuid ead532eb-c8be-45fa-a8b7-0b4c4f884a90 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:52:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-d745a5e3-3d46-43cb-a2df-d91c86d4e4a4 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:44:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1569402446',display_name='tempest-VolumesAdminNegativeTest-server-1569402446',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1569402446',id=5,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM8Mgwh9Oz9c33+lKVITcrw1u2yFY/zSZSn/46TDmummyopuD69BLBhczKDnulz5SNCJw0coB6gJCRJRGmQ7wHrJM2Psl2mrUGpc+wqcJ8RyTMsYtYnIfcVB6fpVlHgaMg==',key_name='tempest-keypair-1129073438',keypairs=<?>,launch_index=0,launched_at=2023-11-10T17:44:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8460c83146a64640ba7e549d159275c2',ramdisk_id='',reservation_id='r-k2gc1wz8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1957922837',owner_user_name='tempest-VolumesAdminNegativeTest-1957922837-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T17:44:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7994564d536446e38002847db1668157',uuid=ead532eb-c8be-45fa-a8b7-0b4c4f884a90,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bdf312ed-cce0-4d35-9257-f6a5a80cc0d2", "address": "fa:16:3e:55:c2:62", "network": {"id": "7b0728f9-3997-4fbd-9583-81a235e0b690", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1553690854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8460c83146a64640ba7e549d159275c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdf312ed-cc", "ovs_interfaceid": "bdf312ed-cce0-4d35-9257-f6a5a80cc0d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 17:52:15 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-d745a5e3-3d46-43cb-a2df-d91c86d4e4a4 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Converting VIF {"id": "bdf312ed-cce0-4d35-9257-f6a5a80cc0d2", "address": "fa:16:3e:55:c2:62", "network": {"id": "7b0728f9-3997-4fbd-9583-81a235e0b690", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1553690854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8460c83146a64640ba7e549d159275c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdf312ed-cc", "ovs_interfaceid": "bdf312ed-cce0-4d35-9257-f6a5a80cc0d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:52:15 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-d745a5e3-3d46-43cb-a2df-d91c86d4e4a4 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:55:c2:62,bridge_name='br-int',has_traffic_filtering=True,id=bdf312ed-cce0-4d35-9257-f6a5a80cc0d2,network=Network(7b0728f9-3997-4fbd-9583-81a235e0b690),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdf312ed-cc') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:52:15 user nova-compute[75100]: DEBUG os_vif [None req-d745a5e3-3d46-43cb-a2df-d91c86d4e4a4 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:c2:62,bridge_name='br-int',has_traffic_filtering=True,id=bdf312ed-cce0-4d35-9257-f6a5a80cc0d2,network=Network(7b0728f9-3997-4fbd-9583-81a235e0b690),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdf312ed-cc') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 17:52:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbdf312ed-cc, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:52:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:52:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4d27d4f6-b799-4520-b5a9-0ec1f246e1d8) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:52:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:15 user nova-compute[75100]: INFO os_vif [None req-d745a5e3-3d46-43cb-a2df-d91c86d4e4a4 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:c2:62,bridge_name='br-int',has_traffic_filtering=True,id=bdf312ed-cce0-4d35-9257-f6a5a80cc0d2,network=Network(7b0728f9-3997-4fbd-9583-81a235e0b690),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdf312ed-cc')
Nov 10 17:52:15 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-d745a5e3-3d46-43cb-a2df-d91c86d4e4a4 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Deleting instance files /opt/stack/data/nova/instances/ead532eb-c8be-45fa-a8b7-0b4c4f884a90_del
Nov 10 17:52:15 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-d745a5e3-3d46-43cb-a2df-d91c86d4e4a4 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Deletion of /opt/stack/data/nova/instances/ead532eb-c8be-45fa-a8b7-0b4c4f884a90_del complete
Nov 10 17:52:15 user nova-compute[75100]: INFO nova.compute.manager [None req-d745a5e3-3d46-43cb-a2df-d91c86d4e4a4 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Took 1.11 seconds to destroy the instance on the hypervisor.
Nov 10 17:52:15 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-d745a5e3-3d46-43cb-a2df-d91c86d4e4a4 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 17:52:15 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:52:15 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 17:52:15 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 17:52:15 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:52:15 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.413s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 17:52:15 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] <== connect_volume: return (1415ms) {'type': 'block', 'scsi_wwn': '23638656166376430', 'path': '/dev/sdb'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 17:52:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638656166376430', 'path': '/dev/sdb'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 17:52:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:51:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1499114588',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1499114588',id=19,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72c970a503d74d32a1e2b71f086649fd',ramdisk_id='',reservation_id='r-2rik8cbf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2001759307',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:51:15Z,user_data=None,user_id='b79cb22ab5774ce8991f237bd2204555',uuid=e6de4626-f097-43b7-8e56-a08415e7d74a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3d11e2e-7099-4c6e-aa65-53f953ce4571", "address": "fa:16:3e:86:a7:41", "network": {"id": "f240fae3-3d7b-4b6e-b04f-18550ab4d0a3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1007355777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c970a503d74d32a1e2b71f086649fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d11e2e-70", "ovs_interfaceid": "d3d11e2e-7099-4c6e-aa65-53f953ce4571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 17:52:15 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Converting VIF {"id": "d3d11e2e-7099-4c6e-aa65-53f953ce4571", "address": "fa:16:3e:86:a7:41", "network": {"id": "f240fae3-3d7b-4b6e-b04f-18550ab4d0a3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1007355777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c970a503d74d32a1e2b71f086649fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d11e2e-70", "ovs_interfaceid": "d3d11e2e-7099-4c6e-aa65-53f953ce4571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:52:15 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:a7:41,bridge_name='br-int',has_traffic_filtering=True,id=d3d11e2e-7099-4c6e-aa65-53f953ce4571,network=Network(f240fae3-3d7b-4b6e-b04f-18550ab4d0a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3d11e2e-70') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:52:15 user nova-compute[75100]: DEBUG nova.objects.instance [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lazy-loading 'pci_devices' on Instance uuid e6de4626-f097-43b7-8e56-a08415e7d74a {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:52:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] End _get_guest_xml xml=<domain type="kvm">
Nov 10 17:52:15 user nova-compute[75100]:   <uuid>e6de4626-f097-43b7-8e56-a08415e7d74a</uuid>
Nov 10 17:52:15 user nova-compute[75100]:   <name>instance-00000013</name>
Nov 10 17:52:15 user nova-compute[75100]:   <memory>524288</memory>
Nov 10 17:52:15 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 10 17:52:15 user nova-compute[75100]:   <metadata>
Nov 10 17:52:15 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 17:52:15 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 10 17:52:15 user nova-compute[75100]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1499114588</nova:name>
Nov 10 17:52:15 user nova-compute[75100]:       <nova:creationTime>2023-11-10 17:52:14</nova:creationTime>
Nov 10 17:52:15 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 10 17:52:15 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 10 17:52:15 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 10 17:52:15 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 10 17:52:15 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 17:52:15 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 10 17:52:15 user nova-compute[75100]:       </nova:flavor>
Nov 10 17:52:15 user nova-compute[75100]:       <nova:owner>
Nov 10 17:52:15 user nova-compute[75100]:         <nova:user uuid="b79cb22ab5774ce8991f237bd2204555">tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member</nova:user>
Nov 10 17:52:15 user nova-compute[75100]:         <nova:project uuid="72c970a503d74d32a1e2b71f086649fd">tempest-ServerBootFromVolumeStableRescueTest-2001759307</nova:project>
Nov 10 17:52:15 user nova-compute[75100]:       </nova:owner>
Nov 10 17:52:15 user nova-compute[75100]:       <nova:root type="image" uuid="e3cc5321-4d40-49ee-885c-700e14741732"/>
Nov 10 17:52:15 user nova-compute[75100]:       <nova:ports>
Nov 10 17:52:15 user nova-compute[75100]:         <nova:port uuid="d3d11e2e-7099-4c6e-aa65-53f953ce4571">
Nov 10 17:52:15 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 10 17:52:15 user nova-compute[75100]:         </nova:port>
Nov 10 17:52:15 user nova-compute[75100]:       </nova:ports>
Nov 10 17:52:15 user nova-compute[75100]:     </nova:instance>
Nov 10 17:52:15 user nova-compute[75100]:   </metadata>
Nov 10 17:52:15 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 10 17:52:15 user nova-compute[75100]:     <system>
Nov 10 17:52:15 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 17:52:15 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 10 17:52:15 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 10 17:52:15 user nova-compute[75100]:       <entry name="serial">e6de4626-f097-43b7-8e56-a08415e7d74a</entry>
Nov 10 17:52:15 user nova-compute[75100]:       <entry name="uuid">e6de4626-f097-43b7-8e56-a08415e7d74a</entry>
Nov 10 17:52:15 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 10 17:52:15 user nova-compute[75100]:     </system>
Nov 10 17:52:15 user nova-compute[75100]:   </sysinfo>
Nov 10 17:52:15 user nova-compute[75100]:   <os>
Nov 10 17:52:15 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 17:52:15 user nova-compute[75100]:     <boot dev="hd"/>
Nov 10 17:52:15 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 10 17:52:15 user nova-compute[75100]:   </os>
Nov 10 17:52:15 user nova-compute[75100]:   <features>
Nov 10 17:52:15 user nova-compute[75100]:     <acpi/>
Nov 10 17:52:15 user nova-compute[75100]:     <apic/>
Nov 10 17:52:15 user nova-compute[75100]:     <vmcoreinfo/>
Nov 10 17:52:15 user nova-compute[75100]:   </features>
Nov 10 17:52:15 user nova-compute[75100]:   <clock offset="utc">
Nov 10 17:52:15 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 17:52:15 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 17:52:15 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 10 17:52:15 user nova-compute[75100]:   </clock>
Nov 10 17:52:15 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 10 17:52:15 user nova-compute[75100]:     <model>Nehalem</model>
Nov 10 17:52:15 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 17:52:15 user nova-compute[75100]:   </cpu>
Nov 10 17:52:15 user nova-compute[75100]:   <devices>
Nov 10 17:52:15 user nova-compute[75100]:     <disk type="block" device="disk">
Nov 10 17:52:15 user nova-compute[75100]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 17:52:15 user nova-compute[75100]:       <source dev="/dev/sdb"/>
Nov 10 17:52:15 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 10 17:52:15 user nova-compute[75100]:       <serial>16fd9f0d-185d-41af-af44-5f52fbfe3c54</serial>
Nov 10 17:52:15 user nova-compute[75100]:     </disk>
Nov 10 17:52:15 user nova-compute[75100]:     <interface type="ethernet">
Nov 10 17:52:15 user nova-compute[75100]:       <mac address="fa:16:3e:86:a7:41"/>
Nov 10 17:52:15 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:52:15 user nova-compute[75100]:       <mtu size="1442"/>
Nov 10 17:52:15 user nova-compute[75100]:       <target dev="tapd3d11e2e-70"/>
Nov 10 17:52:15 user nova-compute[75100]:     </interface>
Nov 10 17:52:15 user nova-compute[75100]:     <serial type="pty">
Nov 10 17:52:15 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/e6de4626-f097-43b7-8e56-a08415e7d74a/console.log" append="off"/>
Nov 10 17:52:15 user nova-compute[75100]:     </serial>
Nov 10 17:52:15 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 17:52:15 user nova-compute[75100]:     <video>
Nov 10 17:52:15 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:52:15 user nova-compute[75100]:     </video>
Nov 10 17:52:15 user nova-compute[75100]:     <rng model="virtio">
Nov 10 17:52:15 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 10 17:52:15 user nova-compute[75100]:     </rng>
Nov 10 17:52:15 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 10 17:52:15 user nova-compute[75100]:     <memballoon model="virtio">
Nov 10 17:52:15 user nova-compute[75100]:       <stats period="10"/>
Nov 10 17:52:15 user nova-compute[75100]:     </memballoon>
Nov 10 17:52:15 user nova-compute[75100]:   </devices>
Nov 10 17:52:15 user nova-compute[75100]: </domain>
Nov 10 17:52:15 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 17:52:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:51:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1499114588',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1499114588',id=19,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72c970a503d74d32a1e2b71f086649fd',ramdisk_id='',reservation_id='r-2rik8cbf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2001759307',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:51:15Z,user_data=None,user_id='b79cb22ab5774ce8991f237bd2204555',uuid=e6de4626-f097-43b7-8e56-a08415e7d74a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3d11e2e-7099-4c6e-aa65-53f953ce4571", "address": "fa:16:3e:86:a7:41", "network": {"id": "f240fae3-3d7b-4b6e-b04f-18550ab4d0a3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1007355777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c970a503d74d32a1e2b71f086649fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d11e2e-70", "ovs_interfaceid": "d3d11e2e-7099-4c6e-aa65-53f953ce4571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 17:52:15 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Converting VIF {"id": "d3d11e2e-7099-4c6e-aa65-53f953ce4571", "address": "fa:16:3e:86:a7:41", "network": {"id": "f240fae3-3d7b-4b6e-b04f-18550ab4d0a3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1007355777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c970a503d74d32a1e2b71f086649fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d11e2e-70", "ovs_interfaceid": "d3d11e2e-7099-4c6e-aa65-53f953ce4571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:52:15 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:a7:41,bridge_name='br-int',has_traffic_filtering=True,id=d3d11e2e-7099-4c6e-aa65-53f953ce4571,network=Network(f240fae3-3d7b-4b6e-b04f-18550ab4d0a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3d11e2e-70') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:52:15 user nova-compute[75100]: DEBUG os_vif [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:a7:41,bridge_name='br-int',has_traffic_filtering=True,id=d3d11e2e-7099-4c6e-aa65-53f953ce4571,network=Network(f240fae3-3d7b-4b6e-b04f-18550ab4d0a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3d11e2e-70') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 17:52:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:52:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 17:52:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eafc51ee-0695-502a-8bcb-2364a9768b70', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:52:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:52:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd3d11e2e-70, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:52:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd3d11e2e-70, col_values=(('qos', UUID('8a740c1f-7ce0-4cc1-b886-10da24303d4a')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:52:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd3d11e2e-70, col_values=(('external_ids', {'iface-id': 'd3d11e2e-7099-4c6e-aa65-53f953ce4571', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:a7:41', 'vm-uuid': 'e6de4626-f097-43b7-8e56-a08415e7d74a'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:52:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:52:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:15 user nova-compute[75100]: INFO os_vif [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:a7:41,bridge_name='br-int',has_traffic_filtering=True,id=d3d11e2e-7099-4c6e-aa65-53f953ce4571,network=Network(f240fae3-3d7b-4b6e-b04f-18550ab4d0a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3d11e2e-70')
Nov 10 17:52:16 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 17:52:16 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] No VIF found with MAC fa:16:3e:86:a7:41, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 17:52:16 user nova-compute[75100]: DEBUG nova.compute.manager [req-638ac306-bef6-4ab7-9390-f96b7e9388ee req-b7944021-1127-4ade-b725-0bd7701c5f8a service nova] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Received event network-vif-plugged-bdf312ed-cce0-4d35-9257-f6a5a80cc0d2 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:52:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-638ac306-bef6-4ab7-9390-f96b7e9388ee req-b7944021-1127-4ade-b725-0bd7701c5f8a service nova] Acquiring lock "ead532eb-c8be-45fa-a8b7-0b4c4f884a90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:52:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-638ac306-bef6-4ab7-9390-f96b7e9388ee req-b7944021-1127-4ade-b725-0bd7701c5f8a service nova] Lock "ead532eb-c8be-45fa-a8b7-0b4c4f884a90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:52:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-638ac306-bef6-4ab7-9390-f96b7e9388ee req-b7944021-1127-4ade-b725-0bd7701c5f8a service nova] Lock "ead532eb-c8be-45fa-a8b7-0b4c4f884a90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:52:16 user nova-compute[75100]: DEBUG nova.compute.manager [req-638ac306-bef6-4ab7-9390-f96b7e9388ee req-b7944021-1127-4ade-b725-0bd7701c5f8a service nova] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] No waiting events found dispatching network-vif-plugged-bdf312ed-cce0-4d35-9257-f6a5a80cc0d2 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:52:16 user nova-compute[75100]: WARNING nova.compute.manager [req-638ac306-bef6-4ab7-9390-f96b7e9388ee req-b7944021-1127-4ade-b725-0bd7701c5f8a service nova] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Received unexpected event network-vif-plugged-bdf312ed-cce0-4d35-9257-f6a5a80cc0d2 for instance with vm_state active and task_state deleting.
Nov 10 17:52:16 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:52:17 user nova-compute[75100]: DEBUG nova.compute.manager [req-299b7783-b4aa-4402-81cc-874b6bfabd95 req-1ddda9f8-f990-4076-bcf3-f96786183986 service nova] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Received event network-vif-deleted-bdf312ed-cce0-4d35-9257-f6a5a80cc0d2 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:52:17 user nova-compute[75100]: INFO nova.compute.manager [req-299b7783-b4aa-4402-81cc-874b6bfabd95 req-1ddda9f8-f990-4076-bcf3-f96786183986 service nova] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Neutron deleted interface bdf312ed-cce0-4d35-9257-f6a5a80cc0d2; detaching it from the instance and deleting it from the info cache
Nov 10 17:52:17 user nova-compute[75100]: DEBUG nova.network.neutron [req-299b7783-b4aa-4402-81cc-874b6bfabd95 req-1ddda9f8-f990-4076-bcf3-f96786183986 service nova] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:52:17 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Took 1.71 seconds to deallocate network for instance.
Nov 10 17:52:17 user nova-compute[75100]: DEBUG nova.compute.manager [req-299b7783-b4aa-4402-81cc-874b6bfabd95 req-1ddda9f8-f990-4076-bcf3-f96786183986 service nova] [instance: ead532eb-c8be-45fa-a8b7-0b4c4f884a90] Detach interface failed, port_id=bdf312ed-cce0-4d35-9257-f6a5a80cc0d2, reason: Instance ead532eb-c8be-45fa-a8b7-0b4c4f884a90 could not be found. {{(pid=75100) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 17:52:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d745a5e3-3d46-43cb-a2df-d91c86d4e4a4 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:52:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d745a5e3-3d46-43cb-a2df-d91c86d4e4a4 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:52:17 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:52:17 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:52:17 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 17:52:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:17 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-d745a5e3-3d46-43cb-a2df-d91c86d4e4a4 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:52:17 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-d745a5e3-3d46-43cb-a2df-d91c86d4e4a4 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:52:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d745a5e3-3d46-43cb-a2df-d91c86d4e4a4 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.608s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:52:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:17 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-d745a5e3-3d46-43cb-a2df-d91c86d4e4a4 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Deleted allocations for instance ead532eb-c8be-45fa-a8b7-0b4c4f884a90
Nov 10 17:52:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d745a5e3-3d46-43cb-a2df-d91c86d4e4a4 tempest-VolumesAdminNegativeTest-1957922837 tempest-VolumesAdminNegativeTest-1957922837-project-member] Lock "ead532eb-c8be-45fa-a8b7-0b4c4f884a90" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.756s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:52:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:18 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:52:18 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 17:52:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "refresh_cache-3e14de19-540d-4dc2-a058-6874d8d14478" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:52:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquired lock "refresh_cache-3e14de19-540d-4dc2-a058-6874d8d14478" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:52:18 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 17:52:18 user nova-compute[75100]: DEBUG nova.compute.manager [req-5bd736b1-1b50-4eab-aba0-0f70c04c75a9 req-14a76729-e63d-4d1b-8cc4-e3cfc3d6ed64 service nova] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Received event network-vif-plugged-d3d11e2e-7099-4c6e-aa65-53f953ce4571 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:52:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5bd736b1-1b50-4eab-aba0-0f70c04c75a9 req-14a76729-e63d-4d1b-8cc4-e3cfc3d6ed64 service nova] Acquiring lock "e6de4626-f097-43b7-8e56-a08415e7d74a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:52:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5bd736b1-1b50-4eab-aba0-0f70c04c75a9 req-14a76729-e63d-4d1b-8cc4-e3cfc3d6ed64 service nova] Lock "e6de4626-f097-43b7-8e56-a08415e7d74a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:52:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5bd736b1-1b50-4eab-aba0-0f70c04c75a9 req-14a76729-e63d-4d1b-8cc4-e3cfc3d6ed64 service nova] Lock "e6de4626-f097-43b7-8e56-a08415e7d74a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:52:18 user nova-compute[75100]: DEBUG nova.compute.manager [req-5bd736b1-1b50-4eab-aba0-0f70c04c75a9 req-14a76729-e63d-4d1b-8cc4-e3cfc3d6ed64 service nova] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] No waiting events found dispatching network-vif-plugged-d3d11e2e-7099-4c6e-aa65-53f953ce4571 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:52:18 user nova-compute[75100]: WARNING nova.compute.manager [req-5bd736b1-1b50-4eab-aba0-0f70c04c75a9 req-14a76729-e63d-4d1b-8cc4-e3cfc3d6ed64 service nova] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Received unexpected event network-vif-plugged-d3d11e2e-7099-4c6e-aa65-53f953ce4571 for instance with vm_state building and task_state spawning.
Nov 10 17:52:18 user nova-compute[75100]: DEBUG nova.compute.manager [req-5bd736b1-1b50-4eab-aba0-0f70c04c75a9 req-14a76729-e63d-4d1b-8cc4-e3cfc3d6ed64 service nova] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Received event network-vif-plugged-d3d11e2e-7099-4c6e-aa65-53f953ce4571 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:52:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5bd736b1-1b50-4eab-aba0-0f70c04c75a9 req-14a76729-e63d-4d1b-8cc4-e3cfc3d6ed64 service nova] Acquiring lock "e6de4626-f097-43b7-8e56-a08415e7d74a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:52:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5bd736b1-1b50-4eab-aba0-0f70c04c75a9 req-14a76729-e63d-4d1b-8cc4-e3cfc3d6ed64 service nova] Lock "e6de4626-f097-43b7-8e56-a08415e7d74a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:52:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5bd736b1-1b50-4eab-aba0-0f70c04c75a9 req-14a76729-e63d-4d1b-8cc4-e3cfc3d6ed64 service nova] Lock "e6de4626-f097-43b7-8e56-a08415e7d74a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:52:18 user nova-compute[75100]: DEBUG nova.compute.manager [req-5bd736b1-1b50-4eab-aba0-0f70c04c75a9 req-14a76729-e63d-4d1b-8cc4-e3cfc3d6ed64 service nova] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] No waiting events found dispatching network-vif-plugged-d3d11e2e-7099-4c6e-aa65-53f953ce4571 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:52:18 user nova-compute[75100]: WARNING nova.compute.manager [req-5bd736b1-1b50-4eab-aba0-0f70c04c75a9 req-14a76729-e63d-4d1b-8cc4-e3cfc3d6ed64 service nova] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Received unexpected event network-vif-plugged-d3d11e2e-7099-4c6e-aa65-53f953ce4571 for instance with vm_state building and task_state spawning.
Nov 10 17:52:18 user nova-compute[75100]: DEBUG nova.compute.manager [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 17:52:18 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 17:52:18 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] Creating image(s)
Nov 10 17:52:18 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] Did not create local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 17:52:18 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] Ensure instance console log exists: /opt/stack/data/nova/instances/e1defbdd-4363-49c9-bc9a-a35da42c53bf/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 17:52:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:52:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:52:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:52:18 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] Start _get_guest_xml network_info=[{"id": "511e58ad-c419-4668-ba70-31049acd2e82", "address": "fa:16:3e:f8:42:9a", "network": {"id": "2a85480b-f67d-4ef1-b967-3e93af57d7c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1717495768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9cd441a46aa4a579feff608d6ff9bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511e58ad-c4", "ovs_interfaceid": "511e58ad-c419-4668-ba70-31049acd2e82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6308a969-f781-41fc-929c-b5b30faf7ec0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gPsGjhAi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e1defbdd-4363-49c9-bc9a-a35da42c53bf', 'attached_at': '', 'detached_at': '', 'volume_id': '6308a969-f781-41fc-929c-b5b30faf7ec0', 'serial': '6308a969-f781-41fc-929c-b5b30faf7ec0'}, 'mount_device': '/dev/vda', 'attachment_id': '72f43c26-78c6-44f3-9642-ee2ecf8d550d', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 17:52:18 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:52:18 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:52:18 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 17:52:18 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 17:52:18 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 17:52:18 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 17:52:18 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 17:52:18 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T17:40:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 17:52:18 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 17:52:18 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 17:52:18 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 17:52:18 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 17:52:18 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 17:52:18 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 17:52:18 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 17:52:18 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 17:52:18 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 17:52:18 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 17:52:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 17:52:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6308a969-f781-41fc-929c-b5b30faf7ec0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gPsGjhAi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 17:52:19 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 17:52:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 17:52:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 17:52:19 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 17:52:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6308a969-f781-41fc-929c-b5b30faf7ec0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 17:52:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6308a969-f781-41fc-929c-b5b30faf7ec0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 17:52:19 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 17:52:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6308a969-f781-41fc-929c-b5b30faf7ec0 -p 172.16.0.220:3260 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:52:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6308a969-f781-41fc-929c-b5b30faf7ec0 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:52:19 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8c42c0-35ba-415e-8797-fefa068bc177]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:52:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 17:52:19 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:52:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6308a969-f781-41fc-929c-b5b30faf7ec0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:52:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6308a969-f781-41fc-929c-b5b30faf7ec0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:52:19 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e6352c-b36a-4e84-9fd0-7c9dbe484142]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6308a969-f781-41fc-929c-b5b30faf7ec0] added\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:52:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6308a969-f781-41fc-929c-b5b30faf7ec0] added
Nov 10 17:52:19 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:52:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6308a969-f781-41fc-929c-b5b30faf7ec0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:52:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6308a969-f781-41fc-929c-b5b30faf7ec0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:52:19 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[71603f7c-c829-4c75-b282-232f11259904]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:52:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:52:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6308a969-f781-41fc-929c-b5b30faf7ec0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:52:19 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Updating instance_info_cache with network_info: [{"id": "d3f47ac6-ad90-4589-b41e-798c6fe6d5cf", "address": "fa:16:3e:b3:84:ec", "network": {"id": "26a554fe-9a5e-40c0-9981-5ac084c9ea73", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-269663495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19755f3e634fdfbd562c33fbfa2a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3f47ac6-ad", "ovs_interfaceid": "d3f47ac6-ad90-4589-b41e-798c6fe6d5cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:52:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6308a969-f781-41fc-929c-b5b30faf7ec0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:52:19 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0313db76-5e17-40e7-a12c-cfabc78e8ebe]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:52:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:52:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Releasing lock "refresh_cache-3e14de19-540d-4dc2-a058-6874d8d14478" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:52:19 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 17:52:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6308a969-f781-41fc-929c-b5b30faf7ec0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gPsGjhAi {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:52:19 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:52:19 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:52:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6308a969-f781-41fc-929c-b5b30faf7ec0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gPsGjhAi" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:52:19 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[37bf1446-e6a8-49c8-8f64-d94e5b67531e]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:52:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gPsGjhAi'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:52:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6308a969-f781-41fc-929c-b5b30faf7ec0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:52:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6308a969-f781-41fc-929c-b5b30faf7ec0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:52:19 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b30f830-0732-496c-8329-6d411a2dc9c8]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:52:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:52:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:52:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:52:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:52:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:52:19 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 17:52:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:52:19 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6972fb01-f5d2-4790-be0b-615e0776ac92]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:52:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)
Nov 10 17:52:19 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:52:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)
Nov 10 17:52:19 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 17:52:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6308a969-f781-41fc-929c-b5b30faf7ec0 -p 172.16.0.220:3260 --login {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:52:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6308a969-f781-41fc-929c-b5b30faf7ec0 -p 172.16.0.220:3260 --login" returned: 0 in 0.099s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:52:19 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4981ebfa-fa1e-4eef-acbb-9e26f569693d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6308a969-f781-41fc-929c-b5b30faf7ec0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6308a969-f781-41fc-929c-b5b30faf7ec0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:52:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6308a969-f781-41fc-929c-b5b30faf7ec0, portal: 172.16.0.220,3260]
Nov 10 17:52:19 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:6308a969-f781-41fc-929c-b5b30faf7ec0, portal: 172.16.0.220,3260] successful.
Nov 10 17:52:19 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:52:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6308a969-f781-41fc-929c-b5b30faf7ec0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:52:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6308a969-f781-41fc-929c-b5b30faf7ec0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:52:19 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae13bf25-52a1-4b59-96e5-248462cfe890]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:52:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:52:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:52:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:52:19 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[304817df-3e60-4687-aecf-a26c450318d3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6308a969-f781-41fc-929c-b5b30faf7ec0 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:52:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)
Nov 10 17:52:19 user nova-compute[75100]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6308a969-f781-41fc-929c-b5b30faf7ec0 (non-flash)
Nov 10 17:52:19 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:52:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)
Nov 10 17:52:19 user nova-compute[75100]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6308a969-f781-41fc-929c-b5b30faf7ec0 (non-flash)
Nov 10 17:52:19 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 17:52:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6308a969-f781-41fc-929c-b5b30faf7ec0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 17:52:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 17:52:19 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] HCTL ('34', '-', '-', 0) found on session 11 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 17:52:19 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 17:52:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:52:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.033s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:52:19 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f083d3-9e73-4a70-9d77-25cd01df305d]: (4, ('- - 0', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:52:19 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Searching for a device in session 11 and hctl ['34', '*', '*', 0] yield: None {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 17:52:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:52:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:52:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:52:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:52:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:52:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:52:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:52:20 user nova-compute[75100]: DEBUG nova.compute.manager [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 17:52:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 17:52:20 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Instance spawned successfully.
Nov 10 17:52:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 17:52:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:52:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:52:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:52:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:52:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:52:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:52:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:52:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:52:20 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Searching for a device in session 11 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 17:52:20 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6308a969-f781-41fc-929c-b5b30faf7ec0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gPsGjhAi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 17:52:20 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.407s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 17:52:20 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] <== connect_volume: return (1411ms) {'type': 'block', 'scsi_wwn': '23161663331613162', 'path': '/dev/sdc'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 17:52:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23161663331613162', 'path': '/dev/sdc'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 17:52:20 user nova-compute[75100]: INFO nova.compute.manager [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Took 6.06 seconds to spawn the instance on the hypervisor.
Nov 10 17:52:20 user nova-compute[75100]: DEBUG nova.compute.manager [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 17:52:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:51:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-876677741',display_name='tempest-TestVolumeBootPattern-server-876677741',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-876677741',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9cd441a46aa4a579feff608d6ff9bb4',ramdisk_id='',reservation_id='r-8xyi0967',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-706331648',owner_user_name='tempest-TestVolumeBootPattern-706331648-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:51:36Z,user_data=None,user_id='323c5738ca424a379f666b4ca60825ac',uuid=e1defbdd-4363-49c9-bc9a-a35da42c53bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "511e58ad-c419-4668-ba70-31049acd2e82", "address": "fa:16:3e:f8:42:9a", "network": {"id": "2a85480b-f67d-4ef1-b967-3e93af57d7c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1717495768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9cd441a46aa4a579feff608d6ff9bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511e58ad-c4", "ovs_interfaceid": "511e58ad-c419-4668-ba70-31049acd2e82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 17:52:20 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Converting VIF {"id": "511e58ad-c419-4668-ba70-31049acd2e82", "address": "fa:16:3e:f8:42:9a", "network": {"id": "2a85480b-f67d-4ef1-b967-3e93af57d7c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1717495768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9cd441a46aa4a579feff608d6ff9bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511e58ad-c4", "ovs_interfaceid": "511e58ad-c419-4668-ba70-31049acd2e82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:52:20 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:42:9a,bridge_name='br-int',has_traffic_filtering=True,id=511e58ad-c419-4668-ba70-31049acd2e82,network=Network(2a85480b-f67d-4ef1-b967-3e93af57d7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap511e58ad-c4') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:52:20 user nova-compute[75100]: DEBUG nova.objects.instance [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lazy-loading 'pci_devices' on Instance uuid e1defbdd-4363-49c9-bc9a-a35da42c53bf {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:52:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] End _get_guest_xml xml=<domain type="kvm">
Nov 10 17:52:20 user nova-compute[75100]:   <uuid>e1defbdd-4363-49c9-bc9a-a35da42c53bf</uuid>
Nov 10 17:52:20 user nova-compute[75100]:   <name>instance-00000014</name>
Nov 10 17:52:20 user nova-compute[75100]:   <memory>524288</memory>
Nov 10 17:52:20 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 10 17:52:20 user nova-compute[75100]:   <metadata>
Nov 10 17:52:20 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 17:52:20 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 10 17:52:20 user nova-compute[75100]:       <nova:name>tempest-TestVolumeBootPattern-server-876677741</nova:name>
Nov 10 17:52:20 user nova-compute[75100]:       <nova:creationTime>2023-11-10 17:52:18</nova:creationTime>
Nov 10 17:52:20 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 10 17:52:20 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 10 17:52:20 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 10 17:52:20 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 10 17:52:20 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 17:52:20 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 10 17:52:20 user nova-compute[75100]:       </nova:flavor>
Nov 10 17:52:20 user nova-compute[75100]:       <nova:owner>
Nov 10 17:52:20 user nova-compute[75100]:         <nova:user uuid="323c5738ca424a379f666b4ca60825ac">tempest-TestVolumeBootPattern-706331648-project-member</nova:user>
Nov 10 17:52:20 user nova-compute[75100]:         <nova:project uuid="b9cd441a46aa4a579feff608d6ff9bb4">tempest-TestVolumeBootPattern-706331648</nova:project>
Nov 10 17:52:20 user nova-compute[75100]:       </nova:owner>
Nov 10 17:52:20 user nova-compute[75100]:       <nova:ports>
Nov 10 17:52:20 user nova-compute[75100]:         <nova:port uuid="511e58ad-c419-4668-ba70-31049acd2e82">
Nov 10 17:52:20 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 10 17:52:20 user nova-compute[75100]:         </nova:port>
Nov 10 17:52:20 user nova-compute[75100]:       </nova:ports>
Nov 10 17:52:20 user nova-compute[75100]:     </nova:instance>
Nov 10 17:52:20 user nova-compute[75100]:   </metadata>
Nov 10 17:52:20 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 10 17:52:20 user nova-compute[75100]:     <system>
Nov 10 17:52:20 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 17:52:20 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 10 17:52:20 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 10 17:52:20 user nova-compute[75100]:       <entry name="serial">e1defbdd-4363-49c9-bc9a-a35da42c53bf</entry>
Nov 10 17:52:20 user nova-compute[75100]:       <entry name="uuid">e1defbdd-4363-49c9-bc9a-a35da42c53bf</entry>
Nov 10 17:52:20 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 10 17:52:20 user nova-compute[75100]:     </system>
Nov 10 17:52:20 user nova-compute[75100]:   </sysinfo>
Nov 10 17:52:20 user nova-compute[75100]:   <os>
Nov 10 17:52:20 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 17:52:20 user nova-compute[75100]:     <boot dev="hd"/>
Nov 10 17:52:20 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 10 17:52:20 user nova-compute[75100]:   </os>
Nov 10 17:52:20 user nova-compute[75100]:   <features>
Nov 10 17:52:20 user nova-compute[75100]:     <acpi/>
Nov 10 17:52:20 user nova-compute[75100]:     <apic/>
Nov 10 17:52:20 user nova-compute[75100]:     <vmcoreinfo/>
Nov 10 17:52:20 user nova-compute[75100]:   </features>
Nov 10 17:52:20 user nova-compute[75100]:   <clock offset="utc">
Nov 10 17:52:20 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 17:52:20 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 17:52:20 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 10 17:52:20 user nova-compute[75100]:   </clock>
Nov 10 17:52:20 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 10 17:52:20 user nova-compute[75100]:     <model>Nehalem</model>
Nov 10 17:52:20 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 17:52:20 user nova-compute[75100]:   </cpu>
Nov 10 17:52:20 user nova-compute[75100]:   <devices>
Nov 10 17:52:20 user nova-compute[75100]:     <disk type="block" device="disk">
Nov 10 17:52:20 user nova-compute[75100]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 17:52:20 user nova-compute[75100]:       <source dev="/dev/sdc"/>
Nov 10 17:52:20 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 10 17:52:20 user nova-compute[75100]:       <serial>6308a969-f781-41fc-929c-b5b30faf7ec0</serial>
Nov 10 17:52:20 user nova-compute[75100]:     </disk>
Nov 10 17:52:20 user nova-compute[75100]:     <interface type="ethernet">
Nov 10 17:52:20 user nova-compute[75100]:       <mac address="fa:16:3e:f8:42:9a"/>
Nov 10 17:52:20 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:52:20 user nova-compute[75100]:       <mtu size="1442"/>
Nov 10 17:52:20 user nova-compute[75100]:       <target dev="tap511e58ad-c4"/>
Nov 10 17:52:20 user nova-compute[75100]:     </interface>
Nov 10 17:52:20 user nova-compute[75100]:     <serial type="pty">
Nov 10 17:52:20 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/e1defbdd-4363-49c9-bc9a-a35da42c53bf/console.log" append="off"/>
Nov 10 17:52:20 user nova-compute[75100]:     </serial>
Nov 10 17:52:20 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 17:52:20 user nova-compute[75100]:     <video>
Nov 10 17:52:20 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:52:20 user nova-compute[75100]:     </video>
Nov 10 17:52:20 user nova-compute[75100]:     <rng model="virtio">
Nov 10 17:52:20 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 10 17:52:20 user nova-compute[75100]:     </rng>
Nov 10 17:52:20 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 10 17:52:20 user nova-compute[75100]:     <memballoon model="virtio">
Nov 10 17:52:20 user nova-compute[75100]:       <stats period="10"/>
Nov 10 17:52:20 user nova-compute[75100]:     </memballoon>
Nov 10 17:52:20 user nova-compute[75100]:   </devices>
Nov 10 17:52:20 user nova-compute[75100]: </domain>
Nov 10 17:52:20 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 17:52:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:51:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-876677741',display_name='tempest-TestVolumeBootPattern-server-876677741',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-876677741',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9cd441a46aa4a579feff608d6ff9bb4',ramdisk_id='',reservation_id='r-8xyi0967',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-706331648',owner_user_name='tempest-TestVolumeBootPattern-706331648-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:51:36Z,user_data=None,user_id='323c5738ca424a379f666b4ca60825ac',uuid=e1defbdd-4363-49c9-bc9a-a35da42c53bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "511e58ad-c419-4668-ba70-31049acd2e82", "address": "fa:16:3e:f8:42:9a", "network": {"id": "2a85480b-f67d-4ef1-b967-3e93af57d7c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1717495768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9cd441a46aa4a579feff608d6ff9bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511e58ad-c4", "ovs_interfaceid": "511e58ad-c419-4668-ba70-31049acd2e82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 17:52:20 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Converting VIF {"id": "511e58ad-c419-4668-ba70-31049acd2e82", "address": "fa:16:3e:f8:42:9a", "network": {"id": "2a85480b-f67d-4ef1-b967-3e93af57d7c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1717495768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9cd441a46aa4a579feff608d6ff9bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511e58ad-c4", "ovs_interfaceid": "511e58ad-c419-4668-ba70-31049acd2e82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:52:20 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:42:9a,bridge_name='br-int',has_traffic_filtering=True,id=511e58ad-c419-4668-ba70-31049acd2e82,network=Network(2a85480b-f67d-4ef1-b967-3e93af57d7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap511e58ad-c4') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:52:20 user nova-compute[75100]: DEBUG os_vif [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:42:9a,bridge_name='br-int',has_traffic_filtering=True,id=511e58ad-c419-4668-ba70-31049acd2e82,network=Network(2a85480b-f67d-4ef1-b967-3e93af57d7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap511e58ad-c4') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 17:52:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:52:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 17:52:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6b7a746e-cbd0-5cc6-8bdd-ba7c49ea9b88', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:52:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:52:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap511e58ad-c4, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:52:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap511e58ad-c4, col_values=(('qos', UUID('ae5fc0dc-3212-4239-967f-e6305277a184')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:52:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap511e58ad-c4, col_values=(('external_ids', {'iface-id': '511e58ad-c419-4668-ba70-31049acd2e82', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:42:9a', 'vm-uuid': 'e1defbdd-4363-49c9-bc9a-a35da42c53bf'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:52:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:20 user nova-compute[75100]: INFO os_vif [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:42:9a,bridge_name='br-int',has_traffic_filtering=True,id=511e58ad-c419-4668-ba70-31049acd2e82,network=Network(2a85480b-f67d-4ef1-b967-3e93af57d7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap511e58ad-c4')
Nov 10 17:52:20 user nova-compute[75100]: INFO nova.compute.manager [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Took 66.37 seconds to build instance.
Nov 10 17:52:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-57bc4b47-9d32-423e-8fe1-c85d9afa228b tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lock "e6de4626-f097-43b7-8e56-a08415e7d74a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 66.563s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:52:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:52:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:52:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 17:52:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] No VIF found with MAC fa:16:3e:f8:42:9a, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 17:52:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:52:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 17:52:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:52:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:52:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:52:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:52:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:52:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk.rescue --force-share --output=json" returned: 0 in 0.211s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:52:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:52:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:52:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:52:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:52:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:52:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk --force-share --output=json" returned: 0 in 0.331s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:52:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:52:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:52:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:52:22 user nova-compute[75100]: DEBUG nova.compute.manager [req-61f6b686-8263-4716-84c6-f071543b173e req-41062fb8-1005-44ee-a4cf-13d4477d72f5 service nova] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] Received event network-vif-plugged-511e58ad-c419-4668-ba70-31049acd2e82 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:52:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-61f6b686-8263-4716-84c6-f071543b173e req-41062fb8-1005-44ee-a4cf-13d4477d72f5 service nova] Acquiring lock "e1defbdd-4363-49c9-bc9a-a35da42c53bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:52:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-61f6b686-8263-4716-84c6-f071543b173e req-41062fb8-1005-44ee-a4cf-13d4477d72f5 service nova] Lock "e1defbdd-4363-49c9-bc9a-a35da42c53bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:52:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-61f6b686-8263-4716-84c6-f071543b173e req-41062fb8-1005-44ee-a4cf-13d4477d72f5 service nova] Lock "e1defbdd-4363-49c9-bc9a-a35da42c53bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:52:22 user nova-compute[75100]: DEBUG nova.compute.manager [req-61f6b686-8263-4716-84c6-f071543b173e req-41062fb8-1005-44ee-a4cf-13d4477d72f5 service nova] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] No waiting events found dispatching network-vif-plugged-511e58ad-c419-4668-ba70-31049acd2e82 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:52:22 user nova-compute[75100]: WARNING nova.compute.manager [req-61f6b686-8263-4716-84c6-f071543b173e req-41062fb8-1005-44ee-a4cf-13d4477d72f5 service nova] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] Received unexpected event network-vif-plugged-511e58ad-c419-4668-ba70-31049acd2e82 for instance with vm_state building and task_state spawning.
Nov 10 17:52:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3/disk --force-share --output=json" returned: 0 in 0.294s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:52:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e73913-30a5-4eaa-9bc0-6e17a0288035/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:52:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e73913-30a5-4eaa-9bc0-6e17a0288035/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:52:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e73913-30a5-4eaa-9bc0-6e17a0288035/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:52:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e73913-30a5-4eaa-9bc0-6e17a0288035/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:52:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61d3862-5be7-45cc-95a0-88124ac1725d/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:52:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61d3862-5be7-45cc-95a0-88124ac1725d/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:52:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61d3862-5be7-45cc-95a0-88124ac1725d/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:52:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61d3862-5be7-45cc-95a0-88124ac1725d/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:52:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:25 user nova-compute[75100]: DEBUG nova.compute.manager [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 17:52:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 17:52:25 user nova-compute[75100]: DEBUG nova.compute.manager [req-a77b0383-b83f-431e-b117-a35595afd739 req-b4eafb6b-2160-4dc4-a55e-cce7b631d57c service nova] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] Received event network-vif-plugged-511e58ad-c419-4668-ba70-31049acd2e82 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:52:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a77b0383-b83f-431e-b117-a35595afd739 req-b4eafb6b-2160-4dc4-a55e-cce7b631d57c service nova] Acquiring lock "e1defbdd-4363-49c9-bc9a-a35da42c53bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:52:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a77b0383-b83f-431e-b117-a35595afd739 req-b4eafb6b-2160-4dc4-a55e-cce7b631d57c service nova] Lock "e1defbdd-4363-49c9-bc9a-a35da42c53bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:52:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a77b0383-b83f-431e-b117-a35595afd739 req-b4eafb6b-2160-4dc4-a55e-cce7b631d57c service nova] Lock "e1defbdd-4363-49c9-bc9a-a35da42c53bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:52:25 user nova-compute[75100]: DEBUG nova.compute.manager [req-a77b0383-b83f-431e-b117-a35595afd739 req-b4eafb6b-2160-4dc4-a55e-cce7b631d57c service nova] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] No waiting events found dispatching network-vif-plugged-511e58ad-c419-4668-ba70-31049acd2e82 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:52:25 user nova-compute[75100]: WARNING nova.compute.manager [req-a77b0383-b83f-431e-b117-a35595afd739 req-b4eafb6b-2160-4dc4-a55e-cce7b631d57c service nova] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] Received unexpected event network-vif-plugged-511e58ad-c419-4668-ba70-31049acd2e82 for instance with vm_state building and task_state spawning.
Nov 10 17:52:25 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] Instance spawned successfully.
Nov 10 17:52:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 17:52:25 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:52:25 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:52:25 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Hypervisor/Node resource view: name=user free_ram=7587MB free_disk=24.70030975341797GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 17:52:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:52:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:52:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:52:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:52:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:52:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:52:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:52:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:52:25 user nova-compute[75100]: INFO nova.compute.manager [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] Took 6.66 seconds to spawn the instance on the hypervisor.
Nov 10 17:52:25 user nova-compute[75100]: DEBUG nova.compute.manager [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 17:52:25 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance c19fc271-a248-4631-a11f-89b7ed73bf85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:52:25 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:52:25 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 3e14de19-540d-4dc2-a058-6874d8d14478 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:52:25 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance d61d3862-5be7-45cc-95a0-88124ac1725d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:52:25 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance eb430407-f836-4510-899f-a5f5d60c73f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:52:25 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:52:25 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:52:25 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance e6de4626-f097-43b7-8e56-a08415e7d74a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:52:25 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance e1defbdd-4363-49c9-bc9a-a35da42c53bf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:52:25 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 61e73913-30a5-4eaa-9bc0-6e17a0288035 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:52:25 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 17:52:25 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 17:52:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:25 user nova-compute[75100]: INFO nova.compute.manager [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] Took 50.77 seconds to build instance.
Nov 10 17:52:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9db7561c-c0fc-4498-8266-58fda83b2f7f tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "e1defbdd-4363-49c9-bc9a-a35da42c53bf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 50.881s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:52:26 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:52:26 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:52:26 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 17:52:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.743s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:52:27 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:52:27 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:52:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-548bbff5-8a94-4d98-9df0-38395836aa88 tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] Acquiring lock "b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:52:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-548bbff5-8a94-4d98-9df0-38395836aa88 tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] Lock "b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:52:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-548bbff5-8a94-4d98-9df0-38395836aa88 tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] Acquiring lock "b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:52:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-548bbff5-8a94-4d98-9df0-38395836aa88 tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] Lock "b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:52:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-548bbff5-8a94-4d98-9df0-38395836aa88 tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] Lock "b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:52:33 user nova-compute[75100]: INFO nova.compute.manager [None req-548bbff5-8a94-4d98-9df0-38395836aa88 tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] [instance: b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9] Terminating instance
Nov 10 17:52:33 user nova-compute[75100]: DEBUG nova.compute.manager [None req-548bbff5-8a94-4d98-9df0-38395836aa88 tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] [instance: b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 17:52:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:33 user nova-compute[75100]: DEBUG nova.compute.manager [req-2597d23a-7190-4b76-8402-57896b83d19a req-9ebc2442-0ca8-45ea-8473-8d8b6b13d053 service nova] [instance: b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9] Received event network-vif-unplugged-51f4f44b-6b18-417e-b33c-49fbfe8c4563 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:52:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2597d23a-7190-4b76-8402-57896b83d19a req-9ebc2442-0ca8-45ea-8473-8d8b6b13d053 service nova] Acquiring lock "b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:52:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2597d23a-7190-4b76-8402-57896b83d19a req-9ebc2442-0ca8-45ea-8473-8d8b6b13d053 service nova] Lock "b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:52:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2597d23a-7190-4b76-8402-57896b83d19a req-9ebc2442-0ca8-45ea-8473-8d8b6b13d053 service nova] Lock "b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:52:33 user nova-compute[75100]: DEBUG nova.compute.manager [req-2597d23a-7190-4b76-8402-57896b83d19a req-9ebc2442-0ca8-45ea-8473-8d8b6b13d053 service nova] [instance: b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9] No waiting events found dispatching network-vif-unplugged-51f4f44b-6b18-417e-b33c-49fbfe8c4563 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:52:33 user nova-compute[75100]: DEBUG nova.compute.manager [req-2597d23a-7190-4b76-8402-57896b83d19a req-9ebc2442-0ca8-45ea-8473-8d8b6b13d053 service nova] [instance: b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9] Received event network-vif-unplugged-51f4f44b-6b18-417e-b33c-49fbfe8c4563 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 17:52:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:34 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9] Instance destroyed successfully.
Nov 10 17:52:34 user nova-compute[75100]: DEBUG nova.objects.instance [None req-548bbff5-8a94-4d98-9df0-38395836aa88 tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] Lazy-loading 'resources' on Instance uuid b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:52:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-548bbff5-8a94-4d98-9df0-38395836aa88 tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:49:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1630873709',display_name='tempest-VolumesActionsTest-instance-1630873709',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1630873709',id=17,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T17:50:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b66facb836f9404c81dcae56f826a4ab',ramdisk_id='',reservation_id='r-103e3my5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-888970826',owner_user_name='tempest-VolumesActionsTest-888970826-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T17:50:06Z,user_data=None,user_id='039410b87e754d8d9a5de124c7e74d3b',uuid=b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51f4f44b-6b18-417e-b33c-49fbfe8c4563", "address": "fa:16:3e:2e:66:3b", "network": {"id": "2ff6ad81-8918-48ea-85e6-54f44265bc4a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1097138698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b66facb836f9404c81dcae56f826a4ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51f4f44b-6b", "ovs_interfaceid": "51f4f44b-6b18-417e-b33c-49fbfe8c4563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 17:52:34 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-548bbff5-8a94-4d98-9df0-38395836aa88 tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] Converting VIF {"id": "51f4f44b-6b18-417e-b33c-49fbfe8c4563", "address": "fa:16:3e:2e:66:3b", "network": {"id": "2ff6ad81-8918-48ea-85e6-54f44265bc4a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1097138698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b66facb836f9404c81dcae56f826a4ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51f4f44b-6b", "ovs_interfaceid": "51f4f44b-6b18-417e-b33c-49fbfe8c4563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:52:34 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-548bbff5-8a94-4d98-9df0-38395836aa88 tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:66:3b,bridge_name='br-int',has_traffic_filtering=True,id=51f4f44b-6b18-417e-b33c-49fbfe8c4563,network=Network(2ff6ad81-8918-48ea-85e6-54f44265bc4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51f4f44b-6b') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:52:34 user nova-compute[75100]: DEBUG os_vif [None req-548bbff5-8a94-4d98-9df0-38395836aa88 tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:66:3b,bridge_name='br-int',has_traffic_filtering=True,id=51f4f44b-6b18-417e-b33c-49fbfe8c4563,network=Network(2ff6ad81-8918-48ea-85e6-54f44265bc4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51f4f44b-6b') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 17:52:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap51f4f44b-6b, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:52:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:52:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=93a964ee-0557-4fa1-93ad-e676f18e4d79) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:52:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:52:34 user nova-compute[75100]: INFO os_vif [None req-548bbff5-8a94-4d98-9df0-38395836aa88 tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:66:3b,bridge_name='br-int',has_traffic_filtering=True,id=51f4f44b-6b18-417e-b33c-49fbfe8c4563,network=Network(2ff6ad81-8918-48ea-85e6-54f44265bc4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51f4f44b-6b')
Nov 10 17:52:34 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-548bbff5-8a94-4d98-9df0-38395836aa88 tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] [instance: b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9] Deleting instance files /opt/stack/data/nova/instances/b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9_del
Nov 10 17:52:34 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-548bbff5-8a94-4d98-9df0-38395836aa88 tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] [instance: b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9] Deletion of /opt/stack/data/nova/instances/b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9_del complete
Nov 10 17:52:34 user nova-compute[75100]: INFO nova.compute.manager [None req-548bbff5-8a94-4d98-9df0-38395836aa88 tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] [instance: b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9] Took 1.04 seconds to destroy the instance on the hypervisor.
Nov 10 17:52:34 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-548bbff5-8a94-4d98-9df0-38395836aa88 tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 17:52:34 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 17:52:34 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 17:52:35 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:52:35 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9] Took 0.76 seconds to deallocate network for instance.
Nov 10 17:52:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-548bbff5-8a94-4d98-9df0-38395836aa88 tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:52:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-548bbff5-8a94-4d98-9df0-38395836aa88 tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:52:35 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-548bbff5-8a94-4d98-9df0-38395836aa88 tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:52:35 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-548bbff5-8a94-4d98-9df0-38395836aa88 tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:52:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-548bbff5-8a94-4d98-9df0-38395836aa88 tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.416s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:52:35 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-548bbff5-8a94-4d98-9df0-38395836aa88 tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] Deleted allocations for instance b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9
Nov 10 17:52:35 user nova-compute[75100]: DEBUG nova.compute.manager [req-b82c6871-7ba6-41ac-aca3-1754ce44be0c req-9652d12c-f7ef-4552-98c1-528665f915c9 service nova] [instance: b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9] Received event network-vif-plugged-51f4f44b-6b18-417e-b33c-49fbfe8c4563 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:52:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b82c6871-7ba6-41ac-aca3-1754ce44be0c req-9652d12c-f7ef-4552-98c1-528665f915c9 service nova] Acquiring lock "b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:52:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b82c6871-7ba6-41ac-aca3-1754ce44be0c req-9652d12c-f7ef-4552-98c1-528665f915c9 service nova] Lock "b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:52:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b82c6871-7ba6-41ac-aca3-1754ce44be0c req-9652d12c-f7ef-4552-98c1-528665f915c9 service nova] Lock "b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:52:35 user nova-compute[75100]: DEBUG nova.compute.manager [req-b82c6871-7ba6-41ac-aca3-1754ce44be0c req-9652d12c-f7ef-4552-98c1-528665f915c9 service nova] [instance: b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9] No waiting events found dispatching network-vif-plugged-51f4f44b-6b18-417e-b33c-49fbfe8c4563 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:52:35 user nova-compute[75100]: WARNING nova.compute.manager [req-b82c6871-7ba6-41ac-aca3-1754ce44be0c req-9652d12c-f7ef-4552-98c1-528665f915c9 service nova] [instance: b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9] Received unexpected event network-vif-plugged-51f4f44b-6b18-417e-b33c-49fbfe8c4563 for instance with vm_state deleted and task_state None.
Nov 10 17:52:35 user nova-compute[75100]: DEBUG nova.compute.manager [req-b82c6871-7ba6-41ac-aca3-1754ce44be0c req-9652d12c-f7ef-4552-98c1-528665f915c9 service nova] [instance: b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9] Received event network-vif-deleted-51f4f44b-6b18-417e-b33c-49fbfe8c4563 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:52:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-548bbff5-8a94-4d98-9df0-38395836aa88 tempest-VolumesActionsTest-888970826 tempest-VolumesActionsTest-888970826-project-member] Lock "b6b2d6d6-7d8a-4c46-8174-f1d5e6c92fc9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.547s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:52:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:54 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:54 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:52:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:52:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 17:52:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:52:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:52:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:53:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:53:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:53:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Acquiring lock "9033f537-bdeb-412c-9337-4ad86f4467b2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:53:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "9033f537-bdeb-412c-9337-4ad86f4467b2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:53:05 user nova-compute[75100]: DEBUG nova.compute.manager [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 17:53:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:53:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:53:05 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 17:53:05 user nova-compute[75100]: INFO nova.compute.claims [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Claim successful on node user
Nov 10 17:53:06 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:53:06 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:53:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.605s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:53:06 user nova-compute[75100]: DEBUG nova.compute.manager [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 17:53:06 user nova-compute[75100]: DEBUG nova.compute.manager [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 17:53:06 user nova-compute[75100]: DEBUG nova.network.neutron [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 17:53:06 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 17:53:06 user nova-compute[75100]: DEBUG nova.compute.manager [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 17:53:06 user nova-compute[75100]: DEBUG nova.policy [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8cdb9250e6c7459587e429a0aea577c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19755f3e634fdfbd562c33fbfa2a88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 17:53:06 user nova-compute[75100]: DEBUG nova.compute.manager [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 17:53:06 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 17:53:06 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Creating image(s)
Nov 10 17:53:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Acquiring lock "/opt/stack/data/nova/instances/9033f537-bdeb-412c-9337-4ad86f4467b2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:53:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "/opt/stack/data/nova/instances/9033f537-bdeb-412c-9337-4ad86f4467b2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:53:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "/opt/stack/data/nova/instances/9033f537-bdeb-412c-9337-4ad86f4467b2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:53:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:53:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.195s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:53:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Acquiring lock "818b9e28e061d41a38d903968b229be2ed9ba520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:53:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:53:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:53:07 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.200s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:53:07 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/9033f537-bdeb-412c-9337-4ad86f4467b2/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:53:07 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/9033f537-bdeb-412c-9337-4ad86f4467b2/disk 1073741824" returned: 0 in 0.057s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:53:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:53:07 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:53:07 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.229s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:53:07 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9033f537-bdeb-412c-9337-4ad86f4467b2/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 17:53:07 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9033f537-bdeb-412c-9337-4ad86f4467b2/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:53:07 user nova-compute[75100]: DEBUG nova.network.neutron [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Successfully created port: 4c49d1d4-dba2-478e-80b6-94e012439af6 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 17:53:07 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9033f537-bdeb-412c-9337-4ad86f4467b2/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:53:07 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Cannot resize image /opt/stack/data/nova/instances/9033f537-bdeb-412c-9337-4ad86f4467b2/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 17:53:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 17:53:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Ensure instance console log exists: /opt/stack/data/nova/instances/9033f537-bdeb-412c-9337-4ad86f4467b2/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 17:53:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:53:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:53:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:53:08 user nova-compute[75100]: DEBUG nova.network.neutron [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Successfully updated port: 4c49d1d4-dba2-478e-80b6-94e012439af6 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 17:53:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Acquiring lock "refresh_cache-9033f537-bdeb-412c-9337-4ad86f4467b2" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:53:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Acquired lock "refresh_cache-9033f537-bdeb-412c-9337-4ad86f4467b2" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:53:08 user nova-compute[75100]: DEBUG nova.network.neutron [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 17:53:08 user nova-compute[75100]: DEBUG nova.compute.manager [req-a8db8043-fd61-465e-9d66-764c27347b86 req-80987d12-0c1f-459c-8317-233c2ec2e8cc service nova] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Received event network-changed-4c49d1d4-dba2-478e-80b6-94e012439af6 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:53:08 user nova-compute[75100]: DEBUG nova.compute.manager [req-a8db8043-fd61-465e-9d66-764c27347b86 req-80987d12-0c1f-459c-8317-233c2ec2e8cc service nova] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Refreshing instance network info cache due to event network-changed-4c49d1d4-dba2-478e-80b6-94e012439af6. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 17:53:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a8db8043-fd61-465e-9d66-764c27347b86 req-80987d12-0c1f-459c-8317-233c2ec2e8cc service nova] Acquiring lock "refresh_cache-9033f537-bdeb-412c-9337-4ad86f4467b2" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:53:08 user nova-compute[75100]: DEBUG nova.network.neutron [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 17:53:08 user nova-compute[75100]: DEBUG nova.network.neutron [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Updating instance_info_cache with network_info: [{"id": "4c49d1d4-dba2-478e-80b6-94e012439af6", "address": "fa:16:3e:01:6b:43", "network": {"id": "26a554fe-9a5e-40c0-9981-5ac084c9ea73", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-269663495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19755f3e634fdfbd562c33fbfa2a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c49d1d4-db", "ovs_interfaceid": "4c49d1d4-dba2-478e-80b6-94e012439af6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:53:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Releasing lock "refresh_cache-9033f537-bdeb-412c-9337-4ad86f4467b2" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:53:08 user nova-compute[75100]: DEBUG nova.compute.manager [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Instance network_info: |[{"id": "4c49d1d4-dba2-478e-80b6-94e012439af6", "address": "fa:16:3e:01:6b:43", "network": {"id": "26a554fe-9a5e-40c0-9981-5ac084c9ea73", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-269663495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19755f3e634fdfbd562c33fbfa2a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c49d1d4-db", "ovs_interfaceid": "4c49d1d4-dba2-478e-80b6-94e012439af6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 17:53:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a8db8043-fd61-465e-9d66-764c27347b86 req-80987d12-0c1f-459c-8317-233c2ec2e8cc service nova] Acquired lock "refresh_cache-9033f537-bdeb-412c-9337-4ad86f4467b2" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:53:08 user nova-compute[75100]: DEBUG nova.network.neutron [req-a8db8043-fd61-465e-9d66-764c27347b86 req-80987d12-0c1f-459c-8317-233c2ec2e8cc service nova] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Refreshing network info cache for port 4c49d1d4-dba2-478e-80b6-94e012439af6 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 17:53:08 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Start _get_guest_xml network_info=[{"id": "4c49d1d4-dba2-478e-80b6-94e012439af6", "address": "fa:16:3e:01:6b:43", "network": {"id": "26a554fe-9a5e-40c0-9981-5ac084c9ea73", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-269663495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19755f3e634fdfbd562c33fbfa2a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c49d1d4-db", "ovs_interfaceid": "4c49d1d4-dba2-478e-80b6-94e012439af6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'e3cc5321-4d40-49ee-885c-700e14741732'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 17:53:08 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:53:08 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:53:08 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 17:53:08 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 17:53:08 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 17:53:08 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 17:53:08 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 17:53:08 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T17:40:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 17:53:08 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 17:53:08 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 17:53:08 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 17:53:08 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 17:53:08 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 17:53:08 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 17:53:08 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 17:53:08 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 17:53:08 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 17:53:08 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 17:53:08 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:53:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-605414180',display_name='tempest-ServerRescueNegativeTestJSON-server-605414180',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-605414180',id=22,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK5WD1+eOwUzsX08cypzhrTma3HkbsN870zT0Y+QTvyZBNlyAR0CbepPOL0EczUTok0EEOnRf3EnHVqUySgcH39xQkMu9DxtypvjKKVzJormvnoofL9/MAfmhYPJK8lu1w==',key_name='tempest-keypair-2016670451',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b19755f3e634fdfbd562c33fbfa2a88',ramdisk_id='',reservation_id='r-78y85sq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-783763036',owner_user_name='tempest-ServerRescueNegativeTestJSON-783763036-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:53:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8cdb9250e6c7459587e429a0aea577c6',uuid=9033f537-bdeb-412c-9337-4ad86f4467b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c49d1d4-dba2-478e-80b6-94e012439af6", "address": "fa:16:3e:01:6b:43", "network": {"id": "26a554fe-9a5e-40c0-9981-5ac084c9ea73", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-269663495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19755f3e634fdfbd562c33fbfa2a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c49d1d4-db", "ovs_interfaceid": "4c49d1d4-dba2-478e-80b6-94e012439af6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 17:53:08 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Converting VIF {"id": "4c49d1d4-dba2-478e-80b6-94e012439af6", "address": "fa:16:3e:01:6b:43", "network": {"id": "26a554fe-9a5e-40c0-9981-5ac084c9ea73", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-269663495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19755f3e634fdfbd562c33fbfa2a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c49d1d4-db", "ovs_interfaceid": "4c49d1d4-dba2-478e-80b6-94e012439af6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:53:08 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:6b:43,bridge_name='br-int',has_traffic_filtering=True,id=4c49d1d4-dba2-478e-80b6-94e012439af6,network=Network(26a554fe-9a5e-40c0-9981-5ac084c9ea73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c49d1d4-db') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:53:08 user nova-compute[75100]: DEBUG nova.objects.instance [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lazy-loading 'pci_devices' on Instance uuid 9033f537-bdeb-412c-9337-4ad86f4467b2 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:53:08 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] End _get_guest_xml xml=<domain type="kvm">
Nov 10 17:53:08 user nova-compute[75100]:   <uuid>9033f537-bdeb-412c-9337-4ad86f4467b2</uuid>
Nov 10 17:53:08 user nova-compute[75100]:   <name>instance-00000016</name>
Nov 10 17:53:08 user nova-compute[75100]:   <memory>524288</memory>
Nov 10 17:53:08 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 10 17:53:08 user nova-compute[75100]:   <metadata>
Nov 10 17:53:08 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 17:53:08 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 10 17:53:08 user nova-compute[75100]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-605414180</nova:name>
Nov 10 17:53:08 user nova-compute[75100]:       <nova:creationTime>2023-11-10 17:53:08</nova:creationTime>
Nov 10 17:53:08 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 10 17:53:08 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 10 17:53:08 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 10 17:53:08 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 10 17:53:08 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 17:53:08 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 10 17:53:08 user nova-compute[75100]:       </nova:flavor>
Nov 10 17:53:08 user nova-compute[75100]:       <nova:owner>
Nov 10 17:53:08 user nova-compute[75100]:         <nova:user uuid="8cdb9250e6c7459587e429a0aea577c6">tempest-ServerRescueNegativeTestJSON-783763036-project-member</nova:user>
Nov 10 17:53:08 user nova-compute[75100]:         <nova:project uuid="6b19755f3e634fdfbd562c33fbfa2a88">tempest-ServerRescueNegativeTestJSON-783763036</nova:project>
Nov 10 17:53:08 user nova-compute[75100]:       </nova:owner>
Nov 10 17:53:08 user nova-compute[75100]:       <nova:root type="image" uuid="e3cc5321-4d40-49ee-885c-700e14741732"/>
Nov 10 17:53:08 user nova-compute[75100]:       <nova:ports>
Nov 10 17:53:08 user nova-compute[75100]:         <nova:port uuid="4c49d1d4-dba2-478e-80b6-94e012439af6">
Nov 10 17:53:08 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 10 17:53:08 user nova-compute[75100]:         </nova:port>
Nov 10 17:53:08 user nova-compute[75100]:       </nova:ports>
Nov 10 17:53:08 user nova-compute[75100]:     </nova:instance>
Nov 10 17:53:08 user nova-compute[75100]:   </metadata>
Nov 10 17:53:08 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 10 17:53:08 user nova-compute[75100]:     <system>
Nov 10 17:53:08 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 17:53:08 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 10 17:53:08 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 10 17:53:08 user nova-compute[75100]:       <entry name="serial">9033f537-bdeb-412c-9337-4ad86f4467b2</entry>
Nov 10 17:53:08 user nova-compute[75100]:       <entry name="uuid">9033f537-bdeb-412c-9337-4ad86f4467b2</entry>
Nov 10 17:53:08 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 10 17:53:08 user nova-compute[75100]:     </system>
Nov 10 17:53:08 user nova-compute[75100]:   </sysinfo>
Nov 10 17:53:08 user nova-compute[75100]:   <os>
Nov 10 17:53:08 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 17:53:08 user nova-compute[75100]:     <boot dev="hd"/>
Nov 10 17:53:08 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 10 17:53:08 user nova-compute[75100]:   </os>
Nov 10 17:53:08 user nova-compute[75100]:   <features>
Nov 10 17:53:08 user nova-compute[75100]:     <acpi/>
Nov 10 17:53:08 user nova-compute[75100]:     <apic/>
Nov 10 17:53:08 user nova-compute[75100]:     <vmcoreinfo/>
Nov 10 17:53:08 user nova-compute[75100]:   </features>
Nov 10 17:53:08 user nova-compute[75100]:   <clock offset="utc">
Nov 10 17:53:08 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 17:53:08 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 17:53:08 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 10 17:53:08 user nova-compute[75100]:   </clock>
Nov 10 17:53:08 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 10 17:53:08 user nova-compute[75100]:     <model>Nehalem</model>
Nov 10 17:53:08 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 17:53:08 user nova-compute[75100]:   </cpu>
Nov 10 17:53:08 user nova-compute[75100]:   <devices>
Nov 10 17:53:08 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 10 17:53:08 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 17:53:08 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/9033f537-bdeb-412c-9337-4ad86f4467b2/disk"/>
Nov 10 17:53:08 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 10 17:53:08 user nova-compute[75100]:     </disk>
Nov 10 17:53:08 user nova-compute[75100]:     <interface type="ethernet">
Nov 10 17:53:08 user nova-compute[75100]:       <mac address="fa:16:3e:01:6b:43"/>
Nov 10 17:53:08 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:53:08 user nova-compute[75100]:       <mtu size="1442"/>
Nov 10 17:53:08 user nova-compute[75100]:       <target dev="tap4c49d1d4-db"/>
Nov 10 17:53:08 user nova-compute[75100]:     </interface>
Nov 10 17:53:08 user nova-compute[75100]:     <serial type="pty">
Nov 10 17:53:08 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/9033f537-bdeb-412c-9337-4ad86f4467b2/console.log" append="off"/>
Nov 10 17:53:08 user nova-compute[75100]:     </serial>
Nov 10 17:53:08 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 17:53:08 user nova-compute[75100]:     <video>
Nov 10 17:53:08 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:53:08 user nova-compute[75100]:     </video>
Nov 10 17:53:08 user nova-compute[75100]:     <rng model="virtio">
Nov 10 17:53:08 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 10 17:53:08 user nova-compute[75100]:     </rng>
Nov 10 17:53:08 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 10 17:53:08 user nova-compute[75100]:     <memballoon model="virtio">
Nov 10 17:53:08 user nova-compute[75100]:       <stats period="10"/>
Nov 10 17:53:08 user nova-compute[75100]:     </memballoon>
Nov 10 17:53:08 user nova-compute[75100]:   </devices>
Nov 10 17:53:08 user nova-compute[75100]: </domain>
Nov 10 17:53:08 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 17:53:08 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:53:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-605414180',display_name='tempest-ServerRescueNegativeTestJSON-server-605414180',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-605414180',id=22,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK5WD1+eOwUzsX08cypzhrTma3HkbsN870zT0Y+QTvyZBNlyAR0CbepPOL0EczUTok0EEOnRf3EnHVqUySgcH39xQkMu9DxtypvjKKVzJormvnoofL9/MAfmhYPJK8lu1w==',key_name='tempest-keypair-2016670451',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b19755f3e634fdfbd562c33fbfa2a88',ramdisk_id='',reservation_id='r-78y85sq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-783763036',owner_user_name='tempest-ServerRescueNegativeTestJSON-783763036-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:53:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8cdb9250e6c7459587e429a0aea577c6',uuid=9033f537-bdeb-412c-9337-4ad86f4467b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c49d1d4-dba2-478e-80b6-94e012439af6", "address": "fa:16:3e:01:6b:43", "network": {"id": "26a554fe-9a5e-40c0-9981-5ac084c9ea73", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-269663495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19755f3e634fdfbd562c33fbfa2a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c49d1d4-db", "ovs_interfaceid": "4c49d1d4-dba2-478e-80b6-94e012439af6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 17:53:08 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Converting VIF {"id": "4c49d1d4-dba2-478e-80b6-94e012439af6", "address": "fa:16:3e:01:6b:43", "network": {"id": "26a554fe-9a5e-40c0-9981-5ac084c9ea73", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-269663495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19755f3e634fdfbd562c33fbfa2a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c49d1d4-db", "ovs_interfaceid": "4c49d1d4-dba2-478e-80b6-94e012439af6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:53:08 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:6b:43,bridge_name='br-int',has_traffic_filtering=True,id=4c49d1d4-dba2-478e-80b6-94e012439af6,network=Network(26a554fe-9a5e-40c0-9981-5ac084c9ea73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c49d1d4-db') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:53:08 user nova-compute[75100]: DEBUG os_vif [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:6b:43,bridge_name='br-int',has_traffic_filtering=True,id=4c49d1d4-dba2-478e-80b6-94e012439af6,network=Network(26a554fe-9a5e-40c0-9981-5ac084c9ea73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c49d1d4-db') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 17:53:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:53:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:53:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 17:53:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:53:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c5a94045-d6e2-5606-9a39-2c62c1966dab', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:53:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:53:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:53:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:53:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4c49d1d4-db, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:53:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4c49d1d4-db, col_values=(('qos', UUID('6f0e51f7-1031-4241-8dd8-6c57357a9641')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:53:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4c49d1d4-db, col_values=(('external_ids', {'iface-id': '4c49d1d4-dba2-478e-80b6-94e012439af6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:6b:43', 'vm-uuid': '9033f537-bdeb-412c-9337-4ad86f4467b2'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:53:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:53:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:53:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:53:08 user nova-compute[75100]: INFO os_vif [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:6b:43,bridge_name='br-int',has_traffic_filtering=True,id=4c49d1d4-dba2-478e-80b6-94e012439af6,network=Network(26a554fe-9a5e-40c0-9981-5ac084c9ea73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c49d1d4-db')
Nov 10 17:53:08 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 17:53:08 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] No VIF found with MAC fa:16:3e:01:6b:43, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 17:53:09 user nova-compute[75100]: DEBUG nova.network.neutron [req-a8db8043-fd61-465e-9d66-764c27347b86 req-80987d12-0c1f-459c-8317-233c2ec2e8cc service nova] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Updated VIF entry in instance network info cache for port 4c49d1d4-dba2-478e-80b6-94e012439af6. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 17:53:09 user nova-compute[75100]: DEBUG nova.network.neutron [req-a8db8043-fd61-465e-9d66-764c27347b86 req-80987d12-0c1f-459c-8317-233c2ec2e8cc service nova] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Updating instance_info_cache with network_info: [{"id": "4c49d1d4-dba2-478e-80b6-94e012439af6", "address": "fa:16:3e:01:6b:43", "network": {"id": "26a554fe-9a5e-40c0-9981-5ac084c9ea73", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-269663495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19755f3e634fdfbd562c33fbfa2a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c49d1d4-db", "ovs_interfaceid": "4c49d1d4-dba2-478e-80b6-94e012439af6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:53:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a8db8043-fd61-465e-9d66-764c27347b86 req-80987d12-0c1f-459c-8317-233c2ec2e8cc service nova] Releasing lock "refresh_cache-9033f537-bdeb-412c-9337-4ad86f4467b2" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:53:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:53:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:53:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:53:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:53:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:53:10 user nova-compute[75100]: DEBUG nova.compute.manager [req-7527d5ef-c704-40db-b027-8d32702de89e req-52d4e4f1-37bf-43c6-9e84-5f784a9eea31 service nova] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Received event network-vif-plugged-4c49d1d4-dba2-478e-80b6-94e012439af6 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:53:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7527d5ef-c704-40db-b027-8d32702de89e req-52d4e4f1-37bf-43c6-9e84-5f784a9eea31 service nova] Acquiring lock "9033f537-bdeb-412c-9337-4ad86f4467b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:53:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7527d5ef-c704-40db-b027-8d32702de89e req-52d4e4f1-37bf-43c6-9e84-5f784a9eea31 service nova] Lock "9033f537-bdeb-412c-9337-4ad86f4467b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:53:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7527d5ef-c704-40db-b027-8d32702de89e req-52d4e4f1-37bf-43c6-9e84-5f784a9eea31 service nova] Lock "9033f537-bdeb-412c-9337-4ad86f4467b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:53:10 user nova-compute[75100]: DEBUG nova.compute.manager [req-7527d5ef-c704-40db-b027-8d32702de89e req-52d4e4f1-37bf-43c6-9e84-5f784a9eea31 service nova] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] No waiting events found dispatching network-vif-plugged-4c49d1d4-dba2-478e-80b6-94e012439af6 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:53:10 user nova-compute[75100]: WARNING nova.compute.manager [req-7527d5ef-c704-40db-b027-8d32702de89e req-52d4e4f1-37bf-43c6-9e84-5f784a9eea31 service nova] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Received unexpected event network-vif-plugged-4c49d1d4-dba2-478e-80b6-94e012439af6 for instance with vm_state building and task_state spawning.
Nov 10 17:53:12 user nova-compute[75100]: DEBUG nova.compute.manager [req-d819eeef-d0e6-47e8-9998-6d7fe6bbb5ed req-d2954c1e-bad2-49b2-b447-6b6947dc2963 service nova] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Received event network-vif-plugged-4c49d1d4-dba2-478e-80b6-94e012439af6 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:53:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d819eeef-d0e6-47e8-9998-6d7fe6bbb5ed req-d2954c1e-bad2-49b2-b447-6b6947dc2963 service nova] Acquiring lock "9033f537-bdeb-412c-9337-4ad86f4467b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:53:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d819eeef-d0e6-47e8-9998-6d7fe6bbb5ed req-d2954c1e-bad2-49b2-b447-6b6947dc2963 service nova] Lock "9033f537-bdeb-412c-9337-4ad86f4467b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:53:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d819eeef-d0e6-47e8-9998-6d7fe6bbb5ed req-d2954c1e-bad2-49b2-b447-6b6947dc2963 service nova] Lock "9033f537-bdeb-412c-9337-4ad86f4467b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:53:12 user nova-compute[75100]: DEBUG nova.compute.manager [req-d819eeef-d0e6-47e8-9998-6d7fe6bbb5ed req-d2954c1e-bad2-49b2-b447-6b6947dc2963 service nova] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] No waiting events found dispatching network-vif-plugged-4c49d1d4-dba2-478e-80b6-94e012439af6 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:53:12 user nova-compute[75100]: WARNING nova.compute.manager [req-d819eeef-d0e6-47e8-9998-6d7fe6bbb5ed req-d2954c1e-bad2-49b2-b447-6b6947dc2963 service nova] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Received unexpected event network-vif-plugged-4c49d1d4-dba2-478e-80b6-94e012439af6 for instance with vm_state building and task_state spawning.
Nov 10 17:53:12 user nova-compute[75100]: DEBUG nova.compute.manager [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 17:53:12 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 17:53:12 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Instance spawned successfully.
Nov 10 17:53:12 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 17:53:12 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:53:12 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:53:12 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:53:12 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:53:12 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:53:12 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:53:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:53:13 user nova-compute[75100]: INFO nova.compute.manager [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Took 6.42 seconds to spawn the instance on the hypervisor.
Nov 10 17:53:13 user nova-compute[75100]: DEBUG nova.compute.manager [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 17:53:13 user nova-compute[75100]: INFO nova.compute.manager [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Took 7.67 seconds to build instance.
Nov 10 17:53:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c2f375ef-b7df-4871-bb37-391b8ba4ee18 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "9033f537-bdeb-412c-9337-4ad86f4467b2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.813s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:53:13 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:53:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:53:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:53:15 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:53:16 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:53:18 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:53:18 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:53:18 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 17:53:18 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:53:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:53:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:53:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:53:18 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 17:53:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:53:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:53:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json" returned: 0 in 0.515s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:53:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:53:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:53:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:53:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:53:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:53:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:53:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:53:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:53:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:53:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:53:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 17:53:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 17:53:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:53:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:53:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk.rescue --force-share --output=json" returned: 0 in 0.259s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:53:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:53:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk.rescue --force-share --output=json" returned: 0 in 0.221s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:53:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:53:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:53:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:53:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:53:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:53:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:53:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:53:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:53:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9033f537-bdeb-412c-9337-4ad86f4467b2/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:53:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9033f537-bdeb-412c-9337-4ad86f4467b2/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:53:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9033f537-bdeb-412c-9337-4ad86f4467b2/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:53:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9033f537-bdeb-412c-9337-4ad86f4467b2/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:53:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e73913-30a5-4eaa-9bc0-6e17a0288035/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:53:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e73913-30a5-4eaa-9bc0-6e17a0288035/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:53:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e73913-30a5-4eaa-9bc0-6e17a0288035/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:53:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:53:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e73913-30a5-4eaa-9bc0-6e17a0288035/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:53:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61d3862-5be7-45cc-95a0-88124ac1725d/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:53:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61d3862-5be7-45cc-95a0-88124ac1725d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:53:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61d3862-5be7-45cc-95a0-88124ac1725d/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:53:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61d3862-5be7-45cc-95a0-88124ac1725d/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:53:23 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:53:23 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:53:23 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Hypervisor/Node resource view: name=user free_ram=7351MB free_disk=24.68604278564453GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 17:53:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:53:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:53:23 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance c19fc271-a248-4631-a11f-89b7ed73bf85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:53:23 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:53:23 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 3e14de19-540d-4dc2-a058-6874d8d14478 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:53:23 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance d61d3862-5be7-45cc-95a0-88124ac1725d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:53:23 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance eb430407-f836-4510-899f-a5f5d60c73f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:53:23 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:53:23 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance e6de4626-f097-43b7-8e56-a08415e7d74a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:53:23 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance e1defbdd-4363-49c9-bc9a-a35da42c53bf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:53:23 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 61e73913-30a5-4eaa-9bc0-6e17a0288035 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:53:23 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 9033f537-bdeb-412c-9337-4ad86f4467b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:53:23 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 17:53:23 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 17:53:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:53:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:53:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Acquiring lock "989f3ce5-067b-45e4-a2e5-445024e13202" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:53:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Lock "989f3ce5-067b-45e4-a2e5-445024e13202" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:53:24 user nova-compute[75100]: DEBUG nova.compute.manager [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 17:53:24 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:53:24 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:53:24 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 17:53:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.623s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:53:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:53:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:53:24 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 17:53:24 user nova-compute[75100]: INFO nova.compute.claims [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] Claim successful on node user
Nov 10 17:53:24 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:53:24 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:53:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.596s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:53:24 user nova-compute[75100]: DEBUG nova.compute.manager [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 17:53:24 user nova-compute[75100]: DEBUG nova.compute.manager [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 17:53:24 user nova-compute[75100]: DEBUG nova.network.neutron [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 17:53:24 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 17:53:24 user nova-compute[75100]: DEBUG nova.compute.manager [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 17:53:25 user nova-compute[75100]: DEBUG nova.policy [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '624efcea1cd1402d93c86d77c1424307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3d8aa64c704f45b08bdb0f1ecb2c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 17:53:25 user nova-compute[75100]: DEBUG nova.compute.manager [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 17:53:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 17:53:25 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] Creating image(s)
Nov 10 17:53:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Acquiring lock "/opt/stack/data/nova/instances/989f3ce5-067b-45e4-a2e5-445024e13202/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:53:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Lock "/opt/stack/data/nova/instances/989f3ce5-067b-45e4-a2e5-445024e13202/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:53:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Lock "/opt/stack/data/nova/instances/989f3ce5-067b-45e4-a2e5-445024e13202/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:53:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:53:25 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:53:25 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:53:25 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 17:53:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.187s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:53:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Acquiring lock "818b9e28e061d41a38d903968b229be2ed9ba520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:53:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:53:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:53:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "refresh_cache-d61d3862-5be7-45cc-95a0-88124ac1725d" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:53:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquired lock "refresh_cache-d61d3862-5be7-45cc-95a0-88124ac1725d" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:53:25 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 17:53:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.229s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:53:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/989f3ce5-067b-45e4-a2e5-445024e13202/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:53:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/989f3ce5-067b-45e4-a2e5-445024e13202/disk 1073741824" returned: 0 in 0.059s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:53:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.294s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:53:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:53:25 user nova-compute[75100]: DEBUG nova.network.neutron [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] Successfully created port: 9dd712ca-c177-4a1b-8d45-78db1470b9c1 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 17:53:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.227s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:53:25 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Checking if we can resize image /opt/stack/data/nova/instances/989f3ce5-067b-45e4-a2e5-445024e13202/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 17:53:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/989f3ce5-067b-45e4-a2e5-445024e13202/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:53:26 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] Updating instance_info_cache with network_info: [{"id": "27667bd1-cc0b-47d7-9e63-5fcc05f8bca7", "address": "fa:16:3e:2e:83:6b", "network": {"id": "f240fae3-3d7b-4b6e-b04f-18550ab4d0a3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1007355777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c970a503d74d32a1e2b71f086649fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27667bd1-cc", "ovs_interfaceid": "27667bd1-cc0b-47d7-9e63-5fcc05f8bca7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:53:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/989f3ce5-067b-45e4-a2e5-445024e13202/disk --force-share --output=json" returned: 0 in 0.413s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:53:26 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Cannot resize image /opt/stack/data/nova/instances/989f3ce5-067b-45e4-a2e5-445024e13202/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 17:53:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 17:53:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] Ensure instance console log exists: /opt/stack/data/nova/instances/989f3ce5-067b-45e4-a2e5-445024e13202/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 17:53:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:53:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:53:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:53:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Releasing lock "refresh_cache-d61d3862-5be7-45cc-95a0-88124ac1725d" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:53:26 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 17:53:26 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:53:26 user nova-compute[75100]: DEBUG nova.network.neutron [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] Successfully updated port: 9dd712ca-c177-4a1b-8d45-78db1470b9c1 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 17:53:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Acquiring lock "refresh_cache-989f3ce5-067b-45e4-a2e5-445024e13202" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:53:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Acquired lock "refresh_cache-989f3ce5-067b-45e4-a2e5-445024e13202" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:53:26 user nova-compute[75100]: DEBUG nova.network.neutron [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 17:53:26 user nova-compute[75100]: DEBUG nova.compute.manager [req-af2ede73-db08-4a51-adc5-99cc0d146d13 req-c02c0066-e89f-46b7-9e35-6a8840924358 service nova] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] Received event network-changed-9dd712ca-c177-4a1b-8d45-78db1470b9c1 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:53:26 user nova-compute[75100]: DEBUG nova.compute.manager [req-af2ede73-db08-4a51-adc5-99cc0d146d13 req-c02c0066-e89f-46b7-9e35-6a8840924358 service nova] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] Refreshing instance network info cache due to event network-changed-9dd712ca-c177-4a1b-8d45-78db1470b9c1. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 17:53:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-af2ede73-db08-4a51-adc5-99cc0d146d13 req-c02c0066-e89f-46b7-9e35-6a8840924358 service nova] Acquiring lock "refresh_cache-989f3ce5-067b-45e4-a2e5-445024e13202" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:53:26 user nova-compute[75100]: DEBUG nova.network.neutron [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 17:53:27 user nova-compute[75100]: DEBUG nova.network.neutron [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] Updating instance_info_cache with network_info: [{"id": "9dd712ca-c177-4a1b-8d45-78db1470b9c1", "address": "fa:16:3e:c5:ed:2a", "network": {"id": "879f9f54-7640-4384-b28f-7d8d38d7f74f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1830593335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc3d8aa64c704f45b08bdb0f1ecb2c90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dd712ca-c1", "ovs_interfaceid": "9dd712ca-c177-4a1b-8d45-78db1470b9c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:53:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Releasing lock "refresh_cache-989f3ce5-067b-45e4-a2e5-445024e13202" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:53:27 user nova-compute[75100]: DEBUG nova.compute.manager [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] Instance network_info: |[{"id": "9dd712ca-c177-4a1b-8d45-78db1470b9c1", "address": "fa:16:3e:c5:ed:2a", "network": {"id": "879f9f54-7640-4384-b28f-7d8d38d7f74f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1830593335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc3d8aa64c704f45b08bdb0f1ecb2c90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dd712ca-c1", "ovs_interfaceid": "9dd712ca-c177-4a1b-8d45-78db1470b9c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 17:53:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-af2ede73-db08-4a51-adc5-99cc0d146d13 req-c02c0066-e89f-46b7-9e35-6a8840924358 service nova] Acquired lock "refresh_cache-989f3ce5-067b-45e4-a2e5-445024e13202" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:53:27 user nova-compute[75100]: DEBUG nova.network.neutron [req-af2ede73-db08-4a51-adc5-99cc0d146d13 req-c02c0066-e89f-46b7-9e35-6a8840924358 service nova] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] Refreshing network info cache for port 9dd712ca-c177-4a1b-8d45-78db1470b9c1 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 17:53:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] Start _get_guest_xml network_info=[{"id": "9dd712ca-c177-4a1b-8d45-78db1470b9c1", "address": "fa:16:3e:c5:ed:2a", "network": {"id": "879f9f54-7640-4384-b28f-7d8d38d7f74f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1830593335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc3d8aa64c704f45b08bdb0f1ecb2c90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dd712ca-c1", "ovs_interfaceid": "9dd712ca-c177-4a1b-8d45-78db1470b9c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'e3cc5321-4d40-49ee-885c-700e14741732'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 17:53:27 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:53:27 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:53:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 17:53:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 17:53:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 17:53:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 17:53:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 17:53:27 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T17:40:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 17:53:27 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 17:53:27 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 17:53:27 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 17:53:27 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 17:53:27 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 17:53:27 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 17:53:27 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 17:53:27 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 17:53:27 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 17:53:27 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 17:53:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:53:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-714070398',display_name='tempest-ServersNegativeTestJSON-server-714070398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-714070398',id=23,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc3d8aa64c704f45b08bdb0f1ecb2c90',ramdisk_id='',reservation_id='r-z3wvbf41',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1166274989',owner_user_name='tempest-ServersNegativeTestJSON-1166274989-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:53:25Z,user_data=None,user_id='624efcea1cd1402d93c86d77c1424307',uuid=989f3ce5-067b-45e4-a2e5-445024e13202,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9dd712ca-c177-4a1b-8d45-78db1470b9c1", "address": "fa:16:3e:c5:ed:2a", "network": {"id": "879f9f54-7640-4384-b28f-7d8d38d7f74f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1830593335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc3d8aa64c704f45b08bdb0f1ecb2c90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dd712ca-c1", "ovs_interfaceid": "9dd712ca-c177-4a1b-8d45-78db1470b9c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 17:53:27 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Converting VIF {"id": "9dd712ca-c177-4a1b-8d45-78db1470b9c1", "address": "fa:16:3e:c5:ed:2a", "network": {"id": "879f9f54-7640-4384-b28f-7d8d38d7f74f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1830593335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc3d8aa64c704f45b08bdb0f1ecb2c90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dd712ca-c1", "ovs_interfaceid": "9dd712ca-c177-4a1b-8d45-78db1470b9c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:53:27 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:ed:2a,bridge_name='br-int',has_traffic_filtering=True,id=9dd712ca-c177-4a1b-8d45-78db1470b9c1,network=Network(879f9f54-7640-4384-b28f-7d8d38d7f74f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dd712ca-c1') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:53:27 user nova-compute[75100]: DEBUG nova.objects.instance [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Lazy-loading 'pci_devices' on Instance uuid 989f3ce5-067b-45e4-a2e5-445024e13202 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:53:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] End _get_guest_xml xml=<domain type="kvm">
Nov 10 17:53:27 user nova-compute[75100]:   <uuid>989f3ce5-067b-45e4-a2e5-445024e13202</uuid>
Nov 10 17:53:27 user nova-compute[75100]:   <name>instance-00000017</name>
Nov 10 17:53:27 user nova-compute[75100]:   <memory>524288</memory>
Nov 10 17:53:27 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 10 17:53:27 user nova-compute[75100]:   <metadata>
Nov 10 17:53:27 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 17:53:27 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 10 17:53:27 user nova-compute[75100]:       <nova:name>tempest-ServersNegativeTestJSON-server-714070398</nova:name>
Nov 10 17:53:27 user nova-compute[75100]:       <nova:creationTime>2023-11-10 17:53:27</nova:creationTime>
Nov 10 17:53:27 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 10 17:53:27 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 10 17:53:27 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 10 17:53:27 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 10 17:53:27 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 17:53:27 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 10 17:53:27 user nova-compute[75100]:       </nova:flavor>
Nov 10 17:53:27 user nova-compute[75100]:       <nova:owner>
Nov 10 17:53:27 user nova-compute[75100]:         <nova:user uuid="624efcea1cd1402d93c86d77c1424307">tempest-ServersNegativeTestJSON-1166274989-project-member</nova:user>
Nov 10 17:53:27 user nova-compute[75100]:         <nova:project uuid="fc3d8aa64c704f45b08bdb0f1ecb2c90">tempest-ServersNegativeTestJSON-1166274989</nova:project>
Nov 10 17:53:27 user nova-compute[75100]:       </nova:owner>
Nov 10 17:53:27 user nova-compute[75100]:       <nova:root type="image" uuid="e3cc5321-4d40-49ee-885c-700e14741732"/>
Nov 10 17:53:27 user nova-compute[75100]:       <nova:ports>
Nov 10 17:53:27 user nova-compute[75100]:         <nova:port uuid="9dd712ca-c177-4a1b-8d45-78db1470b9c1">
Nov 10 17:53:27 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 10 17:53:27 user nova-compute[75100]:         </nova:port>
Nov 10 17:53:27 user nova-compute[75100]:       </nova:ports>
Nov 10 17:53:27 user nova-compute[75100]:     </nova:instance>
Nov 10 17:53:27 user nova-compute[75100]:   </metadata>
Nov 10 17:53:27 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 10 17:53:27 user nova-compute[75100]:     <system>
Nov 10 17:53:27 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 17:53:27 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 10 17:53:27 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 10 17:53:27 user nova-compute[75100]:       <entry name="serial">989f3ce5-067b-45e4-a2e5-445024e13202</entry>
Nov 10 17:53:27 user nova-compute[75100]:       <entry name="uuid">989f3ce5-067b-45e4-a2e5-445024e13202</entry>
Nov 10 17:53:27 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 10 17:53:27 user nova-compute[75100]:     </system>
Nov 10 17:53:27 user nova-compute[75100]:   </sysinfo>
Nov 10 17:53:27 user nova-compute[75100]:   <os>
Nov 10 17:53:27 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 17:53:27 user nova-compute[75100]:     <boot dev="hd"/>
Nov 10 17:53:27 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 10 17:53:27 user nova-compute[75100]:   </os>
Nov 10 17:53:27 user nova-compute[75100]:   <features>
Nov 10 17:53:27 user nova-compute[75100]:     <acpi/>
Nov 10 17:53:27 user nova-compute[75100]:     <apic/>
Nov 10 17:53:27 user nova-compute[75100]:     <vmcoreinfo/>
Nov 10 17:53:27 user nova-compute[75100]:   </features>
Nov 10 17:53:27 user nova-compute[75100]:   <clock offset="utc">
Nov 10 17:53:27 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 17:53:27 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 17:53:27 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 10 17:53:27 user nova-compute[75100]:   </clock>
Nov 10 17:53:27 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 10 17:53:27 user nova-compute[75100]:     <model>Nehalem</model>
Nov 10 17:53:27 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 17:53:27 user nova-compute[75100]:   </cpu>
Nov 10 17:53:27 user nova-compute[75100]:   <devices>
Nov 10 17:53:27 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 10 17:53:27 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 17:53:27 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/989f3ce5-067b-45e4-a2e5-445024e13202/disk"/>
Nov 10 17:53:27 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 10 17:53:27 user nova-compute[75100]:     </disk>
Nov 10 17:53:27 user nova-compute[75100]:     <interface type="ethernet">
Nov 10 17:53:27 user nova-compute[75100]:       <mac address="fa:16:3e:c5:ed:2a"/>
Nov 10 17:53:27 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:53:27 user nova-compute[75100]:       <mtu size="1442"/>
Nov 10 17:53:27 user nova-compute[75100]:       <target dev="tap9dd712ca-c1"/>
Nov 10 17:53:27 user nova-compute[75100]:     </interface>
Nov 10 17:53:27 user nova-compute[75100]:     <serial type="pty">
Nov 10 17:53:27 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/989f3ce5-067b-45e4-a2e5-445024e13202/console.log" append="off"/>
Nov 10 17:53:27 user nova-compute[75100]:     </serial>
Nov 10 17:53:27 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 17:53:27 user nova-compute[75100]:     <video>
Nov 10 17:53:27 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:53:27 user nova-compute[75100]:     </video>
Nov 10 17:53:27 user nova-compute[75100]:     <rng model="virtio">
Nov 10 17:53:27 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 10 17:53:27 user nova-compute[75100]:     </rng>
Nov 10 17:53:27 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 10 17:53:27 user nova-compute[75100]:     <memballoon model="virtio">
Nov 10 17:53:27 user nova-compute[75100]:       <stats period="10"/>
Nov 10 17:53:27 user nova-compute[75100]:     </memballoon>
Nov 10 17:53:27 user nova-compute[75100]:   </devices>
Nov 10 17:53:27 user nova-compute[75100]: </domain>
Nov 10 17:53:27 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 17:53:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:53:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-714070398',display_name='tempest-ServersNegativeTestJSON-server-714070398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-714070398',id=23,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc3d8aa64c704f45b08bdb0f1ecb2c90',ramdisk_id='',reservation_id='r-z3wvbf41',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1166274989',owner_user_name='tempest-ServersNegativeTestJSON-1166274989-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:53:25Z,user_data=None,user_id='624efcea1cd1402d93c86d77c1424307',uuid=989f3ce5-067b-45e4-a2e5-445024e13202,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9dd712ca-c177-4a1b-8d45-78db1470b9c1", "address": "fa:16:3e:c5:ed:2a", "network": {"id": "879f9f54-7640-4384-b28f-7d8d38d7f74f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1830593335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc3d8aa64c704f45b08bdb0f1ecb2c90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dd712ca-c1", "ovs_interfaceid": "9dd712ca-c177-4a1b-8d45-78db1470b9c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 17:53:27 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Converting VIF {"id": "9dd712ca-c177-4a1b-8d45-78db1470b9c1", "address": "fa:16:3e:c5:ed:2a", "network": {"id": "879f9f54-7640-4384-b28f-7d8d38d7f74f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1830593335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc3d8aa64c704f45b08bdb0f1ecb2c90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dd712ca-c1", "ovs_interfaceid": "9dd712ca-c177-4a1b-8d45-78db1470b9c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:53:27 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:ed:2a,bridge_name='br-int',has_traffic_filtering=True,id=9dd712ca-c177-4a1b-8d45-78db1470b9c1,network=Network(879f9f54-7640-4384-b28f-7d8d38d7f74f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dd712ca-c1') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:53:27 user nova-compute[75100]: DEBUG os_vif [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:ed:2a,bridge_name='br-int',has_traffic_filtering=True,id=9dd712ca-c177-4a1b-8d45-78db1470b9c1,network=Network(879f9f54-7640-4384-b28f-7d8d38d7f74f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dd712ca-c1') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 17:53:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:53:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:53:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 17:53:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:53:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0054a7e7-a320-5327-96cf-eef2f3f5f1c8', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:53:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:53:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:53:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:53:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9dd712ca-c1, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:53:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9dd712ca-c1, col_values=(('qos', UUID('aa1cc046-a01d-4cf2-a659-9bede715c6d7')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:53:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9dd712ca-c1, col_values=(('external_ids', {'iface-id': '9dd712ca-c177-4a1b-8d45-78db1470b9c1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:ed:2a', 'vm-uuid': '989f3ce5-067b-45e4-a2e5-445024e13202'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:53:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:53:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:53:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:53:27 user nova-compute[75100]: INFO os_vif [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:ed:2a,bridge_name='br-int',has_traffic_filtering=True,id=9dd712ca-c177-4a1b-8d45-78db1470b9c1,network=Network(879f9f54-7640-4384-b28f-7d8d38d7f74f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dd712ca-c1')
Nov 10 17:53:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 17:53:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] No VIF found with MAC fa:16:3e:c5:ed:2a, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 17:53:27 user nova-compute[75100]: DEBUG nova.network.neutron [req-af2ede73-db08-4a51-adc5-99cc0d146d13 req-c02c0066-e89f-46b7-9e35-6a8840924358 service nova] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] Updated VIF entry in instance network info cache for port 9dd712ca-c177-4a1b-8d45-78db1470b9c1. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 17:53:27 user nova-compute[75100]: DEBUG nova.network.neutron [req-af2ede73-db08-4a51-adc5-99cc0d146d13 req-c02c0066-e89f-46b7-9e35-6a8840924358 service nova] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] Updating instance_info_cache with network_info: [{"id": "9dd712ca-c177-4a1b-8d45-78db1470b9c1", "address": "fa:16:3e:c5:ed:2a", "network": {"id": "879f9f54-7640-4384-b28f-7d8d38d7f74f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1830593335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc3d8aa64c704f45b08bdb0f1ecb2c90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dd712ca-c1", "ovs_interfaceid": "9dd712ca-c177-4a1b-8d45-78db1470b9c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:53:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-af2ede73-db08-4a51-adc5-99cc0d146d13 req-c02c0066-e89f-46b7-9e35-6a8840924358 service nova] Releasing lock "refresh_cache-989f3ce5-067b-45e4-a2e5-445024e13202" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:53:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:53:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:53:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:53:28 user nova-compute[75100]: DEBUG nova.compute.manager [req-ff2cb18f-89b1-408c-9439-5eeefd7f8195 req-c3b2ad93-556f-4c0b-86c4-3b2757053876 service nova] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] Received event network-vif-plugged-9dd712ca-c177-4a1b-8d45-78db1470b9c1 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:53:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ff2cb18f-89b1-408c-9439-5eeefd7f8195 req-c3b2ad93-556f-4c0b-86c4-3b2757053876 service nova] Acquiring lock "989f3ce5-067b-45e4-a2e5-445024e13202-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:53:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ff2cb18f-89b1-408c-9439-5eeefd7f8195 req-c3b2ad93-556f-4c0b-86c4-3b2757053876 service nova] Lock "989f3ce5-067b-45e4-a2e5-445024e13202-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:53:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ff2cb18f-89b1-408c-9439-5eeefd7f8195 req-c3b2ad93-556f-4c0b-86c4-3b2757053876 service nova] Lock "989f3ce5-067b-45e4-a2e5-445024e13202-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:53:28 user nova-compute[75100]: DEBUG nova.compute.manager [req-ff2cb18f-89b1-408c-9439-5eeefd7f8195 req-c3b2ad93-556f-4c0b-86c4-3b2757053876 service nova] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] No waiting events found dispatching network-vif-plugged-9dd712ca-c177-4a1b-8d45-78db1470b9c1 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:53:28 user nova-compute[75100]: WARNING nova.compute.manager [req-ff2cb18f-89b1-408c-9439-5eeefd7f8195 req-c3b2ad93-556f-4c0b-86c4-3b2757053876 service nova] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] Received unexpected event network-vif-plugged-9dd712ca-c177-4a1b-8d45-78db1470b9c1 for instance with vm_state building and task_state spawning.
Nov 10 17:53:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:53:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:53:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:53:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:53:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:53:30 user nova-compute[75100]: DEBUG nova.compute.manager [req-162a7461-b586-4e88-bbc9-186778222f3b req-3bb3d0d5-d5e8-44dc-82fa-c90dd3bde00c service nova] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] Received event network-vif-plugged-9dd712ca-c177-4a1b-8d45-78db1470b9c1 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:53:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-162a7461-b586-4e88-bbc9-186778222f3b req-3bb3d0d5-d5e8-44dc-82fa-c90dd3bde00c service nova] Acquiring lock "989f3ce5-067b-45e4-a2e5-445024e13202-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:53:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-162a7461-b586-4e88-bbc9-186778222f3b req-3bb3d0d5-d5e8-44dc-82fa-c90dd3bde00c service nova] Lock "989f3ce5-067b-45e4-a2e5-445024e13202-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:53:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-162a7461-b586-4e88-bbc9-186778222f3b req-3bb3d0d5-d5e8-44dc-82fa-c90dd3bde00c service nova] Lock "989f3ce5-067b-45e4-a2e5-445024e13202-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:53:30 user nova-compute[75100]: DEBUG nova.compute.manager [req-162a7461-b586-4e88-bbc9-186778222f3b req-3bb3d0d5-d5e8-44dc-82fa-c90dd3bde00c service nova] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] No waiting events found dispatching network-vif-plugged-9dd712ca-c177-4a1b-8d45-78db1470b9c1 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:53:30 user nova-compute[75100]: WARNING nova.compute.manager [req-162a7461-b586-4e88-bbc9-186778222f3b req-3bb3d0d5-d5e8-44dc-82fa-c90dd3bde00c service nova] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] Received unexpected event network-vif-plugged-9dd712ca-c177-4a1b-8d45-78db1470b9c1 for instance with vm_state building and task_state spawning.
Nov 10 17:53:31 user nova-compute[75100]: DEBUG nova.compute.manager [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 17:53:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 17:53:31 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] Instance spawned successfully.
Nov 10 17:53:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 17:53:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:53:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:53:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:53:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:53:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:53:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:53:31 user nova-compute[75100]: INFO nova.compute.manager [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] Took 6.07 seconds to spawn the instance on the hypervisor.
Nov 10 17:53:31 user nova-compute[75100]: DEBUG nova.compute.manager [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 17:53:31 user nova-compute[75100]: INFO nova.compute.manager [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] Took 7.06 seconds to build instance.
Nov 10 17:53:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bc5602d3-b592-48c9-ae7e-9d5e1aa7fdc3 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Lock "989f3ce5-067b-45e4-a2e5-445024e13202" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.214s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:53:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:53:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7a2f198a-15be-4754-b00b-eba274c56e2f tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Acquiring lock "eb430407-f836-4510-899f-a5f5d60c73f3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:53:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7a2f198a-15be-4754-b00b-eba274c56e2f tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Lock "eb430407-f836-4510-899f-a5f5d60c73f3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:53:32 user nova-compute[75100]: DEBUG nova.objects.instance [None req-7a2f198a-15be-4754-b00b-eba274c56e2f tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Lazy-loading 'flavor' on Instance uuid eb430407-f836-4510-899f-a5f5d60c73f3 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:53:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7a2f198a-15be-4754-b00b-eba274c56e2f tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Lock "eb430407-f836-4510-899f-a5f5d60c73f3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:53:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7a2f198a-15be-4754-b00b-eba274c56e2f tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Acquiring lock "eb430407-f836-4510-899f-a5f5d60c73f3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:53:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7a2f198a-15be-4754-b00b-eba274c56e2f tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Lock "eb430407-f836-4510-899f-a5f5d60c73f3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:53:33 user nova-compute[75100]: INFO nova.compute.manager [None req-7a2f198a-15be-4754-b00b-eba274c56e2f tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Attaching volume 9ba96bee-27d3-48fc-9caf-f8932bf96d0c to /dev/vdb
Nov 10 17:53:33 user nova-compute[75100]: DEBUG os_brick.utils [None req-7a2f198a-15be-4754-b00b-eba274c56e2f tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 17:53:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:53:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:53:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f576f48-5426-4c77-9b4b-f671ff4164c4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90b1a229568f\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:53:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:53:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:53:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c975921-8877-4150-8150-737134e4a041]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:53:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:53:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:53:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee08920-3c38-4c9c-8750-0c3517f1fe73]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:53:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a915cbe1-d974-473e-b6b8-aaf7673bcdd6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:53:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-7a2f198a-15be-4754-b00b-eba274c56e2f tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:53:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-7a2f198a-15be-4754-b00b-eba274c56e2f tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 17:53:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7a2f198a-15be-4754-b00b-eba274c56e2f tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 17:53:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:53:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 17:53:33 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 17:53:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd897bcf-ba23-4b1d-b325-05f9b785e7e1]: (4, '') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:53:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-7a2f198a-15be-4754-b00b-eba274c56e2f tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 17:53:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-7a2f198a-15be-4754-b00b-eba274c56e2f tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 17:53:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-7a2f198a-15be-4754-b00b-eba274c56e2f tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 17:53:33 user nova-compute[75100]: DEBUG os_brick.utils [None req-7a2f198a-15be-4754-b00b-eba274c56e2f tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90b1a229568f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 17:53:33 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-7a2f198a-15be-4754-b00b-eba274c56e2f tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Updating existing volume attachment record: fb9efe76-00f8-4a0d-bdb4-a8f952772a88 {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 17:53:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:53:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:53:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:53:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:53:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:53:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Acquiring lock "c7fbe35b-4794-4eb9-8033-923247064458" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:53:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "c7fbe35b-4794-4eb9-8033-923247064458" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:53:45 user nova-compute[75100]: DEBUG nova.compute.manager [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 17:53:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:53:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:53:45 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 17:53:45 user nova-compute[75100]: INFO nova.compute.claims [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Claim successful on node user
Nov 10 17:53:45 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:53:46 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:53:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.608s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:53:46 user nova-compute[75100]: DEBUG nova.compute.manager [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 17:53:46 user nova-compute[75100]: DEBUG nova.compute.manager [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 17:53:46 user nova-compute[75100]: DEBUG nova.network.neutron [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 17:53:46 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 17:53:46 user nova-compute[75100]: DEBUG nova.compute.manager [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 17:53:46 user nova-compute[75100]: DEBUG nova.policy [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9f4df424af2343a2a27e869502651216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7bb141ef59487dbb2ce6243c5002af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 17:53:46 user nova-compute[75100]: DEBUG nova.compute.manager [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 17:53:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 17:53:46 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Creating image(s)
Nov 10 17:53:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Acquiring lock "/opt/stack/data/nova/instances/c7fbe35b-4794-4eb9-8033-923247064458/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:53:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "/opt/stack/data/nova/instances/c7fbe35b-4794-4eb9-8033-923247064458/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:53:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "/opt/stack/data/nova/instances/c7fbe35b-4794-4eb9-8033-923247064458/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.033s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:53:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:53:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.183s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:53:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Acquiring lock "818b9e28e061d41a38d903968b229be2ed9ba520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:53:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:53:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:53:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.199s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:53:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/c7fbe35b-4794-4eb9-8033-923247064458/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:53:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/c7fbe35b-4794-4eb9-8033-923247064458/disk 1073741824" returned: 0 in 0.092s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:53:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.298s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:53:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:53:47 user nova-compute[75100]: DEBUG nova.network.neutron [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Successfully created port: 54a1b80b-3910-4ab8-a694-88989c4b6f4e {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 17:53:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.225s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:53:47 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c7fbe35b-4794-4eb9-8033-923247064458/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 17:53:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7fbe35b-4794-4eb9-8033-923247064458/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:53:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:53:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7fbe35b-4794-4eb9-8033-923247064458/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:53:47 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Cannot resize image /opt/stack/data/nova/instances/c7fbe35b-4794-4eb9-8033-923247064458/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 17:53:47 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 17:53:47 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Ensure instance console log exists: /opt/stack/data/nova/instances/c7fbe35b-4794-4eb9-8033-923247064458/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 17:53:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:53:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:53:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:53:47 user nova-compute[75100]: DEBUG nova.network.neutron [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Successfully updated port: 54a1b80b-3910-4ab8-a694-88989c4b6f4e {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 17:53:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Acquiring lock "refresh_cache-c7fbe35b-4794-4eb9-8033-923247064458" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:53:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Acquired lock "refresh_cache-c7fbe35b-4794-4eb9-8033-923247064458" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:53:47 user nova-compute[75100]: DEBUG nova.network.neutron [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 17:53:47 user nova-compute[75100]: DEBUG nova.compute.manager [req-d7d1d92a-659f-4718-bb12-1cfc7d821d92 req-c9403017-26e0-4eb0-82db-7d3a4bf3b9f2 service nova] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Received event network-changed-54a1b80b-3910-4ab8-a694-88989c4b6f4e {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:53:47 user nova-compute[75100]: DEBUG nova.compute.manager [req-d7d1d92a-659f-4718-bb12-1cfc7d821d92 req-c9403017-26e0-4eb0-82db-7d3a4bf3b9f2 service nova] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Refreshing instance network info cache due to event network-changed-54a1b80b-3910-4ab8-a694-88989c4b6f4e. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 17:53:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d7d1d92a-659f-4718-bb12-1cfc7d821d92 req-c9403017-26e0-4eb0-82db-7d3a4bf3b9f2 service nova] Acquiring lock "refresh_cache-c7fbe35b-4794-4eb9-8033-923247064458" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:53:48 user nova-compute[75100]: DEBUG nova.network.neutron [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 17:53:48 user nova-compute[75100]: DEBUG nova.network.neutron [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Updating instance_info_cache with network_info: [{"id": "54a1b80b-3910-4ab8-a694-88989c4b6f4e", "address": "fa:16:3e:d3:5e:89", "network": {"id": "bf1edb58-ef26-40ca-8ec9-853fa05de13d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1416469583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7bb141ef59487dbb2ce6243c5002af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54a1b80b-39", "ovs_interfaceid": "54a1b80b-3910-4ab8-a694-88989c4b6f4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:53:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Releasing lock "refresh_cache-c7fbe35b-4794-4eb9-8033-923247064458" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:53:48 user nova-compute[75100]: DEBUG nova.compute.manager [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Instance network_info: |[{"id": "54a1b80b-3910-4ab8-a694-88989c4b6f4e", "address": "fa:16:3e:d3:5e:89", "network": {"id": "bf1edb58-ef26-40ca-8ec9-853fa05de13d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1416469583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7bb141ef59487dbb2ce6243c5002af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54a1b80b-39", "ovs_interfaceid": "54a1b80b-3910-4ab8-a694-88989c4b6f4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 17:53:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d7d1d92a-659f-4718-bb12-1cfc7d821d92 req-c9403017-26e0-4eb0-82db-7d3a4bf3b9f2 service nova] Acquired lock "refresh_cache-c7fbe35b-4794-4eb9-8033-923247064458" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:53:48 user nova-compute[75100]: DEBUG nova.network.neutron [req-d7d1d92a-659f-4718-bb12-1cfc7d821d92 req-c9403017-26e0-4eb0-82db-7d3a4bf3b9f2 service nova] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Refreshing network info cache for port 54a1b80b-3910-4ab8-a694-88989c4b6f4e {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 17:53:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Start _get_guest_xml network_info=[{"id": "54a1b80b-3910-4ab8-a694-88989c4b6f4e", "address": "fa:16:3e:d3:5e:89", "network": {"id": "bf1edb58-ef26-40ca-8ec9-853fa05de13d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1416469583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7bb141ef59487dbb2ce6243c5002af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54a1b80b-39", "ovs_interfaceid": "54a1b80b-3910-4ab8-a694-88989c4b6f4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'e3cc5321-4d40-49ee-885c-700e14741732'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 17:53:48 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:53:48 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:53:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 17:53:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 17:53:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 17:53:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 17:53:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 17:53:48 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T17:40:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 17:53:48 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 17:53:48 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 17:53:48 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 17:53:48 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 17:53:48 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 17:53:48 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 17:53:48 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 17:53:48 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 17:53:48 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 17:53:48 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 17:53:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:53:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-843010782',display_name='tempest-tempest.common.compute-instance-843010782',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-843010782',id=24,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiOZtaw5osdCG7Z7OltXtNzbXyV1FVC6Yjpxvw/cDI+myaYVJpvsg9jfQJ1xjf+l5X7jK/9ICsmh5wP1Dm3CArptdAr7p9gmRDbitYb+wjwjgZ+DGtTIty8caL67y+u8g==',key_name='tempest-keypair-1694465190',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce7bb141ef59487dbb2ce6243c5002af',ramdisk_id='',reservation_id='r-pq63h9x0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1364670684',owner_user_name='tempest-ServerActionsTestOtherA-1364670684-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:53:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f4df424af2343a2a27e869502651216',uuid=c7fbe35b-4794-4eb9-8033-923247064458,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54a1b80b-3910-4ab8-a694-88989c4b6f4e", "address": "fa:16:3e:d3:5e:89", "network": {"id": "bf1edb58-ef26-40ca-8ec9-853fa05de13d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1416469583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7bb141ef59487dbb2ce6243c5002af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54a1b80b-39", "ovs_interfaceid": "54a1b80b-3910-4ab8-a694-88989c4b6f4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 17:53:48 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Converting VIF {"id": "54a1b80b-3910-4ab8-a694-88989c4b6f4e", "address": "fa:16:3e:d3:5e:89", "network": {"id": "bf1edb58-ef26-40ca-8ec9-853fa05de13d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1416469583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7bb141ef59487dbb2ce6243c5002af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54a1b80b-39", "ovs_interfaceid": "54a1b80b-3910-4ab8-a694-88989c4b6f4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:53:48 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:5e:89,bridge_name='br-int',has_traffic_filtering=True,id=54a1b80b-3910-4ab8-a694-88989c4b6f4e,network=Network(bf1edb58-ef26-40ca-8ec9-853fa05de13d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54a1b80b-39') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:53:48 user nova-compute[75100]: DEBUG nova.objects.instance [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lazy-loading 'pci_devices' on Instance uuid c7fbe35b-4794-4eb9-8033-923247064458 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:53:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] End _get_guest_xml xml=<domain type="kvm">
Nov 10 17:53:48 user nova-compute[75100]:   <uuid>c7fbe35b-4794-4eb9-8033-923247064458</uuid>
Nov 10 17:53:48 user nova-compute[75100]:   <name>instance-00000018</name>
Nov 10 17:53:48 user nova-compute[75100]:   <memory>524288</memory>
Nov 10 17:53:48 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 10 17:53:48 user nova-compute[75100]:   <metadata>
Nov 10 17:53:48 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 17:53:48 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 10 17:53:48 user nova-compute[75100]:       <nova:name>tempest-tempest.common.compute-instance-843010782</nova:name>
Nov 10 17:53:48 user nova-compute[75100]:       <nova:creationTime>2023-11-10 17:53:48</nova:creationTime>
Nov 10 17:53:48 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 10 17:53:48 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 10 17:53:48 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 10 17:53:48 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 10 17:53:48 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 17:53:48 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 10 17:53:48 user nova-compute[75100]:       </nova:flavor>
Nov 10 17:53:48 user nova-compute[75100]:       <nova:owner>
Nov 10 17:53:48 user nova-compute[75100]:         <nova:user uuid="9f4df424af2343a2a27e869502651216">tempest-ServerActionsTestOtherA-1364670684-project-member</nova:user>
Nov 10 17:53:48 user nova-compute[75100]:         <nova:project uuid="ce7bb141ef59487dbb2ce6243c5002af">tempest-ServerActionsTestOtherA-1364670684</nova:project>
Nov 10 17:53:48 user nova-compute[75100]:       </nova:owner>
Nov 10 17:53:48 user nova-compute[75100]:       <nova:root type="image" uuid="e3cc5321-4d40-49ee-885c-700e14741732"/>
Nov 10 17:53:48 user nova-compute[75100]:       <nova:ports>
Nov 10 17:53:48 user nova-compute[75100]:         <nova:port uuid="54a1b80b-3910-4ab8-a694-88989c4b6f4e">
Nov 10 17:53:48 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 10 17:53:48 user nova-compute[75100]:         </nova:port>
Nov 10 17:53:48 user nova-compute[75100]:       </nova:ports>
Nov 10 17:53:48 user nova-compute[75100]:     </nova:instance>
Nov 10 17:53:48 user nova-compute[75100]:   </metadata>
Nov 10 17:53:48 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 10 17:53:48 user nova-compute[75100]:     <system>
Nov 10 17:53:48 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 17:53:48 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 10 17:53:48 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 10 17:53:48 user nova-compute[75100]:       <entry name="serial">c7fbe35b-4794-4eb9-8033-923247064458</entry>
Nov 10 17:53:48 user nova-compute[75100]:       <entry name="uuid">c7fbe35b-4794-4eb9-8033-923247064458</entry>
Nov 10 17:53:48 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 10 17:53:48 user nova-compute[75100]:     </system>
Nov 10 17:53:48 user nova-compute[75100]:   </sysinfo>
Nov 10 17:53:48 user nova-compute[75100]:   <os>
Nov 10 17:53:48 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 17:53:48 user nova-compute[75100]:     <boot dev="hd"/>
Nov 10 17:53:48 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 10 17:53:48 user nova-compute[75100]:   </os>
Nov 10 17:53:48 user nova-compute[75100]:   <features>
Nov 10 17:53:48 user nova-compute[75100]:     <acpi/>
Nov 10 17:53:48 user nova-compute[75100]:     <apic/>
Nov 10 17:53:48 user nova-compute[75100]:     <vmcoreinfo/>
Nov 10 17:53:48 user nova-compute[75100]:   </features>
Nov 10 17:53:48 user nova-compute[75100]:   <clock offset="utc">
Nov 10 17:53:48 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 17:53:48 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 17:53:48 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 10 17:53:48 user nova-compute[75100]:   </clock>
Nov 10 17:53:48 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 10 17:53:48 user nova-compute[75100]:     <model>Nehalem</model>
Nov 10 17:53:48 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 17:53:48 user nova-compute[75100]:   </cpu>
Nov 10 17:53:48 user nova-compute[75100]:   <devices>
Nov 10 17:53:48 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 10 17:53:48 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 17:53:48 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/c7fbe35b-4794-4eb9-8033-923247064458/disk"/>
Nov 10 17:53:48 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 10 17:53:48 user nova-compute[75100]:     </disk>
Nov 10 17:53:48 user nova-compute[75100]:     <interface type="ethernet">
Nov 10 17:53:48 user nova-compute[75100]:       <mac address="fa:16:3e:d3:5e:89"/>
Nov 10 17:53:48 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:53:48 user nova-compute[75100]:       <mtu size="1442"/>
Nov 10 17:53:48 user nova-compute[75100]:       <target dev="tap54a1b80b-39"/>
Nov 10 17:53:48 user nova-compute[75100]:     </interface>
Nov 10 17:53:48 user nova-compute[75100]:     <serial type="pty">
Nov 10 17:53:48 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/c7fbe35b-4794-4eb9-8033-923247064458/console.log" append="off"/>
Nov 10 17:53:48 user nova-compute[75100]:     </serial>
Nov 10 17:53:48 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 17:53:48 user nova-compute[75100]:     <video>
Nov 10 17:53:48 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:53:48 user nova-compute[75100]:     </video>
Nov 10 17:53:48 user nova-compute[75100]:     <rng model="virtio">
Nov 10 17:53:48 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 10 17:53:48 user nova-compute[75100]:     </rng>
Nov 10 17:53:48 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 10 17:53:48 user nova-compute[75100]:     <memballoon model="virtio">
Nov 10 17:53:48 user nova-compute[75100]:       <stats period="10"/>
Nov 10 17:53:48 user nova-compute[75100]:     </memballoon>
Nov 10 17:53:48 user nova-compute[75100]:   </devices>
Nov 10 17:53:48 user nova-compute[75100]: </domain>
Nov 10 17:53:48 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 17:53:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:53:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-843010782',display_name='tempest-tempest.common.compute-instance-843010782',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-843010782',id=24,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiOZtaw5osdCG7Z7OltXtNzbXyV1FVC6Yjpxvw/cDI+myaYVJpvsg9jfQJ1xjf+l5X7jK/9ICsmh5wP1Dm3CArptdAr7p9gmRDbitYb+wjwjgZ+DGtTIty8caL67y+u8g==',key_name='tempest-keypair-1694465190',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce7bb141ef59487dbb2ce6243c5002af',ramdisk_id='',reservation_id='r-pq63h9x0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1364670684',owner_user_name='tempest-ServerActionsTestOtherA-1364670684-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:53:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f4df424af2343a2a27e869502651216',uuid=c7fbe35b-4794-4eb9-8033-923247064458,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54a1b80b-3910-4ab8-a694-88989c4b6f4e", "address": "fa:16:3e:d3:5e:89", "network": {"id": "bf1edb58-ef26-40ca-8ec9-853fa05de13d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1416469583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7bb141ef59487dbb2ce6243c5002af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54a1b80b-39", "ovs_interfaceid": "54a1b80b-3910-4ab8-a694-88989c4b6f4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 17:53:48 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Converting VIF {"id": "54a1b80b-3910-4ab8-a694-88989c4b6f4e", "address": "fa:16:3e:d3:5e:89", "network": {"id": "bf1edb58-ef26-40ca-8ec9-853fa05de13d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1416469583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7bb141ef59487dbb2ce6243c5002af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54a1b80b-39", "ovs_interfaceid": "54a1b80b-3910-4ab8-a694-88989c4b6f4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:53:48 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:5e:89,bridge_name='br-int',has_traffic_filtering=True,id=54a1b80b-3910-4ab8-a694-88989c4b6f4e,network=Network(bf1edb58-ef26-40ca-8ec9-853fa05de13d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54a1b80b-39') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:53:48 user nova-compute[75100]: DEBUG os_vif [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:5e:89,bridge_name='br-int',has_traffic_filtering=True,id=54a1b80b-3910-4ab8-a694-88989c4b6f4e,network=Network(bf1edb58-ef26-40ca-8ec9-853fa05de13d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54a1b80b-39') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 17:53:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:53:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:53:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 17:53:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:53:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1a10deb3-8aa8-595c-b9d7-35e0d243e513', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:53:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:53:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:53:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:53:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap54a1b80b-39, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:53:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap54a1b80b-39, col_values=(('qos', UUID('7bab61e3-ac9a-422b-b04f-07bcf06f6bc7')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:53:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap54a1b80b-39, col_values=(('external_ids', {'iface-id': '54a1b80b-3910-4ab8-a694-88989c4b6f4e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:5e:89', 'vm-uuid': 'c7fbe35b-4794-4eb9-8033-923247064458'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:53:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:53:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:53:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:53:48 user nova-compute[75100]: INFO os_vif [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:5e:89,bridge_name='br-int',has_traffic_filtering=True,id=54a1b80b-3910-4ab8-a694-88989c4b6f4e,network=Network(bf1edb58-ef26-40ca-8ec9-853fa05de13d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54a1b80b-39')
Nov 10 17:53:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 17:53:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] No VIF found with MAC fa:16:3e:d3:5e:89, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 17:53:48 user nova-compute[75100]: DEBUG nova.network.neutron [req-d7d1d92a-659f-4718-bb12-1cfc7d821d92 req-c9403017-26e0-4eb0-82db-7d3a4bf3b9f2 service nova] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Updated VIF entry in instance network info cache for port 54a1b80b-3910-4ab8-a694-88989c4b6f4e. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 17:53:48 user nova-compute[75100]: DEBUG nova.network.neutron [req-d7d1d92a-659f-4718-bb12-1cfc7d821d92 req-c9403017-26e0-4eb0-82db-7d3a4bf3b9f2 service nova] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Updating instance_info_cache with network_info: [{"id": "54a1b80b-3910-4ab8-a694-88989c4b6f4e", "address": "fa:16:3e:d3:5e:89", "network": {"id": "bf1edb58-ef26-40ca-8ec9-853fa05de13d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1416469583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7bb141ef59487dbb2ce6243c5002af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54a1b80b-39", "ovs_interfaceid": "54a1b80b-3910-4ab8-a694-88989c4b6f4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:53:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d7d1d92a-659f-4718-bb12-1cfc7d821d92 req-c9403017-26e0-4eb0-82db-7d3a4bf3b9f2 service nova] Releasing lock "refresh_cache-c7fbe35b-4794-4eb9-8033-923247064458" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:53:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:53:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:53:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:53:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:53:50 user nova-compute[75100]: DEBUG nova.compute.manager [req-8fe82519-90b9-4ecf-85f1-f88bbb7491a4 req-d6247d15-0456-45ac-a370-bf8a598615d7 service nova] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Received event network-vif-plugged-54a1b80b-3910-4ab8-a694-88989c4b6f4e {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:53:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8fe82519-90b9-4ecf-85f1-f88bbb7491a4 req-d6247d15-0456-45ac-a370-bf8a598615d7 service nova] Acquiring lock "c7fbe35b-4794-4eb9-8033-923247064458-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:53:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8fe82519-90b9-4ecf-85f1-f88bbb7491a4 req-d6247d15-0456-45ac-a370-bf8a598615d7 service nova] Lock "c7fbe35b-4794-4eb9-8033-923247064458-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:53:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8fe82519-90b9-4ecf-85f1-f88bbb7491a4 req-d6247d15-0456-45ac-a370-bf8a598615d7 service nova] Lock "c7fbe35b-4794-4eb9-8033-923247064458-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:53:50 user nova-compute[75100]: DEBUG nova.compute.manager [req-8fe82519-90b9-4ecf-85f1-f88bbb7491a4 req-d6247d15-0456-45ac-a370-bf8a598615d7 service nova] [instance: c7fbe35b-4794-4eb9-8033-923247064458] No waiting events found dispatching network-vif-plugged-54a1b80b-3910-4ab8-a694-88989c4b6f4e {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:53:50 user nova-compute[75100]: WARNING nova.compute.manager [req-8fe82519-90b9-4ecf-85f1-f88bbb7491a4 req-d6247d15-0456-45ac-a370-bf8a598615d7 service nova] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Received unexpected event network-vif-plugged-54a1b80b-3910-4ab8-a694-88989c4b6f4e for instance with vm_state building and task_state spawning.
Nov 10 17:53:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:53:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:53:52 user nova-compute[75100]: DEBUG nova.compute.manager [req-31903722-45c0-44da-b722-6969ba6590a1 req-b17e59c3-4a4c-415c-9b92-558d2d1f282b service nova] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Received event network-vif-plugged-54a1b80b-3910-4ab8-a694-88989c4b6f4e {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:53:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-31903722-45c0-44da-b722-6969ba6590a1 req-b17e59c3-4a4c-415c-9b92-558d2d1f282b service nova] Acquiring lock "c7fbe35b-4794-4eb9-8033-923247064458-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:53:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-31903722-45c0-44da-b722-6969ba6590a1 req-b17e59c3-4a4c-415c-9b92-558d2d1f282b service nova] Lock "c7fbe35b-4794-4eb9-8033-923247064458-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:53:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-31903722-45c0-44da-b722-6969ba6590a1 req-b17e59c3-4a4c-415c-9b92-558d2d1f282b service nova] Lock "c7fbe35b-4794-4eb9-8033-923247064458-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:53:52 user nova-compute[75100]: DEBUG nova.compute.manager [req-31903722-45c0-44da-b722-6969ba6590a1 req-b17e59c3-4a4c-415c-9b92-558d2d1f282b service nova] [instance: c7fbe35b-4794-4eb9-8033-923247064458] No waiting events found dispatching network-vif-plugged-54a1b80b-3910-4ab8-a694-88989c4b6f4e {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:53:52 user nova-compute[75100]: WARNING nova.compute.manager [req-31903722-45c0-44da-b722-6969ba6590a1 req-b17e59c3-4a4c-415c-9b92-558d2d1f282b service nova] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Received unexpected event network-vif-plugged-54a1b80b-3910-4ab8-a694-88989c4b6f4e for instance with vm_state building and task_state spawning.
Nov 10 17:53:52 user nova-compute[75100]: DEBUG nova.compute.manager [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 17:53:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 17:53:52 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Instance spawned successfully.
Nov 10 17:53:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 17:53:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:53:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:53:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:53:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:53:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:53:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:53:52 user nova-compute[75100]: INFO nova.compute.manager [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Took 6.44 seconds to spawn the instance on the hypervisor.
Nov 10 17:53:52 user nova-compute[75100]: DEBUG nova.compute.manager [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 17:53:52 user nova-compute[75100]: INFO nova.compute.manager [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Took 7.52 seconds to build instance.
Nov 10 17:53:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9e0a3b43-190b-4ba6-9e43-0c895542c27e tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "c7fbe35b-4794-4eb9-8033-923247064458" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.718s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:53:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:53:54 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:53:55 user nova-compute[75100]: INFO nova.compute.manager [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Rescuing
Nov 10 17:53:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Acquiring lock "refresh_cache-e6de4626-f097-43b7-8e56-a08415e7d74a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:53:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Acquired lock "refresh_cache-e6de4626-f097-43b7-8e56-a08415e7d74a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:53:55 user nova-compute[75100]: DEBUG nova.network.neutron [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 17:53:56 user nova-compute[75100]: DEBUG nova.network.neutron [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Updating instance_info_cache with network_info: [{"id": "d3d11e2e-7099-4c6e-aa65-53f953ce4571", "address": "fa:16:3e:86:a7:41", "network": {"id": "f240fae3-3d7b-4b6e-b04f-18550ab4d0a3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1007355777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c970a503d74d32a1e2b71f086649fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d11e2e-70", "ovs_interfaceid": "d3d11e2e-7099-4c6e-aa65-53f953ce4571", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:53:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Releasing lock "refresh_cache-e6de4626-f097-43b7-8e56-a08415e7d74a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:53:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:53:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:53:56 user nova-compute[75100]: DEBUG nova.compute.manager [req-86dd98ba-d683-4867-909b-c074758c23b5 req-bc46f10e-00a0-44b2-a574-456460653312 service nova] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Received event network-vif-unplugged-d3d11e2e-7099-4c6e-aa65-53f953ce4571 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:53:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-86dd98ba-d683-4867-909b-c074758c23b5 req-bc46f10e-00a0-44b2-a574-456460653312 service nova] Acquiring lock "e6de4626-f097-43b7-8e56-a08415e7d74a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:53:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-86dd98ba-d683-4867-909b-c074758c23b5 req-bc46f10e-00a0-44b2-a574-456460653312 service nova] Lock "e6de4626-f097-43b7-8e56-a08415e7d74a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:53:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-86dd98ba-d683-4867-909b-c074758c23b5 req-bc46f10e-00a0-44b2-a574-456460653312 service nova] Lock "e6de4626-f097-43b7-8e56-a08415e7d74a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:53:56 user nova-compute[75100]: DEBUG nova.compute.manager [req-86dd98ba-d683-4867-909b-c074758c23b5 req-bc46f10e-00a0-44b2-a574-456460653312 service nova] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] No waiting events found dispatching network-vif-unplugged-d3d11e2e-7099-4c6e-aa65-53f953ce4571 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:53:56 user nova-compute[75100]: WARNING nova.compute.manager [req-86dd98ba-d683-4867-909b-c074758c23b5 req-bc46f10e-00a0-44b2-a574-456460653312 service nova] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Received unexpected event network-vif-unplugged-d3d11e2e-7099-4c6e-aa65-53f953ce4571 for instance with vm_state active and task_state rescuing.
Nov 10 17:53:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:53:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:53:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:53:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:53:57 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Instance destroyed successfully.
Nov 10 17:53:57 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Attempting a stable device rescue
Nov 10 17:53:57 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75100) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 10 17:53:57 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Instance directory exists: not creating {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 10 17:53:57 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Creating image(s)
Nov 10 17:53:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Acquiring lock "/opt/stack/data/nova/instances/e6de4626-f097-43b7-8e56-a08415e7d74a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:53:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lock "/opt/stack/data/nova/instances/e6de4626-f097-43b7-8e56-a08415e7d74a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:53:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lock "/opt/stack/data/nova/instances/e6de4626-f097-43b7-8e56-a08415e7d74a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:53:57 user nova-compute[75100]: DEBUG nova.objects.instance [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lazy-loading 'trusted_certs' on Instance uuid e6de4626-f097-43b7-8e56-a08415e7d74a {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:53:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Acquiring lock "daecc5fa8ac6b547626a5a8d0d4e399d63fbf232" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:53:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lock "daecc5fa8ac6b547626a5a8d0d4e399d63fbf232" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:53:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/daecc5fa8ac6b547626a5a8d0d4e399d63fbf232.part --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:53:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:53:58 user nova-compute[75100]: DEBUG nova.compute.manager [req-9c275c65-0522-4e7b-a73a-a2c4150c481e req-7d67922b-abd6-47d0-8b01-f1c74f417c36 service nova] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Received event network-vif-plugged-d3d11e2e-7099-4c6e-aa65-53f953ce4571 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:53:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9c275c65-0522-4e7b-a73a-a2c4150c481e req-7d67922b-abd6-47d0-8b01-f1c74f417c36 service nova] Acquiring lock "e6de4626-f097-43b7-8e56-a08415e7d74a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:53:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9c275c65-0522-4e7b-a73a-a2c4150c481e req-7d67922b-abd6-47d0-8b01-f1c74f417c36 service nova] Lock "e6de4626-f097-43b7-8e56-a08415e7d74a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:53:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9c275c65-0522-4e7b-a73a-a2c4150c481e req-7d67922b-abd6-47d0-8b01-f1c74f417c36 service nova] Lock "e6de4626-f097-43b7-8e56-a08415e7d74a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:53:58 user nova-compute[75100]: DEBUG nova.compute.manager [req-9c275c65-0522-4e7b-a73a-a2c4150c481e req-7d67922b-abd6-47d0-8b01-f1c74f417c36 service nova] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] No waiting events found dispatching network-vif-plugged-d3d11e2e-7099-4c6e-aa65-53f953ce4571 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:53:58 user nova-compute[75100]: WARNING nova.compute.manager [req-9c275c65-0522-4e7b-a73a-a2c4150c481e req-7d67922b-abd6-47d0-8b01-f1c74f417c36 service nova] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Received unexpected event network-vif-plugged-d3d11e2e-7099-4c6e-aa65-53f953ce4571 for instance with vm_state active and task_state rescuing.
Nov 10 17:53:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/daecc5fa8ac6b547626a5a8d0d4e399d63fbf232.part --force-share --output=json" returned: 0 in 0.197s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:53:58 user nova-compute[75100]: DEBUG nova.virt.images [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] a6bb4d73-bae9-46af-b3e8-607b1a4a7585 was qcow2, converting to raw {{(pid=75100) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 10 17:53:58 user nova-compute[75100]: DEBUG nova.privsep.utils [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75100) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 17:53:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/daecc5fa8ac6b547626a5a8d0d4e399d63fbf232.part /opt/stack/data/nova/instances/_base/daecc5fa8ac6b547626a5a8d0d4e399d63fbf232.converted {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:53:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:53:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/daecc5fa8ac6b547626a5a8d0d4e399d63fbf232.part /opt/stack/data/nova/instances/_base/daecc5fa8ac6b547626a5a8d0d4e399d63fbf232.converted" returned: 0 in 0.523s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:53:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/daecc5fa8ac6b547626a5a8d0d4e399d63fbf232.converted --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:53:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/daecc5fa8ac6b547626a5a8d0d4e399d63fbf232.converted --force-share --output=json" returned: 0 in 0.233s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:53:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lock "daecc5fa8ac6b547626a5a8d0d4e399d63fbf232" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.305s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:53:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Acquiring lock "daecc5fa8ac6b547626a5a8d0d4e399d63fbf232" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:53:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lock "daecc5fa8ac6b547626a5a8d0d4e399d63fbf232" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:53:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/daecc5fa8ac6b547626a5a8d0d4e399d63fbf232 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:53:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/daecc5fa8ac6b547626a5a8d0d4e399d63fbf232 --force-share --output=json" returned: 0 in 0.227s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:53:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/daecc5fa8ac6b547626a5a8d0d4e399d63fbf232,backing_fmt=raw /opt/stack/data/nova/instances/e6de4626-f097-43b7-8e56-a08415e7d74a/disk.rescue {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/daecc5fa8ac6b547626a5a8d0d4e399d63fbf232,backing_fmt=raw /opt/stack/data/nova/instances/e6de4626-f097-43b7-8e56-a08415e7d74a/disk.rescue" returned: 0 in 0.066s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lock "daecc5fa8ac6b547626a5a8d0d4e399d63fbf232" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.300s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG nova.objects.instance [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lazy-loading 'migration_context' on Instance uuid e6de4626-f097-43b7-8e56-a08415e7d74a {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG nova.objects.base [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Object Instance<e6de4626-f097-43b7-8e56-a08415e7d74a> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Start _get_guest_xml network_info=[{"id": "d3d11e2e-7099-4c6e-aa65-53f953ce4571", "address": "fa:16:3e:86:a7:41", "network": {"id": "f240fae3-3d7b-4b6e-b04f-18550ab4d0a3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1007355777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1007355777-network", "vif_mac": "fa:16:3e:86:a7:41"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c970a503d74d32a1e2b71f086649fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d11e2e-70", "ovs_interfaceid": "d3d11e2e-7099-4c6e-aa65-53f953ce4571", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a6bb4d73-bae9-46af-b3e8-607b1a4a7585', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wLIchQgb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'e6de4626-f097-43b7-8e56-a08415e7d74a', 'attached_at': '', 'detached_at': '', 'volume_id': '16fd9f0d-185d-41af-af44-5f52fbfe3c54', 'serial': '16fd9f0d-185d-41af-af44-5f52fbfe3c54'}, 'mount_device': '/dev/vda', 'attachment_id': '22d9fc80-8a01-4fcc-a85a-0cdfd8478c8a', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG nova.objects.instance [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lazy-loading 'resources' on Instance uuid e6de4626-f097-43b7-8e56-a08415e7d74a {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG nova.objects.base [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Object Instance<e6de4626-f097-43b7-8e56-a08415e7d74a> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG nova.objects.instance [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lazy-loading 'numa_topology' on Instance uuid e6de4626-f097-43b7-8e56-a08415e7d74a {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG nova.objects.base [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Object Instance<e6de4626-f097-43b7-8e56-a08415e7d74a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 17:54:00 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:54:00 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:54:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T17:40:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG nova.objects.instance [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lazy-loading 'vcpu_model' on Instance uuid e6de4626-f097-43b7-8e56-a08415e7d74a {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG nova.objects.base [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Object Instance<e6de4626-f097-43b7-8e56-a08415e7d74a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wLIchQgb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 17:54:00 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 17:54:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 17:54:00 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 17:54:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 17:54:00 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 17:54:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 -p 172.16.0.220:3260 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 -p 172.16.0.220:3260" returned: 0 in 0.022s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca32fa0e-f6e7-4009-ab95-bbc3e4078a28]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = wLIchQgb\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 10 17:54:00 user nova-compute[75100]: node.name = iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54
Nov 10 17:54:00 user nova-compute[75100]: node.tpgt = -1
Nov 10 17:54:00 user nova-compute[75100]: node.startup = automatic
Nov 10 17:54:00 user nova-compute[75100]: node.leading_login = No
Nov 10 17:54:00 user nova-compute[75100]: iface.iscsi_ifacename = default
Nov 10 17:54:00 user nova-compute[75100]: iface.net_ifacename = <empty>
Nov 10 17:54:00 user nova-compute[75100]: iface.ipaddress = <empty>
Nov 10 17:54:00 user nova-compute[75100]: iface.prefix_len = 0
Nov 10 17:54:00 user nova-compute[75100]: iface.hwaddress = <empty>
Nov 10 17:54:00 user nova-compute[75100]: iface.transport_name = tcp
Nov 10 17:54:00 user nova-compute[75100]: iface.initiatorname = <empty>
Nov 10 17:54:00 user nova-compute[75100]: iface.state = <empty>
Nov 10 17:54:00 user nova-compute[75100]: iface.vlan_id = 0
Nov 10 17:54:00 user nova-compute[75100]: iface.vlan_priority = 0
Nov 10 17:54:00 user nova-compute[75100]: iface.vlan_state = <empty>
Nov 10 17:54:00 user nova-compute[75100]: iface.iface_num = 0
Nov 10 17:54:00 user nova-compute[75100]: iface.mtu = 0
Nov 10 17:54:00 user nova-compute[75100]: iface.port = 0
Nov 10 17:54:00 user nova-compute[75100]: iface.bootproto = <empty>
Nov 10 17:54:00 user nova-compute[75100]: iface.subnet_mask = <empty>
Nov 10 17:54:00 user nova-compute[75100]: iface.gateway = <empty>
Nov 10 17:54:00 user nova-compute[75100]: iface.dhcp_alt_client_id_state = <empty>
Nov 10 17:54:00 user nova-compute[75100]: iface.dhcp_alt_client_id = <empty>
Nov 10 17:54:00 user nova-compute[75100]: iface.dhcp_dns = <empty>
Nov 10 17:54:00 user nova-compute[75100]: iface.dhcp_learn_iqn = <empty>
Nov 10 17:54:00 user nova-compute[75100]: iface.dhcp_req_vendor_id_state = <empty>
Nov 10 17:54:00 user nova-compute[75100]: iface.dhcp_vendor_id_state = <empty>
Nov 10 17:54:00 user nova-compute[75100]: iface.dhcp_vendor_id = <empty>
Nov 10 17:54:00 user nova-compute[75100]: iface.dhcp_slp_da = <empty>
Nov 10 17:54:00 user nova-compute[75100]: iface.fragmentation = <empty>
Nov 10 17:54:00 user nova-compute[75100]: iface.gratuitous_arp = <empty>
Nov 10 17:54:00 user nova-compute[75100]: iface.incoming_forwarding = <empty>
Nov 10 17:54:00 user nova-compute[75100]: iface.tos_state = <empty>
Nov 10 17:54:00 user nova-compute[75100]: iface.tos = 0
Nov 10 17:54:00 user nova-compute[75100]: iface.ttl = 0
Nov 10 17:54:00 user nova-compute[75100]: iface.delayed_ack = <empty>
Nov 10 17:54:00 user nova-compute[75100]: iface.tcp_nagle = <empty>
Nov 10 17:54:00 user nova-compute[75100]: iface.tcp_wsf_state = <empty>
Nov 10 17:54:00 user nova-compute[75100]: iface.tcp_wsf = 0
Nov 10 17:54:00 user nova-compute[75100]: iface.tcp_timer_scale = 0
Nov 10 17:54:00 user nova-compute[75100]: iface.tcp_timestamp = <empty>
Nov 10 17:54:00 user nova-compute[75100]: iface.redirect = <empty>
Nov 10 17:54:00 user nova-compute[75100]: iface.def_task_mgmt_timeout = 0
Nov 10 17:54:00 user nova-compute[75100]: iface.header_digest = <empty>
Nov 10 17:54:00 user nova-compute[75100]: iface.data_digest = <empty>
Nov 10 17:54:00 user nova-compute[75100]: iface.immediate_data = <empty>
Nov 10 17:54:00 user nova-compute[75100]: iface.initial_r2t = <empty>
Nov 10 17:54:00 user nova-compute[75100]: iface.data_seq_inorder = <empty>
Nov 10 17:54:00 user nova-compute[75100]: iface.data_pdu_inorder = <empty>
Nov 10 17:54:00 user nova-compute[75100]: iface.erl = 0
Nov 10 17:54:00 user nova-compute[75100]: iface.max_receive_data_len = 0
Nov 10 17:54:00 user nova-compute[75100]: iface.first_burst_len = 0
Nov 10 17:54:00 user nova-compute[75100]: iface.max_outstanding_r2t = 0
Nov 10 17:54:00 user nova-compute[75100]: iface.max_burst_len = 0
Nov 10 17:54:00 user nova-compute[75100]: iface.chap_auth = <empty>
Nov 10 17:54:00 user nova-compute[75100]: iface.bidi_chap = <empty>
Nov 10 17:54:00 user nova-compute[75100]: iface.strict_login_compliance = <empty>
Nov 10 17:54:00 user nova-compute[75100]: iface.discovery_auth = <empty>
Nov 10 17:54:00 user nova-compute[75100]: iface.discovery_logout = <empty>
Nov 10 17:54:00 user nova-compute[75100]: node.discovery_address = <empty>
Nov 10 17:54:00 user nova-compute[75100]: node.discovery_port = 0
Nov 10 17:54:00 user nova-compute[75100]: node.discovery_type = static
Nov 10 17:54:00 user nova-compute[75100]: node.session.initial_cmdsn = 0
Nov 10 17:54:00 user nova-compute[75100]: node.session.initial_login_retry_max = 8
Nov 10 17:54:00 user nova-compute[75100]: node.session.xmit_thread_priority = -20
Nov 10 17:54:00 user nova-compute[75100]: node.session.cmds_max = 128
Nov 10 17:54:00 user nova-compute[75100]: node.session.queue_depth = 32
Nov 10 17:54:00 user nova-compute[75100]: node.session.nr_sessions = 1
Nov 10 17:54:00 user nova-compute[75100]: node.session.auth.authmethod = CHAP
Nov 10 17:54:00 user nova-compute[75100]: node.session.auth.username = wLIchQgb
Nov 10 17:54:00 user nova-compute[75100]: node.session.auth.password = ***
Nov 10 17:54:00 user nova-compute[75100]: node.session.auth.username_in = <empty>
Nov 10 17:54:00 user nova-compute[75100]: node.session.auth.password_in = <empty>
Nov 10 17:54:00 user nova-compute[75100]: node.session.auth.chap_algs = MD5
Nov 10 17:54:00 user nova-compute[75100]: node.session.timeo.replacement_timeout = 120
Nov 10 17:54:00 user nova-compute[75100]: node.session.err_timeo.abort_timeout = 15
Nov 10 17:54:00 user nova-compute[75100]: node.session.err_timeo.lu_reset_timeout = 30
Nov 10 17:54:00 user nova-compute[75100]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 10 17:54:00 user nova-compute[75100]: node.session.err_timeo.host_reset_timeout = 60
Nov 10 17:54:00 user nova-compute[75100]: node.session.iscsi.FastAbort = Yes
Nov 10 17:54:00 user nova-compute[75100]: node.session.iscsi.InitialR2T = No
Nov 10 17:54:00 user nova-compute[75100]: node.session.iscsi.ImmediateData = Yes
Nov 10 17:54:00 user nova-compute[75100]: node.session.iscsi.FirstBurstLength = 262144
Nov 10 17:54:00 user nova-compute[75100]: node.session.iscsi.MaxBurstLength = 16776192
Nov 10 17:54:00 user nova-compute[75100]: node.session.iscsi.DefaultTime2Retain = 0
Nov 10 17:54:00 user nova-compute[75100]: node.session.iscsi.DefaultTime2Wait = 2
Nov 10 17:54:00 user nova-compute[75100]: node.session.iscsi.MaxConnections = 1
Nov 10 17:54:00 user nova-compute[75100]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 10 17:54:00 user nova-compute[75100]: node.session.iscsi.ERL = 0
Nov 10 17:54:00 user nova-compute[75100]: node.session.scan = manual
Nov 10 17:54:00 user nova-compute[75100]: node.session.reopen_max = 0
Nov 10 17:54:00 user nova-compute[75100]: node.conn[0].address = 172.16.0.220
Nov 10 17:54:00 user nova-compute[75100]: node.conn[0].port = 3260
Nov 10 17:54:00 user nova-compute[75100]: node.conn[0].startup = manual
Nov 10 17:54:00 user nova-compute[75100]: node.conn[0].tcp.window_size = 524288
Nov 10 17:54:00 user nova-compute[75100]: node.conn[0].tcp.type_of_service = 0
Nov 10 17:54:00 user nova-compute[75100]: node.conn[0].timeo.logout_timeout = 15
Nov 10 17:54:00 user nova-compute[75100]: node.conn[0].timeo.login_timeout = 15
Nov 10 17:54:00 user nova-compute[75100]: node.conn[0].timeo.auth_timeout = 45
Nov 10 17:54:00 user nova-compute[75100]: node.conn[0].timeo.noop_out_interval = 5
Nov 10 17:54:00 user nova-compute[75100]: node.conn[0].timeo.noop_out_timeout = 5
Nov 10 17:54:00 user nova-compute[75100]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 10 17:54:00 user nova-compute[75100]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 10 17:54:00 user nova-compute[75100]: node.conn[0].iscsi.HeaderDigest = None
Nov 10 17:54:00 user nova-compute[75100]: node.conn[0].iscsi.DataDigest = None
Nov 10 17:54:00 user nova-compute[75100]: node.conn[0].iscsi.IFMarker = No
Nov 10 17:54:00 user nova-compute[75100]: node.conn[0].iscsi.OFMarker = No
Nov 10 17:54:00 user nova-compute[75100]: # END RECORD
Nov 10 17:54:00 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b845f3-892b-459b-b07f-c2b3d84f34d5]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[42fe63e3-2a59-4ecb-81a9-b08d62f4103d]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wLIchQgb {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wLIchQgb" returned: 0 in 0.023s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[49955b1a-e4f4-4d87-9539-511bb48746a4]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wLIchQgb'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[73da08de-2d2b-4235-ad98-ee42cdecc800]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce3447f7-62d9-46a8-8de8-221dfdc6befe]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6308a969-f781-41fc-929c-b5b30faf7ec0 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)
Nov 10 17:54:00 user nova-compute[75100]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6308a969-f781-41fc-929c-b5b30faf7ec0 (non-flash)
Nov 10 17:54:00 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)
Nov 10 17:54:00 user nova-compute[75100]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6308a969-f781-41fc-929c-b5b30faf7ec0 (non-flash)
Nov 10 17:54:00 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.185s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] HCTL ('33', '0', '0', 0) found on session 10 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[40549d5e-75e9-466b-a2c4-9f6bb7f75b91]: (4, ('0 0 0', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Searching for a device in session 10 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wLIchQgb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.217s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] <== connect_volume: return (219ms) {'type': 'block', 'scsi_wwn': '23638656166376430', 'path': '/dev/sdb'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638656166376430', 'path': '/dev/sdb'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:51:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1499114588',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1499114588',id=19,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T17:52:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='72c970a503d74d32a1e2b71f086649fd',ramdisk_id='',reservation_id='r-2rik8cbf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2001759307',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:52:21Z,user_data=None,user_id='b79cb22ab5774ce8991f237bd2204555',uuid=e6de4626-f097-43b7-8e56-a08415e7d74a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d3d11e2e-7099-4c6e-aa65-53f953ce4571", "address": "fa:16:3e:86:a7:41", "network": {"id": "f240fae3-3d7b-4b6e-b04f-18550ab4d0a3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1007355777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1007355777-network", "vif_mac": "fa:16:3e:86:a7:41"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c970a503d74d32a1e2b71f086649fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d11e2e-70", "ovs_interfaceid": "d3d11e2e-7099-4c6e-aa65-53f953ce4571", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Converting VIF {"id": "d3d11e2e-7099-4c6e-aa65-53f953ce4571", "address": "fa:16:3e:86:a7:41", "network": {"id": "f240fae3-3d7b-4b6e-b04f-18550ab4d0a3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1007355777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1007355777-network", "vif_mac": "fa:16:3e:86:a7:41"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c970a503d74d32a1e2b71f086649fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d11e2e-70", "ovs_interfaceid": "d3d11e2e-7099-4c6e-aa65-53f953ce4571", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:a7:41,bridge_name='br-int',has_traffic_filtering=True,id=d3d11e2e-7099-4c6e-aa65-53f953ce4571,network=Network(f240fae3-3d7b-4b6e-b04f-18550ab4d0a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3d11e2e-70') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG nova.objects.instance [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lazy-loading 'pci_devices' on Instance uuid e6de4626-f097-43b7-8e56-a08415e7d74a {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG nova.objects.base [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Object Instance<e6de4626-f097-43b7-8e56-a08415e7d74a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] End _get_guest_xml xml=<domain type="kvm">
Nov 10 17:54:00 user nova-compute[75100]:   <uuid>e6de4626-f097-43b7-8e56-a08415e7d74a</uuid>
Nov 10 17:54:00 user nova-compute[75100]:   <name>instance-00000013</name>
Nov 10 17:54:00 user nova-compute[75100]:   <memory>524288</memory>
Nov 10 17:54:00 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 10 17:54:00 user nova-compute[75100]:   <metadata>
Nov 10 17:54:00 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 17:54:00 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 10 17:54:00 user nova-compute[75100]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1499114588</nova:name>
Nov 10 17:54:00 user nova-compute[75100]:       <nova:creationTime>2023-11-10 17:54:00</nova:creationTime>
Nov 10 17:54:00 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 10 17:54:00 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 10 17:54:00 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 10 17:54:00 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 10 17:54:00 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 17:54:00 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 10 17:54:00 user nova-compute[75100]:       </nova:flavor>
Nov 10 17:54:00 user nova-compute[75100]:       <nova:owner>
Nov 10 17:54:00 user nova-compute[75100]:         <nova:user uuid="b79cb22ab5774ce8991f237bd2204555">tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member</nova:user>
Nov 10 17:54:00 user nova-compute[75100]:         <nova:project uuid="72c970a503d74d32a1e2b71f086649fd">tempest-ServerBootFromVolumeStableRescueTest-2001759307</nova:project>
Nov 10 17:54:00 user nova-compute[75100]:       </nova:owner>
Nov 10 17:54:00 user nova-compute[75100]:       <nova:root type="image" uuid="e3cc5321-4d40-49ee-885c-700e14741732"/>
Nov 10 17:54:00 user nova-compute[75100]:       <nova:ports>
Nov 10 17:54:00 user nova-compute[75100]:         <nova:port uuid="d3d11e2e-7099-4c6e-aa65-53f953ce4571">
Nov 10 17:54:00 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 10 17:54:00 user nova-compute[75100]:         </nova:port>
Nov 10 17:54:00 user nova-compute[75100]:       </nova:ports>
Nov 10 17:54:00 user nova-compute[75100]:     </nova:instance>
Nov 10 17:54:00 user nova-compute[75100]:   </metadata>
Nov 10 17:54:00 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 10 17:54:00 user nova-compute[75100]:     <system>
Nov 10 17:54:00 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 17:54:00 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 10 17:54:00 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 10 17:54:00 user nova-compute[75100]:       <entry name="serial">e6de4626-f097-43b7-8e56-a08415e7d74a</entry>
Nov 10 17:54:00 user nova-compute[75100]:       <entry name="uuid">e6de4626-f097-43b7-8e56-a08415e7d74a</entry>
Nov 10 17:54:00 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 10 17:54:00 user nova-compute[75100]:     </system>
Nov 10 17:54:00 user nova-compute[75100]:   </sysinfo>
Nov 10 17:54:00 user nova-compute[75100]:   <os>
Nov 10 17:54:00 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 17:54:00 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 10 17:54:00 user nova-compute[75100]:   </os>
Nov 10 17:54:00 user nova-compute[75100]:   <features>
Nov 10 17:54:00 user nova-compute[75100]:     <acpi/>
Nov 10 17:54:00 user nova-compute[75100]:     <apic/>
Nov 10 17:54:00 user nova-compute[75100]:     <vmcoreinfo/>
Nov 10 17:54:00 user nova-compute[75100]:   </features>
Nov 10 17:54:00 user nova-compute[75100]:   <clock offset="utc">
Nov 10 17:54:00 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 17:54:00 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 17:54:00 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 10 17:54:00 user nova-compute[75100]:   </clock>
Nov 10 17:54:00 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 10 17:54:00 user nova-compute[75100]:     <model>Nehalem</model>
Nov 10 17:54:00 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 17:54:00 user nova-compute[75100]:   </cpu>
Nov 10 17:54:00 user nova-compute[75100]:   <devices>
Nov 10 17:54:00 user nova-compute[75100]:     <disk type="block" device="disk">
Nov 10 17:54:00 user nova-compute[75100]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 17:54:00 user nova-compute[75100]:       <source dev="/dev/sdb"/>
Nov 10 17:54:00 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 10 17:54:00 user nova-compute[75100]:       <serial>16fd9f0d-185d-41af-af44-5f52fbfe3c54</serial>
Nov 10 17:54:00 user nova-compute[75100]:     </disk>
Nov 10 17:54:00 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 10 17:54:00 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 17:54:00 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/e6de4626-f097-43b7-8e56-a08415e7d74a/disk.rescue"/>
Nov 10 17:54:00 user nova-compute[75100]:       <target dev="vdb" bus="virtio"/>
Nov 10 17:54:00 user nova-compute[75100]:       <boot order="1"/>
Nov 10 17:54:00 user nova-compute[75100]:     </disk>
Nov 10 17:54:00 user nova-compute[75100]:     <interface type="ethernet">
Nov 10 17:54:00 user nova-compute[75100]:       <mac address="fa:16:3e:86:a7:41"/>
Nov 10 17:54:00 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:54:00 user nova-compute[75100]:       <mtu size="1442"/>
Nov 10 17:54:00 user nova-compute[75100]:       <target dev="tapd3d11e2e-70"/>
Nov 10 17:54:00 user nova-compute[75100]:     </interface>
Nov 10 17:54:00 user nova-compute[75100]:     <serial type="pty">
Nov 10 17:54:00 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/e6de4626-f097-43b7-8e56-a08415e7d74a/console.log" append="off"/>
Nov 10 17:54:00 user nova-compute[75100]:     </serial>
Nov 10 17:54:00 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 17:54:00 user nova-compute[75100]:     <video>
Nov 10 17:54:00 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:54:00 user nova-compute[75100]:     </video>
Nov 10 17:54:00 user nova-compute[75100]:     <rng model="virtio">
Nov 10 17:54:00 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 10 17:54:00 user nova-compute[75100]:     </rng>
Nov 10 17:54:00 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 10 17:54:00 user nova-compute[75100]:     <memballoon model="virtio">
Nov 10 17:54:00 user nova-compute[75100]:       <stats period="10"/>
Nov 10 17:54:00 user nova-compute[75100]:     </memballoon>
Nov 10 17:54:00 user nova-compute[75100]:   </devices>
Nov 10 17:54:00 user nova-compute[75100]: </domain>
Nov 10 17:54:00 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 17:54:00 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Instance destroyed successfully.
Nov 10 17:54:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] No VIF found with MAC fa:16:3e:86:a7:41, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG nova.compute.manager [req-c6a32088-d556-4f80-8694-8357099cd774 req-5668e091-93c4-4232-8747-94c8006409ea service nova] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Received event network-changed-5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG nova.compute.manager [req-c6a32088-d556-4f80-8694-8357099cd774 req-5668e091-93c4-4232-8747-94c8006409ea service nova] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Refreshing instance network info cache due to event network-changed-5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c6a32088-d556-4f80-8694-8357099cd774 req-5668e091-93c4-4232-8747-94c8006409ea service nova] Acquiring lock "refresh_cache-61e73913-30a5-4eaa-9bc0-6e17a0288035" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c6a32088-d556-4f80-8694-8357099cd774 req-5668e091-93c4-4232-8747-94c8006409ea service nova] Acquired lock "refresh_cache-61e73913-30a5-4eaa-9bc0-6e17a0288035" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:54:00 user nova-compute[75100]: DEBUG nova.network.neutron [req-c6a32088-d556-4f80-8694-8357099cd774 req-5668e091-93c4-4232-8747-94c8006409ea service nova] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Refreshing network info cache for port 5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 17:54:01 user nova-compute[75100]: DEBUG nova.network.neutron [req-c6a32088-d556-4f80-8694-8357099cd774 req-5668e091-93c4-4232-8747-94c8006409ea service nova] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Updated VIF entry in instance network info cache for port 5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 17:54:01 user nova-compute[75100]: DEBUG nova.network.neutron [req-c6a32088-d556-4f80-8694-8357099cd774 req-5668e091-93c4-4232-8747-94c8006409ea service nova] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Updating instance_info_cache with network_info: [{"id": "5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c", "address": "fa:16:3e:75:69:61", "network": {"id": "7a78ac5d-8f24-436d-9cb9-05f4efecb101", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-476509015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae38bb92c5474a578f3827bdae12cd74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e7d8cb1-7f", "ovs_interfaceid": "5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:54:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c6a32088-d556-4f80-8694-8357099cd774 req-5668e091-93c4-4232-8747-94c8006409ea service nova] Releasing lock "refresh_cache-61e73913-30a5-4eaa-9bc0-6e17a0288035" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:54:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-56fd9c72-4360-44bc-9c64-5a70009f99b7 req-930071ce-e9a9-4863-a203-b59913d288e0 service nova] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Received event network-vif-plugged-d3d11e2e-7099-4c6e-aa65-53f953ce4571 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:54:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-56fd9c72-4360-44bc-9c64-5a70009f99b7 req-930071ce-e9a9-4863-a203-b59913d288e0 service nova] Acquiring lock "e6de4626-f097-43b7-8e56-a08415e7d74a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:54:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-56fd9c72-4360-44bc-9c64-5a70009f99b7 req-930071ce-e9a9-4863-a203-b59913d288e0 service nova] Lock "e6de4626-f097-43b7-8e56-a08415e7d74a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:54:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-56fd9c72-4360-44bc-9c64-5a70009f99b7 req-930071ce-e9a9-4863-a203-b59913d288e0 service nova] Lock "e6de4626-f097-43b7-8e56-a08415e7d74a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:54:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-56fd9c72-4360-44bc-9c64-5a70009f99b7 req-930071ce-e9a9-4863-a203-b59913d288e0 service nova] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] No waiting events found dispatching network-vif-plugged-d3d11e2e-7099-4c6e-aa65-53f953ce4571 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:54:03 user nova-compute[75100]: WARNING nova.compute.manager [req-56fd9c72-4360-44bc-9c64-5a70009f99b7 req-930071ce-e9a9-4863-a203-b59913d288e0 service nova] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Received unexpected event network-vif-plugged-d3d11e2e-7099-4c6e-aa65-53f953ce4571 for instance with vm_state active and task_state rescuing.
Nov 10 17:54:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-56fd9c72-4360-44bc-9c64-5a70009f99b7 req-930071ce-e9a9-4863-a203-b59913d288e0 service nova] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Received event network-vif-plugged-d3d11e2e-7099-4c6e-aa65-53f953ce4571 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:54:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-56fd9c72-4360-44bc-9c64-5a70009f99b7 req-930071ce-e9a9-4863-a203-b59913d288e0 service nova] Acquiring lock "e6de4626-f097-43b7-8e56-a08415e7d74a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:54:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-56fd9c72-4360-44bc-9c64-5a70009f99b7 req-930071ce-e9a9-4863-a203-b59913d288e0 service nova] Lock "e6de4626-f097-43b7-8e56-a08415e7d74a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:54:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-56fd9c72-4360-44bc-9c64-5a70009f99b7 req-930071ce-e9a9-4863-a203-b59913d288e0 service nova] Lock "e6de4626-f097-43b7-8e56-a08415e7d74a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:54:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-56fd9c72-4360-44bc-9c64-5a70009f99b7 req-930071ce-e9a9-4863-a203-b59913d288e0 service nova] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] No waiting events found dispatching network-vif-plugged-d3d11e2e-7099-4c6e-aa65-53f953ce4571 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:54:03 user nova-compute[75100]: WARNING nova.compute.manager [req-56fd9c72-4360-44bc-9c64-5a70009f99b7 req-930071ce-e9a9-4863-a203-b59913d288e0 service nova] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Received unexpected event network-vif-plugged-d3d11e2e-7099-4c6e-aa65-53f953ce4571 for instance with vm_state active and task_state rescuing.
Nov 10 17:54:03 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a2f198a-15be-4754-b00b-eba274c56e2f tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 17:54:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a2f198a-15be-4754-b00b-eba274c56e2f tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xESYIPuD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 17:54:03 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-7a2f198a-15be-4754-b00b-eba274c56e2f tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 17:54:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-7a2f198a-15be-4754-b00b-eba274c56e2f tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 17:54:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-7a2f198a-15be-4754-b00b-eba274c56e2f tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 17:54:03 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-7a2f198a-15be-4754-b00b-eba274c56e2f tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 17:54:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-7a2f198a-15be-4754-b00b-eba274c56e2f tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 17:54:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-7a2f198a-15be-4754-b00b-eba274c56e2f tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 17:54:03 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-7a2f198a-15be-4754-b00b-eba274c56e2f tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 17:54:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c -p 172.16.0.220:3260 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:03 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[114025de-a965-4b99-bf4a-e199a8275a1a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:54:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a2f198a-15be-4754-b00b-eba274c56e2f tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 17:54:03 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:54:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c -p 172.16.0.220:3260 --interface default --op new {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:03 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d554f1-f37f-4f67-b13f-c24870f4abb1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c] added\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:54:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a2f198a-15be-4754-b00b-eba274c56e2f tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c] added
Nov 10 17:54:03 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:54:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:03 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9305a503-e1f7-4040-9924-93a68b4080bc]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:54:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a2f198a-15be-4754-b00b-eba274c56e2f tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:54:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:03 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b148788-edbe-4634-8999-99a2bb7f09f6]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:54:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a2f198a-15be-4754-b00b-eba274c56e2f tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:54:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xESYIPuD {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xESYIPuD" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:03 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e689874-7a1c-4b0f-b4e3-a211354931a9]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:54:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a2f198a-15be-4754-b00b-eba274c56e2f tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xESYIPuD'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:54:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:03 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b8e931-ce2c-47c9-8664-50e6a1c615b0]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:54:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a2f198a-15be-4754-b00b-eba274c56e2f tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:54:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:03 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9224ab7e-a3fd-46c2-ab73-f138a98da484]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6308a969-f781-41fc-929c-b5b30faf7ec0 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:54:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a2f198a-15be-4754-b00b-eba274c56e2f tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)
Nov 10 17:54:03 user nova-compute[75100]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6308a969-f781-41fc-929c-b5b30faf7ec0 (non-flash)
Nov 10 17:54:03 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:54:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a2f198a-15be-4754-b00b-eba274c56e2f tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)
Nov 10 17:54:03 user nova-compute[75100]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6308a969-f781-41fc-929c-b5b30faf7ec0 (non-flash)
Nov 10 17:54:03 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 17:54:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c -p 172.16.0.220:3260 --login {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:03 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a81c17-a537-47f0-a6c0-383a33a86e25]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:54:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a2f198a-15be-4754-b00b-eba274c56e2f tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c, portal: 172.16.0.220,3260]
Nov 10 17:54:03 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c, portal: 172.16.0.220,3260] successful.
Nov 10 17:54:03 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:54:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:03 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c89c290-2bce-4b2c-8bad-56e9f1fca7c1]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:54:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a2f198a-15be-4754-b00b-eba274c56e2f tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:54:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:03 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0b7515-d276-46f3-862d-1befbaabc524]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6308a969-f781-41fc-929c-b5b30faf7ec0 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:54:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a2f198a-15be-4754-b00b-eba274c56e2f tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)
Nov 10 17:54:03 user nova-compute[75100]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6308a969-f781-41fc-929c-b5b30faf7ec0 (non-flash)
Nov 10 17:54:03 user nova-compute[75100]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c (non-flash)
Nov 10 17:54:03 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:54:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a2f198a-15be-4754-b00b-eba274c56e2f tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)
Nov 10 17:54:03 user nova-compute[75100]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6308a969-f781-41fc-929c-b5b30faf7ec0 (non-flash)
Nov 10 17:54:03 user nova-compute[75100]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c (non-flash)
Nov 10 17:54:03 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 17:54:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-7a2f198a-15be-4754-b00b-eba274c56e2f tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.345s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 17:54:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a2f198a-15be-4754-b00b-eba274c56e2f tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 17:54:03 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-7a2f198a-15be-4754-b00b-eba274c56e2f tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] HCTL ('35', '-', '-', 0) found on session 12 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 17:54:03 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-7a2f198a-15be-4754-b00b-eba274c56e2f tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 17:54:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:03 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[28dc81fc-591d-488f-b6e4-142b41e01e5e]: (4, ('- - 0', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:54:03 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-7a2f198a-15be-4754-b00b-eba274c56e2f tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Searching for a device in session 12 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 17:54:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a2f198a-15be-4754-b00b-eba274c56e2f tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xESYIPuD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 17:54:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:04 user nova-compute[75100]: DEBUG nova.compute.manager [None req-0f169c65-46cd-43ca-898e-25d325a56b70 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 17:54:04 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-7a2f198a-15be-4754-b00b-eba274c56e2f tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.389s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 17:54:04 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a2f198a-15be-4754-b00b-eba274c56e2f tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] <== connect_volume: return (1391ms) {'type': 'block', 'scsi_wwn': '23632363436396263', 'path': '/dev/sdd'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 17:54:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a2f198a-15be-4754-b00b-eba274c56e2f tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23632363436396263', 'path': '/dev/sdd'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 17:54:04 user nova-compute[75100]: DEBUG nova.objects.instance [None req-7a2f198a-15be-4754-b00b-eba274c56e2f tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Lazy-loading 'flavor' on Instance uuid eb430407-f836-4510-899f-a5f5d60c73f3 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:54:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-7a2f198a-15be-4754-b00b-eba274c56e2f tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 17:54:05 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 17:54:05 user nova-compute[75100]:   <source dev="/dev/sdd"/>
Nov 10 17:54:05 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 17:54:05 user nova-compute[75100]:   <serial>9ba96bee-27d3-48fc-9caf-f8932bf96d0c</serial>
Nov 10 17:54:05 user nova-compute[75100]: </disk>
Nov 10 17:54:05 user nova-compute[75100]:  {{(pid=75100) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 17:54:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7a2f198a-15be-4754-b00b-eba274c56e2f tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 17:54:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7a2f198a-15be-4754-b00b-eba274c56e2f tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 17:54:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7a2f198a-15be-4754-b00b-eba274c56e2f tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] No VIF found with MAC fa:16:3e:2f:11:f6, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 17:54:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7a2f198a-15be-4754-b00b-eba274c56e2f tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Lock "eb430407-f836-4510-899f-a5f5d60c73f3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 32.763s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:54:08 user nova-compute[75100]: DEBUG nova.compute.manager [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Stashing vm_state: active {{(pid=75100) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 10 17:54:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:54:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:54:08 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 17:54:08 user nova-compute[75100]: INFO nova.compute.claims [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Claim successful on node user
Nov 10 17:54:08 user nova-compute[75100]: INFO nova.compute.resource_tracker [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Updating resource usage from migration 819b8490-d7be-448c-a56b-19060b11a2f1
Nov 10 17:54:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:09 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:54:09 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:54:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.727s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:54:09 user nova-compute[75100]: INFO nova.compute.manager [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Migrating
Nov 10 17:54:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:54:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:54:09 user nova-compute[75100]: INFO nova.compute.rpcapi [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 10 17:54:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:54:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Acquiring lock "refresh_cache-eb430407-f836-4510-899f-a5f5d60c73f3" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:54:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Acquired lock "refresh_cache-eb430407-f836-4510-899f-a5f5d60c73f3" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:54:09 user nova-compute[75100]: DEBUG nova.network.neutron [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 17:54:10 user nova-compute[75100]: DEBUG nova.network.neutron [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Updating instance_info_cache with network_info: [{"id": "6e9b2058-6104-4f6c-8c72-f5f15d0d116b", "address": "fa:16:3e:2f:11:f6", "network": {"id": "f67bc940-2f01-4255-b12e-427ffcd7e4e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-977195248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e95560897fb46258db0ecd7dc7b9294", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9b2058-61", "ovs_interfaceid": "6e9b2058-6104-4f6c-8c72-f5f15d0d116b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:54:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Releasing lock "refresh_cache-eb430407-f836-4510-899f-a5f5d60c73f3" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:54:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Starting migrate_disk_and_power_off {{(pid=75100) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 10 17:54:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:10 user nova-compute[75100]: DEBUG nova.compute.manager [req-037fe731-d84c-4f02-827c-6872d5613ab2 req-f655fcfd-f279-450e-9cce-f6fc5f6c61de service nova] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Received event network-vif-unplugged-6e9b2058-6104-4f6c-8c72-f5f15d0d116b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:54:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-037fe731-d84c-4f02-827c-6872d5613ab2 req-f655fcfd-f279-450e-9cce-f6fc5f6c61de service nova] Acquiring lock "eb430407-f836-4510-899f-a5f5d60c73f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:54:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-037fe731-d84c-4f02-827c-6872d5613ab2 req-f655fcfd-f279-450e-9cce-f6fc5f6c61de service nova] Lock "eb430407-f836-4510-899f-a5f5d60c73f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:54:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-037fe731-d84c-4f02-827c-6872d5613ab2 req-f655fcfd-f279-450e-9cce-f6fc5f6c61de service nova] Lock "eb430407-f836-4510-899f-a5f5d60c73f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:54:10 user nova-compute[75100]: DEBUG nova.compute.manager [req-037fe731-d84c-4f02-827c-6872d5613ab2 req-f655fcfd-f279-450e-9cce-f6fc5f6c61de service nova] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] No waiting events found dispatching network-vif-unplugged-6e9b2058-6104-4f6c-8c72-f5f15d0d116b {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:54:10 user nova-compute[75100]: WARNING nova.compute.manager [req-037fe731-d84c-4f02-827c-6872d5613ab2 req-f655fcfd-f279-450e-9cce-f6fc5f6c61de service nova] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Received unexpected event network-vif-unplugged-6e9b2058-6104-4f6c-8c72-f5f15d0d116b for instance with vm_state active and task_state resize_migrating.
Nov 10 17:54:11 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Instance destroyed successfully.
Nov 10 17:54:11 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:49:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1267762012',display_name='tempest-ServerActionsTestOtherB-server-1267762012',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1267762012',id=16,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDPSiJ0FfbNgNhKoheve47DT1uQV1oaC9CdV5NhlB12KyXHFwXlJCN0xOr09naWU21Nb1dG7o7w/ZzPU0YohVQI5ip5k2vJ5Db3SiA/LtLwk+OdOmsxEc+IoKJ74LTBECw==',key_name='tempest-keypair-1684715830',keypairs=<?>,launch_index=0,launched_at=2023-11-10T17:49:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1e95560897fb46258db0ecd7dc7b9294',ramdisk_id='',reservation_id='r-55f5hxbc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1027676823',owner_user_name='tempest-ServerActionsTestOtherB-1027676823-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:54:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da45741ccb5d4b00a0784d7ef9063243',uuid=eb430407-f836-4510-899f-a5f5d60c73f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6e9b2058-6104-4f6c-8c72-f5f15d0d116b", "address": "fa:16:3e:2f:11:f6", "network": {"id": "f67bc940-2f01-4255-b12e-427ffcd7e4e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-977195248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-977195248-network", "vif_mac": "fa:16:3e:2f:11:f6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e95560897fb46258db0ecd7dc7b9294", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9b2058-61", "ovs_interfaceid": "6e9b2058-6104-4f6c-8c72-f5f15d0d116b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 17:54:11 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Converting VIF {"id": "6e9b2058-6104-4f6c-8c72-f5f15d0d116b", "address": "fa:16:3e:2f:11:f6", "network": {"id": "f67bc940-2f01-4255-b12e-427ffcd7e4e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-977195248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-977195248-network", "vif_mac": "fa:16:3e:2f:11:f6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e95560897fb46258db0ecd7dc7b9294", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9b2058-61", "ovs_interfaceid": "6e9b2058-6104-4f6c-8c72-f5f15d0d116b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:54:11 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:11:f6,bridge_name='br-int',has_traffic_filtering=True,id=6e9b2058-6104-4f6c-8c72-f5f15d0d116b,network=Network(f67bc940-2f01-4255-b12e-427ffcd7e4e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e9b2058-61') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:54:11 user nova-compute[75100]: DEBUG os_vif [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:11:f6,bridge_name='br-int',has_traffic_filtering=True,id=6e9b2058-6104-4f6c-8c72-f5f15d0d116b,network=Network(f67bc940-2f01-4255-b12e-427ffcd7e4e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e9b2058-61') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 17:54:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6e9b2058-61, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:54:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:54:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cc4b7d6e-d7f1-4361-aacd-30ff9d66fa68) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:54:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:11 user nova-compute[75100]: INFO os_vif [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:11:f6,bridge_name='br-int',has_traffic_filtering=True,id=6e9b2058-6104-4f6c-8c72-f5f15d0d116b,network=Network(f67bc940-2f01-4255-b12e-427ffcd7e4e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e9b2058-61')
Nov 10 17:54:11 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 17:54:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, {'target_iqn': 'iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xESYIPuD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 17:54:11 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 17:54:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 17:54:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 17:54:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:11 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a51c97c3-6653-48dd-b62d-130130c87eab]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6308a969-f781-41fc-929c-b5b30faf7ec0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:54:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 17:54:11 user nova-compute[75100]: No targets found.
Nov 10 17:54:11 user nova-compute[75100]: iSNS:
Nov 10 17:54:11 user nova-compute[75100]: No targets found.
Nov 10 17:54:11 user nova-compute[75100]: STATIC:
Nov 10 17:54:11 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c
Nov 10 17:54:11 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 17:54:11 user nova-compute[75100]:                 Iface Name: default
Nov 10 17:54:11 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54
Nov 10 17:54:11 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 17:54:11 user nova-compute[75100]:                 Iface Name: default
Nov 10 17:54:11 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:6308a969-f781-41fc-929c-b5b30faf7ec0
Nov 10 17:54:11 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 17:54:11 user nova-compute[75100]:                 Iface Name: default
Nov 10 17:54:11 user nova-compute[75100]: FIRMWARE:
Nov 10 17:54:11 user nova-compute[75100]: No targets found.
Nov 10 17:54:11 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:54:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 17:54:11 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 17:54:11 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 17:54:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 17:54:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:11 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[374eb5f3-c135-4402-9bb3-aa6bdb400bf1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6308a969-f781-41fc-929c-b5b30faf7ec0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:54:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:11 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4f943d-78f9-4ebf-902f-4f84c9081f0d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6308a969-f781-41fc-929c-b5b30faf7ec0 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:54:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)
Nov 10 17:54:11 user nova-compute[75100]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6308a969-f781-41fc-929c-b5b30faf7ec0 (non-flash)
Nov 10 17:54:11 user nova-compute[75100]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c (non-flash)
Nov 10 17:54:11 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:54:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)
Nov 10 17:54:11 user nova-compute[75100]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6308a969-f781-41fc-929c-b5b30faf7ec0 (non-flash)
Nov 10 17:54:11 user nova-compute[75100]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c (non-flash)
Nov 10 17:54:11 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 17:54:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3bc78b010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c'): ({'sdd'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 17:54:11 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Removing single pathed devices sdd {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 17:54:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:11 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a10984-7ba5-45bf-89b5-49edf35e72e1]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:54:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.026s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:11 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7076bd0a-7ae1-45cc-89b1-ed13f5a6cf6c]: (4, ('ok\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:54:11 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Flushing IO for device /dev/sdd {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 17:54:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:11 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa810b21-9902-4a1d-9587-365fa79b8398]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:54:11 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 17:54:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:11 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a496eec-1424-4eba-8f0c-55e8b002fb8b]: (4, ('1', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:54:11 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 17:54:11 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] SCSI volumes sdd have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 17:54:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 17:54:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:11 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2c8248-5416-4cc3-aaa5-ca2543b947e0]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:54:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:54:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c -p 172.16.0.220:3260 --logout {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:11 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97b4f58-5a8a-42ff-9caf-34f3cda2dcdb]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:54:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c, portal: 172.16.0.220,3260]
Nov 10 17:54:11 user nova-compute[75100]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c, portal: 172.16.0.220,3260] successful.
Nov 10 17:54:11 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:54:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c -p 172.16.0.220:3260 --op delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:11 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[662783e3-5d9e-4836-b912-7eab53ef52c4]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:54:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:54:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.376s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 17:54:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] <== disconnect_volume: return (379ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 17:54:11 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 17:54:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3/disk --force-share --output=json" returned: 0 in 0.310s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:12 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 17:54:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3_resize/disk /opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3/disk {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:12 user nova-compute[75100]: DEBUG nova.compute.manager [req-06d6fb22-b2c1-4fa2-b88b-417f221f19ac req-a14d27ce-07f4-4f72-8649-da01f71221ce service nova] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Received event network-vif-plugged-6e9b2058-6104-4f6c-8c72-f5f15d0d116b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:54:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-06d6fb22-b2c1-4fa2-b88b-417f221f19ac req-a14d27ce-07f4-4f72-8649-da01f71221ce service nova] Acquiring lock "eb430407-f836-4510-899f-a5f5d60c73f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:54:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-06d6fb22-b2c1-4fa2-b88b-417f221f19ac req-a14d27ce-07f4-4f72-8649-da01f71221ce service nova] Lock "eb430407-f836-4510-899f-a5f5d60c73f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:54:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-06d6fb22-b2c1-4fa2-b88b-417f221f19ac req-a14d27ce-07f4-4f72-8649-da01f71221ce service nova] Lock "eb430407-f836-4510-899f-a5f5d60c73f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:54:12 user nova-compute[75100]: DEBUG nova.compute.manager [req-06d6fb22-b2c1-4fa2-b88b-417f221f19ac req-a14d27ce-07f4-4f72-8649-da01f71221ce service nova] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] No waiting events found dispatching network-vif-plugged-6e9b2058-6104-4f6c-8c72-f5f15d0d116b {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:54:12 user nova-compute[75100]: WARNING nova.compute.manager [req-06d6fb22-b2c1-4fa2-b88b-417f221f19ac req-a14d27ce-07f4-4f72-8649-da01f71221ce service nova] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Received unexpected event network-vif-plugged-6e9b2058-6104-4f6c-8c72-f5f15d0d116b for instance with vm_state active and task_state resize_migrating.
Nov 10 17:54:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] CMD "cp -r /opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3_resize/disk /opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3/disk" returned: 0 in 0.510s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3_resize/disk.info /opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3/disk.info {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] CMD "cp -r /opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3_resize/disk.info /opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3/disk.info" returned: 0 in 0.038s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:13 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:54:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f521d5ef-294e-4a8d-a1c4-9f58f9f81abe tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Acquiring lock "61e73913-30a5-4eaa-9bc0-6e17a0288035" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:54:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f521d5ef-294e-4a8d-a1c4-9f58f9f81abe tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "61e73913-30a5-4eaa-9bc0-6e17a0288035" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:54:14 user nova-compute[75100]: INFO nova.compute.manager [None req-f521d5ef-294e-4a8d-a1c4-9f58f9f81abe tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Shelving
Nov 10 17:54:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:14 user nova-compute[75100]: DEBUG nova.compute.manager [req-73a595b5-719e-44c2-88c6-eb0d16d8f6e1 req-ed10a394-14ae-45c0-a84a-079c9433dbf1 service nova] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Received event network-vif-unplugged-5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:54:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-73a595b5-719e-44c2-88c6-eb0d16d8f6e1 req-ed10a394-14ae-45c0-a84a-079c9433dbf1 service nova] Acquiring lock "61e73913-30a5-4eaa-9bc0-6e17a0288035-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:54:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-73a595b5-719e-44c2-88c6-eb0d16d8f6e1 req-ed10a394-14ae-45c0-a84a-079c9433dbf1 service nova] Lock "61e73913-30a5-4eaa-9bc0-6e17a0288035-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:54:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-73a595b5-719e-44c2-88c6-eb0d16d8f6e1 req-ed10a394-14ae-45c0-a84a-079c9433dbf1 service nova] Lock "61e73913-30a5-4eaa-9bc0-6e17a0288035-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:54:14 user nova-compute[75100]: DEBUG nova.compute.manager [req-73a595b5-719e-44c2-88c6-eb0d16d8f6e1 req-ed10a394-14ae-45c0-a84a-079c9433dbf1 service nova] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] No waiting events found dispatching network-vif-unplugged-5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:54:14 user nova-compute[75100]: WARNING nova.compute.manager [req-73a595b5-719e-44c2-88c6-eb0d16d8f6e1 req-ed10a394-14ae-45c0-a84a-079c9433dbf1 service nova] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Received unexpected event network-vif-unplugged-5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c for instance with vm_state active and task_state shelving.
Nov 10 17:54:15 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Instance destroyed successfully.
Nov 10 17:54:15 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-f521d5ef-294e-4a8d-a1c4-9f58f9f81abe tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Beginning cold snapshot process
Nov 10 17:54:15 user nova-compute[75100]: DEBUG nova.network.neutron [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Port 6e9b2058-6104-4f6c-8c72-f5f15d0d116b binding to destination host user is already ACTIVE {{(pid=75100) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 10 17:54:15 user nova-compute[75100]: DEBUG nova.privsep.utils [None req-f521d5ef-294e-4a8d-a1c4-9f58f9f81abe tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75100) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 17:54:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-f521d5ef-294e-4a8d-a1c4-9f58f9f81abe tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/61e73913-30a5-4eaa-9bc0-6e17a0288035/disk /opt/stack/data/nova/instances/snapshots/tmp5jgzhv9j/71f30f636e49475a845d864c71a27d23 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Acquiring lock "eb430407-f836-4510-899f-a5f5d60c73f3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:54:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Lock "eb430407-f836-4510-899f-a5f5d60c73f3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:54:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Lock "eb430407-f836-4510-899f-a5f5d60c73f3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:54:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Acquiring lock "refresh_cache-eb430407-f836-4510-899f-a5f5d60c73f3" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:54:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Acquired lock "refresh_cache-eb430407-f836-4510-899f-a5f5d60c73f3" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:54:15 user nova-compute[75100]: DEBUG nova.network.neutron [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 17:54:16 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:54:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-f521d5ef-294e-4a8d-a1c4-9f58f9f81abe tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/61e73913-30a5-4eaa-9bc0-6e17a0288035/disk /opt/stack/data/nova/instances/snapshots/tmp5jgzhv9j/71f30f636e49475a845d864c71a27d23" returned: 0 in 1.064s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:16 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-f521d5ef-294e-4a8d-a1c4-9f58f9f81abe tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Snapshot extracted, beginning image upload
Nov 10 17:54:16 user nova-compute[75100]: DEBUG nova.network.neutron [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Updating instance_info_cache with network_info: [{"id": "6e9b2058-6104-4f6c-8c72-f5f15d0d116b", "address": "fa:16:3e:2f:11:f6", "network": {"id": "f67bc940-2f01-4255-b12e-427ffcd7e4e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-977195248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e95560897fb46258db0ecd7dc7b9294", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9b2058-61", "ovs_interfaceid": "6e9b2058-6104-4f6c-8c72-f5f15d0d116b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:54:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Releasing lock "refresh_cache-eb430407-f836-4510-899f-a5f5d60c73f3" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:54:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-54aff06d-e040-49bf-a5ef-6ebea66fc17e tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Acquiring lock "e1defbdd-4363-49c9-bc9a-a35da42c53bf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:54:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-54aff06d-e040-49bf-a5ef-6ebea66fc17e tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "e1defbdd-4363-49c9-bc9a-a35da42c53bf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:54:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-54aff06d-e040-49bf-a5ef-6ebea66fc17e tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Acquiring lock "e1defbdd-4363-49c9-bc9a-a35da42c53bf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:54:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-54aff06d-e040-49bf-a5ef-6ebea66fc17e tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "e1defbdd-4363-49c9-bc9a-a35da42c53bf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:54:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-54aff06d-e040-49bf-a5ef-6ebea66fc17e tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "e1defbdd-4363-49c9-bc9a-a35da42c53bf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:54:16 user nova-compute[75100]: INFO nova.compute.manager [None req-54aff06d-e040-49bf-a5ef-6ebea66fc17e tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] Terminating instance
Nov 10 17:54:16 user nova-compute[75100]: DEBUG nova.compute.manager [None req-54aff06d-e040-49bf-a5ef-6ebea66fc17e tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 17:54:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:16 user nova-compute[75100]: DEBUG os_brick.utils [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 17:54:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c151b5-2a22-4d1b-ab96-606e38d75d40]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90b1a229568f\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:54:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[59740e31-160a-474d-a75d-397dd44f525b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:54:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d79491-e9a3-4b1b-8cd9-a073f0e566cb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:54:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[af246e3a-35e3-47b4-9994-ae5bf192948f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:54:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 17:54:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 17:54:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 17:54:16 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 17:54:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf427d4e-9ffa-454e-9637-70aaf43f5f73]: (4, '') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:54:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 17:54:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 17:54:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 17:54:16 user nova-compute[75100]: DEBUG os_brick.utils [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90b1a229568f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG nova.compute.manager [req-24d55407-adee-4408-9a95-92db19918371 req-1d49cd02-0828-4478-bf8d-7367a6d2b62f service nova] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Received event network-vif-plugged-5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-24d55407-adee-4408-9a95-92db19918371 req-1d49cd02-0828-4478-bf8d-7367a6d2b62f service nova] Acquiring lock "61e73913-30a5-4eaa-9bc0-6e17a0288035-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-24d55407-adee-4408-9a95-92db19918371 req-1d49cd02-0828-4478-bf8d-7367a6d2b62f service nova] Lock "61e73913-30a5-4eaa-9bc0-6e17a0288035-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-24d55407-adee-4408-9a95-92db19918371 req-1d49cd02-0828-4478-bf8d-7367a6d2b62f service nova] Lock "61e73913-30a5-4eaa-9bc0-6e17a0288035-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG nova.compute.manager [req-24d55407-adee-4408-9a95-92db19918371 req-1d49cd02-0828-4478-bf8d-7367a6d2b62f service nova] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] No waiting events found dispatching network-vif-plugged-5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:54:17 user nova-compute[75100]: WARNING nova.compute.manager [req-24d55407-adee-4408-9a95-92db19918371 req-1d49cd02-0828-4478-bf8d-7367a6d2b62f service nova] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Received unexpected event network-vif-plugged-5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c for instance with vm_state active and task_state shelving_image_uploading.
Nov 10 17:54:17 user nova-compute[75100]: DEBUG nova.compute.manager [req-24d55407-adee-4408-9a95-92db19918371 req-1d49cd02-0828-4478-bf8d-7367a6d2b62f service nova] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] Received event network-vif-unplugged-511e58ad-c419-4668-ba70-31049acd2e82 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-24d55407-adee-4408-9a95-92db19918371 req-1d49cd02-0828-4478-bf8d-7367a6d2b62f service nova] Acquiring lock "e1defbdd-4363-49c9-bc9a-a35da42c53bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-24d55407-adee-4408-9a95-92db19918371 req-1d49cd02-0828-4478-bf8d-7367a6d2b62f service nova] Lock "e1defbdd-4363-49c9-bc9a-a35da42c53bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-24d55407-adee-4408-9a95-92db19918371 req-1d49cd02-0828-4478-bf8d-7367a6d2b62f service nova] Lock "e1defbdd-4363-49c9-bc9a-a35da42c53bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG nova.compute.manager [req-24d55407-adee-4408-9a95-92db19918371 req-1d49cd02-0828-4478-bf8d-7367a6d2b62f service nova] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] No waiting events found dispatching network-vif-unplugged-511e58ad-c419-4668-ba70-31049acd2e82 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG nova.compute.manager [req-24d55407-adee-4408-9a95-92db19918371 req-1d49cd02-0828-4478-bf8d-7367a6d2b62f service nova] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] Received event network-vif-unplugged-511e58ad-c419-4668-ba70-31049acd2e82 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 17:54:17 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] Instance destroyed successfully.
Nov 10 17:54:17 user nova-compute[75100]: DEBUG nova.objects.instance [None req-54aff06d-e040-49bf-a5ef-6ebea66fc17e tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lazy-loading 'resources' on Instance uuid e1defbdd-4363-49c9-bc9a-a35da42c53bf {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-54aff06d-e040-49bf-a5ef-6ebea66fc17e tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:51:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-876677741',display_name='tempest-TestVolumeBootPattern-server-876677741',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-876677741',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T17:52:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b9cd441a46aa4a579feff608d6ff9bb4',ramdisk_id='',reservation_id='r-8xyi0967',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-706331648',owner_user_name='tempest-TestVolumeBootPattern-706331648-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T17:52:26Z,user_data=None,user_id='323c5738ca424a379f666b4ca60825ac',uuid=e1defbdd-4363-49c9-bc9a-a35da42c53bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "511e58ad-c419-4668-ba70-31049acd2e82", "address": "fa:16:3e:f8:42:9a", "network": {"id": "2a85480b-f67d-4ef1-b967-3e93af57d7c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1717495768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9cd441a46aa4a579feff608d6ff9bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511e58ad-c4", "ovs_interfaceid": "511e58ad-c419-4668-ba70-31049acd2e82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-54aff06d-e040-49bf-a5ef-6ebea66fc17e tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Converting VIF {"id": "511e58ad-c419-4668-ba70-31049acd2e82", "address": "fa:16:3e:f8:42:9a", "network": {"id": "2a85480b-f67d-4ef1-b967-3e93af57d7c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1717495768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9cd441a46aa4a579feff608d6ff9bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511e58ad-c4", "ovs_interfaceid": "511e58ad-c419-4668-ba70-31049acd2e82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-54aff06d-e040-49bf-a5ef-6ebea66fc17e tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:42:9a,bridge_name='br-int',has_traffic_filtering=True,id=511e58ad-c419-4668-ba70-31049acd2e82,network=Network(2a85480b-f67d-4ef1-b967-3e93af57d7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap511e58ad-c4') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG os_vif [None req-54aff06d-e040-49bf-a5ef-6ebea66fc17e tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:42:9a,bridge_name='br-int',has_traffic_filtering=True,id=511e58ad-c419-4668-ba70-31049acd2e82,network=Network(2a85480b-f67d-4ef1-b967-3e93af57d7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap511e58ad-c4') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap511e58ad-c4, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ae5fc0dc-3212-4239-967f-e6305277a184) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:17 user nova-compute[75100]: INFO os_vif [None req-54aff06d-e040-49bf-a5ef-6ebea66fc17e tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:42:9a,bridge_name='br-int',has_traffic_filtering=True,id=511e58ad-c419-4668-ba70-31049acd2e82,network=Network(2a85480b-f67d-4ef1-b967-3e93af57d7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap511e58ad-c4')
Nov 10 17:54:17 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54aff06d-e040-49bf-a5ef-6ebea66fc17e tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aff06d-e040-49bf-a5ef-6ebea66fc17e tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, {'target_iqn': 'iqn.2010-10.org.openstack:6308a969-f781-41fc-929c-b5b30faf7ec0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gPsGjhAi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 17:54:17 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-54aff06d-e040-49bf-a5ef-6ebea66fc17e tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 17:54:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-54aff06d-e040-49bf-a5ef-6ebea66fc17e tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-54aff06d-e040-49bf-a5ef-6ebea66fc17e tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6412918c-26fe-4937-8e97-b129130fe303]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6308a969-f781-41fc-929c-b5b30faf7ec0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aff06d-e040-49bf-a5ef-6ebea66fc17e tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 17:54:17 user nova-compute[75100]: No targets found.
Nov 10 17:54:17 user nova-compute[75100]: iSNS:
Nov 10 17:54:17 user nova-compute[75100]: No targets found.
Nov 10 17:54:17 user nova-compute[75100]: STATIC:
Nov 10 17:54:17 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54
Nov 10 17:54:17 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 17:54:17 user nova-compute[75100]:                 Iface Name: default
Nov 10 17:54:17 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:6308a969-f781-41fc-929c-b5b30faf7ec0
Nov 10 17:54:17 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 17:54:17 user nova-compute[75100]:                 Iface Name: default
Nov 10 17:54:17 user nova-compute[75100]: FIRMWARE:
Nov 10 17:54:17 user nova-compute[75100]: No targets found.
Nov 10 17:54:17 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aff06d-e040-49bf-a5ef-6ebea66fc17e tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 17:54:17 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 17:54:17 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aff06d-e040-49bf-a5ef-6ebea66fc17e tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6308a969-f781-41fc-929c-b5b30faf7ec0', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[491e894e-b426-40c1-9890-ec51383397c6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6308a969-f781-41fc-929c-b5b30faf7ec0\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b41f89-2b24-4e4b-9930-071db0c059e1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6308a969-f781-41fc-929c-b5b30faf7ec0 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aff06d-e040-49bf-a5ef-6ebea66fc17e tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)
Nov 10 17:54:17 user nova-compute[75100]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6308a969-f781-41fc-929c-b5b30faf7ec0 (non-flash)
Nov 10 17:54:17 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aff06d-e040-49bf-a5ef-6ebea66fc17e tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)
Nov 10 17:54:17 user nova-compute[75100]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6308a969-f781-41fc-929c-b5b30faf7ec0 (non-flash)
Nov 10 17:54:17 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aff06d-e040-49bf-a5ef-6ebea66fc17e tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa398738550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6308a969-f781-41fc-929c-b5b30faf7ec0'): ({'sdc'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-54aff06d-e040-49bf-a5ef-6ebea66fc17e tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Removing single pathed devices sdc {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[529fda09-5914-44b7-b919-0848c08ad8e9]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[666727b5-6993-47a0-bc83-500885dd37e1]: (4, ('ok\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-54aff06d-e040-49bf-a5ef-6ebea66fc17e tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Flushing IO for device /dev/sdc {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[55dcee30-9f01-493b-a0f0-1e0e18a075a6]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-54aff06d-e040-49bf-a5ef-6ebea66fc17e tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[af55bac1-e791-4689-916f-d17923018c34]: (4, ('1', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-54aff06d-e040-49bf-a5ef-6ebea66fc17e tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-54aff06d-e040-49bf-a5ef-6ebea66fc17e tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] SCSI volumes sdc have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aff06d-e040-49bf-a5ef-6ebea66fc17e tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6308a969-f781-41fc-929c-b5b30faf7ec0')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6308a969-f781-41fc-929c-b5b30faf7ec0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6308a969-f781-41fc-929c-b5b30faf7ec0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[353ecca3-a741-4044-a34c-0015266ff466]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aff06d-e040-49bf-a5ef-6ebea66fc17e tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6308a969-f781-41fc-929c-b5b30faf7ec0 -p 172.16.0.220:3260 --logout {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6308a969-f781-41fc-929c-b5b30faf7ec0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7141c8ed-5795-4ff4-8df7-f29b3637f91e]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:6308a969-f781-41fc-929c-b5b30faf7ec0, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:6308a969-f781-41fc-929c-b5b30faf7ec0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aff06d-e040-49bf-a5ef-6ebea66fc17e tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:6308a969-f781-41fc-929c-b5b30faf7ec0, portal: 172.16.0.220,3260]
Nov 10 17:54:17 user nova-compute[75100]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:6308a969-f781-41fc-929c-b5b30faf7ec0, portal: 172.16.0.220,3260] successful.
Nov 10 17:54:17 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6308a969-f781-41fc-929c-b5b30faf7ec0 -p 172.16.0.220:3260 --op delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6308a969-f781-41fc-929c-b5b30faf7ec0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e26aa07-0ac9-421f-bae0-104c77054d17]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aff06d-e040-49bf-a5ef-6ebea66fc17e tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-54aff06d-e040-49bf-a5ef-6ebea66fc17e tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aff06d-e040-49bf-a5ef-6ebea66fc17e tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] <== disconnect_volume: return (360ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 17:54:17 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54aff06d-e040-49bf-a5ef-6ebea66fc17e tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 17:54:17 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-54aff06d-e040-49bf-a5ef-6ebea66fc17e tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] Deleting instance files /opt/stack/data/nova/instances/e1defbdd-4363-49c9-bc9a-a35da42c53bf_del
Nov 10 17:54:17 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-54aff06d-e040-49bf-a5ef-6ebea66fc17e tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] Deletion of /opt/stack/data/nova/instances/e1defbdd-4363-49c9-bc9a-a35da42c53bf_del complete
Nov 10 17:54:18 user nova-compute[75100]: INFO nova.compute.manager [None req-54aff06d-e040-49bf-a5ef-6ebea66fc17e tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] Took 1.36 seconds to destroy the instance on the hypervisor.
Nov 10 17:54:18 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-54aff06d-e040-49bf-a5ef-6ebea66fc17e tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 17:54:18 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 17:54:18 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 17:54:18 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:54:18 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:54:18 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] Took 0.65 seconds to deallocate network for instance.
Nov 10 17:54:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:19 user nova-compute[75100]: DEBUG nova.compute.manager [req-e8853d30-d075-4d4c-98b3-dce4be4c3ea3 req-9cddbc17-75f1-4479-a55c-9cd122631068 service nova] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] Received event network-vif-plugged-511e58ad-c419-4668-ba70-31049acd2e82 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:54:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-e8853d30-d075-4d4c-98b3-dce4be4c3ea3 req-9cddbc17-75f1-4479-a55c-9cd122631068 service nova] Acquiring lock "e1defbdd-4363-49c9-bc9a-a35da42c53bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:54:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-e8853d30-d075-4d4c-98b3-dce4be4c3ea3 req-9cddbc17-75f1-4479-a55c-9cd122631068 service nova] Lock "e1defbdd-4363-49c9-bc9a-a35da42c53bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:54:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-e8853d30-d075-4d4c-98b3-dce4be4c3ea3 req-9cddbc17-75f1-4479-a55c-9cd122631068 service nova] Lock "e1defbdd-4363-49c9-bc9a-a35da42c53bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:54:19 user nova-compute[75100]: DEBUG nova.compute.manager [req-e8853d30-d075-4d4c-98b3-dce4be4c3ea3 req-9cddbc17-75f1-4479-a55c-9cd122631068 service nova] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] No waiting events found dispatching network-vif-plugged-511e58ad-c419-4668-ba70-31049acd2e82 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:54:19 user nova-compute[75100]: WARNING nova.compute.manager [req-e8853d30-d075-4d4c-98b3-dce4be4c3ea3 req-9cddbc17-75f1-4479-a55c-9cd122631068 service nova] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] Received unexpected event network-vif-plugged-511e58ad-c419-4668-ba70-31049acd2e82 for instance with vm_state active and task_state deleting.
Nov 10 17:54:19 user nova-compute[75100]: DEBUG nova.compute.manager [req-e8853d30-d075-4d4c-98b3-dce4be4c3ea3 req-9cddbc17-75f1-4479-a55c-9cd122631068 service nova] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] Received event network-vif-deleted-511e58ad-c419-4668-ba70-31049acd2e82 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:54:19 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:54:19 user nova-compute[75100]: INFO nova.compute.manager [None req-54aff06d-e040-49bf-a5ef-6ebea66fc17e tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] Took 1.25 seconds to detach 1 volumes for instance.
Nov 10 17:54:19 user nova-compute[75100]: DEBUG nova.compute.manager [None req-54aff06d-e040-49bf-a5ef-6ebea66fc17e tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: e1defbdd-4363-49c9-bc9a-a35da42c53bf] Deleting volume: 6308a969-f781-41fc-929c-b5b30faf7ec0 {{(pid=75100) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 10 17:54:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-54aff06d-e040-49bf-a5ef-6ebea66fc17e tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:54:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-54aff06d-e040-49bf-a5ef-6ebea66fc17e tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:54:20 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:54:20 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:54:20 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 17:54:20 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:54:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:54:20 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-f521d5ef-294e-4a8d-a1c4-9f58f9f81abe tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Snapshot image upload complete
Nov 10 17:54:20 user nova-compute[75100]: DEBUG nova.compute.manager [None req-f521d5ef-294e-4a8d-a1c4-9f58f9f81abe tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 17:54:20 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-54aff06d-e040-49bf-a5ef-6ebea66fc17e tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:54:20 user nova-compute[75100]: INFO nova.compute.manager [None req-f521d5ef-294e-4a8d-a1c4-9f58f9f81abe tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Shelve offloading
Nov 10 17:54:20 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Instance destroyed successfully.
Nov 10 17:54:20 user nova-compute[75100]: DEBUG nova.compute.manager [None req-f521d5ef-294e-4a8d-a1c4-9f58f9f81abe tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 17:54:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f521d5ef-294e-4a8d-a1c4-9f58f9f81abe tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Acquiring lock "refresh_cache-61e73913-30a5-4eaa-9bc0-6e17a0288035" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:54:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f521d5ef-294e-4a8d-a1c4-9f58f9f81abe tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Acquired lock "refresh_cache-61e73913-30a5-4eaa-9bc0-6e17a0288035" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:54:20 user nova-compute[75100]: DEBUG nova.network.neutron [None req-f521d5ef-294e-4a8d-a1c4-9f58f9f81abe tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 17:54:20 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-54aff06d-e040-49bf-a5ef-6ebea66fc17e tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:54:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-54aff06d-e040-49bf-a5ef-6ebea66fc17e tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.548s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:54:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.334s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:54:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:54:20 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 17:54:20 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-54aff06d-e040-49bf-a5ef-6ebea66fc17e tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Deleted allocations for instance e1defbdd-4363-49c9-bc9a-a35da42c53bf
Nov 10 17:54:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-54aff06d-e040-49bf-a5ef-6ebea66fc17e tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "e1defbdd-4363-49c9-bc9a-a35da42c53bf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.145s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:54:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:21 user nova-compute[75100]: DEBUG nova.network.neutron [None req-f521d5ef-294e-4a8d-a1c4-9f58f9f81abe tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Updating instance_info_cache with network_info: [{"id": "5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c", "address": "fa:16:3e:75:69:61", "network": {"id": "7a78ac5d-8f24-436d-9cb9-05f4efecb101", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-476509015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae38bb92c5474a578f3827bdae12cd74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e7d8cb1-7f", "ovs_interfaceid": "5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:54:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f521d5ef-294e-4a8d-a1c4-9f58f9f81abe tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Releasing lock "refresh_cache-61e73913-30a5-4eaa-9bc0-6e17a0288035" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:54:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:21 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Instance destroyed successfully.
Nov 10 17:54:21 user nova-compute[75100]: DEBUG nova.objects.instance [None req-f521d5ef-294e-4a8d-a1c4-9f58f9f81abe tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lazy-loading 'resources' on Instance uuid 61e73913-30a5-4eaa-9bc0-6e17a0288035 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:54:22 user nova-compute[75100]: DEBUG nova.compute.manager [req-75e727fd-9015-4afa-a0b7-9711597b0d22 req-09479743-f2c2-41be-9ea7-b686f25f1fdc service nova] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Received event network-changed-5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:54:22 user nova-compute[75100]: DEBUG nova.compute.manager [req-75e727fd-9015-4afa-a0b7-9711597b0d22 req-09479743-f2c2-41be-9ea7-b686f25f1fdc service nova] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Refreshing instance network info cache due to event network-changed-5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 17:54:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-75e727fd-9015-4afa-a0b7-9711597b0d22 req-09479743-f2c2-41be-9ea7-b686f25f1fdc service nova] Acquiring lock "refresh_cache-61e73913-30a5-4eaa-9bc0-6e17a0288035" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:54:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-75e727fd-9015-4afa-a0b7-9711597b0d22 req-09479743-f2c2-41be-9ea7-b686f25f1fdc service nova] Acquired lock "refresh_cache-61e73913-30a5-4eaa-9bc0-6e17a0288035" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:54:22 user nova-compute[75100]: DEBUG nova.network.neutron [req-75e727fd-9015-4afa-a0b7-9711597b0d22 req-09479743-f2c2-41be-9ea7-b686f25f1fdc service nova] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Refreshing network info cache for port 5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 17:54:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-f521d5ef-294e-4a8d-a1c4-9f58f9f81abe tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:52:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-887105111',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-887105111',id=21,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBt2k7JxeVDSCQYts3sglUNOlb3MEWalyA8Gt0mz8JaQfSywhdMWdKSG8xorXGHO9nRL4EecdmVdPAfYdrz5N1fvzulYNxG/vm6Llz3SnJfNeh1Mc8m59tlOvf70gw1Adw==',key_name='tempest-keypair-1379432359',keypairs=<?>,launch_index=0,launched_at=2023-11-10T17:52:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ae38bb92c5474a578f3827bdae12cd74',ramdisk_id='',reservation_id='r-w7bzktq8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2073508773',owner_user_name='tempest-AttachVolumeShelveTestJSON-2073508773-project-member',shelved_at='2023-11-10T17:54:20.483356',shelved_host='user',shelved_image_id='0a7539df-e92a-4f1e-a032-730dd60e763f'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T17:54:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='805917c846f34264b51388bfd9a8413f',uuid=61e73913-30a5-4eaa-9bc0-6e17a0288035,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c", "address": "fa:16:3e:75:69:61", "network": {"id": "7a78ac5d-8f24-436d-9cb9-05f4efecb101", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-476509015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae38bb92c5474a578f3827bdae12cd74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e7d8cb1-7f", "ovs_interfaceid": "5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 17:54:22 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-f521d5ef-294e-4a8d-a1c4-9f58f9f81abe tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Converting VIF {"id": "5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c", "address": "fa:16:3e:75:69:61", "network": {"id": "7a78ac5d-8f24-436d-9cb9-05f4efecb101", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-476509015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae38bb92c5474a578f3827bdae12cd74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e7d8cb1-7f", "ovs_interfaceid": "5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:54:22 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-f521d5ef-294e-4a8d-a1c4-9f58f9f81abe tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:69:61,bridge_name='br-int',has_traffic_filtering=True,id=5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c,network=Network(7a78ac5d-8f24-436d-9cb9-05f4efecb101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e7d8cb1-7f') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:54:22 user nova-compute[75100]: DEBUG os_vif [None req-f521d5ef-294e-4a8d-a1c4-9f58f9f81abe tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:69:61,bridge_name='br-int',has_traffic_filtering=True,id=5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c,network=Network(7a78ac5d-8f24-436d-9cb9-05f4efecb101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e7d8cb1-7f') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 17:54:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5e7d8cb1-7f, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:54:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:54:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d13643ef-d984-4d33-9fea-fe5c2e07dd38) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:54:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:22 user nova-compute[75100]: INFO os_vif [None req-f521d5ef-294e-4a8d-a1c4-9f58f9f81abe tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:69:61,bridge_name='br-int',has_traffic_filtering=True,id=5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c,network=Network(7a78ac5d-8f24-436d-9cb9-05f4efecb101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e7d8cb1-7f')
Nov 10 17:54:22 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-f521d5ef-294e-4a8d-a1c4-9f58f9f81abe tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Deleting instance files /opt/stack/data/nova/instances/61e73913-30a5-4eaa-9bc0-6e17a0288035_del
Nov 10 17:54:22 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-f521d5ef-294e-4a8d-a1c4-9f58f9f81abe tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Deletion of /opt/stack/data/nova/instances/61e73913-30a5-4eaa-9bc0-6e17a0288035_del complete
Nov 10 17:54:22 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-f521d5ef-294e-4a8d-a1c4-9f58f9f81abe tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Deleted allocations for instance 61e73913-30a5-4eaa-9bc0-6e17a0288035
Nov 10 17:54:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 17:54:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6de4626-f097-43b7-8e56-a08415e7d74a/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f521d5ef-294e-4a8d-a1c4-9f58f9f81abe tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:54:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f521d5ef-294e-4a8d-a1c4-9f58f9f81abe tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:54:22 user nova-compute[75100]: DEBUG nova.objects.instance [None req-f521d5ef-294e-4a8d-a1c4-9f58f9f81abe tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lazy-loading 'numa_topology' on Instance uuid 61e73913-30a5-4eaa-9bc0-6e17a0288035 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:54:22 user nova-compute[75100]: DEBUG nova.objects.base [None req-f521d5ef-294e-4a8d-a1c4-9f58f9f81abe tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Object Instance<61e73913-30a5-4eaa-9bc0-6e17a0288035> lazy-loaded attributes: resources,numa_topology {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 17:54:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6de4626-f097-43b7-8e56-a08415e7d74a/disk.rescue --force-share --output=json" returned: 0 in 0.252s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6de4626-f097-43b7-8e56-a08415e7d74a/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6de4626-f097-43b7-8e56-a08415e7d74a/disk.rescue --force-share --output=json" returned: 0 in 0.221s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7fbe35b-4794-4eb9-8033-923247064458/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:22 user nova-compute[75100]: DEBUG nova.network.neutron [req-75e727fd-9015-4afa-a0b7-9711597b0d22 req-09479743-f2c2-41be-9ea7-b686f25f1fdc service nova] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Updated VIF entry in instance network info cache for port 5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 17:54:22 user nova-compute[75100]: DEBUG nova.network.neutron [req-75e727fd-9015-4afa-a0b7-9711597b0d22 req-09479743-f2c2-41be-9ea7-b686f25f1fdc service nova] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Updating instance_info_cache with network_info: [{"id": "5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c", "address": "fa:16:3e:75:69:61", "network": {"id": "7a78ac5d-8f24-436d-9cb9-05f4efecb101", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-476509015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae38bb92c5474a578f3827bdae12cd74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap5e7d8cb1-7f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:54:22 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-f521d5ef-294e-4a8d-a1c4-9f58f9f81abe tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:54:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-75e727fd-9015-4afa-a0b7-9711597b0d22 req-09479743-f2c2-41be-9ea7-b686f25f1fdc service nova] Releasing lock "refresh_cache-61e73913-30a5-4eaa-9bc0-6e17a0288035" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:54:22 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-f521d5ef-294e-4a8d-a1c4-9f58f9f81abe tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:54:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f521d5ef-294e-4a8d-a1c4-9f58f9f81abe tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.588s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:54:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7fbe35b-4794-4eb9-8033-923247064458/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7fbe35b-4794-4eb9-8033-923247064458/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f521d5ef-294e-4a8d-a1c4-9f58f9f81abe tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "61e73913-30a5-4eaa-9bc0-6e17a0288035" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 8.553s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:54:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7fbe35b-4794-4eb9-8033-923247064458/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk.rescue --force-share --output=json" returned: 0 in 0.318s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/989f3ce5-067b-45e4-a2e5-445024e13202/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/989f3ce5-067b-45e4-a2e5-445024e13202/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/989f3ce5-067b-45e4-a2e5-445024e13202/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/989f3ce5-067b-45e4-a2e5-445024e13202/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 17:54:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9033f537-bdeb-412c-9337-4ad86f4467b2/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9033f537-bdeb-412c-9337-4ad86f4467b2/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9033f537-bdeb-412c-9337-4ad86f4467b2/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9033f537-bdeb-412c-9337-4ad86f4467b2/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:25 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Error from libvirt while getting description of instance-00000015: [Error Code 42] Domain not found: no domain with matching uuid '61e73913-30a5-4eaa-9bc0-6e17a0288035' (instance-00000015): libvirt.libvirtError: Domain not found: no domain with matching uuid '61e73913-30a5-4eaa-9bc0-6e17a0288035' (instance-00000015)
Nov 10 17:54:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61d3862-5be7-45cc-95a0-88124ac1725d/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61d3862-5be7-45cc-95a0-88124ac1725d/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61d3862-5be7-45cc-95a0-88124ac1725d/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61d3862-5be7-45cc-95a0-88124ac1725d/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:26 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:54:26 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:54:26 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Hypervisor/Node resource view: name=user free_ram=7339MB free_disk=24.41320037841797GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 17:54:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:54:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:54:26 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Applying migration context for instance eb430407-f836-4510-899f-a5f5d60c73f3 as it has an incoming, in-progress migration 819b8490-d7be-448c-a56b-19060b11a2f1. Migration status is post-migrating {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 10 17:54:26 user nova-compute[75100]: INFO nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Updating resource usage from migration 819b8490-d7be-448c-a56b-19060b11a2f1
Nov 10 17:54:26 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance c19fc271-a248-4631-a11f-89b7ed73bf85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:54:26 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:54:26 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 3e14de19-540d-4dc2-a058-6874d8d14478 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:54:26 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance d61d3862-5be7-45cc-95a0-88124ac1725d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:54:26 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:54:26 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance e6de4626-f097-43b7-8e56-a08415e7d74a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:54:26 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 9033f537-bdeb-412c-9337-4ad86f4467b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:54:26 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 989f3ce5-067b-45e4-a2e5-445024e13202 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:54:26 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance c7fbe35b-4794-4eb9-8033-923247064458 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:54:26 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Migration 819b8490-d7be-448c-a56b-19060b11a2f1 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 10 17:54:26 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance eb430407-f836-4510-899f-a5f5d60c73f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:54:26 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 17:54:26 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 17:54:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:27 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:54:27 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:54:27 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 17:54:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.621s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:54:28 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:54:28 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:54:28 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:54:28 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 17:54:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "refresh_cache-eb430407-f836-4510-899f-a5f5d60c73f3" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:54:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquired lock "refresh_cache-eb430407-f836-4510-899f-a5f5d60c73f3" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:54:28 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 17:54:28 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Updating instance_info_cache with network_info: [{"id": "6e9b2058-6104-4f6c-8c72-f5f15d0d116b", "address": "fa:16:3e:2f:11:f6", "network": {"id": "f67bc940-2f01-4255-b12e-427ffcd7e4e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-977195248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e95560897fb46258db0ecd7dc7b9294", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9b2058-61", "ovs_interfaceid": "6e9b2058-6104-4f6c-8c72-f5f15d0d116b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:54:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Releasing lock "refresh_cache-eb430407-f836-4510-899f-a5f5d60c73f3" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:54:28 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 17:54:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:44 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Starting finish_migration {{(pid=75100) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 10 17:54:44 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Instance directory exists: not creating {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 10 17:54:44 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Creating image(s)
Nov 10 17:54:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.186s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:44 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3/disk. size=21474836480 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 17:54:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3/disk 21474836480 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3/disk 21474836480" returned: 0 in 0.048s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Did not create local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Ensure instance console log exists: /opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Start _get_guest_xml network_info=[{"id": "6e9b2058-6104-4f6c-8c72-f5f15d0d116b", "address": "fa:16:3e:2f:11:f6", "network": {"id": "f67bc940-2f01-4255-b12e-427ffcd7e4e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-977195248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-977195248-network", "vif_mac": "fa:16:3e:2f:11:f6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e95560897fb46258db0ecd7dc7b9294", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9b2058-61", "ovs_interfaceid": "6e9b2058-6104-4f6c-8c72-f5f15d0d116b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'e3cc5321-4d40-49ee-885c-700e14741732'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xESYIPuD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'eb430407-f836-4510-899f-a5f5d60c73f3', 'attached_at': '2023-11-10T17:54:44.000000', 'detached_at': '', 'volume_id': '9ba96bee-27d3-48fc-9caf-f8932bf96d0c', 'serial': '9ba96bee-27d3-48fc-9caf-f8932bf96d0c'}, 'mount_device': '/dev/vdb', 'attachment_id': '08a90232-b74d-429f-817e-e8bf4ed3b90f', 'device_type': 'disk', 'guest_format': None, 'boot_index': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 17:54:45 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:54:45 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:54:45 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T17:40:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xESYIPuD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 17:54:45 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 17:54:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 17:54:45 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 17:54:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 17:54:45 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 17:54:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c -p 172.16.0.220:3260 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7e6ab8-ad1d-469d-bfe1-e5dbb4ea6918]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 17:54:45 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c -p 172.16.0.220:3260 --interface default --op new {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b812de-3de1-4e2d-b0fe-63685527d2eb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c] added\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c] added
Nov 10 17:54:45 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21d0a26-d312-4343-b0d3-30f3e4504ce6]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c37ed59-4fee-4b18-b0d3-f96e93954764]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xESYIPuD {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xESYIPuD" returned: 0 in 0.026s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[641d9efc-d36e-4c82-bbf1-34a53efd7aff]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xESYIPuD'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8760ed9b-47a1-4c49-b306-da6f703d4fee]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[067778d9-d776-411a-bb73-eca3785942d0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)
Nov 10 17:54:45 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)
Nov 10 17:54:45 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c -p 172.16.0.220:3260 --login {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b067133d-d033-41a4-ac08-9c8d1dd1b70c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c, portal: 172.16.0.220,3260]
Nov 10 17:54:45 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c, portal: 172.16.0.220,3260] successful.
Nov 10 17:54:45 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50b11b2-400f-49e8-be3d-436092d2f766]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5114d078-b2f7-4edc-ae41-0f008a8d7989]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)
Nov 10 17:54:45 user nova-compute[75100]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c (non-flash)
Nov 10 17:54:45 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)
Nov 10 17:54:45 user nova-compute[75100]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c (non-flash)
Nov 10 17:54:45 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] HCTL ('34', '-', '-', 0) found on session 13 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[63fbe011-a5a0-4c33-8580-92ed4e6ac446]: (4, ('- - 0', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Searching for a device in session 13 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 17:54:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xESYIPuD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 17:54:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 17:54:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '23632363436396263', 'path': '/dev/sdc'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 17:54:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23632363436396263', 'path': '/dev/sdc'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 17:54:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:49:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1267762012',display_name='tempest-ServerActionsTestOtherB-server-1267762012',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1267762012',id=16,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDPSiJ0FfbNgNhKoheve47DT1uQV1oaC9CdV5NhlB12KyXHFwXlJCN0xOr09naWU21Nb1dG7o7w/ZzPU0YohVQI5ip5k2vJ5Db3SiA/LtLwk+OdOmsxEc+IoKJ74LTBECw==',key_name='tempest-keypair-1684715830',keypairs=<?>,launch_index=0,launched_at=2023-11-10T17:49:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1e95560897fb46258db0ecd7dc7b9294',ramdisk_id='',reservation_id='r-55f5hxbc',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1027676823',owner_user_name='tempest-ServerActionsTestOtherB-1027676823-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:54:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da45741ccb5d4b00a0784d7ef9063243',uuid=eb430407-f836-4510-899f-a5f5d60c73f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6e9b2058-6104-4f6c-8c72-f5f15d0d116b", "address": "fa:16:3e:2f:11:f6", "network": {"id": "f67bc940-2f01-4255-b12e-427ffcd7e4e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-977195248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-977195248-network", "vif_mac": "fa:16:3e:2f:11:f6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e95560897fb46258db0ecd7dc7b9294", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9b2058-61", "ovs_interfaceid": "6e9b2058-6104-4f6c-8c72-f5f15d0d116b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 17:54:46 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Converting VIF {"id": "6e9b2058-6104-4f6c-8c72-f5f15d0d116b", "address": "fa:16:3e:2f:11:f6", "network": {"id": "f67bc940-2f01-4255-b12e-427ffcd7e4e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-977195248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-977195248-network", "vif_mac": "fa:16:3e:2f:11:f6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e95560897fb46258db0ecd7dc7b9294", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9b2058-61", "ovs_interfaceid": "6e9b2058-6104-4f6c-8c72-f5f15d0d116b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:54:46 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:11:f6,bridge_name='br-int',has_traffic_filtering=True,id=6e9b2058-6104-4f6c-8c72-f5f15d0d116b,network=Network(f67bc940-2f01-4255-b12e-427ffcd7e4e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e9b2058-61') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:54:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] End _get_guest_xml xml=<domain type="kvm">
Nov 10 17:54:46 user nova-compute[75100]:   <uuid>eb430407-f836-4510-899f-a5f5d60c73f3</uuid>
Nov 10 17:54:46 user nova-compute[75100]:   <name>instance-00000010</name>
Nov 10 17:54:46 user nova-compute[75100]:   <memory>2097152</memory>
Nov 10 17:54:46 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 10 17:54:46 user nova-compute[75100]:   <metadata>
Nov 10 17:54:46 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 17:54:46 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 10 17:54:46 user nova-compute[75100]:       <nova:name>tempest-ServerActionsTestOtherB-server-1267762012</nova:name>
Nov 10 17:54:46 user nova-compute[75100]:       <nova:creationTime>2023-11-10 17:54:45</nova:creationTime>
Nov 10 17:54:46 user nova-compute[75100]:       <nova:flavor name="m1.small">
Nov 10 17:54:46 user nova-compute[75100]:         <nova:memory>2048</nova:memory>
Nov 10 17:54:46 user nova-compute[75100]:         <nova:disk>20</nova:disk>
Nov 10 17:54:46 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 10 17:54:46 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 17:54:46 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 10 17:54:46 user nova-compute[75100]:       </nova:flavor>
Nov 10 17:54:46 user nova-compute[75100]:       <nova:owner>
Nov 10 17:54:46 user nova-compute[75100]:         <nova:user uuid="da45741ccb5d4b00a0784d7ef9063243">tempest-ServerActionsTestOtherB-1027676823-project-member</nova:user>
Nov 10 17:54:46 user nova-compute[75100]:         <nova:project uuid="1e95560897fb46258db0ecd7dc7b9294">tempest-ServerActionsTestOtherB-1027676823</nova:project>
Nov 10 17:54:46 user nova-compute[75100]:       </nova:owner>
Nov 10 17:54:46 user nova-compute[75100]:       <nova:root type="image" uuid="e3cc5321-4d40-49ee-885c-700e14741732"/>
Nov 10 17:54:46 user nova-compute[75100]:       <nova:ports>
Nov 10 17:54:46 user nova-compute[75100]:         <nova:port uuid="6e9b2058-6104-4f6c-8c72-f5f15d0d116b">
Nov 10 17:54:46 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 10 17:54:46 user nova-compute[75100]:         </nova:port>
Nov 10 17:54:46 user nova-compute[75100]:       </nova:ports>
Nov 10 17:54:46 user nova-compute[75100]:     </nova:instance>
Nov 10 17:54:46 user nova-compute[75100]:   </metadata>
Nov 10 17:54:46 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 10 17:54:46 user nova-compute[75100]:     <system>
Nov 10 17:54:46 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 17:54:46 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 10 17:54:46 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 10 17:54:46 user nova-compute[75100]:       <entry name="serial">eb430407-f836-4510-899f-a5f5d60c73f3</entry>
Nov 10 17:54:46 user nova-compute[75100]:       <entry name="uuid">eb430407-f836-4510-899f-a5f5d60c73f3</entry>
Nov 10 17:54:46 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 10 17:54:46 user nova-compute[75100]:     </system>
Nov 10 17:54:46 user nova-compute[75100]:   </sysinfo>
Nov 10 17:54:46 user nova-compute[75100]:   <os>
Nov 10 17:54:46 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 17:54:46 user nova-compute[75100]:     <boot dev="hd"/>
Nov 10 17:54:46 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 10 17:54:46 user nova-compute[75100]:   </os>
Nov 10 17:54:46 user nova-compute[75100]:   <features>
Nov 10 17:54:46 user nova-compute[75100]:     <acpi/>
Nov 10 17:54:46 user nova-compute[75100]:     <apic/>
Nov 10 17:54:46 user nova-compute[75100]:     <vmcoreinfo/>
Nov 10 17:54:46 user nova-compute[75100]:   </features>
Nov 10 17:54:46 user nova-compute[75100]:   <clock offset="utc">
Nov 10 17:54:46 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 17:54:46 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 17:54:46 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 10 17:54:46 user nova-compute[75100]:   </clock>
Nov 10 17:54:46 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 10 17:54:46 user nova-compute[75100]:     <model>Nehalem</model>
Nov 10 17:54:46 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 17:54:46 user nova-compute[75100]:   </cpu>
Nov 10 17:54:46 user nova-compute[75100]:   <devices>
Nov 10 17:54:46 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 10 17:54:46 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 17:54:46 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3/disk"/>
Nov 10 17:54:46 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 10 17:54:46 user nova-compute[75100]:     </disk>
Nov 10 17:54:46 user nova-compute[75100]:     <disk type="block" device="disk">
Nov 10 17:54:46 user nova-compute[75100]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 17:54:46 user nova-compute[75100]:       <source dev="/dev/sdc"/>
Nov 10 17:54:46 user nova-compute[75100]:       <target dev="vdb" bus="virtio"/>
Nov 10 17:54:46 user nova-compute[75100]:       <serial>9ba96bee-27d3-48fc-9caf-f8932bf96d0c</serial>
Nov 10 17:54:46 user nova-compute[75100]:     </disk>
Nov 10 17:54:46 user nova-compute[75100]:     <interface type="ethernet">
Nov 10 17:54:46 user nova-compute[75100]:       <mac address="fa:16:3e:2f:11:f6"/>
Nov 10 17:54:46 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:54:46 user nova-compute[75100]:       <mtu size="1442"/>
Nov 10 17:54:46 user nova-compute[75100]:       <target dev="tap6e9b2058-61"/>
Nov 10 17:54:46 user nova-compute[75100]:     </interface>
Nov 10 17:54:46 user nova-compute[75100]:     <serial type="pty">
Nov 10 17:54:46 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3/console.log" append="off"/>
Nov 10 17:54:46 user nova-compute[75100]:     </serial>
Nov 10 17:54:46 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 17:54:46 user nova-compute[75100]:     <video>
Nov 10 17:54:46 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:54:46 user nova-compute[75100]:     </video>
Nov 10 17:54:46 user nova-compute[75100]:     <rng model="virtio">
Nov 10 17:54:46 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 10 17:54:46 user nova-compute[75100]:     </rng>
Nov 10 17:54:46 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 10 17:54:46 user nova-compute[75100]:     <memballoon model="virtio">
Nov 10 17:54:46 user nova-compute[75100]:       <stats period="10"/>
Nov 10 17:54:46 user nova-compute[75100]:     </memballoon>
Nov 10 17:54:46 user nova-compute[75100]:   </devices>
Nov 10 17:54:46 user nova-compute[75100]: </domain>
Nov 10 17:54:46 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 17:54:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:49:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1267762012',display_name='tempest-ServerActionsTestOtherB-server-1267762012',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1267762012',id=16,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDPSiJ0FfbNgNhKoheve47DT1uQV1oaC9CdV5NhlB12KyXHFwXlJCN0xOr09naWU21Nb1dG7o7w/ZzPU0YohVQI5ip5k2vJ5Db3SiA/LtLwk+OdOmsxEc+IoKJ74LTBECw==',key_name='tempest-keypair-1684715830',keypairs=<?>,launch_index=0,launched_at=2023-11-10T17:49:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1e95560897fb46258db0ecd7dc7b9294',ramdisk_id='',reservation_id='r-55f5hxbc',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1027676823',owner_user_name='tempest-ServerActionsTestOtherB-1027676823-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:54:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da45741ccb5d4b00a0784d7ef9063243',uuid=eb430407-f836-4510-899f-a5f5d60c73f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6e9b2058-6104-4f6c-8c72-f5f15d0d116b", "address": "fa:16:3e:2f:11:f6", "network": {"id": "f67bc940-2f01-4255-b12e-427ffcd7e4e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-977195248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-977195248-network", "vif_mac": "fa:16:3e:2f:11:f6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e95560897fb46258db0ecd7dc7b9294", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9b2058-61", "ovs_interfaceid": "6e9b2058-6104-4f6c-8c72-f5f15d0d116b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 17:54:46 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Converting VIF {"id": "6e9b2058-6104-4f6c-8c72-f5f15d0d116b", "address": "fa:16:3e:2f:11:f6", "network": {"id": "f67bc940-2f01-4255-b12e-427ffcd7e4e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-977195248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-977195248-network", "vif_mac": "fa:16:3e:2f:11:f6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e95560897fb46258db0ecd7dc7b9294", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9b2058-61", "ovs_interfaceid": "6e9b2058-6104-4f6c-8c72-f5f15d0d116b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:54:46 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:11:f6,bridge_name='br-int',has_traffic_filtering=True,id=6e9b2058-6104-4f6c-8c72-f5f15d0d116b,network=Network(f67bc940-2f01-4255-b12e-427ffcd7e4e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e9b2058-61') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:54:46 user nova-compute[75100]: DEBUG os_vif [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:11:f6,bridge_name='br-int',has_traffic_filtering=True,id=6e9b2058-6104-4f6c-8c72-f5f15d0d116b,network=Network(f67bc940-2f01-4255-b12e-427ffcd7e4e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e9b2058-61') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 17:54:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:54:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 17:54:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8bc5a11a-5e00-5489-bc6d-6e57a02476e3', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:54:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6e9b2058-61, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:54:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6e9b2058-61, col_values=(('qos', UUID('a612315b-41fb-49c9-892d-6580075df499')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:54:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6e9b2058-61, col_values=(('external_ids', {'iface-id': '6e9b2058-6104-4f6c-8c72-f5f15d0d116b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:11:f6', 'vm-uuid': 'eb430407-f836-4510-899f-a5f5d60c73f3'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:54:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:54:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:46 user nova-compute[75100]: INFO os_vif [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:11:f6,bridge_name='br-int',has_traffic_filtering=True,id=6e9b2058-6104-4f6c-8c72-f5f15d0d116b,network=Network(f67bc940-2f01-4255-b12e-427ffcd7e4e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e9b2058-61')
Nov 10 17:54:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 17:54:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 17:54:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] No VIF found with MAC fa:16:3e:2f:11:f6, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 17:54:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:48 user nova-compute[75100]: DEBUG nova.compute.manager [req-97bd9d0a-d1d7-4502-a956-2e3b8c095594 req-13aa9f39-2536-4383-97ab-f149e56d280a service nova] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Received event network-vif-plugged-6e9b2058-6104-4f6c-8c72-f5f15d0d116b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:54:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-97bd9d0a-d1d7-4502-a956-2e3b8c095594 req-13aa9f39-2536-4383-97ab-f149e56d280a service nova] Acquiring lock "eb430407-f836-4510-899f-a5f5d60c73f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:54:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-97bd9d0a-d1d7-4502-a956-2e3b8c095594 req-13aa9f39-2536-4383-97ab-f149e56d280a service nova] Lock "eb430407-f836-4510-899f-a5f5d60c73f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:54:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-97bd9d0a-d1d7-4502-a956-2e3b8c095594 req-13aa9f39-2536-4383-97ab-f149e56d280a service nova] Lock "eb430407-f836-4510-899f-a5f5d60c73f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:54:48 user nova-compute[75100]: DEBUG nova.compute.manager [req-97bd9d0a-d1d7-4502-a956-2e3b8c095594 req-13aa9f39-2536-4383-97ab-f149e56d280a service nova] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] No waiting events found dispatching network-vif-plugged-6e9b2058-6104-4f6c-8c72-f5f15d0d116b {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:54:48 user nova-compute[75100]: WARNING nova.compute.manager [req-97bd9d0a-d1d7-4502-a956-2e3b8c095594 req-13aa9f39-2536-4383-97ab-f149e56d280a service nova] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Received unexpected event network-vif-plugged-6e9b2058-6104-4f6c-8c72-f5f15d0d116b for instance with vm_state active and task_state resize_finish.
Nov 10 17:54:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:50 user nova-compute[75100]: DEBUG nova.compute.manager [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 17:54:50 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Instance running successfully.
Nov 10 17:54:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Failed to set time: agent not configured {{(pid=75100) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 10 17:54:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-1ee33dc5-544e-4414-a2d6-326cb54f4357 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] finish_migration finished successfully. {{(pid=75100) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 10 17:54:50 user nova-compute[75100]: DEBUG nova.compute.manager [req-f5368dba-4edc-4601-a2ff-848cf1575603 req-5ed7e863-4ebc-4e1c-a76c-3858ba84158d service nova] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Received event network-vif-plugged-6e9b2058-6104-4f6c-8c72-f5f15d0d116b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:54:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f5368dba-4edc-4601-a2ff-848cf1575603 req-5ed7e863-4ebc-4e1c-a76c-3858ba84158d service nova] Acquiring lock "eb430407-f836-4510-899f-a5f5d60c73f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:54:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f5368dba-4edc-4601-a2ff-848cf1575603 req-5ed7e863-4ebc-4e1c-a76c-3858ba84158d service nova] Lock "eb430407-f836-4510-899f-a5f5d60c73f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:54:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f5368dba-4edc-4601-a2ff-848cf1575603 req-5ed7e863-4ebc-4e1c-a76c-3858ba84158d service nova] Lock "eb430407-f836-4510-899f-a5f5d60c73f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:54:50 user nova-compute[75100]: DEBUG nova.compute.manager [req-f5368dba-4edc-4601-a2ff-848cf1575603 req-5ed7e863-4ebc-4e1c-a76c-3858ba84158d service nova] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] No waiting events found dispatching network-vif-plugged-6e9b2058-6104-4f6c-8c72-f5f15d0d116b {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:54:50 user nova-compute[75100]: WARNING nova.compute.manager [req-f5368dba-4edc-4601-a2ff-848cf1575603 req-5ed7e863-4ebc-4e1c-a76c-3858ba84158d service nova] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Received unexpected event network-vif-plugged-6e9b2058-6104-4f6c-8c72-f5f15d0d116b for instance with vm_state active and task_state resize_finish.
Nov 10 17:54:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:54 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:54:56 user nova-compute[75100]: DEBUG nova.compute.manager [req-40143e0f-0f3c-4d00-8961-af5dbed7d607 req-9a24cd79-2ade-44a9-bb29-7979db2ac226 service nova] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Received event network-changed-4c49d1d4-dba2-478e-80b6-94e012439af6 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:54:56 user nova-compute[75100]: DEBUG nova.compute.manager [req-40143e0f-0f3c-4d00-8961-af5dbed7d607 req-9a24cd79-2ade-44a9-bb29-7979db2ac226 service nova] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Refreshing instance network info cache due to event network-changed-4c49d1d4-dba2-478e-80b6-94e012439af6. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 17:54:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-40143e0f-0f3c-4d00-8961-af5dbed7d607 req-9a24cd79-2ade-44a9-bb29-7979db2ac226 service nova] Acquiring lock "refresh_cache-9033f537-bdeb-412c-9337-4ad86f4467b2" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:54:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-40143e0f-0f3c-4d00-8961-af5dbed7d607 req-9a24cd79-2ade-44a9-bb29-7979db2ac226 service nova] Acquired lock "refresh_cache-9033f537-bdeb-412c-9337-4ad86f4467b2" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:54:56 user nova-compute[75100]: DEBUG nova.network.neutron [req-40143e0f-0f3c-4d00-8961-af5dbed7d607 req-9a24cd79-2ade-44a9-bb29-7979db2ac226 service nova] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Refreshing network info cache for port 4c49d1d4-dba2-478e-80b6-94e012439af6 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 17:54:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-956bb1e5-25fe-4669-976c-0d2144ef4295 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Acquiring lock "9033f537-bdeb-412c-9337-4ad86f4467b2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:54:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-956bb1e5-25fe-4669-976c-0d2144ef4295 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "9033f537-bdeb-412c-9337-4ad86f4467b2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:54:57 user nova-compute[75100]: DEBUG nova.objects.instance [None req-956bb1e5-25fe-4669-976c-0d2144ef4295 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lazy-loading 'flavor' on Instance uuid 9033f537-bdeb-412c-9337-4ad86f4467b2 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:54:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-956bb1e5-25fe-4669-976c-0d2144ef4295 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "9033f537-bdeb-412c-9337-4ad86f4467b2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:54:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-956bb1e5-25fe-4669-976c-0d2144ef4295 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Acquiring lock "9033f537-bdeb-412c-9337-4ad86f4467b2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:54:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-956bb1e5-25fe-4669-976c-0d2144ef4295 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "9033f537-bdeb-412c-9337-4ad86f4467b2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:54:57 user nova-compute[75100]: INFO nova.compute.manager [None req-956bb1e5-25fe-4669-976c-0d2144ef4295 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Attaching volume f802b50f-f3b6-4f97-a95e-f838ec169652 to /dev/vdb
Nov 10 17:54:57 user nova-compute[75100]: DEBUG os_brick.utils [None req-956bb1e5-25fe-4669-976c-0d2144ef4295 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 17:54:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:57 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1bc68be-113e-4717-82c1-c134de8b6db7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90b1a229568f\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:54:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:57 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9262019-c37f-454f-8853-ba2306061c52]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:54:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:54:57 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3279f7e6-b118-4846-951a-a8b8e93884eb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:54:57 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc864cb0-179b-4ba8-9495-6fef678a0fb6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:54:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-956bb1e5-25fe-4669-976c-0d2144ef4295 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-956bb1e5-25fe-4669-976c-0d2144ef4295 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 17:54:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-956bb1e5-25fe-4669-976c-0d2144ef4295 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 17:54:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:54:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 17:54:57 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 17:54:57 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[188e440d-b876-4bb9-89c9-1a85953a5fd4]: (4, '') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:54:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-956bb1e5-25fe-4669-976c-0d2144ef4295 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 17:54:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-956bb1e5-25fe-4669-976c-0d2144ef4295 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 17:54:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-956bb1e5-25fe-4669-976c-0d2144ef4295 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 17:54:57 user nova-compute[75100]: DEBUG os_brick.utils [None req-956bb1e5-25fe-4669-976c-0d2144ef4295 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90b1a229568f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 17:54:57 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-956bb1e5-25fe-4669-976c-0d2144ef4295 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Updating existing volume attachment record: 915976cd-8355-4ac3-914a-713dbebe4cd7 {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 17:54:57 user nova-compute[75100]: DEBUG nova.network.neutron [req-40143e0f-0f3c-4d00-8961-af5dbed7d607 req-9a24cd79-2ade-44a9-bb29-7979db2ac226 service nova] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Updated VIF entry in instance network info cache for port 4c49d1d4-dba2-478e-80b6-94e012439af6. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 17:54:57 user nova-compute[75100]: DEBUG nova.network.neutron [req-40143e0f-0f3c-4d00-8961-af5dbed7d607 req-9a24cd79-2ade-44a9-bb29-7979db2ac226 service nova] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Updating instance_info_cache with network_info: [{"id": "4c49d1d4-dba2-478e-80b6-94e012439af6", "address": "fa:16:3e:01:6b:43", "network": {"id": "26a554fe-9a5e-40c0-9981-5ac084c9ea73", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-269663495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19755f3e634fdfbd562c33fbfa2a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c49d1d4-db", "ovs_interfaceid": "4c49d1d4-dba2-478e-80b6-94e012439af6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:54:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-40143e0f-0f3c-4d00-8961-af5dbed7d607 req-9a24cd79-2ade-44a9-bb29-7979db2ac226 service nova] Releasing lock "refresh_cache-9033f537-bdeb-412c-9337-4ad86f4467b2" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:54:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:12 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:55:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:14 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:55:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Acquiring lock "6140056a-ced1-4240-a11a-795a260adf46" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:55:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Lock "6140056a-ced1-4240-a11a-795a260adf46" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:55:16 user nova-compute[75100]: DEBUG nova.compute.manager [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 6140056a-ced1-4240-a11a-795a260adf46] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 17:55:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:55:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:55:16 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 17:55:16 user nova-compute[75100]: INFO nova.compute.claims [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 6140056a-ced1-4240-a11a-795a260adf46] Claim successful on node user
Nov 10 17:55:16 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:55:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:16 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:55:16 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:55:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.581s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:55:16 user nova-compute[75100]: DEBUG nova.compute.manager [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 6140056a-ced1-4240-a11a-795a260adf46] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 17:55:16 user nova-compute[75100]: DEBUG nova.compute.manager [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 6140056a-ced1-4240-a11a-795a260adf46] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 17:55:16 user nova-compute[75100]: DEBUG nova.network.neutron [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 6140056a-ced1-4240-a11a-795a260adf46] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 17:55:16 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 6140056a-ced1-4240-a11a-795a260adf46] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 17:55:16 user nova-compute[75100]: DEBUG nova.compute.manager [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 6140056a-ced1-4240-a11a-795a260adf46] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 17:55:16 user nova-compute[75100]: DEBUG nova.policy [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '624efcea1cd1402d93c86d77c1424307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3d8aa64c704f45b08bdb0f1ecb2c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 17:55:17 user nova-compute[75100]: DEBUG nova.compute.manager [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 6140056a-ced1-4240-a11a-795a260adf46] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 17:55:17 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 6140056a-ced1-4240-a11a-795a260adf46] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 17:55:17 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 6140056a-ced1-4240-a11a-795a260adf46] Creating image(s)
Nov 10 17:55:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Acquiring lock "/opt/stack/data/nova/instances/6140056a-ced1-4240-a11a-795a260adf46/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:55:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Lock "/opt/stack/data/nova/instances/6140056a-ced1-4240-a11a-795a260adf46/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:55:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Lock "/opt/stack/data/nova/instances/6140056a-ced1-4240-a11a-795a260adf46/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:55:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:55:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.206s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:55:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Acquiring lock "818b9e28e061d41a38d903968b229be2ed9ba520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:55:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:55:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:55:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.201s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:55:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/6140056a-ced1-4240-a11a-795a260adf46/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:55:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/6140056a-ced1-4240-a11a-795a260adf46/disk 1073741824" returned: 0 in 0.051s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:55:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:55:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:55:17 user nova-compute[75100]: DEBUG nova.network.neutron [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 6140056a-ced1-4240-a11a-795a260adf46] Successfully created port: 5a0341df-e2e2-42f8-8b6e-35376780584e {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 17:55:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.188s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:55:17 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6140056a-ced1-4240-a11a-795a260adf46/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 17:55:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6140056a-ced1-4240-a11a-795a260adf46/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:55:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6140056a-ced1-4240-a11a-795a260adf46/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:55:17 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Cannot resize image /opt/stack/data/nova/instances/6140056a-ced1-4240-a11a-795a260adf46/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 17:55:17 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 6140056a-ced1-4240-a11a-795a260adf46] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 17:55:17 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 6140056a-ced1-4240-a11a-795a260adf46] Ensure instance console log exists: /opt/stack/data/nova/instances/6140056a-ced1-4240-a11a-795a260adf46/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 17:55:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:55:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:55:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:55:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:19 user nova-compute[75100]: DEBUG nova.network.neutron [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 6140056a-ced1-4240-a11a-795a260adf46] Successfully updated port: 5a0341df-e2e2-42f8-8b6e-35376780584e {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 17:55:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Acquiring lock "refresh_cache-6140056a-ced1-4240-a11a-795a260adf46" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:55:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Acquired lock "refresh_cache-6140056a-ced1-4240-a11a-795a260adf46" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:55:19 user nova-compute[75100]: DEBUG nova.network.neutron [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 6140056a-ced1-4240-a11a-795a260adf46] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 17:55:19 user nova-compute[75100]: DEBUG nova.network.neutron [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 6140056a-ced1-4240-a11a-795a260adf46] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 17:55:19 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:55:19 user nova-compute[75100]: DEBUG nova.compute.manager [req-b8b57257-ccd8-40fe-baa2-ba6e3a6fa298 req-a12eb719-dba6-4ade-95f2-19dfb2639a25 service nova] [instance: 6140056a-ced1-4240-a11a-795a260adf46] Received event network-changed-5a0341df-e2e2-42f8-8b6e-35376780584e {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:55:19 user nova-compute[75100]: DEBUG nova.compute.manager [req-b8b57257-ccd8-40fe-baa2-ba6e3a6fa298 req-a12eb719-dba6-4ade-95f2-19dfb2639a25 service nova] [instance: 6140056a-ced1-4240-a11a-795a260adf46] Refreshing instance network info cache due to event network-changed-5a0341df-e2e2-42f8-8b6e-35376780584e. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 17:55:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b8b57257-ccd8-40fe-baa2-ba6e3a6fa298 req-a12eb719-dba6-4ade-95f2-19dfb2639a25 service nova] Acquiring lock "refresh_cache-6140056a-ced1-4240-a11a-795a260adf46" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:55:19 user nova-compute[75100]: DEBUG nova.network.neutron [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 6140056a-ced1-4240-a11a-795a260adf46] Updating instance_info_cache with network_info: [{"id": "5a0341df-e2e2-42f8-8b6e-35376780584e", "address": "fa:16:3e:4b:82:f1", "network": {"id": "879f9f54-7640-4384-b28f-7d8d38d7f74f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1830593335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc3d8aa64c704f45b08bdb0f1ecb2c90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a0341df-e2", "ovs_interfaceid": "5a0341df-e2e2-42f8-8b6e-35376780584e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:55:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Releasing lock "refresh_cache-6140056a-ced1-4240-a11a-795a260adf46" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:55:19 user nova-compute[75100]: DEBUG nova.compute.manager [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 6140056a-ced1-4240-a11a-795a260adf46] Instance network_info: |[{"id": "5a0341df-e2e2-42f8-8b6e-35376780584e", "address": "fa:16:3e:4b:82:f1", "network": {"id": "879f9f54-7640-4384-b28f-7d8d38d7f74f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1830593335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc3d8aa64c704f45b08bdb0f1ecb2c90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a0341df-e2", "ovs_interfaceid": "5a0341df-e2e2-42f8-8b6e-35376780584e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 17:55:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b8b57257-ccd8-40fe-baa2-ba6e3a6fa298 req-a12eb719-dba6-4ade-95f2-19dfb2639a25 service nova] Acquired lock "refresh_cache-6140056a-ced1-4240-a11a-795a260adf46" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:55:19 user nova-compute[75100]: DEBUG nova.network.neutron [req-b8b57257-ccd8-40fe-baa2-ba6e3a6fa298 req-a12eb719-dba6-4ade-95f2-19dfb2639a25 service nova] [instance: 6140056a-ced1-4240-a11a-795a260adf46] Refreshing network info cache for port 5a0341df-e2e2-42f8-8b6e-35376780584e {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 17:55:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 6140056a-ced1-4240-a11a-795a260adf46] Start _get_guest_xml network_info=[{"id": "5a0341df-e2e2-42f8-8b6e-35376780584e", "address": "fa:16:3e:4b:82:f1", "network": {"id": "879f9f54-7640-4384-b28f-7d8d38d7f74f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1830593335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc3d8aa64c704f45b08bdb0f1ecb2c90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a0341df-e2", "ovs_interfaceid": "5a0341df-e2e2-42f8-8b6e-35376780584e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'e3cc5321-4d40-49ee-885c-700e14741732'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 17:55:19 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:55:19 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:55:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 17:55:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 17:55:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 17:55:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 17:55:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 17:55:19 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T17:40:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 17:55:19 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 17:55:19 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 17:55:19 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 17:55:19 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 17:55:19 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 17:55:19 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 17:55:19 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 17:55:19 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 17:55:19 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 17:55:19 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 17:55:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:55:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1436541398',display_name='tempest-ServersNegativeTestJSON-server-1436541398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1436541398',id=25,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc3d8aa64c704f45b08bdb0f1ecb2c90',ramdisk_id='',reservation_id='r-1fvxw6z3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1166274989',owner_user_name='tempest-ServersNegativeTestJSON-1166274989-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:55:17Z,user_data=None,user_id='624efcea1cd1402d93c86d77c1424307',uuid=6140056a-ced1-4240-a11a-795a260adf46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a0341df-e2e2-42f8-8b6e-35376780584e", "address": "fa:16:3e:4b:82:f1", "network": {"id": "879f9f54-7640-4384-b28f-7d8d38d7f74f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1830593335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc3d8aa64c704f45b08bdb0f1ecb2c90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a0341df-e2", "ovs_interfaceid": "5a0341df-e2e2-42f8-8b6e-35376780584e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 17:55:19 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Converting VIF {"id": "5a0341df-e2e2-42f8-8b6e-35376780584e", "address": "fa:16:3e:4b:82:f1", "network": {"id": "879f9f54-7640-4384-b28f-7d8d38d7f74f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1830593335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc3d8aa64c704f45b08bdb0f1ecb2c90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a0341df-e2", "ovs_interfaceid": "5a0341df-e2e2-42f8-8b6e-35376780584e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:55:19 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:82:f1,bridge_name='br-int',has_traffic_filtering=True,id=5a0341df-e2e2-42f8-8b6e-35376780584e,network=Network(879f9f54-7640-4384-b28f-7d8d38d7f74f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a0341df-e2') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:55:19 user nova-compute[75100]: DEBUG nova.objects.instance [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Lazy-loading 'pci_devices' on Instance uuid 6140056a-ced1-4240-a11a-795a260adf46 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:55:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 6140056a-ced1-4240-a11a-795a260adf46] End _get_guest_xml xml=<domain type="kvm">
Nov 10 17:55:19 user nova-compute[75100]:   <uuid>6140056a-ced1-4240-a11a-795a260adf46</uuid>
Nov 10 17:55:19 user nova-compute[75100]:   <name>instance-00000019</name>
Nov 10 17:55:19 user nova-compute[75100]:   <memory>524288</memory>
Nov 10 17:55:19 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 10 17:55:19 user nova-compute[75100]:   <metadata>
Nov 10 17:55:19 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 17:55:19 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 10 17:55:19 user nova-compute[75100]:       <nova:name>tempest-ServersNegativeTestJSON-server-1436541398</nova:name>
Nov 10 17:55:19 user nova-compute[75100]:       <nova:creationTime>2023-11-10 17:55:19</nova:creationTime>
Nov 10 17:55:19 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 10 17:55:19 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 10 17:55:19 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 10 17:55:19 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 10 17:55:19 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 17:55:19 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 10 17:55:19 user nova-compute[75100]:       </nova:flavor>
Nov 10 17:55:19 user nova-compute[75100]:       <nova:owner>
Nov 10 17:55:19 user nova-compute[75100]:         <nova:user uuid="624efcea1cd1402d93c86d77c1424307">tempest-ServersNegativeTestJSON-1166274989-project-member</nova:user>
Nov 10 17:55:19 user nova-compute[75100]:         <nova:project uuid="fc3d8aa64c704f45b08bdb0f1ecb2c90">tempest-ServersNegativeTestJSON-1166274989</nova:project>
Nov 10 17:55:19 user nova-compute[75100]:       </nova:owner>
Nov 10 17:55:19 user nova-compute[75100]:       <nova:root type="image" uuid="e3cc5321-4d40-49ee-885c-700e14741732"/>
Nov 10 17:55:19 user nova-compute[75100]:       <nova:ports>
Nov 10 17:55:19 user nova-compute[75100]:         <nova:port uuid="5a0341df-e2e2-42f8-8b6e-35376780584e">
Nov 10 17:55:19 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 10 17:55:19 user nova-compute[75100]:         </nova:port>
Nov 10 17:55:19 user nova-compute[75100]:       </nova:ports>
Nov 10 17:55:19 user nova-compute[75100]:     </nova:instance>
Nov 10 17:55:19 user nova-compute[75100]:   </metadata>
Nov 10 17:55:19 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 10 17:55:19 user nova-compute[75100]:     <system>
Nov 10 17:55:19 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 17:55:19 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 10 17:55:19 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 10 17:55:19 user nova-compute[75100]:       <entry name="serial">6140056a-ced1-4240-a11a-795a260adf46</entry>
Nov 10 17:55:19 user nova-compute[75100]:       <entry name="uuid">6140056a-ced1-4240-a11a-795a260adf46</entry>
Nov 10 17:55:19 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 10 17:55:19 user nova-compute[75100]:     </system>
Nov 10 17:55:19 user nova-compute[75100]:   </sysinfo>
Nov 10 17:55:19 user nova-compute[75100]:   <os>
Nov 10 17:55:19 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 17:55:19 user nova-compute[75100]:     <boot dev="hd"/>
Nov 10 17:55:19 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 10 17:55:19 user nova-compute[75100]:   </os>
Nov 10 17:55:19 user nova-compute[75100]:   <features>
Nov 10 17:55:19 user nova-compute[75100]:     <acpi/>
Nov 10 17:55:19 user nova-compute[75100]:     <apic/>
Nov 10 17:55:19 user nova-compute[75100]:     <vmcoreinfo/>
Nov 10 17:55:19 user nova-compute[75100]:   </features>
Nov 10 17:55:19 user nova-compute[75100]:   <clock offset="utc">
Nov 10 17:55:19 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 17:55:19 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 17:55:19 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 10 17:55:19 user nova-compute[75100]:   </clock>
Nov 10 17:55:19 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 10 17:55:19 user nova-compute[75100]:     <model>Nehalem</model>
Nov 10 17:55:19 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 17:55:19 user nova-compute[75100]:   </cpu>
Nov 10 17:55:19 user nova-compute[75100]:   <devices>
Nov 10 17:55:19 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 10 17:55:19 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 17:55:19 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/6140056a-ced1-4240-a11a-795a260adf46/disk"/>
Nov 10 17:55:19 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 10 17:55:19 user nova-compute[75100]:     </disk>
Nov 10 17:55:19 user nova-compute[75100]:     <interface type="ethernet">
Nov 10 17:55:19 user nova-compute[75100]:       <mac address="fa:16:3e:4b:82:f1"/>
Nov 10 17:55:19 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:55:19 user nova-compute[75100]:       <mtu size="1442"/>
Nov 10 17:55:19 user nova-compute[75100]:       <target dev="tap5a0341df-e2"/>
Nov 10 17:55:19 user nova-compute[75100]:     </interface>
Nov 10 17:55:19 user nova-compute[75100]:     <serial type="pty">
Nov 10 17:55:19 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/6140056a-ced1-4240-a11a-795a260adf46/console.log" append="off"/>
Nov 10 17:55:19 user nova-compute[75100]:     </serial>
Nov 10 17:55:19 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 17:55:19 user nova-compute[75100]:     <video>
Nov 10 17:55:19 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:55:19 user nova-compute[75100]:     </video>
Nov 10 17:55:19 user nova-compute[75100]:     <rng model="virtio">
Nov 10 17:55:19 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 10 17:55:19 user nova-compute[75100]:     </rng>
Nov 10 17:55:19 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 10 17:55:19 user nova-compute[75100]:     <memballoon model="virtio">
Nov 10 17:55:19 user nova-compute[75100]:       <stats period="10"/>
Nov 10 17:55:19 user nova-compute[75100]:     </memballoon>
Nov 10 17:55:19 user nova-compute[75100]:   </devices>
Nov 10 17:55:19 user nova-compute[75100]: </domain>
Nov 10 17:55:19 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 17:55:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:55:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1436541398',display_name='tempest-ServersNegativeTestJSON-server-1436541398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1436541398',id=25,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc3d8aa64c704f45b08bdb0f1ecb2c90',ramdisk_id='',reservation_id='r-1fvxw6z3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1166274989',owner_user_name='tempest-ServersNegativeTestJSON-1166274989-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:55:17Z,user_data=None,user_id='624efcea1cd1402d93c86d77c1424307',uuid=6140056a-ced1-4240-a11a-795a260adf46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a0341df-e2e2-42f8-8b6e-35376780584e", "address": "fa:16:3e:4b:82:f1", "network": {"id": "879f9f54-7640-4384-b28f-7d8d38d7f74f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1830593335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc3d8aa64c704f45b08bdb0f1ecb2c90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a0341df-e2", "ovs_interfaceid": "5a0341df-e2e2-42f8-8b6e-35376780584e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 17:55:19 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Converting VIF {"id": "5a0341df-e2e2-42f8-8b6e-35376780584e", "address": "fa:16:3e:4b:82:f1", "network": {"id": "879f9f54-7640-4384-b28f-7d8d38d7f74f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1830593335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc3d8aa64c704f45b08bdb0f1ecb2c90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a0341df-e2", "ovs_interfaceid": "5a0341df-e2e2-42f8-8b6e-35376780584e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:55:19 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:82:f1,bridge_name='br-int',has_traffic_filtering=True,id=5a0341df-e2e2-42f8-8b6e-35376780584e,network=Network(879f9f54-7640-4384-b28f-7d8d38d7f74f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a0341df-e2') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:55:19 user nova-compute[75100]: DEBUG os_vif [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:82:f1,bridge_name='br-int',has_traffic_filtering=True,id=5a0341df-e2e2-42f8-8b6e-35376780584e,network=Network(879f9f54-7640-4384-b28f-7d8d38d7f74f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a0341df-e2') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 17:55:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:55:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 17:55:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0c756713-3dca-5fce-a0e6-84c932203ef7', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:55:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5a0341df-e2, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:55:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5a0341df-e2, col_values=(('qos', UUID('50708581-3593-43fc-88ed-4f5aab7d73e2')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:55:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5a0341df-e2, col_values=(('external_ids', {'iface-id': '5a0341df-e2e2-42f8-8b6e-35376780584e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:82:f1', 'vm-uuid': '6140056a-ced1-4240-a11a-795a260adf46'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:55:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:55:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:19 user nova-compute[75100]: INFO os_vif [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:82:f1,bridge_name='br-int',has_traffic_filtering=True,id=5a0341df-e2e2-42f8-8b6e-35376780584e,network=Network(879f9f54-7640-4384-b28f-7d8d38d7f74f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a0341df-e2')
Nov 10 17:55:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 17:55:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] No VIF found with MAC fa:16:3e:4b:82:f1, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 17:55:20 user nova-compute[75100]: DEBUG nova.network.neutron [req-b8b57257-ccd8-40fe-baa2-ba6e3a6fa298 req-a12eb719-dba6-4ade-95f2-19dfb2639a25 service nova] [instance: 6140056a-ced1-4240-a11a-795a260adf46] Updated VIF entry in instance network info cache for port 5a0341df-e2e2-42f8-8b6e-35376780584e. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 17:55:20 user nova-compute[75100]: DEBUG nova.network.neutron [req-b8b57257-ccd8-40fe-baa2-ba6e3a6fa298 req-a12eb719-dba6-4ade-95f2-19dfb2639a25 service nova] [instance: 6140056a-ced1-4240-a11a-795a260adf46] Updating instance_info_cache with network_info: [{"id": "5a0341df-e2e2-42f8-8b6e-35376780584e", "address": "fa:16:3e:4b:82:f1", "network": {"id": "879f9f54-7640-4384-b28f-7d8d38d7f74f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1830593335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc3d8aa64c704f45b08bdb0f1ecb2c90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a0341df-e2", "ovs_interfaceid": "5a0341df-e2e2-42f8-8b6e-35376780584e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:55:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b8b57257-ccd8-40fe-baa2-ba6e3a6fa298 req-a12eb719-dba6-4ade-95f2-19dfb2639a25 service nova] Releasing lock "refresh_cache-6140056a-ced1-4240-a11a-795a260adf46" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:55:20 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:55:21 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:55:21 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 17:55:21 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:55:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:55:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:55:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:55:21 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 17:55:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:21 user nova-compute[75100]: DEBUG nova.compute.manager [req-fd2f5e66-19df-404f-9312-48bf9b8830eb req-c8de1f5f-ac83-4f18-87db-67cca7f5e9dc service nova] [instance: 6140056a-ced1-4240-a11a-795a260adf46] Received event network-vif-plugged-5a0341df-e2e2-42f8-8b6e-35376780584e {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:55:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-fd2f5e66-19df-404f-9312-48bf9b8830eb req-c8de1f5f-ac83-4f18-87db-67cca7f5e9dc service nova] Acquiring lock "6140056a-ced1-4240-a11a-795a260adf46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:55:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-fd2f5e66-19df-404f-9312-48bf9b8830eb req-c8de1f5f-ac83-4f18-87db-67cca7f5e9dc service nova] Lock "6140056a-ced1-4240-a11a-795a260adf46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:55:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-fd2f5e66-19df-404f-9312-48bf9b8830eb req-c8de1f5f-ac83-4f18-87db-67cca7f5e9dc service nova] Lock "6140056a-ced1-4240-a11a-795a260adf46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:55:21 user nova-compute[75100]: DEBUG nova.compute.manager [req-fd2f5e66-19df-404f-9312-48bf9b8830eb req-c8de1f5f-ac83-4f18-87db-67cca7f5e9dc service nova] [instance: 6140056a-ced1-4240-a11a-795a260adf46] No waiting events found dispatching network-vif-plugged-5a0341df-e2e2-42f8-8b6e-35376780584e {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:55:21 user nova-compute[75100]: WARNING nova.compute.manager [req-fd2f5e66-19df-404f-9312-48bf9b8830eb req-c8de1f5f-ac83-4f18-87db-67cca7f5e9dc service nova] [instance: 6140056a-ced1-4240-a11a-795a260adf46] Received unexpected event network-vif-plugged-5a0341df-e2e2-42f8-8b6e-35376780584e for instance with vm_state building and task_state spawning.
Nov 10 17:55:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:55:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:55:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:55:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:55:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:55:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:55:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:55:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:55:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:55:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:55:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:55:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:55:23 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 17:55:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6de4626-f097-43b7-8e56-a08415e7d74a/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:55:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6de4626-f097-43b7-8e56-a08415e7d74a/disk.rescue --force-share --output=json" returned: 0 in 0.249s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:55:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6de4626-f097-43b7-8e56-a08415e7d74a/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:55:23 user nova-compute[75100]: DEBUG nova.compute.manager [req-748a4f54-c882-49b6-91cc-b0e2e25b78d9 req-0898fc64-17a3-4e4a-bc21-40cfea22e61e service nova] [instance: 6140056a-ced1-4240-a11a-795a260adf46] Received event network-vif-plugged-5a0341df-e2e2-42f8-8b6e-35376780584e {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:55:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-748a4f54-c882-49b6-91cc-b0e2e25b78d9 req-0898fc64-17a3-4e4a-bc21-40cfea22e61e service nova] Acquiring lock "6140056a-ced1-4240-a11a-795a260adf46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:55:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-748a4f54-c882-49b6-91cc-b0e2e25b78d9 req-0898fc64-17a3-4e4a-bc21-40cfea22e61e service nova] Lock "6140056a-ced1-4240-a11a-795a260adf46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:55:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-748a4f54-c882-49b6-91cc-b0e2e25b78d9 req-0898fc64-17a3-4e4a-bc21-40cfea22e61e service nova] Lock "6140056a-ced1-4240-a11a-795a260adf46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:55:23 user nova-compute[75100]: DEBUG nova.compute.manager [req-748a4f54-c882-49b6-91cc-b0e2e25b78d9 req-0898fc64-17a3-4e4a-bc21-40cfea22e61e service nova] [instance: 6140056a-ced1-4240-a11a-795a260adf46] No waiting events found dispatching network-vif-plugged-5a0341df-e2e2-42f8-8b6e-35376780584e {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:55:23 user nova-compute[75100]: WARNING nova.compute.manager [req-748a4f54-c882-49b6-91cc-b0e2e25b78d9 req-0898fc64-17a3-4e4a-bc21-40cfea22e61e service nova] [instance: 6140056a-ced1-4240-a11a-795a260adf46] Received unexpected event network-vif-plugged-5a0341df-e2e2-42f8-8b6e-35376780584e for instance with vm_state building and task_state spawning.
Nov 10 17:55:23 user nova-compute[75100]: DEBUG nova.compute.manager [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 6140056a-ced1-4240-a11a-795a260adf46] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 17:55:23 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 6140056a-ced1-4240-a11a-795a260adf46] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 17:55:23 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 6140056a-ced1-4240-a11a-795a260adf46] Instance spawned successfully.
Nov 10 17:55:23 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 6140056a-ced1-4240-a11a-795a260adf46] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 17:55:23 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 6140056a-ced1-4240-a11a-795a260adf46] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:55:23 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 6140056a-ced1-4240-a11a-795a260adf46] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:55:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 6140056a-ced1-4240-a11a-795a260adf46] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:55:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 6140056a-ced1-4240-a11a-795a260adf46] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:55:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 6140056a-ced1-4240-a11a-795a260adf46] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:55:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 6140056a-ced1-4240-a11a-795a260adf46] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:55:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6de4626-f097-43b7-8e56-a08415e7d74a/disk.rescue --force-share --output=json" returned: 0 in 0.282s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:55:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7fbe35b-4794-4eb9-8033-923247064458/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:55:24 user nova-compute[75100]: INFO nova.compute.manager [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 6140056a-ced1-4240-a11a-795a260adf46] Took 7.08 seconds to spawn the instance on the hypervisor.
Nov 10 17:55:24 user nova-compute[75100]: DEBUG nova.compute.manager [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 6140056a-ced1-4240-a11a-795a260adf46] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 17:55:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:24 user nova-compute[75100]: INFO nova.compute.manager [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 6140056a-ced1-4240-a11a-795a260adf46] Took 8.06 seconds to build instance.
Nov 10 17:55:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c5b1f158-b21c-4d7b-aed5-31703c4b0a5f tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Lock "6140056a-ced1-4240-a11a-795a260adf46" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.207s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:55:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7fbe35b-4794-4eb9-8033-923247064458/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:55:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7fbe35b-4794-4eb9-8033-923247064458/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:55:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7fbe35b-4794-4eb9-8033-923247064458/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:55:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:55:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:55:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:55:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:55:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:55:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:55:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:55:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:55:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/989f3ce5-067b-45e4-a2e5-445024e13202/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:55:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/989f3ce5-067b-45e4-a2e5-445024e13202/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:55:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/989f3ce5-067b-45e4-a2e5-445024e13202/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:55:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-956bb1e5-25fe-4669-976c-0d2144ef4295 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 17:55:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-956bb1e5-25fe-4669-976c-0d2144ef4295 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yjIaTUJi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 17:55:25 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-956bb1e5-25fe-4669-976c-0d2144ef4295 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 17:55:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-956bb1e5-25fe-4669-976c-0d2144ef4295 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 17:55:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-956bb1e5-25fe-4669-976c-0d2144ef4295 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 17:55:25 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-956bb1e5-25fe-4669-976c-0d2144ef4295 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 17:55:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-956bb1e5-25fe-4669-976c-0d2144ef4295 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 17:55:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-956bb1e5-25fe-4669-976c-0d2144ef4295 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 17:55:25 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-956bb1e5-25fe-4669-976c-0d2144ef4295 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 17:55:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 -p 172.16.0.220:3260 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:55:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:55:25 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e21a52d-3a41-40b0-8dea-5761d62f20a7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:55:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-956bb1e5-25fe-4669-976c-0d2144ef4295 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 17:55:25 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:55:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 -p 172.16.0.220:3260 --interface default --op new {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:55:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:55:25 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3a22ed-929e-4f6c-b615-4640384c05e3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652] added\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:55:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-956bb1e5-25fe-4669-976c-0d2144ef4295 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652] added
Nov 10 17:55:25 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:55:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:55:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:55:25 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[311241be-51e6-43b4-9986-390ed5c95078]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:55:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-956bb1e5-25fe-4669-976c-0d2144ef4295 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:55:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:55:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:55:25 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[61229903-11aa-4c98-b735-0e61e99fcb72]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:55:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-956bb1e5-25fe-4669-976c-0d2144ef4295 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:55:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yjIaTUJi {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:55:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/989f3ce5-067b-45e4-a2e5-445024e13202/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:55:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yjIaTUJi" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:55:25 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f809c0-7ff6-4e7f-846f-5545ba25e566]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:55:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-956bb1e5-25fe-4669-976c-0d2144ef4295 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yjIaTUJi'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:55:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:55:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:55:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:55:25 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[33001cfc-af8b-44d9-9988-d572aab83fe8]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:55:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-956bb1e5-25fe-4669-976c-0d2144ef4295 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:55:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:55:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:55:25 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cbd2ee9-d347-4da5-998c-50539aea8a5c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:55:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-956bb1e5-25fe-4669-976c-0d2144ef4295 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)
Nov 10 17:55:25 user nova-compute[75100]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c (non-flash)
Nov 10 17:55:25 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:55:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-956bb1e5-25fe-4669-976c-0d2144ef4295 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)
Nov 10 17:55:25 user nova-compute[75100]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c (non-flash)
Nov 10 17:55:25 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 17:55:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 -p 172.16.0.220:3260 --login {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:55:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:55:25 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e6410b5-8687-4afb-bde4-c3dada5bfd95]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:55:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-956bb1e5-25fe-4669-976c-0d2144ef4295 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652, portal: 172.16.0.220,3260]
Nov 10 17:55:25 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652, portal: 172.16.0.220,3260] successful.
Nov 10 17:55:25 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:55:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:55:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:55:25 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11f09e2-72bb-4da2-9657-390a4b470971]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:55:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-956bb1e5-25fe-4669-976c-0d2144ef4295 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:55:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:55:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:55:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:55:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:55:26 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb249b98-9cd7-47b9-b3ac-869935a89e0c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:55:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-956bb1e5-25fe-4669-976c-0d2144ef4295 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)
Nov 10 17:55:26 user nova-compute[75100]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c (non-flash)
Nov 10 17:55:26 user nova-compute[75100]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)
Nov 10 17:55:26 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:55:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-956bb1e5-25fe-4669-976c-0d2144ef4295 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)
Nov 10 17:55:26 user nova-compute[75100]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c (non-flash)
Nov 10 17:55:26 user nova-compute[75100]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)
Nov 10 17:55:26 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 17:55:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-956bb1e5-25fe-4669-976c-0d2144ef4295 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.425s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 17:55:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-956bb1e5-25fe-4669-976c-0d2144ef4295 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 17:55:26 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-956bb1e5-25fe-4669-976c-0d2144ef4295 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] HCTL ('35', '-', '-', 0) found on session 14 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 17:55:26 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-956bb1e5-25fe-4669-976c-0d2144ef4295 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 17:55:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:55:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:55:26 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[75518c0c-b3a1-41fc-9e3e-c3ac73014de7]: (4, ('- - 0', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:55:26 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-956bb1e5-25fe-4669-976c-0d2144ef4295 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Searching for a device in session 14 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 17:55:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-956bb1e5-25fe-4669-976c-0d2144ef4295 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yjIaTUJi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 17:55:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:55:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 17:55:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9033f537-bdeb-412c-9337-4ad86f4467b2/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:55:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9033f537-bdeb-412c-9337-4ad86f4467b2/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:55:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9033f537-bdeb-412c-9337-4ad86f4467b2/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:55:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9033f537-bdeb-412c-9337-4ad86f4467b2/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:55:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6140056a-ced1-4240-a11a-795a260adf46/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:55:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6140056a-ced1-4240-a11a-795a260adf46/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:55:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6140056a-ced1-4240-a11a-795a260adf46/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:55:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6140056a-ced1-4240-a11a-795a260adf46/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:55:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61d3862-5be7-45cc-95a0-88124ac1725d/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:55:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-956bb1e5-25fe-4669-976c-0d2144ef4295 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.479s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 17:55:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-956bb1e5-25fe-4669-976c-0d2144ef4295 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] <== connect_volume: return (1485ms) {'type': 'block', 'scsi_wwn': '26364313736346538', 'path': '/dev/sdd'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 17:55:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-956bb1e5-25fe-4669-976c-0d2144ef4295 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364313736346538', 'path': '/dev/sdd'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 17:55:27 user nova-compute[75100]: DEBUG nova.objects.instance [None req-956bb1e5-25fe-4669-976c-0d2144ef4295 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lazy-loading 'flavor' on Instance uuid 9033f537-bdeb-412c-9337-4ad86f4467b2 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:55:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-956bb1e5-25fe-4669-976c-0d2144ef4295 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 17:55:27 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 17:55:27 user nova-compute[75100]:   <source dev="/dev/sdd"/>
Nov 10 17:55:27 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 17:55:27 user nova-compute[75100]:   <serial>f802b50f-f3b6-4f97-a95e-f838ec169652</serial>
Nov 10 17:55:27 user nova-compute[75100]: </disk>
Nov 10 17:55:27 user nova-compute[75100]:  {{(pid=75100) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 17:55:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61d3862-5be7-45cc-95a0-88124ac1725d/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:55:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61d3862-5be7-45cc-95a0-88124ac1725d/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:55:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61d3862-5be7-45cc-95a0-88124ac1725d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:55:27 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:55:27 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:55:27 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Hypervisor/Node resource view: name=user free_ram=7348MB free_disk=24.426795959472656GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 17:55:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:55:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:55:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-956bb1e5-25fe-4669-976c-0d2144ef4295 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 17:55:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-956bb1e5-25fe-4669-976c-0d2144ef4295 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 17:55:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-956bb1e5-25fe-4669-976c-0d2144ef4295 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] No VIF found with MAC fa:16:3e:01:6b:43, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 17:55:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Applying migration context for instance eb430407-f836-4510-899f-a5f5d60c73f3 as it has an incoming, in-progress migration 819b8490-d7be-448c-a56b-19060b11a2f1. Migration status is finished {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 10 17:55:28 user nova-compute[75100]: INFO nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Updating resource usage from migration 819b8490-d7be-448c-a56b-19060b11a2f1
Nov 10 17:55:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-956bb1e5-25fe-4669-976c-0d2144ef4295 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "9033f537-bdeb-412c-9337-4ad86f4467b2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 30.767s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:55:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance c19fc271-a248-4631-a11f-89b7ed73bf85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:55:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:55:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 3e14de19-540d-4dc2-a058-6874d8d14478 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:55:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance d61d3862-5be7-45cc-95a0-88124ac1725d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:55:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:55:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance e6de4626-f097-43b7-8e56-a08415e7d74a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:55:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 9033f537-bdeb-412c-9337-4ad86f4467b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:55:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 989f3ce5-067b-45e4-a2e5-445024e13202 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:55:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance c7fbe35b-4794-4eb9-8033-923247064458 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:55:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Migration 819b8490-d7be-448c-a56b-19060b11a2f1 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 10 17:55:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance eb430407-f836-4510-899f-a5f5d60c73f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:55:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 6140056a-ced1-4240-a11a-795a260adf46 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:55:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 17:55:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 17:55:28 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:55:28 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:55:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 17:55:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.807s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:55:28 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:55:28 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Cleaning up deleted instances {{(pid=75100) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 17:55:28 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] There are 0 instances to clean {{(pid=75100) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 17:55:28 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:55:28 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75100) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 17:55:28 user nova-compute[75100]: INFO nova.compute.manager [None req-99e75acb-79a2-4004-8fc1-33564bb8b12e tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Rescuing
Nov 10 17:55:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-99e75acb-79a2-4004-8fc1-33564bb8b12e tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Acquiring lock "refresh_cache-9033f537-bdeb-412c-9337-4ad86f4467b2" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:55:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-99e75acb-79a2-4004-8fc1-33564bb8b12e tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Acquired lock "refresh_cache-9033f537-bdeb-412c-9337-4ad86f4467b2" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:55:28 user nova-compute[75100]: DEBUG nova.network.neutron [None req-99e75acb-79a2-4004-8fc1-33564bb8b12e tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 17:55:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:29 user nova-compute[75100]: DEBUG nova.network.neutron [None req-99e75acb-79a2-4004-8fc1-33564bb8b12e tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Updating instance_info_cache with network_info: [{"id": "4c49d1d4-dba2-478e-80b6-94e012439af6", "address": "fa:16:3e:01:6b:43", "network": {"id": "26a554fe-9a5e-40c0-9981-5ac084c9ea73", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-269663495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19755f3e634fdfbd562c33fbfa2a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c49d1d4-db", "ovs_interfaceid": "4c49d1d4-dba2-478e-80b6-94e012439af6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:55:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-99e75acb-79a2-4004-8fc1-33564bb8b12e tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Releasing lock "refresh_cache-9033f537-bdeb-412c-9337-4ad86f4467b2" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:55:29 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:55:29 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:55:29 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 17:55:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "refresh_cache-22c021d9-c8e4-455d-8e2a-a9cdfbb38f75" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:55:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquired lock "refresh_cache-22c021d9-c8e4-455d-8e2a-a9cdfbb38f75" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:55:29 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 17:55:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:30 user nova-compute[75100]: DEBUG nova.compute.manager [req-4755b098-53d1-4e81-85e3-9d302d7c825b req-459f5c32-832c-4319-acd8-cfdf7387b6aa service nova] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Received event network-vif-unplugged-4c49d1d4-dba2-478e-80b6-94e012439af6 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:55:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4755b098-53d1-4e81-85e3-9d302d7c825b req-459f5c32-832c-4319-acd8-cfdf7387b6aa service nova] Acquiring lock "9033f537-bdeb-412c-9337-4ad86f4467b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:55:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4755b098-53d1-4e81-85e3-9d302d7c825b req-459f5c32-832c-4319-acd8-cfdf7387b6aa service nova] Lock "9033f537-bdeb-412c-9337-4ad86f4467b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:55:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4755b098-53d1-4e81-85e3-9d302d7c825b req-459f5c32-832c-4319-acd8-cfdf7387b6aa service nova] Lock "9033f537-bdeb-412c-9337-4ad86f4467b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:55:30 user nova-compute[75100]: DEBUG nova.compute.manager [req-4755b098-53d1-4e81-85e3-9d302d7c825b req-459f5c32-832c-4319-acd8-cfdf7387b6aa service nova] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] No waiting events found dispatching network-vif-unplugged-4c49d1d4-dba2-478e-80b6-94e012439af6 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:55:30 user nova-compute[75100]: WARNING nova.compute.manager [req-4755b098-53d1-4e81-85e3-9d302d7c825b req-459f5c32-832c-4319-acd8-cfdf7387b6aa service nova] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Received unexpected event network-vif-unplugged-4c49d1d4-dba2-478e-80b6-94e012439af6 for instance with vm_state active and task_state rescuing.
Nov 10 17:55:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:30 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Updating instance_info_cache with network_info: [{"id": "9855a14c-55c7-4a35-a4cc-7085dfbda684", "address": "fa:16:3e:02:b1:a1", "network": {"id": "bf1edb58-ef26-40ca-8ec9-853fa05de13d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1416469583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7bb141ef59487dbb2ce6243c5002af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9855a14c-55", "ovs_interfaceid": "9855a14c-55c7-4a35-a4cc-7085dfbda684", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:55:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Releasing lock "refresh_cache-22c021d9-c8e4-455d-8e2a-a9cdfbb38f75" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:55:30 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 17:55:30 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:55:30 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Instance destroyed successfully.
Nov 10 17:55:30 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-99e75acb-79a2-4004-8fc1-33564bb8b12e tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Attempting rescue
Nov 10 17:55:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-99e75acb-79a2-4004-8fc1-33564bb8b12e tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75100) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 10 17:55:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-99e75acb-79a2-4004-8fc1-33564bb8b12e tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Instance directory exists: not creating {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 10 17:55:30 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-99e75acb-79a2-4004-8fc1-33564bb8b12e tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Creating image(s)
Nov 10 17:55:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-99e75acb-79a2-4004-8fc1-33564bb8b12e tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Acquiring lock "/opt/stack/data/nova/instances/9033f537-bdeb-412c-9337-4ad86f4467b2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:55:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-99e75acb-79a2-4004-8fc1-33564bb8b12e tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "/opt/stack/data/nova/instances/9033f537-bdeb-412c-9337-4ad86f4467b2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:55:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-99e75acb-79a2-4004-8fc1-33564bb8b12e tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "/opt/stack/data/nova/instances/9033f537-bdeb-412c-9337-4ad86f4467b2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:55:30 user nova-compute[75100]: DEBUG nova.objects.instance [None req-99e75acb-79a2-4004-8fc1-33564bb8b12e tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9033f537-bdeb-412c-9337-4ad86f4467b2 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:55:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-99e75acb-79a2-4004-8fc1-33564bb8b12e tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Acquiring lock "818b9e28e061d41a38d903968b229be2ed9ba520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:55:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-99e75acb-79a2-4004-8fc1-33564bb8b12e tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:55:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-99e75acb-79a2-4004-8fc1-33564bb8b12e tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:55:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-99e75acb-79a2-4004-8fc1-33564bb8b12e tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.217s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:55:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-99e75acb-79a2-4004-8fc1-33564bb8b12e tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/9033f537-bdeb-412c-9337-4ad86f4467b2/disk.rescue {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:55:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-99e75acb-79a2-4004-8fc1-33564bb8b12e tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/9033f537-bdeb-412c-9337-4ad86f4467b2/disk.rescue" returned: 0 in 0.071s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:55:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-99e75acb-79a2-4004-8fc1-33564bb8b12e tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.298s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:55:31 user nova-compute[75100]: DEBUG nova.objects.instance [None req-99e75acb-79a2-4004-8fc1-33564bb8b12e tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lazy-loading 'migration_context' on Instance uuid 9033f537-bdeb-412c-9337-4ad86f4467b2 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:55:31 user nova-compute[75100]: DEBUG nova.objects.base [None req-99e75acb-79a2-4004-8fc1-33564bb8b12e tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Object Instance<9033f537-bdeb-412c-9337-4ad86f4467b2> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 17:55:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-99e75acb-79a2-4004-8fc1-33564bb8b12e tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 17:55:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-99e75acb-79a2-4004-8fc1-33564bb8b12e tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Start _get_guest_xml network_info=[{"id": "4c49d1d4-dba2-478e-80b6-94e012439af6", "address": "fa:16:3e:01:6b:43", "network": {"id": "26a554fe-9a5e-40c0-9981-5ac084c9ea73", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-269663495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-269663495-network", "vif_mac": "fa:16:3e:01:6b:43"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19755f3e634fdfbd562c33fbfa2a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c49d1d4-db", "ovs_interfaceid": "4c49d1d4-dba2-478e-80b6-94e012439af6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e3cc5321-4d40-49ee-885c-700e14741732', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 17:55:31 user nova-compute[75100]: DEBUG nova.objects.instance [None req-99e75acb-79a2-4004-8fc1-33564bb8b12e tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lazy-loading 'resources' on Instance uuid 9033f537-bdeb-412c-9337-4ad86f4467b2 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:55:31 user nova-compute[75100]: DEBUG nova.objects.base [None req-99e75acb-79a2-4004-8fc1-33564bb8b12e tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Object Instance<9033f537-bdeb-412c-9337-4ad86f4467b2> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 17:55:31 user nova-compute[75100]: DEBUG nova.objects.instance [None req-99e75acb-79a2-4004-8fc1-33564bb8b12e tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lazy-loading 'numa_topology' on Instance uuid 9033f537-bdeb-412c-9337-4ad86f4467b2 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:55:31 user nova-compute[75100]: DEBUG nova.objects.base [None req-99e75acb-79a2-4004-8fc1-33564bb8b12e tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Object Instance<9033f537-bdeb-412c-9337-4ad86f4467b2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 17:55:31 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-99e75acb-79a2-4004-8fc1-33564bb8b12e tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:55:31 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-99e75acb-79a2-4004-8fc1-33564bb8b12e tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:55:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-99e75acb-79a2-4004-8fc1-33564bb8b12e tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 17:55:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-99e75acb-79a2-4004-8fc1-33564bb8b12e tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 17:55:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-99e75acb-79a2-4004-8fc1-33564bb8b12e tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 17:55:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-99e75acb-79a2-4004-8fc1-33564bb8b12e tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 17:55:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-99e75acb-79a2-4004-8fc1-33564bb8b12e tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 17:55:31 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-99e75acb-79a2-4004-8fc1-33564bb8b12e tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T17:40:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 17:55:31 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-99e75acb-79a2-4004-8fc1-33564bb8b12e tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 17:55:31 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-99e75acb-79a2-4004-8fc1-33564bb8b12e tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 17:55:31 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-99e75acb-79a2-4004-8fc1-33564bb8b12e tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 17:55:31 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-99e75acb-79a2-4004-8fc1-33564bb8b12e tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 17:55:31 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-99e75acb-79a2-4004-8fc1-33564bb8b12e tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 17:55:31 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-99e75acb-79a2-4004-8fc1-33564bb8b12e tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 17:55:31 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-99e75acb-79a2-4004-8fc1-33564bb8b12e tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 17:55:31 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-99e75acb-79a2-4004-8fc1-33564bb8b12e tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 17:55:31 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-99e75acb-79a2-4004-8fc1-33564bb8b12e tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 17:55:31 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-99e75acb-79a2-4004-8fc1-33564bb8b12e tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 17:55:31 user nova-compute[75100]: DEBUG nova.objects.instance [None req-99e75acb-79a2-4004-8fc1-33564bb8b12e tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9033f537-bdeb-412c-9337-4ad86f4467b2 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:55:31 user nova-compute[75100]: DEBUG nova.objects.base [None req-99e75acb-79a2-4004-8fc1-33564bb8b12e tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Object Instance<9033f537-bdeb-412c-9337-4ad86f4467b2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 17:55:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-99e75acb-79a2-4004-8fc1-33564bb8b12e tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:53:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-605414180',display_name='tempest-ServerRescueNegativeTestJSON-server-605414180',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-605414180',id=22,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK5WD1+eOwUzsX08cypzhrTma3HkbsN870zT0Y+QTvyZBNlyAR0CbepPOL0EczUTok0EEOnRf3EnHVqUySgcH39xQkMu9DxtypvjKKVzJormvnoofL9/MAfmhYPJK8lu1w==',key_name='tempest-keypair-2016670451',keypairs=<?>,launch_index=0,launched_at=2023-11-10T17:53:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6b19755f3e634fdfbd562c33fbfa2a88',ramdisk_id='',reservation_id='r-78y85sq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-783763036',owner_user_name='tempest-ServerRescueNegativeTestJSON-783763036-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:53:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8cdb9250e6c7459587e429a0aea577c6',uuid=9033f537-bdeb-412c-9337-4ad86f4467b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c49d1d4-dba2-478e-80b6-94e012439af6", "address": "fa:16:3e:01:6b:43", "network": {"id": "26a554fe-9a5e-40c0-9981-5ac084c9ea73", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-269663495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-269663495-network", "vif_mac": "fa:16:3e:01:6b:43"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19755f3e634fdfbd562c33fbfa2a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c49d1d4-db", "ovs_interfaceid": "4c49d1d4-dba2-478e-80b6-94e012439af6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 17:55:31 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-99e75acb-79a2-4004-8fc1-33564bb8b12e tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Converting VIF {"id": "4c49d1d4-dba2-478e-80b6-94e012439af6", "address": "fa:16:3e:01:6b:43", "network": {"id": "26a554fe-9a5e-40c0-9981-5ac084c9ea73", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-269663495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-269663495-network", "vif_mac": "fa:16:3e:01:6b:43"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19755f3e634fdfbd562c33fbfa2a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c49d1d4-db", "ovs_interfaceid": "4c49d1d4-dba2-478e-80b6-94e012439af6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:55:31 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-99e75acb-79a2-4004-8fc1-33564bb8b12e tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:01:6b:43,bridge_name='br-int',has_traffic_filtering=True,id=4c49d1d4-dba2-478e-80b6-94e012439af6,network=Network(26a554fe-9a5e-40c0-9981-5ac084c9ea73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c49d1d4-db') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:55:31 user nova-compute[75100]: DEBUG nova.objects.instance [None req-99e75acb-79a2-4004-8fc1-33564bb8b12e tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lazy-loading 'pci_devices' on Instance uuid 9033f537-bdeb-412c-9337-4ad86f4467b2 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:55:31 user nova-compute[75100]: DEBUG nova.objects.base [None req-99e75acb-79a2-4004-8fc1-33564bb8b12e tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Object Instance<9033f537-bdeb-412c-9337-4ad86f4467b2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 17:55:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-99e75acb-79a2-4004-8fc1-33564bb8b12e tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] End _get_guest_xml xml=<domain type="kvm">
Nov 10 17:55:31 user nova-compute[75100]:   <uuid>9033f537-bdeb-412c-9337-4ad86f4467b2</uuid>
Nov 10 17:55:31 user nova-compute[75100]:   <name>instance-00000016</name>
Nov 10 17:55:31 user nova-compute[75100]:   <memory>524288</memory>
Nov 10 17:55:31 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 10 17:55:31 user nova-compute[75100]:   <metadata>
Nov 10 17:55:31 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 17:55:31 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 10 17:55:31 user nova-compute[75100]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-605414180</nova:name>
Nov 10 17:55:31 user nova-compute[75100]:       <nova:creationTime>2023-11-10 17:55:31</nova:creationTime>
Nov 10 17:55:31 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 10 17:55:31 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 10 17:55:31 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 10 17:55:31 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 10 17:55:31 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 17:55:31 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 10 17:55:31 user nova-compute[75100]:       </nova:flavor>
Nov 10 17:55:31 user nova-compute[75100]:       <nova:owner>
Nov 10 17:55:31 user nova-compute[75100]:         <nova:user uuid="8cdb9250e6c7459587e429a0aea577c6">tempest-ServerRescueNegativeTestJSON-783763036-project-member</nova:user>
Nov 10 17:55:31 user nova-compute[75100]:         <nova:project uuid="6b19755f3e634fdfbd562c33fbfa2a88">tempest-ServerRescueNegativeTestJSON-783763036</nova:project>
Nov 10 17:55:31 user nova-compute[75100]:       </nova:owner>
Nov 10 17:55:31 user nova-compute[75100]:       <nova:root type="image" uuid="e3cc5321-4d40-49ee-885c-700e14741732"/>
Nov 10 17:55:31 user nova-compute[75100]:       <nova:ports>
Nov 10 17:55:31 user nova-compute[75100]:         <nova:port uuid="4c49d1d4-dba2-478e-80b6-94e012439af6">
Nov 10 17:55:31 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 10 17:55:31 user nova-compute[75100]:         </nova:port>
Nov 10 17:55:31 user nova-compute[75100]:       </nova:ports>
Nov 10 17:55:31 user nova-compute[75100]:     </nova:instance>
Nov 10 17:55:31 user nova-compute[75100]:   </metadata>
Nov 10 17:55:31 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 10 17:55:31 user nova-compute[75100]:     <system>
Nov 10 17:55:31 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 17:55:31 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 10 17:55:31 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 10 17:55:31 user nova-compute[75100]:       <entry name="serial">9033f537-bdeb-412c-9337-4ad86f4467b2</entry>
Nov 10 17:55:31 user nova-compute[75100]:       <entry name="uuid">9033f537-bdeb-412c-9337-4ad86f4467b2</entry>
Nov 10 17:55:31 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 10 17:55:31 user nova-compute[75100]:     </system>
Nov 10 17:55:31 user nova-compute[75100]:   </sysinfo>
Nov 10 17:55:31 user nova-compute[75100]:   <os>
Nov 10 17:55:31 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 17:55:31 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 10 17:55:31 user nova-compute[75100]:   </os>
Nov 10 17:55:31 user nova-compute[75100]:   <features>
Nov 10 17:55:31 user nova-compute[75100]:     <acpi/>
Nov 10 17:55:31 user nova-compute[75100]:     <apic/>
Nov 10 17:55:31 user nova-compute[75100]:     <vmcoreinfo/>
Nov 10 17:55:31 user nova-compute[75100]:   </features>
Nov 10 17:55:31 user nova-compute[75100]:   <clock offset="utc">
Nov 10 17:55:31 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 17:55:31 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 17:55:31 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 10 17:55:31 user nova-compute[75100]:   </clock>
Nov 10 17:55:31 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 10 17:55:31 user nova-compute[75100]:     <model>Nehalem</model>
Nov 10 17:55:31 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 17:55:31 user nova-compute[75100]:   </cpu>
Nov 10 17:55:31 user nova-compute[75100]:   <devices>
Nov 10 17:55:31 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 10 17:55:31 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 17:55:31 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/9033f537-bdeb-412c-9337-4ad86f4467b2/disk.rescue"/>
Nov 10 17:55:31 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 10 17:55:31 user nova-compute[75100]:     </disk>
Nov 10 17:55:31 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 10 17:55:31 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 17:55:31 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/9033f537-bdeb-412c-9337-4ad86f4467b2/disk"/>
Nov 10 17:55:31 user nova-compute[75100]:       <target dev="vdb" bus="virtio"/>
Nov 10 17:55:31 user nova-compute[75100]:     </disk>
Nov 10 17:55:31 user nova-compute[75100]:     <interface type="ethernet">
Nov 10 17:55:31 user nova-compute[75100]:       <mac address="fa:16:3e:01:6b:43"/>
Nov 10 17:55:31 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:55:31 user nova-compute[75100]:       <mtu size="1442"/>
Nov 10 17:55:31 user nova-compute[75100]:       <target dev="tap4c49d1d4-db"/>
Nov 10 17:55:31 user nova-compute[75100]:     </interface>
Nov 10 17:55:31 user nova-compute[75100]:     <serial type="pty">
Nov 10 17:55:31 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/9033f537-bdeb-412c-9337-4ad86f4467b2/console.log" append="off"/>
Nov 10 17:55:31 user nova-compute[75100]:     </serial>
Nov 10 17:55:31 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 17:55:31 user nova-compute[75100]:     <video>
Nov 10 17:55:31 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:55:31 user nova-compute[75100]:     </video>
Nov 10 17:55:31 user nova-compute[75100]:     <rng model="virtio">
Nov 10 17:55:31 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 10 17:55:31 user nova-compute[75100]:     </rng>
Nov 10 17:55:31 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 10 17:55:31 user nova-compute[75100]:     <memballoon model="virtio">
Nov 10 17:55:31 user nova-compute[75100]:       <stats period="10"/>
Nov 10 17:55:31 user nova-compute[75100]:     </memballoon>
Nov 10 17:55:31 user nova-compute[75100]:   </devices>
Nov 10 17:55:31 user nova-compute[75100]: </domain>
Nov 10 17:55:31 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 17:55:31 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Instance destroyed successfully.
Nov 10 17:55:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-99e75acb-79a2-4004-8fc1-33564bb8b12e tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 17:55:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-99e75acb-79a2-4004-8fc1-33564bb8b12e tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 17:55:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-99e75acb-79a2-4004-8fc1-33564bb8b12e tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] No VIF found with MAC fa:16:3e:01:6b:43, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 17:55:32 user nova-compute[75100]: DEBUG nova.compute.manager [req-6fde01e3-1b20-4484-8216-bb60d5bce52b req-300b6015-725f-41cd-849e-655c3b84273d service nova] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Received event network-vif-plugged-4c49d1d4-dba2-478e-80b6-94e012439af6 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:55:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6fde01e3-1b20-4484-8216-bb60d5bce52b req-300b6015-725f-41cd-849e-655c3b84273d service nova] Acquiring lock "9033f537-bdeb-412c-9337-4ad86f4467b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:55:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6fde01e3-1b20-4484-8216-bb60d5bce52b req-300b6015-725f-41cd-849e-655c3b84273d service nova] Lock "9033f537-bdeb-412c-9337-4ad86f4467b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:55:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6fde01e3-1b20-4484-8216-bb60d5bce52b req-300b6015-725f-41cd-849e-655c3b84273d service nova] Lock "9033f537-bdeb-412c-9337-4ad86f4467b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:55:32 user nova-compute[75100]: DEBUG nova.compute.manager [req-6fde01e3-1b20-4484-8216-bb60d5bce52b req-300b6015-725f-41cd-849e-655c3b84273d service nova] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] No waiting events found dispatching network-vif-plugged-4c49d1d4-dba2-478e-80b6-94e012439af6 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:55:32 user nova-compute[75100]: WARNING nova.compute.manager [req-6fde01e3-1b20-4484-8216-bb60d5bce52b req-300b6015-725f-41cd-849e-655c3b84273d service nova] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Received unexpected event network-vif-plugged-4c49d1d4-dba2-478e-80b6-94e012439af6 for instance with vm_state active and task_state rescuing.
Nov 10 17:55:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:34 user nova-compute[75100]: DEBUG nova.compute.manager [req-92d2a0b6-7927-4c84-ba56-220fb9995085 req-915ee0cf-cbdf-42d9-b77e-cdd0f3596a7d service nova] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Received event network-vif-plugged-4c49d1d4-dba2-478e-80b6-94e012439af6 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:55:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-92d2a0b6-7927-4c84-ba56-220fb9995085 req-915ee0cf-cbdf-42d9-b77e-cdd0f3596a7d service nova] Acquiring lock "9033f537-bdeb-412c-9337-4ad86f4467b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:55:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-92d2a0b6-7927-4c84-ba56-220fb9995085 req-915ee0cf-cbdf-42d9-b77e-cdd0f3596a7d service nova] Lock "9033f537-bdeb-412c-9337-4ad86f4467b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:55:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-92d2a0b6-7927-4c84-ba56-220fb9995085 req-915ee0cf-cbdf-42d9-b77e-cdd0f3596a7d service nova] Lock "9033f537-bdeb-412c-9337-4ad86f4467b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:55:34 user nova-compute[75100]: DEBUG nova.compute.manager [req-92d2a0b6-7927-4c84-ba56-220fb9995085 req-915ee0cf-cbdf-42d9-b77e-cdd0f3596a7d service nova] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] No waiting events found dispatching network-vif-plugged-4c49d1d4-dba2-478e-80b6-94e012439af6 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:55:34 user nova-compute[75100]: WARNING nova.compute.manager [req-92d2a0b6-7927-4c84-ba56-220fb9995085 req-915ee0cf-cbdf-42d9-b77e-cdd0f3596a7d service nova] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Received unexpected event network-vif-plugged-4c49d1d4-dba2-478e-80b6-94e012439af6 for instance with vm_state active and task_state rescuing.
Nov 10 17:55:34 user nova-compute[75100]: DEBUG nova.compute.manager [req-92d2a0b6-7927-4c84-ba56-220fb9995085 req-915ee0cf-cbdf-42d9-b77e-cdd0f3596a7d service nova] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Received event network-vif-plugged-4c49d1d4-dba2-478e-80b6-94e012439af6 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:55:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-92d2a0b6-7927-4c84-ba56-220fb9995085 req-915ee0cf-cbdf-42d9-b77e-cdd0f3596a7d service nova] Acquiring lock "9033f537-bdeb-412c-9337-4ad86f4467b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:55:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-92d2a0b6-7927-4c84-ba56-220fb9995085 req-915ee0cf-cbdf-42d9-b77e-cdd0f3596a7d service nova] Lock "9033f537-bdeb-412c-9337-4ad86f4467b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:55:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-92d2a0b6-7927-4c84-ba56-220fb9995085 req-915ee0cf-cbdf-42d9-b77e-cdd0f3596a7d service nova] Lock "9033f537-bdeb-412c-9337-4ad86f4467b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:55:34 user nova-compute[75100]: DEBUG nova.compute.manager [req-92d2a0b6-7927-4c84-ba56-220fb9995085 req-915ee0cf-cbdf-42d9-b77e-cdd0f3596a7d service nova] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] No waiting events found dispatching network-vif-plugged-4c49d1d4-dba2-478e-80b6-94e012439af6 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:55:34 user nova-compute[75100]: WARNING nova.compute.manager [req-92d2a0b6-7927-4c84-ba56-220fb9995085 req-915ee0cf-cbdf-42d9-b77e-cdd0f3596a7d service nova] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Received unexpected event network-vif-plugged-4c49d1d4-dba2-478e-80b6-94e012439af6 for instance with vm_state active and task_state rescuing.
Nov 10 17:55:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:35 user nova-compute[75100]: DEBUG nova.compute.manager [None req-99e75acb-79a2-4004-8fc1-33564bb8b12e tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 17:55:37 user nova-compute[75100]: DEBUG nova.compute.manager [req-1b55322c-aebc-436e-a636-65175bacfced req-91d7861f-fd80-4254-8350-aef13b7f8e79 service nova] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Received event network-changed-54a1b80b-3910-4ab8-a694-88989c4b6f4e {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:55:37 user nova-compute[75100]: DEBUG nova.compute.manager [req-1b55322c-aebc-436e-a636-65175bacfced req-91d7861f-fd80-4254-8350-aef13b7f8e79 service nova] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Refreshing instance network info cache due to event network-changed-54a1b80b-3910-4ab8-a694-88989c4b6f4e. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 17:55:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-1b55322c-aebc-436e-a636-65175bacfced req-91d7861f-fd80-4254-8350-aef13b7f8e79 service nova] Acquiring lock "refresh_cache-c7fbe35b-4794-4eb9-8033-923247064458" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:55:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-1b55322c-aebc-436e-a636-65175bacfced req-91d7861f-fd80-4254-8350-aef13b7f8e79 service nova] Acquired lock "refresh_cache-c7fbe35b-4794-4eb9-8033-923247064458" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:55:37 user nova-compute[75100]: DEBUG nova.network.neutron [req-1b55322c-aebc-436e-a636-65175bacfced req-91d7861f-fd80-4254-8350-aef13b7f8e79 service nova] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Refreshing network info cache for port 54a1b80b-3910-4ab8-a694-88989c4b6f4e {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 17:55:37 user nova-compute[75100]: DEBUG nova.network.neutron [req-1b55322c-aebc-436e-a636-65175bacfced req-91d7861f-fd80-4254-8350-aef13b7f8e79 service nova] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Updated VIF entry in instance network info cache for port 54a1b80b-3910-4ab8-a694-88989c4b6f4e. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 17:55:37 user nova-compute[75100]: DEBUG nova.network.neutron [req-1b55322c-aebc-436e-a636-65175bacfced req-91d7861f-fd80-4254-8350-aef13b7f8e79 service nova] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Updating instance_info_cache with network_info: [{"id": "54a1b80b-3910-4ab8-a694-88989c4b6f4e", "address": "fa:16:3e:d3:5e:89", "network": {"id": "bf1edb58-ef26-40ca-8ec9-853fa05de13d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1416469583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7bb141ef59487dbb2ce6243c5002af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54a1b80b-39", "ovs_interfaceid": "54a1b80b-3910-4ab8-a694-88989c4b6f4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:55:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-1b55322c-aebc-436e-a636-65175bacfced req-91d7861f-fd80-4254-8350-aef13b7f8e79 service nova] Releasing lock "refresh_cache-c7fbe35b-4794-4eb9-8033-923247064458" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:55:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b8ed1c8d-2d53-4878-b81c-4c717c27f3d6 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Acquiring lock "c7fbe35b-4794-4eb9-8033-923247064458" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:55:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b8ed1c8d-2d53-4878-b81c-4c717c27f3d6 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "c7fbe35b-4794-4eb9-8033-923247064458" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:55:37 user nova-compute[75100]: DEBUG nova.objects.instance [None req-b8ed1c8d-2d53-4878-b81c-4c717c27f3d6 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lazy-loading 'flavor' on Instance uuid c7fbe35b-4794-4eb9-8033-923247064458 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:55:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b8ed1c8d-2d53-4878-b81c-4c717c27f3d6 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "c7fbe35b-4794-4eb9-8033-923247064458" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:55:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b8ed1c8d-2d53-4878-b81c-4c717c27f3d6 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Acquiring lock "c7fbe35b-4794-4eb9-8033-923247064458" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:55:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b8ed1c8d-2d53-4878-b81c-4c717c27f3d6 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "c7fbe35b-4794-4eb9-8033-923247064458" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:55:38 user nova-compute[75100]: INFO nova.compute.manager [None req-b8ed1c8d-2d53-4878-b81c-4c717c27f3d6 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Attaching volume 0280d371-2779-450b-9c9a-c5adde034308 to /dev/vdb
Nov 10 17:55:38 user nova-compute[75100]: DEBUG os_brick.utils [None req-b8ed1c8d-2d53-4878-b81c-4c717c27f3d6 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 17:55:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:55:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:55:38 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4167a3d3-0a9b-4a83-b22d-00b264c4175a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90b1a229568f\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:55:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:55:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:55:38 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae8d5c1-5d90-4a20-8573-febd9f7f22a7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:55:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:55:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:55:38 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3223dc61-7f9f-4030-8753-bd15ec8333e4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:55:38 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[46931cc9-ec72-4447-b30f-1bc2e8736d74]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:55:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-b8ed1c8d-2d53-4878-b81c-4c717c27f3d6 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:55:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-b8ed1c8d-2d53-4878-b81c-4c717c27f3d6 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 17:55:38 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b8ed1c8d-2d53-4878-b81c-4c717c27f3d6 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 17:55:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:55:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 17:55:38 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 17:55:38 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf5cb3c5-e2c6-4f83-868a-369990d9d5e9]: (4, '') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:55:38 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-b8ed1c8d-2d53-4878-b81c-4c717c27f3d6 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 17:55:38 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-b8ed1c8d-2d53-4878-b81c-4c717c27f3d6 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 17:55:38 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-b8ed1c8d-2d53-4878-b81c-4c717c27f3d6 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 17:55:38 user nova-compute[75100]: DEBUG os_brick.utils [None req-b8ed1c8d-2d53-4878-b81c-4c717c27f3d6 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90b1a229568f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 17:55:38 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-b8ed1c8d-2d53-4878-b81c-4c717c27f3d6 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Updating existing volume attachment record: 82d10506-1156-49ba-920f-650ea8b1ac25 {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 17:55:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:46 user nova-compute[75100]: INFO nova.compute.manager [None req-41a951a0-4990-48e3-82fd-9ed6b59cfe33 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Unrescuing
Nov 10 17:55:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-41a951a0-4990-48e3-82fd-9ed6b59cfe33 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Acquiring lock "refresh_cache-e6de4626-f097-43b7-8e56-a08415e7d74a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:55:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-41a951a0-4990-48e3-82fd-9ed6b59cfe33 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Acquired lock "refresh_cache-e6de4626-f097-43b7-8e56-a08415e7d74a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:55:46 user nova-compute[75100]: DEBUG nova.network.neutron [None req-41a951a0-4990-48e3-82fd-9ed6b59cfe33 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 17:55:47 user nova-compute[75100]: DEBUG nova.network.neutron [None req-41a951a0-4990-48e3-82fd-9ed6b59cfe33 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Updating instance_info_cache with network_info: [{"id": "d3d11e2e-7099-4c6e-aa65-53f953ce4571", "address": "fa:16:3e:86:a7:41", "network": {"id": "f240fae3-3d7b-4b6e-b04f-18550ab4d0a3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1007355777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c970a503d74d32a1e2b71f086649fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d11e2e-70", "ovs_interfaceid": "d3d11e2e-7099-4c6e-aa65-53f953ce4571", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:55:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-41a951a0-4990-48e3-82fd-9ed6b59cfe33 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Releasing lock "refresh_cache-e6de4626-f097-43b7-8e56-a08415e7d74a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:55:47 user nova-compute[75100]: DEBUG nova.objects.instance [None req-41a951a0-4990-48e3-82fd-9ed6b59cfe33 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lazy-loading 'flavor' on Instance uuid e6de4626-f097-43b7-8e56-a08415e7d74a {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:55:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:48 user nova-compute[75100]: DEBUG nova.compute.manager [req-b0eae534-95c7-42f5-b661-d62859346e88 req-cd697143-eb56-4b61-9fc9-cd8f213de516 service nova] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Received event network-vif-unplugged-d3d11e2e-7099-4c6e-aa65-53f953ce4571 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:55:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b0eae534-95c7-42f5-b661-d62859346e88 req-cd697143-eb56-4b61-9fc9-cd8f213de516 service nova] Acquiring lock "e6de4626-f097-43b7-8e56-a08415e7d74a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:55:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b0eae534-95c7-42f5-b661-d62859346e88 req-cd697143-eb56-4b61-9fc9-cd8f213de516 service nova] Lock "e6de4626-f097-43b7-8e56-a08415e7d74a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:55:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b0eae534-95c7-42f5-b661-d62859346e88 req-cd697143-eb56-4b61-9fc9-cd8f213de516 service nova] Lock "e6de4626-f097-43b7-8e56-a08415e7d74a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:55:48 user nova-compute[75100]: DEBUG nova.compute.manager [req-b0eae534-95c7-42f5-b661-d62859346e88 req-cd697143-eb56-4b61-9fc9-cd8f213de516 service nova] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] No waiting events found dispatching network-vif-unplugged-d3d11e2e-7099-4c6e-aa65-53f953ce4571 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:55:48 user nova-compute[75100]: WARNING nova.compute.manager [req-b0eae534-95c7-42f5-b661-d62859346e88 req-cd697143-eb56-4b61-9fc9-cd8f213de516 service nova] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Received unexpected event network-vif-unplugged-d3d11e2e-7099-4c6e-aa65-53f953ce4571 for instance with vm_state rescued and task_state unrescuing.
Nov 10 17:55:48 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Instance destroyed successfully.
Nov 10 17:55:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:50 user nova-compute[75100]: DEBUG nova.compute.manager [req-f2497065-3632-4771-8e6d-2b93aa88cafb req-9f60cdb8-1eab-43e4-a5fb-1a426744881d service nova] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Received event network-vif-plugged-d3d11e2e-7099-4c6e-aa65-53f953ce4571 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:55:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f2497065-3632-4771-8e6d-2b93aa88cafb req-9f60cdb8-1eab-43e4-a5fb-1a426744881d service nova] Acquiring lock "e6de4626-f097-43b7-8e56-a08415e7d74a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:55:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f2497065-3632-4771-8e6d-2b93aa88cafb req-9f60cdb8-1eab-43e4-a5fb-1a426744881d service nova] Lock "e6de4626-f097-43b7-8e56-a08415e7d74a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:55:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f2497065-3632-4771-8e6d-2b93aa88cafb req-9f60cdb8-1eab-43e4-a5fb-1a426744881d service nova] Lock "e6de4626-f097-43b7-8e56-a08415e7d74a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:55:50 user nova-compute[75100]: DEBUG nova.compute.manager [req-f2497065-3632-4771-8e6d-2b93aa88cafb req-9f60cdb8-1eab-43e4-a5fb-1a426744881d service nova] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] No waiting events found dispatching network-vif-plugged-d3d11e2e-7099-4c6e-aa65-53f953ce4571 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:55:50 user nova-compute[75100]: WARNING nova.compute.manager [req-f2497065-3632-4771-8e6d-2b93aa88cafb req-9f60cdb8-1eab-43e4-a5fb-1a426744881d service nova] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Received unexpected event network-vif-plugged-d3d11e2e-7099-4c6e-aa65-53f953ce4571 for instance with vm_state rescued and task_state unrescuing.
Nov 10 17:55:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:52 user nova-compute[75100]: DEBUG nova.compute.manager [req-8dc0ae64-5bdc-40b6-aeec-d241a539453b req-7a0c7892-1da2-4d6a-a2f7-4b1057ed3a37 service nova] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Received event network-vif-plugged-d3d11e2e-7099-4c6e-aa65-53f953ce4571 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:55:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8dc0ae64-5bdc-40b6-aeec-d241a539453b req-7a0c7892-1da2-4d6a-a2f7-4b1057ed3a37 service nova] Acquiring lock "e6de4626-f097-43b7-8e56-a08415e7d74a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:55:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8dc0ae64-5bdc-40b6-aeec-d241a539453b req-7a0c7892-1da2-4d6a-a2f7-4b1057ed3a37 service nova] Lock "e6de4626-f097-43b7-8e56-a08415e7d74a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:55:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8dc0ae64-5bdc-40b6-aeec-d241a539453b req-7a0c7892-1da2-4d6a-a2f7-4b1057ed3a37 service nova] Lock "e6de4626-f097-43b7-8e56-a08415e7d74a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:55:52 user nova-compute[75100]: DEBUG nova.compute.manager [req-8dc0ae64-5bdc-40b6-aeec-d241a539453b req-7a0c7892-1da2-4d6a-a2f7-4b1057ed3a37 service nova] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] No waiting events found dispatching network-vif-plugged-d3d11e2e-7099-4c6e-aa65-53f953ce4571 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:55:52 user nova-compute[75100]: WARNING nova.compute.manager [req-8dc0ae64-5bdc-40b6-aeec-d241a539453b req-7a0c7892-1da2-4d6a-a2f7-4b1057ed3a37 service nova] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Received unexpected event network-vif-plugged-d3d11e2e-7099-4c6e-aa65-53f953ce4571 for instance with vm_state rescued and task_state unrescuing.
Nov 10 17:55:52 user nova-compute[75100]: DEBUG nova.compute.manager [req-8dc0ae64-5bdc-40b6-aeec-d241a539453b req-7a0c7892-1da2-4d6a-a2f7-4b1057ed3a37 service nova] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Received event network-vif-plugged-d3d11e2e-7099-4c6e-aa65-53f953ce4571 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:55:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8dc0ae64-5bdc-40b6-aeec-d241a539453b req-7a0c7892-1da2-4d6a-a2f7-4b1057ed3a37 service nova] Acquiring lock "e6de4626-f097-43b7-8e56-a08415e7d74a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:55:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8dc0ae64-5bdc-40b6-aeec-d241a539453b req-7a0c7892-1da2-4d6a-a2f7-4b1057ed3a37 service nova] Lock "e6de4626-f097-43b7-8e56-a08415e7d74a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:55:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8dc0ae64-5bdc-40b6-aeec-d241a539453b req-7a0c7892-1da2-4d6a-a2f7-4b1057ed3a37 service nova] Lock "e6de4626-f097-43b7-8e56-a08415e7d74a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:55:52 user nova-compute[75100]: DEBUG nova.compute.manager [req-8dc0ae64-5bdc-40b6-aeec-d241a539453b req-7a0c7892-1da2-4d6a-a2f7-4b1057ed3a37 service nova] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] No waiting events found dispatching network-vif-plugged-d3d11e2e-7099-4c6e-aa65-53f953ce4571 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:55:52 user nova-compute[75100]: WARNING nova.compute.manager [req-8dc0ae64-5bdc-40b6-aeec-d241a539453b req-7a0c7892-1da2-4d6a-a2f7-4b1057ed3a37 service nova] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Received unexpected event network-vif-plugged-d3d11e2e-7099-4c6e-aa65-53f953ce4571 for instance with vm_state rescued and task_state unrescuing.
Nov 10 17:55:52 user nova-compute[75100]: DEBUG nova.compute.manager [None req-41a951a0-4990-48e3-82fd-9ed6b59cfe33 tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 17:55:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:54 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:54 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Acquiring lock "adf9e657-d366-4afd-a752-87e69b73eb81" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:55:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lock "adf9e657-d366-4afd-a752-87e69b73eb81" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:55:56 user nova-compute[75100]: DEBUG nova.compute.manager [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 17:55:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:55:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:55:56 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 17:55:56 user nova-compute[75100]: INFO nova.compute.claims [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Claim successful on node user
Nov 10 17:55:57 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Refreshing inventories for resource provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 17:55:57 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Updating ProviderTree inventory for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 17:55:57 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Updating inventory in ProviderTree for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 17:55:57 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Refreshing aggregate associations for resource provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64, aggregates: None {{(pid=75100) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 17:55:57 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Refreshing trait associations for resource provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2 {{(pid=75100) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 17:55:57 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:55:57 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:55:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.714s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:55:57 user nova-compute[75100]: DEBUG nova.compute.manager [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 17:55:57 user nova-compute[75100]: DEBUG nova.compute.manager [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 17:55:57 user nova-compute[75100]: DEBUG nova.network.neutron [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 17:55:57 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 17:55:57 user nova-compute[75100]: DEBUG nova.compute.manager [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 17:55:57 user nova-compute[75100]: DEBUG nova.policy [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '695874f914a149a6a432598bee57a80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27994d50bda0480f8964e687ed76805c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 17:55:57 user nova-compute[75100]: DEBUG nova.compute.manager [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 17:55:57 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 17:55:57 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Creating image(s)
Nov 10 17:55:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Acquiring lock "/opt/stack/data/nova/instances/adf9e657-d366-4afd-a752-87e69b73eb81/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:55:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lock "/opt/stack/data/nova/instances/adf9e657-d366-4afd-a752-87e69b73eb81/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:55:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lock "/opt/stack/data/nova/instances/adf9e657-d366-4afd-a752-87e69b73eb81/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:55:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:55:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.233s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:55:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Acquiring lock "818b9e28e061d41a38d903968b229be2ed9ba520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:55:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:55:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:55:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.197s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:55:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/adf9e657-d366-4afd-a752-87e69b73eb81/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:55:58 user nova-compute[75100]: DEBUG nova.network.neutron [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Port 6e9b2058-6104-4f6c-8c72-f5f15d0d116b binding to destination host user is already ACTIVE {{(pid=75100) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 10 17:55:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Acquiring lock "refresh_cache-eb430407-f836-4510-899f-a5f5d60c73f3" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:55:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Acquired lock "refresh_cache-eb430407-f836-4510-899f-a5f5d60c73f3" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:55:58 user nova-compute[75100]: DEBUG nova.network.neutron [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 17:55:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/adf9e657-d366-4afd-a752-87e69b73eb81/disk 1073741824" returned: 0 in 0.065s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:55:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:55:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:55:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.181s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:55:58 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Checking if we can resize image /opt/stack/data/nova/instances/adf9e657-d366-4afd-a752-87e69b73eb81/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 17:55:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adf9e657-d366-4afd-a752-87e69b73eb81/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:55:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adf9e657-d366-4afd-a752-87e69b73eb81/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:55:58 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Cannot resize image /opt/stack/data/nova/instances/adf9e657-d366-4afd-a752-87e69b73eb81/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 17:55:58 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 17:55:58 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Ensure instance console log exists: /opt/stack/data/nova/instances/adf9e657-d366-4afd-a752-87e69b73eb81/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 17:55:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:55:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:55:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:55:59 user nova-compute[75100]: DEBUG nova.network.neutron [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Successfully created port: aaf05601-502a-464f-b119-d4fcc50001ab {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 17:55:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:59 user nova-compute[75100]: DEBUG nova.network.neutron [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Updating instance_info_cache with network_info: [{"id": "6e9b2058-6104-4f6c-8c72-f5f15d0d116b", "address": "fa:16:3e:2f:11:f6", "network": {"id": "f67bc940-2f01-4255-b12e-427ffcd7e4e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-977195248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e95560897fb46258db0ecd7dc7b9294", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9b2058-61", "ovs_interfaceid": "6e9b2058-6104-4f6c-8c72-f5f15d0d116b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:55:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Releasing lock "refresh_cache-eb430407-f836-4510-899f-a5f5d60c73f3" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:55:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Creating tmpfile /opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3/tmpoali5pl8 to verify with other compute node that the instance is on the same shared storage. {{(pid=75100) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 10 17:55:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:55:59 user nova-compute[75100]: DEBUG nova.network.neutron [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Successfully updated port: aaf05601-502a-464f-b119-d4fcc50001ab {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Acquiring lock "refresh_cache-adf9e657-d366-4afd-a752-87e69b73eb81" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Acquired lock "refresh_cache-adf9e657-d366-4afd-a752-87e69b73eb81" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG nova.network.neutron [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG nova.compute.manager [req-99c30c85-ef0c-4929-b56f-93adcf88060c req-1ab0e119-fc2d-43f4-9708-9a5a8c47a5b9 service nova] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Received event network-changed-aaf05601-502a-464f-b119-d4fcc50001ab {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG nova.compute.manager [req-99c30c85-ef0c-4929-b56f-93adcf88060c req-1ab0e119-fc2d-43f4-9708-9a5a8c47a5b9 service nova] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Refreshing instance network info cache due to event network-changed-aaf05601-502a-464f-b119-d4fcc50001ab. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-99c30c85-ef0c-4929-b56f-93adcf88060c req-1ab0e119-fc2d-43f4-9708-9a5a8c47a5b9 service nova] Acquiring lock "refresh_cache-adf9e657-d366-4afd-a752-87e69b73eb81" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG nova.network.neutron [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 17:56:00 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Instance destroyed successfully.
Nov 10 17:56:00 user nova-compute[75100]: DEBUG nova.objects.instance [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Lazy-loading 'resources' on Instance uuid eb430407-f836-4510-899f-a5f5d60c73f3 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:49:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1267762012',display_name='tempest-ServerActionsTestOtherB-server-1267762012',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1267762012',id=16,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDPSiJ0FfbNgNhKoheve47DT1uQV1oaC9CdV5NhlB12KyXHFwXlJCN0xOr09naWU21Nb1dG7o7w/ZzPU0YohVQI5ip5k2vJ5Db3SiA/LtLwk+OdOmsxEc+IoKJ74LTBECw==',key_name='tempest-keypair-1684715830',keypairs=<?>,launch_index=0,launched_at=2023-11-10T17:54:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e95560897fb46258db0ecd7dc7b9294',ramdisk_id='',reservation_id='r-55f5hxbc',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1027676823',owner_user_name='tempest-ServerActionsTestOtherB-1027676823-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T17:54:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da45741ccb5d4b00a0784d7ef9063243',uuid=eb430407-f836-4510-899f-a5f5d60c73f3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "6e9b2058-6104-4f6c-8c72-f5f15d0d116b", "address": "fa:16:3e:2f:11:f6", "network": {"id": "f67bc940-2f01-4255-b12e-427ffcd7e4e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-977195248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e95560897fb46258db0ecd7dc7b9294", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9b2058-61", "ovs_interfaceid": "6e9b2058-6104-4f6c-8c72-f5f15d0d116b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Converting VIF {"id": "6e9b2058-6104-4f6c-8c72-f5f15d0d116b", "address": "fa:16:3e:2f:11:f6", "network": {"id": "f67bc940-2f01-4255-b12e-427ffcd7e4e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-977195248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e95560897fb46258db0ecd7dc7b9294", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9b2058-61", "ovs_interfaceid": "6e9b2058-6104-4f6c-8c72-f5f15d0d116b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:11:f6,bridge_name='br-int',has_traffic_filtering=True,id=6e9b2058-6104-4f6c-8c72-f5f15d0d116b,network=Network(f67bc940-2f01-4255-b12e-427ffcd7e4e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e9b2058-61') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG os_vif [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:11:f6,bridge_name='br-int',has_traffic_filtering=True,id=6e9b2058-6104-4f6c-8c72-f5f15d0d116b,network=Network(f67bc940-2f01-4255-b12e-427ffcd7e4e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e9b2058-61') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6e9b2058-61, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a612315b-41fb-49c9-892d-6580075df499) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:56:00 user nova-compute[75100]: INFO os_vif [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:11:f6,bridge_name='br-int',has_traffic_filtering=True,id=6e9b2058-6104-4f6c-8c72-f5f15d0d116b,network=Network(f67bc940-2f01-4255-b12e-427ffcd7e4e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e9b2058-61')
Nov 10 17:56:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, {'target_iqn': 'iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xESYIPuD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 17:56:00 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 17:56:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e52fd0-80a1-4f03-84c2-a3dd0a5ceb84]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 17:56:00 user nova-compute[75100]: No targets found.
Nov 10 17:56:00 user nova-compute[75100]: iSNS:
Nov 10 17:56:00 user nova-compute[75100]: No targets found.
Nov 10 17:56:00 user nova-compute[75100]: STATIC:
Nov 10 17:56:00 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c
Nov 10 17:56:00 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 17:56:00 user nova-compute[75100]:                 Iface Name: default
Nov 10 17:56:00 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54
Nov 10 17:56:00 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 17:56:00 user nova-compute[75100]:                 Iface Name: default
Nov 10 17:56:00 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652
Nov 10 17:56:00 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 17:56:00 user nova-compute[75100]:                 Iface Name: default
Nov 10 17:56:00 user nova-compute[75100]: FIRMWARE:
Nov 10 17:56:00 user nova-compute[75100]: No targets found.
Nov 10 17:56:00 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 17:56:00 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 17:56:00 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc573997-0a5b-471e-856e-4796cd3b8314]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eaf8ae5-68d8-4f62-81ff-209084133d68]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)
Nov 10 17:56:00 user nova-compute[75100]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c (non-flash)
Nov 10 17:56:00 user nova-compute[75100]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)
Nov 10 17:56:00 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)
Nov 10 17:56:00 user nova-compute[75100]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c (non-flash)
Nov 10 17:56:00 user nova-compute[75100]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)
Nov 10 17:56:00 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3d4257490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c'): ({'sdc'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Removing single pathed devices sdc {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ed4c85-c5a4-44b5-8afe-37d655eadad5]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4992c7fb-851d-4da4-8628-5c9d63109070]: (4, ('ok\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Flushing IO for device /dev/sdc {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d4c74c-265e-45c1-a879-2b8c1abf2222]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG nova.network.neutron [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Updating instance_info_cache with network_info: [{"id": "aaf05601-502a-464f-b119-d4fcc50001ab", "address": "fa:16:3e:12:d5:10", "network": {"id": "fa38ae2b-75a1-4312-9b92-462a4240d792", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-822691382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27994d50bda0480f8964e687ed76805c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaf05601-50", "ovs_interfaceid": "aaf05601-502a-464f-b119-d4fcc50001ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Releasing lock "refresh_cache-adf9e657-d366-4afd-a752-87e69b73eb81" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG nova.compute.manager [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Instance network_info: |[{"id": "aaf05601-502a-464f-b119-d4fcc50001ab", "address": "fa:16:3e:12:d5:10", "network": {"id": "fa38ae2b-75a1-4312-9b92-462a4240d792", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-822691382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27994d50bda0480f8964e687ed76805c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaf05601-50", "ovs_interfaceid": "aaf05601-502a-464f-b119-d4fcc50001ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-99c30c85-ef0c-4929-b56f-93adcf88060c req-1ab0e119-fc2d-43f4-9708-9a5a8c47a5b9 service nova] Acquired lock "refresh_cache-adf9e657-d366-4afd-a752-87e69b73eb81" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG nova.network.neutron [req-99c30c85-ef0c-4929-b56f-93adcf88060c req-1ab0e119-fc2d-43f4-9708-9a5a8c47a5b9 service nova] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Refreshing network info cache for port aaf05601-502a-464f-b119-d4fcc50001ab {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Start _get_guest_xml network_info=[{"id": "aaf05601-502a-464f-b119-d4fcc50001ab", "address": "fa:16:3e:12:d5:10", "network": {"id": "fa38ae2b-75a1-4312-9b92-462a4240d792", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-822691382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27994d50bda0480f8964e687ed76805c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaf05601-50", "ovs_interfaceid": "aaf05601-502a-464f-b119-d4fcc50001ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'e3cc5321-4d40-49ee-885c-700e14741732'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c7a19f-a0d3-4230-990d-d20c14d67ef6]: (4, ('1', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] SCSI volumes sdc have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:00 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:56:00 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:56:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7550182a-812d-4121-87cc-0baf674e6d4c]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c -p 172.16.0.220:3260 --logout {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T17:40:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:55:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-767812613',display_name='tempest-VolumesSnapshotTestJSON-instance-767812613',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-767812613',id=26,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJktL9PPom+6SpnCH7GZeZrfHv8U/OnCAaR5TBVvosTDmmCSY2dR/eQ8fHnYglw8HArx9/9KkGgig6TS7Xfht9K64LstpKiYENOoiggQdlrijsIsbgODO/4VWW4nO5dJmQ==',key_name='tempest-keypair-1888131039',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27994d50bda0480f8964e687ed76805c',ramdisk_id='',reservation_id='r-rjj4okoh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1608810188',owner_user_name='tempest-VolumesSnapshotTestJSON-1608810188-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:55:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='695874f914a149a6a432598bee57a80e',uuid=adf9e657-d366-4afd-a752-87e69b73eb81,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aaf05601-502a-464f-b119-d4fcc50001ab", "address": "fa:16:3e:12:d5:10", "network": {"id": "fa38ae2b-75a1-4312-9b92-462a4240d792", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-822691382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27994d50bda0480f8964e687ed76805c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaf05601-50", "ovs_interfaceid": "aaf05601-502a-464f-b119-d4fcc50001ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Converting VIF {"id": "aaf05601-502a-464f-b119-d4fcc50001ab", "address": "fa:16:3e:12:d5:10", "network": {"id": "fa38ae2b-75a1-4312-9b92-462a4240d792", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-822691382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27994d50bda0480f8964e687ed76805c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaf05601-50", "ovs_interfaceid": "aaf05601-502a-464f-b119-d4fcc50001ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:d5:10,bridge_name='br-int',has_traffic_filtering=True,id=aaf05601-502a-464f-b119-d4fcc50001ab,network=Network(fa38ae2b-75a1-4312-9b92-462a4240d792),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaaf05601-50') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG nova.objects.instance [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lazy-loading 'pci_devices' on Instance uuid adf9e657-d366-4afd-a752-87e69b73eb81 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e047a553-5afa-4625-80e9-72674c09538a]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] End _get_guest_xml xml=<domain type="kvm">
Nov 10 17:56:00 user nova-compute[75100]:   <uuid>adf9e657-d366-4afd-a752-87e69b73eb81</uuid>
Nov 10 17:56:00 user nova-compute[75100]:   <name>instance-0000001a</name>
Nov 10 17:56:00 user nova-compute[75100]:   <memory>524288</memory>
Nov 10 17:56:00 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 10 17:56:00 user nova-compute[75100]:   <metadata>
Nov 10 17:56:00 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 17:56:00 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 10 17:56:00 user nova-compute[75100]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-767812613</nova:name>
Nov 10 17:56:00 user nova-compute[75100]:       <nova:creationTime>2023-11-10 17:56:00</nova:creationTime>
Nov 10 17:56:00 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 10 17:56:00 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 10 17:56:00 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 10 17:56:00 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 10 17:56:00 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 17:56:00 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 10 17:56:00 user nova-compute[75100]:       </nova:flavor>
Nov 10 17:56:00 user nova-compute[75100]:       <nova:owner>
Nov 10 17:56:00 user nova-compute[75100]:         <nova:user uuid="695874f914a149a6a432598bee57a80e">tempest-VolumesSnapshotTestJSON-1608810188-project-member</nova:user>
Nov 10 17:56:00 user nova-compute[75100]:         <nova:project uuid="27994d50bda0480f8964e687ed76805c">tempest-VolumesSnapshotTestJSON-1608810188</nova:project>
Nov 10 17:56:00 user nova-compute[75100]:       </nova:owner>
Nov 10 17:56:00 user nova-compute[75100]:       <nova:root type="image" uuid="e3cc5321-4d40-49ee-885c-700e14741732"/>
Nov 10 17:56:00 user nova-compute[75100]:       <nova:ports>
Nov 10 17:56:00 user nova-compute[75100]:         <nova:port uuid="aaf05601-502a-464f-b119-d4fcc50001ab">
Nov 10 17:56:00 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 10 17:56:00 user nova-compute[75100]:         </nova:port>
Nov 10 17:56:00 user nova-compute[75100]:       </nova:ports>
Nov 10 17:56:00 user nova-compute[75100]:     </nova:instance>
Nov 10 17:56:00 user nova-compute[75100]:   </metadata>
Nov 10 17:56:00 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 10 17:56:00 user nova-compute[75100]:     <system>
Nov 10 17:56:00 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 17:56:00 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 10 17:56:00 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 10 17:56:00 user nova-compute[75100]:       <entry name="serial">adf9e657-d366-4afd-a752-87e69b73eb81</entry>
Nov 10 17:56:00 user nova-compute[75100]:       <entry name="uuid">adf9e657-d366-4afd-a752-87e69b73eb81</entry>
Nov 10 17:56:00 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 10 17:56:00 user nova-compute[75100]:     </system>
Nov 10 17:56:00 user nova-compute[75100]:   </sysinfo>
Nov 10 17:56:00 user nova-compute[75100]:   <os>
Nov 10 17:56:00 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 17:56:00 user nova-compute[75100]:     <boot dev="hd"/>
Nov 10 17:56:00 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 10 17:56:00 user nova-compute[75100]:   </os>
Nov 10 17:56:00 user nova-compute[75100]:   <features>
Nov 10 17:56:00 user nova-compute[75100]:     <acpi/>
Nov 10 17:56:00 user nova-compute[75100]:     <apic/>
Nov 10 17:56:00 user nova-compute[75100]:     <vmcoreinfo/>
Nov 10 17:56:00 user nova-compute[75100]:   </features>
Nov 10 17:56:00 user nova-compute[75100]:   <clock offset="utc">
Nov 10 17:56:00 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 17:56:00 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 17:56:00 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 10 17:56:00 user nova-compute[75100]:   </clock>
Nov 10 17:56:00 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 10 17:56:00 user nova-compute[75100]:     <model>Nehalem</model>
Nov 10 17:56:00 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 17:56:00 user nova-compute[75100]:   </cpu>
Nov 10 17:56:00 user nova-compute[75100]:   <devices>
Nov 10 17:56:00 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 10 17:56:00 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 17:56:00 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/adf9e657-d366-4afd-a752-87e69b73eb81/disk"/>
Nov 10 17:56:00 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 10 17:56:00 user nova-compute[75100]:     </disk>
Nov 10 17:56:00 user nova-compute[75100]:     <interface type="ethernet">
Nov 10 17:56:00 user nova-compute[75100]:       <mac address="fa:16:3e:12:d5:10"/>
Nov 10 17:56:00 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:56:00 user nova-compute[75100]:       <mtu size="1442"/>
Nov 10 17:56:00 user nova-compute[75100]:       <target dev="tapaaf05601-50"/>
Nov 10 17:56:00 user nova-compute[75100]:     </interface>
Nov 10 17:56:00 user nova-compute[75100]:     <serial type="pty">
Nov 10 17:56:00 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/adf9e657-d366-4afd-a752-87e69b73eb81/console.log" append="off"/>
Nov 10 17:56:00 user nova-compute[75100]:     </serial>
Nov 10 17:56:00 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 17:56:00 user nova-compute[75100]:     <video>
Nov 10 17:56:00 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:56:00 user nova-compute[75100]:     </video>
Nov 10 17:56:00 user nova-compute[75100]:     <rng model="virtio">
Nov 10 17:56:00 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 10 17:56:00 user nova-compute[75100]:     </rng>
Nov 10 17:56:00 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 10 17:56:00 user nova-compute[75100]:     <memballoon model="virtio">
Nov 10 17:56:00 user nova-compute[75100]:       <stats period="10"/>
Nov 10 17:56:00 user nova-compute[75100]:     </memballoon>
Nov 10 17:56:00 user nova-compute[75100]:   </devices>
Nov 10 17:56:00 user nova-compute[75100]: </domain>
Nov 10 17:56:00 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:55:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-767812613',display_name='tempest-VolumesSnapshotTestJSON-instance-767812613',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-767812613',id=26,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJktL9PPom+6SpnCH7GZeZrfHv8U/OnCAaR5TBVvosTDmmCSY2dR/eQ8fHnYglw8HArx9/9KkGgig6TS7Xfht9K64LstpKiYENOoiggQdlrijsIsbgODO/4VWW4nO5dJmQ==',key_name='tempest-keypair-1888131039',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27994d50bda0480f8964e687ed76805c',ramdisk_id='',reservation_id='r-rjj4okoh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1608810188',owner_user_name='tempest-VolumesSnapshotTestJSON-1608810188-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:55:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='695874f914a149a6a432598bee57a80e',uuid=adf9e657-d366-4afd-a752-87e69b73eb81,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aaf05601-502a-464f-b119-d4fcc50001ab", "address": "fa:16:3e:12:d5:10", "network": {"id": "fa38ae2b-75a1-4312-9b92-462a4240d792", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-822691382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27994d50bda0480f8964e687ed76805c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaf05601-50", "ovs_interfaceid": "aaf05601-502a-464f-b119-d4fcc50001ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Converting VIF {"id": "aaf05601-502a-464f-b119-d4fcc50001ab", "address": "fa:16:3e:12:d5:10", "network": {"id": "fa38ae2b-75a1-4312-9b92-462a4240d792", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-822691382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27994d50bda0480f8964e687ed76805c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaf05601-50", "ovs_interfaceid": "aaf05601-502a-464f-b119-d4fcc50001ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:d5:10,bridge_name='br-int',has_traffic_filtering=True,id=aaf05601-502a-464f-b119-d4fcc50001ab,network=Network(fa38ae2b-75a1-4312-9b92-462a4240d792),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaaf05601-50') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG os_vif [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:d5:10,bridge_name='br-int',has_traffic_filtering=True,id=aaf05601-502a-464f-b119-d4fcc50001ab,network=Network(fa38ae2b-75a1-4312-9b92-462a4240d792),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaaf05601-50') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c, portal: 172.16.0.220,3260]
Nov 10 17:56:00 user nova-compute[75100]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c, portal: 172.16.0.220,3260] successful.
Nov 10 17:56:00 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6b139fd0-b398-541c-906e-741f2032952c', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c -p 172.16.0.220:3260 --op delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaaf05601-50, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaaf05601-50, col_values=(('qos', UUID('0fe6d9ee-eb5b-4bef-8e23-d549b64d3c7e')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaaf05601-50, col_values=(('external_ids', {'iface-id': 'aaf05601-502a-464f-b119-d4fcc50001ab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:d5:10', 'vm-uuid': 'adf9e657-d366-4afd-a752-87e69b73eb81'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f2aad9-754b-46fe-bd0c-afb39a2448d1]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.429s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] <== disconnect_volume: return (431ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:00 user nova-compute[75100]: INFO os_vif [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:d5:10,bridge_name='br-int',has_traffic_filtering=True,id=aaf05601-502a-464f-b119-d4fcc50001ab,network=Network(fa38ae2b-75a1-4312-9b92-462a4240d792),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaaf05601-50')
Nov 10 17:56:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 17:56:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] No VIF found with MAC fa:16:3e:12:d5:10, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 17:56:01 user nova-compute[75100]: DEBUG nova.network.neutron [req-99c30c85-ef0c-4929-b56f-93adcf88060c req-1ab0e119-fc2d-43f4-9708-9a5a8c47a5b9 service nova] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Updated VIF entry in instance network info cache for port aaf05601-502a-464f-b119-d4fcc50001ab. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 17:56:01 user nova-compute[75100]: DEBUG nova.network.neutron [req-99c30c85-ef0c-4929-b56f-93adcf88060c req-1ab0e119-fc2d-43f4-9708-9a5a8c47a5b9 service nova] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Updating instance_info_cache with network_info: [{"id": "aaf05601-502a-464f-b119-d4fcc50001ab", "address": "fa:16:3e:12:d5:10", "network": {"id": "fa38ae2b-75a1-4312-9b92-462a4240d792", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-822691382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27994d50bda0480f8964e687ed76805c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaf05601-50", "ovs_interfaceid": "aaf05601-502a-464f-b119-d4fcc50001ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:56:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-99c30c85-ef0c-4929-b56f-93adcf88060c req-1ab0e119-fc2d-43f4-9708-9a5a8c47a5b9 service nova] Releasing lock "refresh_cache-adf9e657-d366-4afd-a752-87e69b73eb81" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:56:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:56:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:56:02 user nova-compute[75100]: DEBUG nova.objects.instance [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Lazy-loading 'migration_context' on Instance uuid eb430407-f836-4510-899f-a5f5d60c73f3 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:56:02 user nova-compute[75100]: DEBUG nova.objects.base [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Object Instance<eb430407-f836-4510-899f-a5f5d60c73f3> lazy-loaded attributes: resources,migration_context {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 17:56:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:02 user nova-compute[75100]: DEBUG nova.compute.manager [req-eef19d2c-c1d6-429a-81b7-1a230f6744b1 req-209acb6d-9e9a-49b4-97ed-72b1f542ae76 service nova] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Received event network-vif-unplugged-6e9b2058-6104-4f6c-8c72-f5f15d0d116b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:56:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-eef19d2c-c1d6-429a-81b7-1a230f6744b1 req-209acb6d-9e9a-49b4-97ed-72b1f542ae76 service nova] Acquiring lock "eb430407-f836-4510-899f-a5f5d60c73f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:56:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-eef19d2c-c1d6-429a-81b7-1a230f6744b1 req-209acb6d-9e9a-49b4-97ed-72b1f542ae76 service nova] Lock "eb430407-f836-4510-899f-a5f5d60c73f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:56:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-eef19d2c-c1d6-429a-81b7-1a230f6744b1 req-209acb6d-9e9a-49b4-97ed-72b1f542ae76 service nova] Lock "eb430407-f836-4510-899f-a5f5d60c73f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:56:02 user nova-compute[75100]: DEBUG nova.compute.manager [req-eef19d2c-c1d6-429a-81b7-1a230f6744b1 req-209acb6d-9e9a-49b4-97ed-72b1f542ae76 service nova] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] No waiting events found dispatching network-vif-unplugged-6e9b2058-6104-4f6c-8c72-f5f15d0d116b {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:56:02 user nova-compute[75100]: WARNING nova.compute.manager [req-eef19d2c-c1d6-429a-81b7-1a230f6744b1 req-209acb6d-9e9a-49b4-97ed-72b1f542ae76 service nova] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Received unexpected event network-vif-unplugged-6e9b2058-6104-4f6c-8c72-f5f15d0d116b for instance with vm_state resized and task_state resize_reverting.
Nov 10 17:56:02 user nova-compute[75100]: DEBUG nova.compute.manager [req-f1be0d7f-c6f5-4646-84d4-3ea7e6f002ad req-22f3c84a-62fd-4964-948c-c1d47a0a92a9 service nova] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Received event network-vif-plugged-aaf05601-502a-464f-b119-d4fcc50001ab {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:56:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f1be0d7f-c6f5-4646-84d4-3ea7e6f002ad req-22f3c84a-62fd-4964-948c-c1d47a0a92a9 service nova] Acquiring lock "adf9e657-d366-4afd-a752-87e69b73eb81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:56:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f1be0d7f-c6f5-4646-84d4-3ea7e6f002ad req-22f3c84a-62fd-4964-948c-c1d47a0a92a9 service nova] Lock "adf9e657-d366-4afd-a752-87e69b73eb81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:56:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f1be0d7f-c6f5-4646-84d4-3ea7e6f002ad req-22f3c84a-62fd-4964-948c-c1d47a0a92a9 service nova] Lock "adf9e657-d366-4afd-a752-87e69b73eb81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:56:02 user nova-compute[75100]: DEBUG nova.compute.manager [req-f1be0d7f-c6f5-4646-84d4-3ea7e6f002ad req-22f3c84a-62fd-4964-948c-c1d47a0a92a9 service nova] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] No waiting events found dispatching network-vif-plugged-aaf05601-502a-464f-b119-d4fcc50001ab {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:56:02 user nova-compute[75100]: WARNING nova.compute.manager [req-f1be0d7f-c6f5-4646-84d4-3ea7e6f002ad req-22f3c84a-62fd-4964-948c-c1d47a0a92a9 service nova] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Received unexpected event network-vif-plugged-aaf05601-502a-464f-b119-d4fcc50001ab for instance with vm_state building and task_state spawning.
Nov 10 17:56:02 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:56:02 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:56:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.745s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:56:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:02 user nova-compute[75100]: INFO nova.compute.manager [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Swapping old allocation on dict_keys(['54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64']) held by migration 819b8490-d7be-448c-a56b-19060b11a2f1 for instance
Nov 10 17:56:03 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Overwriting current allocation {'allocations': {'54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 30}}, 'project_id': '1e95560897fb46258db0ecd7dc7b9294', 'user_id': 'da45741ccb5d4b00a0784d7ef9063243', 'consumer_generation': 1} on consumer eb430407-f836-4510-899f-a5f5d60c73f3 {{(pid=75100) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 10 17:56:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Acquiring lock "refresh_cache-eb430407-f836-4510-899f-a5f5d60c73f3" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:56:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Acquired lock "refresh_cache-eb430407-f836-4510-899f-a5f5d60c73f3" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:56:03 user nova-compute[75100]: DEBUG nova.network.neutron [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 17:56:03 user nova-compute[75100]: DEBUG nova.network.neutron [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Updating instance_info_cache with network_info: [{"id": "6e9b2058-6104-4f6c-8c72-f5f15d0d116b", "address": "fa:16:3e:2f:11:f6", "network": {"id": "f67bc940-2f01-4255-b12e-427ffcd7e4e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-977195248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e95560897fb46258db0ecd7dc7b9294", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9b2058-61", "ovs_interfaceid": "6e9b2058-6104-4f6c-8c72-f5f15d0d116b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:56:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Releasing lock "refresh_cache-eb430407-f836-4510-899f-a5f5d60c73f3" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:56:03 user nova-compute[75100]: DEBUG os_brick.utils [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 17:56:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:03 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e268da3-f032-4ad6-8ef1-839bde1dbb54]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90b1a229568f\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:03 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9234b13c-127d-4a8b-b513-7df4afea7681]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:03 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4478404-cb3a-44ed-885a-b56fb3dd0094]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:03 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[291a59a3-3f43-4211-a7f0-03967cd28330]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 17:56:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 17:56:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 17:56:03 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 17:56:03 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cda9c8d-56c2-4ba7-9758-c279603cf0fb]: (4, '') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 17:56:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 17:56:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 17:56:03 user nova-compute[75100]: DEBUG os_brick.utils [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90b1a229568f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 17:56:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:04 user nova-compute[75100]: DEBUG nova.compute.manager [req-65238efa-ed49-4369-8157-25ff4763760a req-343c41ba-b825-40da-8ea0-2ec1880046c6 service nova] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Received event network-vif-plugged-6e9b2058-6104-4f6c-8c72-f5f15d0d116b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:56:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-65238efa-ed49-4369-8157-25ff4763760a req-343c41ba-b825-40da-8ea0-2ec1880046c6 service nova] Acquiring lock "eb430407-f836-4510-899f-a5f5d60c73f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:56:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-65238efa-ed49-4369-8157-25ff4763760a req-343c41ba-b825-40da-8ea0-2ec1880046c6 service nova] Lock "eb430407-f836-4510-899f-a5f5d60c73f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:56:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-65238efa-ed49-4369-8157-25ff4763760a req-343c41ba-b825-40da-8ea0-2ec1880046c6 service nova] Lock "eb430407-f836-4510-899f-a5f5d60c73f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:56:04 user nova-compute[75100]: DEBUG nova.compute.manager [req-65238efa-ed49-4369-8157-25ff4763760a req-343c41ba-b825-40da-8ea0-2ec1880046c6 service nova] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] No waiting events found dispatching network-vif-plugged-6e9b2058-6104-4f6c-8c72-f5f15d0d116b {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:56:04 user nova-compute[75100]: WARNING nova.compute.manager [req-65238efa-ed49-4369-8157-25ff4763760a req-343c41ba-b825-40da-8ea0-2ec1880046c6 service nova] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Received unexpected event network-vif-plugged-6e9b2058-6104-4f6c-8c72-f5f15d0d116b for instance with vm_state resized and task_state resize_reverting.
Nov 10 17:56:04 user nova-compute[75100]: DEBUG nova.compute.manager [req-4dfe72af-205d-4b83-b0c2-272417381081 req-e4b380eb-59e8-4482-85d3-0d1189eb4a6e service nova] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Received event network-vif-plugged-aaf05601-502a-464f-b119-d4fcc50001ab {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:56:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4dfe72af-205d-4b83-b0c2-272417381081 req-e4b380eb-59e8-4482-85d3-0d1189eb4a6e service nova] Acquiring lock "adf9e657-d366-4afd-a752-87e69b73eb81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:56:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4dfe72af-205d-4b83-b0c2-272417381081 req-e4b380eb-59e8-4482-85d3-0d1189eb4a6e service nova] Lock "adf9e657-d366-4afd-a752-87e69b73eb81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:56:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4dfe72af-205d-4b83-b0c2-272417381081 req-e4b380eb-59e8-4482-85d3-0d1189eb4a6e service nova] Lock "adf9e657-d366-4afd-a752-87e69b73eb81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:56:04 user nova-compute[75100]: DEBUG nova.compute.manager [req-4dfe72af-205d-4b83-b0c2-272417381081 req-e4b380eb-59e8-4482-85d3-0d1189eb4a6e service nova] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] No waiting events found dispatching network-vif-plugged-aaf05601-502a-464f-b119-d4fcc50001ab {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:56:04 user nova-compute[75100]: WARNING nova.compute.manager [req-4dfe72af-205d-4b83-b0c2-272417381081 req-e4b380eb-59e8-4482-85d3-0d1189eb4a6e service nova] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Received unexpected event network-vif-plugged-aaf05601-502a-464f-b119-d4fcc50001ab for instance with vm_state building and task_state spawning.
Nov 10 17:56:04 user nova-compute[75100]: DEBUG nova.compute.manager [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 17:56:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 17:56:04 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Instance spawned successfully.
Nov 10 17:56:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 17:56:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:56:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:56:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:56:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:56:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:56:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:56:04 user nova-compute[75100]: INFO nova.compute.manager [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Took 7.02 seconds to spawn the instance on the hypervisor.
Nov 10 17:56:04 user nova-compute[75100]: DEBUG nova.compute.manager [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 17:56:05 user nova-compute[75100]: INFO nova.compute.manager [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Took 8.24 seconds to build instance.
Nov 10 17:56:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-528d2297-6b55-4bbd-b49f-252aae9e8b23 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lock "adf9e657-d366-4afd-a752-87e69b73eb81" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.337s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:56:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Acquiring lock "6d227210-c4df-4aa7-9969-70fa137aeb63" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:56:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "6d227210-c4df-4aa7-9969-70fa137aeb63" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:56:05 user nova-compute[75100]: DEBUG nova.compute.manager [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 17:56:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:56:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:56:05 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 17:56:05 user nova-compute[75100]: INFO nova.compute.claims [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Claim successful on node user
Nov 10 17:56:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:06 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:56:06 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:56:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.703s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:56:06 user nova-compute[75100]: DEBUG nova.compute.manager [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 17:56:06 user nova-compute[75100]: DEBUG nova.compute.manager [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 17:56:06 user nova-compute[75100]: DEBUG nova.network.neutron [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 17:56:06 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 17:56:06 user nova-compute[75100]: DEBUG nova.compute.manager [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 17:56:06 user nova-compute[75100]: DEBUG nova.policy [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '323c5738ca424a379f666b4ca60825ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd441a46aa4a579feff608d6ff9bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 17:56:06 user nova-compute[75100]: INFO nova.virt.block_device [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Booting with volume e6c2e35c-41f9-4c5b-92da-f29547ae8b00 at /dev/vda
Nov 10 17:56:06 user nova-compute[75100]: DEBUG os_brick.utils [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 17:56:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:06 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[095448da-0e0b-44b7-8a49-393d1c80e99b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90b1a229568f\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:06 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a937b9-6cc6-4418-b0c0-ce95e6668b4f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:06 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61c441d-65ef-4ded-958f-0ba5996a0de5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:06 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee8a4c2-7958-4b3c-93b2-9ddf31961c47]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 17:56:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 17:56:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 17:56:06 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 17:56:06 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd8302c-cd1a-4552-9a9e-8cad34548033]: (4, '') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 17:56:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 17:56:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 17:56:06 user nova-compute[75100]: DEBUG os_brick.utils [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90b1a229568f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 17:56:06 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Updating existing volume attachment record: c0d9201b-4229-4c42-ae66-54ba8ffccbec {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 17:56:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Acquiring lock "ca2f4288-da43-4bf3-9ef4-fd53961fe74c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:56:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "ca2f4288-da43-4bf3-9ef4-fd53961fe74c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:56:07 user nova-compute[75100]: DEBUG nova.network.neutron [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Successfully created port: 230f2661-361c-4699-8dbc-fac4fbc6b612 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 17:56:07 user nova-compute[75100]: DEBUG nova.compute.manager [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 17:56:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:56:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:56:07 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 17:56:07 user nova-compute[75100]: INFO nova.compute.claims [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Claim successful on node user
Nov 10 17:56:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Acquiring lock "61e73913-30a5-4eaa-9bc0-6e17a0288035" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:56:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "61e73913-30a5-4eaa-9bc0-6e17a0288035" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:56:07 user nova-compute[75100]: INFO nova.compute.manager [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Unshelving
Nov 10 17:56:07 user nova-compute[75100]: INFO nova.virt.block_device [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Booting with volume 6ccb0564-db0c-4906-ba81-08ec9b05c5a7 at /dev/vdc
Nov 10 17:56:07 user nova-compute[75100]: DEBUG nova.network.neutron [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Successfully updated port: 230f2661-361c-4699-8dbc-fac4fbc6b612 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 17:56:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Acquiring lock "refresh_cache-6d227210-c4df-4aa7-9969-70fa137aeb63" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:56:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Acquired lock "refresh_cache-6d227210-c4df-4aa7-9969-70fa137aeb63" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:56:07 user nova-compute[75100]: DEBUG nova.network.neutron [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 17:56:07 user nova-compute[75100]: DEBUG nova.compute.manager [req-47784ab7-1b4f-467c-ba9c-d861585883a6 req-350d5c30-a7a0-4033-bfb0-aec81b45fea0 service nova] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Received event network-changed-230f2661-361c-4699-8dbc-fac4fbc6b612 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:56:07 user nova-compute[75100]: DEBUG nova.compute.manager [req-47784ab7-1b4f-467c-ba9c-d861585883a6 req-350d5c30-a7a0-4033-bfb0-aec81b45fea0 service nova] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Refreshing instance network info cache due to event network-changed-230f2661-361c-4699-8dbc-fac4fbc6b612. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 17:56:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-47784ab7-1b4f-467c-ba9c-d861585883a6 req-350d5c30-a7a0-4033-bfb0-aec81b45fea0 service nova] Acquiring lock "refresh_cache-6d227210-c4df-4aa7-9969-70fa137aeb63" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:56:07 user nova-compute[75100]: DEBUG nova.network.neutron [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 17:56:08 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:56:08 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:56:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.769s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:56:08 user nova-compute[75100]: DEBUG nova.compute.manager [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 17:56:08 user nova-compute[75100]: DEBUG nova.compute.manager [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 17:56:08 user nova-compute[75100]: DEBUG nova.network.neutron [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 17:56:08 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 17:56:08 user nova-compute[75100]: DEBUG nova.compute.manager [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 17:56:08 user nova-compute[75100]: DEBUG nova.policy [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4d873ec5a11a4ccdb868fef673ffc568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19cfb454e59745bf9c77d7a7ede2bc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 17:56:08 user nova-compute[75100]: DEBUG nova.network.neutron [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Updating instance_info_cache with network_info: [{"id": "230f2661-361c-4699-8dbc-fac4fbc6b612", "address": "fa:16:3e:9d:d1:eb", "network": {"id": "2a85480b-f67d-4ef1-b967-3e93af57d7c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1717495768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9cd441a46aa4a579feff608d6ff9bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap230f2661-36", "ovs_interfaceid": "230f2661-361c-4699-8dbc-fac4fbc6b612", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:56:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Releasing lock "refresh_cache-6d227210-c4df-4aa7-9969-70fa137aeb63" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:56:08 user nova-compute[75100]: DEBUG nova.compute.manager [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Instance network_info: |[{"id": "230f2661-361c-4699-8dbc-fac4fbc6b612", "address": "fa:16:3e:9d:d1:eb", "network": {"id": "2a85480b-f67d-4ef1-b967-3e93af57d7c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1717495768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9cd441a46aa4a579feff608d6ff9bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap230f2661-36", "ovs_interfaceid": "230f2661-361c-4699-8dbc-fac4fbc6b612", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 17:56:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-47784ab7-1b4f-467c-ba9c-d861585883a6 req-350d5c30-a7a0-4033-bfb0-aec81b45fea0 service nova] Acquired lock "refresh_cache-6d227210-c4df-4aa7-9969-70fa137aeb63" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:56:08 user nova-compute[75100]: DEBUG nova.network.neutron [req-47784ab7-1b4f-467c-ba9c-d861585883a6 req-350d5c30-a7a0-4033-bfb0-aec81b45fea0 service nova] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Refreshing network info cache for port 230f2661-361c-4699-8dbc-fac4fbc6b612 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 17:56:08 user nova-compute[75100]: DEBUG nova.compute.manager [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 17:56:08 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 17:56:08 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Creating image(s)
Nov 10 17:56:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Acquiring lock "/opt/stack/data/nova/instances/ca2f4288-da43-4bf3-9ef4-fd53961fe74c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:56:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "/opt/stack/data/nova/instances/ca2f4288-da43-4bf3-9ef4-fd53961fe74c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:56:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "/opt/stack/data/nova/instances/ca2f4288-da43-4bf3-9ef4-fd53961fe74c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:56:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Acquiring lock "c5090bf38fcf4e6c952dd13213f6cbb47fa74b36" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:56:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "c5090bf38fcf4e6c952dd13213f6cbb47fa74b36" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:56:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c5090bf38fcf4e6c952dd13213f6cbb47fa74b36.part --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:08 user nova-compute[75100]: DEBUG nova.network.neutron [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Successfully created port: f33ff122-270e-4129-be5b-e67c0bc0708c {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c5090bf38fcf4e6c952dd13213f6cbb47fa74b36.part --force-share --output=json" returned: 0 in 0.187s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG nova.virt.images [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] 9aca461c-4c8d-4e01-96d9-5330997a3b2b was qcow2, converting to raw {{(pid=75100) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG nova.privsep.utils [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75100) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c5090bf38fcf4e6c952dd13213f6cbb47fa74b36.part /opt/stack/data/nova/instances/_base/c5090bf38fcf4e6c952dd13213f6cbb47fa74b36.converted {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8ed1c8d-2d53-4878-b81c-4c717c27f3d6 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8ed1c8d-2d53-4878-b81c-4c717c27f3d6 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gzFeJSLW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 17:56:09 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-b8ed1c8d-2d53-4878-b81c-4c717c27f3d6 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 17:56:09 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-b8ed1c8d-2d53-4878-b81c-4c717c27f3d6 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-b8ed1c8d-2d53-4878-b81c-4c717c27f3d6 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 17:56:09 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-b8ed1c8d-2d53-4878-b81c-4c717c27f3d6 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 17:56:09 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-b8ed1c8d-2d53-4878-b81c-4c717c27f3d6 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-b8ed1c8d-2d53-4878-b81c-4c717c27f3d6 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 17:56:09 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-b8ed1c8d-2d53-4878-b81c-4c717c27f3d6 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 17:56:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 -p 172.16.0.220:3260 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee8cfcc-66b0-4313-84f0-48d0844aefb9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8ed1c8d-2d53-4878-b81c-4c717c27f3d6 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 17:56:09 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 -p 172.16.0.220:3260 --interface default --op new {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c350f9f-5804-431a-a1ec-f29654d0b091]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308] added\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8ed1c8d-2d53-4878-b81c-4c717c27f3d6 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308] added
Nov 10 17:56:09 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.090s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc36f624-aa7a-43e7-8b27-ede08b3313bf]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8ed1c8d-2d53-4878-b81c-4c717c27f3d6 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88c97ba-3883-4612-b456-9638dff22065]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8ed1c8d-2d53-4878-b81c-4c717c27f3d6 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gzFeJSLW {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gzFeJSLW" returned: 0 in 0.056s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[87fef293-3a0d-40ba-b519-9d2fd3322dd9]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8ed1c8d-2d53-4878-b81c-4c717c27f3d6 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gzFeJSLW'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c5090bf38fcf4e6c952dd13213f6cbb47fa74b36.part /opt/stack/data/nova/instances/_base/c5090bf38fcf4e6c952dd13213f6cbb47fa74b36.converted" returned: 0 in 0.352s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c5090bf38fcf4e6c952dd13213f6cbb47fa74b36.converted --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG nova.network.neutron [req-47784ab7-1b4f-467c-ba9c-d861585883a6 req-350d5c30-a7a0-4033-bfb0-aec81b45fea0 service nova] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Updated VIF entry in instance network info cache for port 230f2661-361c-4699-8dbc-fac4fbc6b612. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG nova.network.neutron [req-47784ab7-1b4f-467c-ba9c-d861585883a6 req-350d5c30-a7a0-4033-bfb0-aec81b45fea0 service nova] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Updating instance_info_cache with network_info: [{"id": "230f2661-361c-4699-8dbc-fac4fbc6b612", "address": "fa:16:3e:9d:d1:eb", "network": {"id": "2a85480b-f67d-4ef1-b967-3e93af57d7c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1717495768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9cd441a46aa4a579feff608d6ff9bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap230f2661-36", "ovs_interfaceid": "230f2661-361c-4699-8dbc-fac4fbc6b612", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43bd1f4-0aec-4dfb-8201-98a5026c64e6]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8ed1c8d-2d53-4878-b81c-4c717c27f3d6 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-47784ab7-1b4f-467c-ba9c-d861585883a6 req-350d5c30-a7a0-4033-bfb0-aec81b45fea0 service nova] Releasing lock "refresh_cache-6d227210-c4df-4aa7-9969-70fa137aeb63" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d71c014-cffc-40b4-a82e-7cedcb0dcf8a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8ed1c8d-2d53-4878-b81c-4c717c27f3d6 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)
Nov 10 17:56:09 user nova-compute[75100]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)
Nov 10 17:56:09 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8ed1c8d-2d53-4878-b81c-4c717c27f3d6 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)
Nov 10 17:56:09 user nova-compute[75100]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)
Nov 10 17:56:09 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 -p 172.16.0.220:3260 --login {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e638bee6-3fc0-4376-acf0-5d773ae78bea]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8ed1c8d-2d53-4878-b81c-4c717c27f3d6 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308, portal: 172.16.0.220,3260]
Nov 10 17:56:09 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308, portal: 172.16.0.220,3260] successful.
Nov 10 17:56:09 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a33639-c67e-4d9c-a693-4198bfaa5ef4]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8ed1c8d-2d53-4878-b81c-4c717c27f3d6 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c5090bf38fcf4e6c952dd13213f6cbb47fa74b36.converted --force-share --output=json" returned: 0 in 0.200s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "c5090bf38fcf4e6c952dd13213f6cbb47fa74b36" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.335s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c5090bf38fcf4e6c952dd13213f6cbb47fa74b36 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG os_brick.utils [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08ae848-da56-46af-a443-287f58343234]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8ed1c8d-2d53-4878-b81c-4c717c27f3d6 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)
Nov 10 17:56:09 user nova-compute[75100]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)
Nov 10 17:56:09 user nova-compute[75100]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 (non-flash)
Nov 10 17:56:09 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8ed1c8d-2d53-4878-b81c-4c717c27f3d6 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)
Nov 10 17:56:09 user nova-compute[75100]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)
Nov 10 17:56:09 user nova-compute[75100]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 (non-flash)
Nov 10 17:56:09 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-b8ed1c8d-2d53-4878-b81c-4c717c27f3d6 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.565s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8ed1c8d-2d53-4878-b81c-4c717c27f3d6 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-b8ed1c8d-2d53-4878-b81c-4c717c27f3d6 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] HCTL ('34', '-', '-', 0) found on session 15 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-b8ed1c8d-2d53-4878-b81c-4c717c27f3d6 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG nova.network.neutron [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Successfully updated port: f33ff122-270e-4129-be5b-e67c0bc0708c {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8410a4a-b4df-412b-a946-69e2eb4c36b3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90b1a229568f\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.028s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Acquiring lock "refresh_cache-ca2f4288-da43-4bf3-9ef4-fd53961fe74c" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Acquired lock "refresh_cache-ca2f4288-da43-4bf3-9ef4-fd53961fe74c" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG nova.network.neutron [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f10e24-30ad-4f0c-acb0-78c653f1e292]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b31c26-0097-43c7-8167-f88e0c3a4358]: (4, ('- - 0', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-b8ed1c8d-2d53-4878-b81c-4c717c27f3d6 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8ed1c8d-2d53-4878-b81c-4c717c27f3d6 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gzFeJSLW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG nova.compute.manager [req-d8bc5af0-2355-4df8-a9cb-377cf9615ffa req-4dcf7f18-8fa8-432b-b5ee-c0f5f3028035 service nova] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Received event network-changed-f33ff122-270e-4129-be5b-e67c0bc0708c {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG nova.compute.manager [req-d8bc5af0-2355-4df8-a9cb-377cf9615ffa req-4dcf7f18-8fa8-432b-b5ee-c0f5f3028035 service nova] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Refreshing instance network info cache due to event network-changed-f33ff122-270e-4129-be5b-e67c0bc0708c. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d8bc5af0-2355-4df8-a9cb-377cf9615ffa req-4dcf7f18-8fa8-432b-b5ee-c0f5f3028035 service nova] Acquiring lock "refresh_cache-ca2f4288-da43-4bf3-9ef4-fd53961fe74c" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3d9d98-c31c-4739-86a1-4e0efe4a654d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c8ab39-b83c-4481-b254-323a907c960b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG nova.network.neutron [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 17:56:09 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 17:56:09 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2dcce15-b375-4669-a7bc-38f96c564868]: (4, '') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG os_brick.utils [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] <== get_connector_properties: return (171ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90b1a229568f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Updating existing volume attachment record: 67a12b68-8a50-4321-925a-c0e97becee1e {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c5090bf38fcf4e6c952dd13213f6cbb47fa74b36 --force-share --output=json" returned: 0 in 0.239s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Acquiring lock "c5090bf38fcf4e6c952dd13213f6cbb47fa74b36" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "c5090bf38fcf4e6c952dd13213f6cbb47fa74b36" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:56:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c5090bf38fcf4e6c952dd13213f6cbb47fa74b36 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c5090bf38fcf4e6c952dd13213f6cbb47fa74b36 --force-share --output=json" returned: 0 in 0.192s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c5090bf38fcf4e6c952dd13213f6cbb47fa74b36,backing_fmt=raw /opt/stack/data/nova/instances/ca2f4288-da43-4bf3-9ef4-fd53961fe74c/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c5090bf38fcf4e6c952dd13213f6cbb47fa74b36,backing_fmt=raw /opt/stack/data/nova/instances/ca2f4288-da43-4bf3-9ef4-fd53961fe74c/disk 1073741824" returned: 0 in 0.064s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "c5090bf38fcf4e6c952dd13213f6cbb47fa74b36" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c5090bf38fcf4e6c952dd13213f6cbb47fa74b36 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG nova.network.neutron [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Updating instance_info_cache with network_info: [{"id": "f33ff122-270e-4129-be5b-e67c0bc0708c", "address": "fa:16:3e:e0:bd:a4", "network": {"id": "78d86418-c0e0-4cc2-8f4f-262f600f7d66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2054827063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19cfb454e59745bf9c77d7a7ede2bc0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33ff122-27", "ovs_interfaceid": "f33ff122-270e-4129-be5b-e67c0bc0708c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Releasing lock "refresh_cache-ca2f4288-da43-4bf3-9ef4-fd53961fe74c" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG nova.compute.manager [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Instance network_info: |[{"id": "f33ff122-270e-4129-be5b-e67c0bc0708c", "address": "fa:16:3e:e0:bd:a4", "network": {"id": "78d86418-c0e0-4cc2-8f4f-262f600f7d66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2054827063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19cfb454e59745bf9c77d7a7ede2bc0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33ff122-27", "ovs_interfaceid": "f33ff122-270e-4129-be5b-e67c0bc0708c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d8bc5af0-2355-4df8-a9cb-377cf9615ffa req-4dcf7f18-8fa8-432b-b5ee-c0f5f3028035 service nova] Acquired lock "refresh_cache-ca2f4288-da43-4bf3-9ef4-fd53961fe74c" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG nova.network.neutron [req-d8bc5af0-2355-4df8-a9cb-377cf9615ffa req-4dcf7f18-8fa8-432b-b5ee-c0f5f3028035 service nova] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Refreshing network info cache for port f33ff122-270e-4129-be5b-e67c0bc0708c {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c5090bf38fcf4e6c952dd13213f6cbb47fa74b36 --force-share --output=json" returned: 0 in 0.217s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ca2f4288-da43-4bf3-9ef4-fd53961fe74c/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2f4288-da43-4bf3-9ef4-fd53961fe74c/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2f4288-da43-4bf3-9ef4-fd53961fe74c/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Cannot resize image /opt/stack/data/nova/instances/ca2f4288-da43-4bf3-9ef4-fd53961fe74c/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Ensure instance console log exists: /opt/stack/data/nova/instances/ca2f4288-da43-4bf3-9ef4-fd53961fe74c/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Start _get_guest_xml network_info=[{"id": "f33ff122-270e-4129-be5b-e67c0bc0708c", "address": "fa:16:3e:e0:bd:a4", "network": {"id": "78d86418-c0e0-4cc2-8f4f-262f600f7d66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2054827063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19cfb454e59745bf9c77d7a7ede2bc0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33ff122-27", "ovs_interfaceid": "f33ff122-270e-4129-be5b-e67c0bc0708c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:56:03Z,direct_url=<?>,disk_format='qcow2',id=9aca461c-4c8d-4e01-96d9-5330997a3b2b,min_disk=0,min_ram=0,name='tempest-scenario-img--1933465866',owner='19cfb454e59745bf9c77d7a7ede2bc0e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:56:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '9aca461c-4c8d-4e01-96d9-5330997a3b2b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 17:56:10 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:56:10 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:56:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T17:40:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:56:03Z,direct_url=<?>,disk_format='qcow2',id=9aca461c-4c8d-4e01-96d9-5330997a3b2b,min_disk=0,min_ram=0,name='tempest-scenario-img--1933465866',owner='19cfb454e59745bf9c77d7a7ede2bc0e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:56:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:56:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2141027010',display_name='tempest-TestMinimumBasicScenario-server-2141027010',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2141027010',id=28,image_ref='9aca461c-4c8d-4e01-96d9-5330997a3b2b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+9Ljzn6uNPZfvsGzjgf1rzPigyBeIjo1hMLKvKaNMvgjphzLJkq/N+5Rj1I8Bo9ee1XzM24XDugNOdWVPL1ENg5TesGhg9QW7vu/ykAEwYg59w+wwxgQEjuXd/8c6JAA==',key_name='tempest-TestMinimumBasicScenario-2102848825',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='19cfb454e59745bf9c77d7a7ede2bc0e',ramdisk_id='',reservation_id='r-nrbksuex',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9aca461c-4c8d-4e01-96d9-5330997a3b2b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-281006384',owner_user_name='tempest-TestMinimumBasicScenario-281006384-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:56:08Z,user_data=None,user_id='4d873ec5a11a4ccdb868fef673ffc568',uuid=ca2f4288-da43-4bf3-9ef4-fd53961fe74c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f33ff122-270e-4129-be5b-e67c0bc0708c", "address": "fa:16:3e:e0:bd:a4", "network": {"id": "78d86418-c0e0-4cc2-8f4f-262f600f7d66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2054827063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19cfb454e59745bf9c77d7a7ede2bc0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33ff122-27", "ovs_interfaceid": "f33ff122-270e-4129-be5b-e67c0bc0708c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Converting VIF {"id": "f33ff122-270e-4129-be5b-e67c0bc0708c", "address": "fa:16:3e:e0:bd:a4", "network": {"id": "78d86418-c0e0-4cc2-8f4f-262f600f7d66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2054827063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19cfb454e59745bf9c77d7a7ede2bc0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33ff122-27", "ovs_interfaceid": "f33ff122-270e-4129-be5b-e67c0bc0708c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:bd:a4,bridge_name='br-int',has_traffic_filtering=True,id=f33ff122-270e-4129-be5b-e67c0bc0708c,network=Network(78d86418-c0e0-4cc2-8f4f-262f600f7d66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf33ff122-27') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG nova.objects.instance [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lazy-loading 'pci_devices' on Instance uuid ca2f4288-da43-4bf3-9ef4-fd53961fe74c {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG nova.network.neutron [req-d8bc5af0-2355-4df8-a9cb-377cf9615ffa req-4dcf7f18-8fa8-432b-b5ee-c0f5f3028035 service nova] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Updated VIF entry in instance network info cache for port f33ff122-270e-4129-be5b-e67c0bc0708c. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG nova.network.neutron [req-d8bc5af0-2355-4df8-a9cb-377cf9615ffa req-4dcf7f18-8fa8-432b-b5ee-c0f5f3028035 service nova] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Updating instance_info_cache with network_info: [{"id": "f33ff122-270e-4129-be5b-e67c0bc0708c", "address": "fa:16:3e:e0:bd:a4", "network": {"id": "78d86418-c0e0-4cc2-8f4f-262f600f7d66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2054827063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19cfb454e59745bf9c77d7a7ede2bc0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33ff122-27", "ovs_interfaceid": "f33ff122-270e-4129-be5b-e67c0bc0708c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] End _get_guest_xml xml=<domain type="kvm">
Nov 10 17:56:10 user nova-compute[75100]:   <uuid>ca2f4288-da43-4bf3-9ef4-fd53961fe74c</uuid>
Nov 10 17:56:10 user nova-compute[75100]:   <name>instance-0000001c</name>
Nov 10 17:56:10 user nova-compute[75100]:   <memory>524288</memory>
Nov 10 17:56:10 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 10 17:56:10 user nova-compute[75100]:   <metadata>
Nov 10 17:56:10 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 17:56:10 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 10 17:56:10 user nova-compute[75100]:       <nova:name>tempest-TestMinimumBasicScenario-server-2141027010</nova:name>
Nov 10 17:56:10 user nova-compute[75100]:       <nova:creationTime>2023-11-10 17:56:10</nova:creationTime>
Nov 10 17:56:10 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 10 17:56:10 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 10 17:56:10 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 10 17:56:10 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 10 17:56:10 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 17:56:10 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 10 17:56:10 user nova-compute[75100]:       </nova:flavor>
Nov 10 17:56:10 user nova-compute[75100]:       <nova:owner>
Nov 10 17:56:10 user nova-compute[75100]:         <nova:user uuid="4d873ec5a11a4ccdb868fef673ffc568">tempest-TestMinimumBasicScenario-281006384-project-member</nova:user>
Nov 10 17:56:10 user nova-compute[75100]:         <nova:project uuid="19cfb454e59745bf9c77d7a7ede2bc0e">tempest-TestMinimumBasicScenario-281006384</nova:project>
Nov 10 17:56:10 user nova-compute[75100]:       </nova:owner>
Nov 10 17:56:10 user nova-compute[75100]:       <nova:root type="image" uuid="9aca461c-4c8d-4e01-96d9-5330997a3b2b"/>
Nov 10 17:56:10 user nova-compute[75100]:       <nova:ports>
Nov 10 17:56:10 user nova-compute[75100]:         <nova:port uuid="f33ff122-270e-4129-be5b-e67c0bc0708c">
Nov 10 17:56:10 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 10 17:56:10 user nova-compute[75100]:         </nova:port>
Nov 10 17:56:10 user nova-compute[75100]:       </nova:ports>
Nov 10 17:56:10 user nova-compute[75100]:     </nova:instance>
Nov 10 17:56:10 user nova-compute[75100]:   </metadata>
Nov 10 17:56:10 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 10 17:56:10 user nova-compute[75100]:     <system>
Nov 10 17:56:10 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 17:56:10 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 10 17:56:10 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 10 17:56:10 user nova-compute[75100]:       <entry name="serial">ca2f4288-da43-4bf3-9ef4-fd53961fe74c</entry>
Nov 10 17:56:10 user nova-compute[75100]:       <entry name="uuid">ca2f4288-da43-4bf3-9ef4-fd53961fe74c</entry>
Nov 10 17:56:10 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 10 17:56:10 user nova-compute[75100]:     </system>
Nov 10 17:56:10 user nova-compute[75100]:   </sysinfo>
Nov 10 17:56:10 user nova-compute[75100]:   <os>
Nov 10 17:56:10 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 17:56:10 user nova-compute[75100]:     <boot dev="hd"/>
Nov 10 17:56:10 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 10 17:56:10 user nova-compute[75100]:   </os>
Nov 10 17:56:10 user nova-compute[75100]:   <features>
Nov 10 17:56:10 user nova-compute[75100]:     <acpi/>
Nov 10 17:56:10 user nova-compute[75100]:     <apic/>
Nov 10 17:56:10 user nova-compute[75100]:     <vmcoreinfo/>
Nov 10 17:56:10 user nova-compute[75100]:   </features>
Nov 10 17:56:10 user nova-compute[75100]:   <clock offset="utc">
Nov 10 17:56:10 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 17:56:10 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 17:56:10 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 10 17:56:10 user nova-compute[75100]:   </clock>
Nov 10 17:56:10 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 10 17:56:10 user nova-compute[75100]:     <model>Nehalem</model>
Nov 10 17:56:10 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 17:56:10 user nova-compute[75100]:   </cpu>
Nov 10 17:56:10 user nova-compute[75100]:   <devices>
Nov 10 17:56:10 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 10 17:56:10 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 17:56:10 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/ca2f4288-da43-4bf3-9ef4-fd53961fe74c/disk"/>
Nov 10 17:56:10 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 10 17:56:10 user nova-compute[75100]:     </disk>
Nov 10 17:56:10 user nova-compute[75100]:     <interface type="ethernet">
Nov 10 17:56:10 user nova-compute[75100]:       <mac address="fa:16:3e:e0:bd:a4"/>
Nov 10 17:56:10 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:56:10 user nova-compute[75100]:       <mtu size="1442"/>
Nov 10 17:56:10 user nova-compute[75100]:       <target dev="tapf33ff122-27"/>
Nov 10 17:56:10 user nova-compute[75100]:     </interface>
Nov 10 17:56:10 user nova-compute[75100]:     <serial type="pty">
Nov 10 17:56:10 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/ca2f4288-da43-4bf3-9ef4-fd53961fe74c/console.log" append="off"/>
Nov 10 17:56:10 user nova-compute[75100]:     </serial>
Nov 10 17:56:10 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 17:56:10 user nova-compute[75100]:     <video>
Nov 10 17:56:10 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:56:10 user nova-compute[75100]:     </video>
Nov 10 17:56:10 user nova-compute[75100]:     <rng model="virtio">
Nov 10 17:56:10 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 10 17:56:10 user nova-compute[75100]:     </rng>
Nov 10 17:56:10 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 10 17:56:10 user nova-compute[75100]:     <memballoon model="virtio">
Nov 10 17:56:10 user nova-compute[75100]:       <stats period="10"/>
Nov 10 17:56:10 user nova-compute[75100]:     </memballoon>
Nov 10 17:56:10 user nova-compute[75100]:   </devices>
Nov 10 17:56:10 user nova-compute[75100]: </domain>
Nov 10 17:56:10 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:56:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2141027010',display_name='tempest-TestMinimumBasicScenario-server-2141027010',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2141027010',id=28,image_ref='9aca461c-4c8d-4e01-96d9-5330997a3b2b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+9Ljzn6uNPZfvsGzjgf1rzPigyBeIjo1hMLKvKaNMvgjphzLJkq/N+5Rj1I8Bo9ee1XzM24XDugNOdWVPL1ENg5TesGhg9QW7vu/ykAEwYg59w+wwxgQEjuXd/8c6JAA==',key_name='tempest-TestMinimumBasicScenario-2102848825',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='19cfb454e59745bf9c77d7a7ede2bc0e',ramdisk_id='',reservation_id='r-nrbksuex',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9aca461c-4c8d-4e01-96d9-5330997a3b2b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-281006384',owner_user_name='tempest-TestMinimumBasicScenario-281006384-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:56:08Z,user_data=None,user_id='4d873ec5a11a4ccdb868fef673ffc568',uuid=ca2f4288-da43-4bf3-9ef4-fd53961fe74c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f33ff122-270e-4129-be5b-e67c0bc0708c", "address": "fa:16:3e:e0:bd:a4", "network": {"id": "78d86418-c0e0-4cc2-8f4f-262f600f7d66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2054827063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19cfb454e59745bf9c77d7a7ede2bc0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33ff122-27", "ovs_interfaceid": "f33ff122-270e-4129-be5b-e67c0bc0708c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Converting VIF {"id": "f33ff122-270e-4129-be5b-e67c0bc0708c", "address": "fa:16:3e:e0:bd:a4", "network": {"id": "78d86418-c0e0-4cc2-8f4f-262f600f7d66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2054827063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19cfb454e59745bf9c77d7a7ede2bc0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33ff122-27", "ovs_interfaceid": "f33ff122-270e-4129-be5b-e67c0bc0708c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:bd:a4,bridge_name='br-int',has_traffic_filtering=True,id=f33ff122-270e-4129-be5b-e67c0bc0708c,network=Network(78d86418-c0e0-4cc2-8f4f-262f600f7d66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf33ff122-27') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG os_vif [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:bd:a4,bridge_name='br-int',has_traffic_filtering=True,id=f33ff122-270e-4129-be5b-e67c0bc0708c,network=Network(78d86418-c0e0-4cc2-8f4f-262f600f7d66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf33ff122-27') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '492effb1-839f-5fc3-8b5c-0f7b7fe01d53', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d8bc5af0-2355-4df8-a9cb-377cf9615ffa req-4dcf7f18-8fa8-432b-b5ee-c0f5f3028035 service nova] Releasing lock "refresh_cache-ca2f4288-da43-4bf3-9ef4-fd53961fe74c" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf33ff122-27, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf33ff122-27, col_values=(('qos', UUID('bb681ae5-deb6-470e-be91-0994ea7e0628')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf33ff122-27, col_values=(('external_ids', {'iface-id': 'f33ff122-270e-4129-be5b-e67c0bc0708c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:bd:a4', 'vm-uuid': 'ca2f4288-da43-4bf3-9ef4-fd53961fe74c'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:10 user nova-compute[75100]: INFO os_vif [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:bd:a4,bridge_name='br-int',has_traffic_filtering=True,id=f33ff122-270e-4129-be5b-e67c0bc0708c,network=Network(78d86418-c0e0-4cc2-8f4f-262f600f7d66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf33ff122-27')
Nov 10 17:56:10 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-b8ed1c8d-2d53-4878-b81c-4c717c27f3d6 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.629s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8ed1c8d-2d53-4878-b81c-4c717c27f3d6 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] <== connect_volume: return (1631ms) {'type': 'block', 'scsi_wwn': '23966643664316166', 'path': '/dev/sdc'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8ed1c8d-2d53-4878-b81c-4c717c27f3d6 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966643664316166', 'path': '/dev/sdc'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG nova.objects.instance [None req-b8ed1c8d-2d53-4878-b81c-4c717c27f3d6 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lazy-loading 'flavor' on Instance uuid c7fbe35b-4794-4eb9-8033-923247064458 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] No VIF found with MAC fa:16:3e:e0:bd:a4, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 17:56:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-b8ed1c8d-2d53-4878-b81c-4c717c27f3d6 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 17:56:10 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 17:56:10 user nova-compute[75100]:   <source dev="/dev/sdc"/>
Nov 10 17:56:10 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 17:56:10 user nova-compute[75100]:   <serial>0280d371-2779-450b-9c9a-c5adde034308</serial>
Nov 10 17:56:10 user nova-compute[75100]: </disk>
Nov 10 17:56:10 user nova-compute[75100]:  {{(pid=75100) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 17:56:11 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-b8ed1c8d-2d53-4878-b81c-4c717c27f3d6 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 17:56:11 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-b8ed1c8d-2d53-4878-b81c-4c717c27f3d6 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 17:56:11 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-b8ed1c8d-2d53-4878-b81c-4c717c27f3d6 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] No VIF found with MAC fa:16:3e:d3:5e:89, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 17:56:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:12 user nova-compute[75100]: DEBUG nova.compute.manager [req-13efbf4b-2459-47fe-b43e-2a4a6d93e612 req-7bd6d963-cea1-4c24-ae4b-00b53e011ef1 service nova] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Received event network-vif-plugged-f33ff122-270e-4129-be5b-e67c0bc0708c {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:56:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-13efbf4b-2459-47fe-b43e-2a4a6d93e612 req-7bd6d963-cea1-4c24-ae4b-00b53e011ef1 service nova] Acquiring lock "ca2f4288-da43-4bf3-9ef4-fd53961fe74c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:56:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-13efbf4b-2459-47fe-b43e-2a4a6d93e612 req-7bd6d963-cea1-4c24-ae4b-00b53e011ef1 service nova] Lock "ca2f4288-da43-4bf3-9ef4-fd53961fe74c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:56:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-13efbf4b-2459-47fe-b43e-2a4a6d93e612 req-7bd6d963-cea1-4c24-ae4b-00b53e011ef1 service nova] Lock "ca2f4288-da43-4bf3-9ef4-fd53961fe74c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:56:12 user nova-compute[75100]: DEBUG nova.compute.manager [req-13efbf4b-2459-47fe-b43e-2a4a6d93e612 req-7bd6d963-cea1-4c24-ae4b-00b53e011ef1 service nova] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] No waiting events found dispatching network-vif-plugged-f33ff122-270e-4129-be5b-e67c0bc0708c {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:56:12 user nova-compute[75100]: WARNING nova.compute.manager [req-13efbf4b-2459-47fe-b43e-2a4a6d93e612 req-7bd6d963-cea1-4c24-ae4b-00b53e011ef1 service nova] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Received unexpected event network-vif-plugged-f33ff122-270e-4129-be5b-e67c0bc0708c for instance with vm_state building and task_state spawning.
Nov 10 17:56:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:14 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:56:15 user nova-compute[75100]: DEBUG nova.compute.manager [req-9d0e131b-6465-449f-b377-82b6965ba1c5 req-1f958c71-155a-471c-bb7d-cf765b477f1b service nova] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Received event network-vif-plugged-f33ff122-270e-4129-be5b-e67c0bc0708c {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:56:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9d0e131b-6465-449f-b377-82b6965ba1c5 req-1f958c71-155a-471c-bb7d-cf765b477f1b service nova] Acquiring lock "ca2f4288-da43-4bf3-9ef4-fd53961fe74c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:56:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9d0e131b-6465-449f-b377-82b6965ba1c5 req-1f958c71-155a-471c-bb7d-cf765b477f1b service nova] Lock "ca2f4288-da43-4bf3-9ef4-fd53961fe74c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:56:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9d0e131b-6465-449f-b377-82b6965ba1c5 req-1f958c71-155a-471c-bb7d-cf765b477f1b service nova] Lock "ca2f4288-da43-4bf3-9ef4-fd53961fe74c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:56:15 user nova-compute[75100]: DEBUG nova.compute.manager [req-9d0e131b-6465-449f-b377-82b6965ba1c5 req-1f958c71-155a-471c-bb7d-cf765b477f1b service nova] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] No waiting events found dispatching network-vif-plugged-f33ff122-270e-4129-be5b-e67c0bc0708c {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:56:15 user nova-compute[75100]: WARNING nova.compute.manager [req-9d0e131b-6465-449f-b377-82b6965ba1c5 req-1f958c71-155a-471c-bb7d-cf765b477f1b service nova] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Received unexpected event network-vif-plugged-f33ff122-270e-4129-be5b-e67c0bc0708c for instance with vm_state building and task_state spawning.
Nov 10 17:56:15 user nova-compute[75100]: DEBUG nova.compute.manager [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 17:56:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 17:56:15 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Instance spawned successfully.
Nov 10 17:56:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 17:56:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:56:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:56:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:56:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:56:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:56:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:56:15 user nova-compute[75100]: INFO nova.compute.manager [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Took 6.99 seconds to spawn the instance on the hypervisor.
Nov 10 17:56:15 user nova-compute[75100]: DEBUG nova.compute.manager [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 17:56:15 user nova-compute[75100]: INFO nova.compute.manager [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Took 8.14 seconds to build instance.
Nov 10 17:56:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bf555ad4-753a-4f74-8611-a76eda6180f4 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "ca2f4288-da43-4bf3-9ef4-fd53961fe74c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.292s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:56:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:17 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:56:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:20 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:56:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:21 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:56:21 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:56:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:56:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:56:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:56:21 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 17:56:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 17:56:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7fbe35b-4794-4eb9-8033-923247064458/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7fbe35b-4794-4eb9-8033-923247064458/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7fbe35b-4794-4eb9-8033-923247064458/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7fbe35b-4794-4eb9-8033-923247064458/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:23 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 17:56:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/989f3ce5-067b-45e4-a2e5-445024e13202/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/989f3ce5-067b-45e4-a2e5-445024e13202/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/989f3ce5-067b-45e4-a2e5-445024e13202/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/989f3ce5-067b-45e4-a2e5-445024e13202/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2f4288-da43-4bf3-9ef4-fd53961fe74c/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2f4288-da43-4bf3-9ef4-fd53961fe74c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2f4288-da43-4bf3-9ef4-fd53961fe74c/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2f4288-da43-4bf3-9ef4-fd53961fe74c/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adf9e657-d366-4afd-a752-87e69b73eb81/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adf9e657-d366-4afd-a752-87e69b73eb81/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adf9e657-d366-4afd-a752-87e69b73eb81/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adf9e657-d366-4afd-a752-87e69b73eb81/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9033f537-bdeb-412c-9337-4ad86f4467b2/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9033f537-bdeb-412c-9337-4ad86f4467b2/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9033f537-bdeb-412c-9337-4ad86f4467b2/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9033f537-bdeb-412c-9337-4ad86f4467b2/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] skipping disk /opt/stack/data/nova/instances/9033f537-bdeb-412c-9337-4ad86f4467b2/disk (vdb) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 17:56:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6140056a-ced1-4240-a11a-795a260adf46/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6140056a-ced1-4240-a11a-795a260adf46/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6140056a-ced1-4240-a11a-795a260adf46/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6140056a-ced1-4240-a11a-795a260adf46/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61d3862-5be7-45cc-95a0-88124ac1725d/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61d3862-5be7-45cc-95a0-88124ac1725d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61d3862-5be7-45cc-95a0-88124ac1725d/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61d3862-5be7-45cc-95a0-88124ac1725d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:26 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:56:26 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:56:26 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Hypervisor/Node resource view: name=user free_ram=7079MB free_disk=24.295150756835938GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 17:56:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:56:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:56:27 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance c19fc271-a248-4631-a11f-89b7ed73bf85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:56:27 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:56:27 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 3e14de19-540d-4dc2-a058-6874d8d14478 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:56:27 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance d61d3862-5be7-45cc-95a0-88124ac1725d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:56:27 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:56:27 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance e6de4626-f097-43b7-8e56-a08415e7d74a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:56:27 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 9033f537-bdeb-412c-9337-4ad86f4467b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:56:27 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 989f3ce5-067b-45e4-a2e5-445024e13202 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:56:27 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance c7fbe35b-4794-4eb9-8033-923247064458 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:56:27 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance eb430407-f836-4510-899f-a5f5d60c73f3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:56:27 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 6140056a-ced1-4240-a11a-795a260adf46 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:56:27 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance adf9e657-d366-4afd-a752-87e69b73eb81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:56:27 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 6d227210-c4df-4aa7-9969-70fa137aeb63 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:56:27 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance ca2f4288-da43-4bf3-9ef4-fd53961fe74c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:56:27 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 61e73913-30a5-4eaa-9bc0-6e17a0288035 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 10 17:56:27 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 17:56:27 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 17:56:27 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:56:27 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:56:27 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 17:56:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.725s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:56:28 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:56:28 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:56:28 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:56:28 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 17:56:28 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Rebuilding the list of instances to heal {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 17:56:28 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Skipping network cache update for instance because it is Building. {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 10 17:56:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "refresh_cache-c19fc271-a248-4631-a11f-89b7ed73bf85" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:56:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquired lock "refresh_cache-c19fc271-a248-4631-a11f-89b7ed73bf85" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:56:28 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 17:56:28 user nova-compute[75100]: DEBUG nova.objects.instance [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lazy-loading 'info_cache' on Instance uuid c19fc271-a248-4631-a11f-89b7ed73bf85 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:56:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:29 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Updating instance_info_cache with network_info: [{"id": "eedb3d8e-5619-4df9-aef9-bbc44db1dba9", "address": "fa:16:3e:ee:f9:3d", "network": {"id": "f240fae3-3d7b-4b6e-b04f-18550ab4d0a3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1007355777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c970a503d74d32a1e2b71f086649fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeedb3d8e-56", "ovs_interfaceid": "eedb3d8e-5619-4df9-aef9-bbc44db1dba9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:56:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Releasing lock "refresh_cache-c19fc271-a248-4631-a11f-89b7ed73bf85" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:56:29 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 17:56:29 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:56:29 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:56:29 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 17:56:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b8ed1c8d-2d53-4878-b81c-4c717c27f3d6 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "c7fbe35b-4794-4eb9-8033-923247064458" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 53.995s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Starting finish_revert_migration {{(pid=75100) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Start _get_guest_xml network_info=[{"id": "6e9b2058-6104-4f6c-8c72-f5f15d0d116b", "address": "fa:16:3e:2f:11:f6", "network": {"id": "f67bc940-2f01-4255-b12e-427ffcd7e4e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-977195248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e95560897fb46258db0ecd7dc7b9294", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9b2058-61", "ovs_interfaceid": "6e9b2058-6104-4f6c-8c72-f5f15d0d116b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'e3cc5321-4d40-49ee-885c-700e14741732'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xESYIPuD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'eb430407-f836-4510-899f-a5f5d60c73f3', 'attached_at': '2023-11-10T17:56:32.000000', 'detached_at': '', 'volume_id': '9ba96bee-27d3-48fc-9caf-f8932bf96d0c', 'serial': '9ba96bee-27d3-48fc-9caf-f8932bf96d0c'}, 'mount_device': '/dev/vdb', 'attachment_id': 'ce4ec632-3090-4f90-a5b8-769355ace8f4', 'device_type': 'disk', 'guest_format': None, 'boot_index': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 17:56:32 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:56:32 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:56:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T17:40:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG nova.objects.instance [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Lazy-loading 'vcpu_model' on Instance uuid eb430407-f836-4510-899f-a5f5d60c73f3 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xESYIPuD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 17:56:32 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 17:56:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 17:56:32 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 17:56:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 17:56:32 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 17:56:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c -p 172.16.0.220:3260 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9240c2ce-02d0-454c-b68f-9d814a23adb5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 17:56:32 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c -p 172.16.0.220:3260 --interface default --op new {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[974d54cf-8042-4924-9bc3-5cfa672ff7d3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c] added\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c] added
Nov 10 17:56:32 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[680f7ecd-1a87-4dc9-87c5-d2e2633b6c8a]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[30bedf2e-dddd-4ba1-8774-b65ee26b457a]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xESYIPuD {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xESYIPuD" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e99fc81-de4c-4ae2-9fa3-c41d34fa8dae]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xESYIPuD'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee005d8-cc04-44dd-a1d8-e484fc613bb8]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d84c8622-124a-4503-9713-7c2ae7babd2f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)
Nov 10 17:56:32 user nova-compute[75100]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)
Nov 10 17:56:32 user nova-compute[75100]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 (non-flash)
Nov 10 17:56:32 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)
Nov 10 17:56:32 user nova-compute[75100]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)
Nov 10 17:56:32 user nova-compute[75100]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 (non-flash)
Nov 10 17:56:32 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c -p 172.16.0.220:3260 --login {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42dab5b-379e-45df-83ba-c7dc7887fc55]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c, portal: 172.16.0.220,3260]
Nov 10 17:56:32 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c, portal: 172.16.0.220,3260] successful.
Nov 10 17:56:32 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[88036714-33f4-4817-b223-599af3c326b1]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8dac495-88e2-4a89-a987-53f39790f3d3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)
Nov 10 17:56:32 user nova-compute[75100]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)
Nov 10 17:56:32 user nova-compute[75100]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 (non-flash)
Nov 10 17:56:32 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c (non-flash)
Nov 10 17:56:32 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)
Nov 10 17:56:32 user nova-compute[75100]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)
Nov 10 17:56:32 user nova-compute[75100]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 (non-flash)
Nov 10 17:56:32 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c (non-flash)
Nov 10 17:56:32 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] HCTL ('36', '-', '-', 0) found on session 16 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.030s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b9be08-fd5c-4ba9-a1a4-abe70ab7a55a]: (4, ('- - 0', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Searching for a device in session 16 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xESYIPuD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 17:56:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 17:56:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '23632363436396263', 'path': '/dev/sde'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 17:56:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23632363436396263', 'path': '/dev/sde'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 17:56:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:49:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1267762012',display_name='tempest-ServerActionsTestOtherB-server-1267762012',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1267762012',id=16,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDPSiJ0FfbNgNhKoheve47DT1uQV1oaC9CdV5NhlB12KyXHFwXlJCN0xOr09naWU21Nb1dG7o7w/ZzPU0YohVQI5ip5k2vJ5Db3SiA/LtLwk+OdOmsxEc+IoKJ74LTBECw==',key_name='tempest-keypair-1684715830',keypairs=<?>,launch_index=0,launched_at=2023-11-10T17:54:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1e95560897fb46258db0ecd7dc7b9294',ramdisk_id='',reservation_id='r-55f5hxbc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1027676823',owner_user_name='tempest-ServerActionsTestOtherB-1027676823-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T17:55:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da45741ccb5d4b00a0784d7ef9063243',uuid=eb430407-f836-4510-899f-a5f5d60c73f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "6e9b2058-6104-4f6c-8c72-f5f15d0d116b", "address": "fa:16:3e:2f:11:f6", "network": {"id": "f67bc940-2f01-4255-b12e-427ffcd7e4e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-977195248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e95560897fb46258db0ecd7dc7b9294", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9b2058-61", "ovs_interfaceid": "6e9b2058-6104-4f6c-8c72-f5f15d0d116b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 17:56:33 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Converting VIF {"id": "6e9b2058-6104-4f6c-8c72-f5f15d0d116b", "address": "fa:16:3e:2f:11:f6", "network": {"id": "f67bc940-2f01-4255-b12e-427ffcd7e4e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-977195248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e95560897fb46258db0ecd7dc7b9294", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9b2058-61", "ovs_interfaceid": "6e9b2058-6104-4f6c-8c72-f5f15d0d116b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:56:33 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:11:f6,bridge_name='br-int',has_traffic_filtering=True,id=6e9b2058-6104-4f6c-8c72-f5f15d0d116b,network=Network(f67bc940-2f01-4255-b12e-427ffcd7e4e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e9b2058-61') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:56:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] End _get_guest_xml xml=<domain type="kvm">
Nov 10 17:56:33 user nova-compute[75100]:   <uuid>eb430407-f836-4510-899f-a5f5d60c73f3</uuid>
Nov 10 17:56:33 user nova-compute[75100]:   <name>instance-00000010</name>
Nov 10 17:56:33 user nova-compute[75100]:   <memory>524288</memory>
Nov 10 17:56:33 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 10 17:56:33 user nova-compute[75100]:   <metadata>
Nov 10 17:56:33 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 17:56:33 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 10 17:56:33 user nova-compute[75100]:       <nova:name>tempest-ServerActionsTestOtherB-server-1267762012</nova:name>
Nov 10 17:56:33 user nova-compute[75100]:       <nova:creationTime>2023-11-10 17:56:32</nova:creationTime>
Nov 10 17:56:33 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 10 17:56:33 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 10 17:56:33 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 10 17:56:33 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 10 17:56:33 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 17:56:33 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 10 17:56:33 user nova-compute[75100]:       </nova:flavor>
Nov 10 17:56:33 user nova-compute[75100]:       <nova:owner>
Nov 10 17:56:33 user nova-compute[75100]:         <nova:user uuid="da45741ccb5d4b00a0784d7ef9063243">tempest-ServerActionsTestOtherB-1027676823-project-member</nova:user>
Nov 10 17:56:33 user nova-compute[75100]:         <nova:project uuid="1e95560897fb46258db0ecd7dc7b9294">tempest-ServerActionsTestOtherB-1027676823</nova:project>
Nov 10 17:56:33 user nova-compute[75100]:       </nova:owner>
Nov 10 17:56:33 user nova-compute[75100]:       <nova:root type="image" uuid="e3cc5321-4d40-49ee-885c-700e14741732"/>
Nov 10 17:56:33 user nova-compute[75100]:       <nova:ports>
Nov 10 17:56:33 user nova-compute[75100]:         <nova:port uuid="6e9b2058-6104-4f6c-8c72-f5f15d0d116b">
Nov 10 17:56:33 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 10 17:56:33 user nova-compute[75100]:         </nova:port>
Nov 10 17:56:33 user nova-compute[75100]:       </nova:ports>
Nov 10 17:56:33 user nova-compute[75100]:     </nova:instance>
Nov 10 17:56:33 user nova-compute[75100]:   </metadata>
Nov 10 17:56:33 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 10 17:56:33 user nova-compute[75100]:     <system>
Nov 10 17:56:33 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 17:56:33 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 10 17:56:33 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 10 17:56:33 user nova-compute[75100]:       <entry name="serial">eb430407-f836-4510-899f-a5f5d60c73f3</entry>
Nov 10 17:56:33 user nova-compute[75100]:       <entry name="uuid">eb430407-f836-4510-899f-a5f5d60c73f3</entry>
Nov 10 17:56:33 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 10 17:56:33 user nova-compute[75100]:     </system>
Nov 10 17:56:33 user nova-compute[75100]:   </sysinfo>
Nov 10 17:56:33 user nova-compute[75100]:   <os>
Nov 10 17:56:33 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 17:56:33 user nova-compute[75100]:     <boot dev="hd"/>
Nov 10 17:56:33 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 10 17:56:33 user nova-compute[75100]:   </os>
Nov 10 17:56:33 user nova-compute[75100]:   <features>
Nov 10 17:56:33 user nova-compute[75100]:     <acpi/>
Nov 10 17:56:33 user nova-compute[75100]:     <apic/>
Nov 10 17:56:33 user nova-compute[75100]:     <vmcoreinfo/>
Nov 10 17:56:33 user nova-compute[75100]:   </features>
Nov 10 17:56:33 user nova-compute[75100]:   <clock offset="utc">
Nov 10 17:56:33 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 17:56:33 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 17:56:33 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 10 17:56:33 user nova-compute[75100]:   </clock>
Nov 10 17:56:33 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 10 17:56:33 user nova-compute[75100]:     <model>Nehalem</model>
Nov 10 17:56:33 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 17:56:33 user nova-compute[75100]:   </cpu>
Nov 10 17:56:33 user nova-compute[75100]:   <devices>
Nov 10 17:56:33 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 10 17:56:33 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 17:56:33 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3/disk"/>
Nov 10 17:56:33 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 10 17:56:33 user nova-compute[75100]:     </disk>
Nov 10 17:56:33 user nova-compute[75100]:     <disk type="block" device="disk">
Nov 10 17:56:33 user nova-compute[75100]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 17:56:33 user nova-compute[75100]:       <source dev="/dev/sde"/>
Nov 10 17:56:33 user nova-compute[75100]:       <target dev="vdb" bus="virtio"/>
Nov 10 17:56:33 user nova-compute[75100]:       <serial>9ba96bee-27d3-48fc-9caf-f8932bf96d0c</serial>
Nov 10 17:56:33 user nova-compute[75100]:     </disk>
Nov 10 17:56:33 user nova-compute[75100]:     <interface type="ethernet">
Nov 10 17:56:33 user nova-compute[75100]:       <mac address="fa:16:3e:2f:11:f6"/>
Nov 10 17:56:33 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:56:33 user nova-compute[75100]:       <mtu size="1442"/>
Nov 10 17:56:33 user nova-compute[75100]:       <target dev="tap6e9b2058-61"/>
Nov 10 17:56:33 user nova-compute[75100]:     </interface>
Nov 10 17:56:33 user nova-compute[75100]:     <serial type="pty">
Nov 10 17:56:33 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3/console.log" append="off"/>
Nov 10 17:56:33 user nova-compute[75100]:     </serial>
Nov 10 17:56:33 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 17:56:33 user nova-compute[75100]:     <video>
Nov 10 17:56:33 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:56:33 user nova-compute[75100]:     </video>
Nov 10 17:56:33 user nova-compute[75100]:     <rng model="virtio">
Nov 10 17:56:33 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 10 17:56:33 user nova-compute[75100]:     </rng>
Nov 10 17:56:33 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 10 17:56:33 user nova-compute[75100]:     <memballoon model="virtio">
Nov 10 17:56:33 user nova-compute[75100]:       <stats period="10"/>
Nov 10 17:56:33 user nova-compute[75100]:     </memballoon>
Nov 10 17:56:33 user nova-compute[75100]:   </devices>
Nov 10 17:56:33 user nova-compute[75100]: </domain>
Nov 10 17:56:33 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 17:56:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:49:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1267762012',display_name='tempest-ServerActionsTestOtherB-server-1267762012',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1267762012',id=16,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDPSiJ0FfbNgNhKoheve47DT1uQV1oaC9CdV5NhlB12KyXHFwXlJCN0xOr09naWU21Nb1dG7o7w/ZzPU0YohVQI5ip5k2vJ5Db3SiA/LtLwk+OdOmsxEc+IoKJ74LTBECw==',key_name='tempest-keypair-1684715830',keypairs=<?>,launch_index=0,launched_at=2023-11-10T17:54:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1e95560897fb46258db0ecd7dc7b9294',ramdisk_id='',reservation_id='r-55f5hxbc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1027676823',owner_user_name='tempest-ServerActionsTestOtherB-1027676823-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T17:55:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da45741ccb5d4b00a0784d7ef9063243',uuid=eb430407-f836-4510-899f-a5f5d60c73f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "6e9b2058-6104-4f6c-8c72-f5f15d0d116b", "address": "fa:16:3e:2f:11:f6", "network": {"id": "f67bc940-2f01-4255-b12e-427ffcd7e4e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-977195248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e95560897fb46258db0ecd7dc7b9294", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9b2058-61", "ovs_interfaceid": "6e9b2058-6104-4f6c-8c72-f5f15d0d116b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 17:56:33 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Converting VIF {"id": "6e9b2058-6104-4f6c-8c72-f5f15d0d116b", "address": "fa:16:3e:2f:11:f6", "network": {"id": "f67bc940-2f01-4255-b12e-427ffcd7e4e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-977195248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e95560897fb46258db0ecd7dc7b9294", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9b2058-61", "ovs_interfaceid": "6e9b2058-6104-4f6c-8c72-f5f15d0d116b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:56:33 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:11:f6,bridge_name='br-int',has_traffic_filtering=True,id=6e9b2058-6104-4f6c-8c72-f5f15d0d116b,network=Network(f67bc940-2f01-4255-b12e-427ffcd7e4e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e9b2058-61') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:56:33 user nova-compute[75100]: DEBUG os_vif [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:11:f6,bridge_name='br-int',has_traffic_filtering=True,id=6e9b2058-6104-4f6c-8c72-f5f15d0d116b,network=Network(f67bc940-2f01-4255-b12e-427ffcd7e4e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e9b2058-61') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 17:56:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:56:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 17:56:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8bc5a11a-5e00-5489-bc6d-6e57a02476e3', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:56:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6e9b2058-61, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:56:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6e9b2058-61, col_values=(('qos', UUID('8aa337c6-9017-471b-850a-2b66529c9669')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:56:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6e9b2058-61, col_values=(('external_ids', {'iface-id': '6e9b2058-6104-4f6c-8c72-f5f15d0d116b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:11:f6', 'vm-uuid': 'eb430407-f836-4510-899f-a5f5d60c73f3'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:56:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:56:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:33 user nova-compute[75100]: INFO os_vif [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:11:f6,bridge_name='br-int',has_traffic_filtering=True,id=6e9b2058-6104-4f6c-8c72-f5f15d0d116b,network=Network(f67bc940-2f01-4255-b12e-427ffcd7e4e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e9b2058-61')
Nov 10 17:56:33 user nova-compute[75100]: INFO nova.compute.manager [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Rebuilding instance
Nov 10 17:56:34 user nova-compute[75100]: DEBUG nova.compute.manager [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 17:56:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:34 user nova-compute[75100]: DEBUG nova.compute.manager [req-e07ca5de-c15c-4f1d-acc3-a1317fceffbf req-7259b716-8fca-44ee-86ee-f6a80a0e38a5 service nova] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Received event network-vif-unplugged-54a1b80b-3910-4ab8-a694-88989c4b6f4e {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:56:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-e07ca5de-c15c-4f1d-acc3-a1317fceffbf req-7259b716-8fca-44ee-86ee-f6a80a0e38a5 service nova] Acquiring lock "c7fbe35b-4794-4eb9-8033-923247064458-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:56:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-e07ca5de-c15c-4f1d-acc3-a1317fceffbf req-7259b716-8fca-44ee-86ee-f6a80a0e38a5 service nova] Lock "c7fbe35b-4794-4eb9-8033-923247064458-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:56:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-e07ca5de-c15c-4f1d-acc3-a1317fceffbf req-7259b716-8fca-44ee-86ee-f6a80a0e38a5 service nova] Lock "c7fbe35b-4794-4eb9-8033-923247064458-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:56:34 user nova-compute[75100]: DEBUG nova.compute.manager [req-e07ca5de-c15c-4f1d-acc3-a1317fceffbf req-7259b716-8fca-44ee-86ee-f6a80a0e38a5 service nova] [instance: c7fbe35b-4794-4eb9-8033-923247064458] No waiting events found dispatching network-vif-unplugged-54a1b80b-3910-4ab8-a694-88989c4b6f4e {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:56:34 user nova-compute[75100]: WARNING nova.compute.manager [req-e07ca5de-c15c-4f1d-acc3-a1317fceffbf req-7259b716-8fca-44ee-86ee-f6a80a0e38a5 service nova] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Received unexpected event network-vif-unplugged-54a1b80b-3910-4ab8-a694-88989c4b6f4e for instance with vm_state active and task_state rebuilding.
Nov 10 17:56:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:35 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Instance destroyed successfully.
Nov 10 17:56:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:36 user nova-compute[75100]: INFO nova.compute.manager [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Detaching volume 0280d371-2779-450b-9c9a-c5adde034308
Nov 10 17:56:36 user nova-compute[75100]: INFO nova.virt.block_device [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Attempting to driver detach volume 0280d371-2779-450b-9c9a-c5adde034308 from mountpoint /dev/vdb
Nov 10 17:56:36 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Attempting to detach device vdb from instance c7fbe35b-4794-4eb9-8033-923247064458 from the persistent domain config. {{(pid=75100) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 17:56:36 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 17:56:36 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 17:56:36 user nova-compute[75100]:   <source dev="/dev/sdc"/>
Nov 10 17:56:36 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 17:56:36 user nova-compute[75100]:   <serial>0280d371-2779-450b-9c9a-c5adde034308</serial>
Nov 10 17:56:36 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 17:56:36 user nova-compute[75100]: </disk>
Nov 10 17:56:36 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 17:56:36 user nova-compute[75100]: DEBUG nova.compute.manager [req-f6f12b09-6914-4e0b-97b7-b2572e9ae9dc req-e297ba53-4dd5-4132-b724-118919461797 service nova] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Received event network-vif-plugged-54a1b80b-3910-4ab8-a694-88989c4b6f4e {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:56:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f6f12b09-6914-4e0b-97b7-b2572e9ae9dc req-e297ba53-4dd5-4132-b724-118919461797 service nova] Acquiring lock "c7fbe35b-4794-4eb9-8033-923247064458-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:56:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f6f12b09-6914-4e0b-97b7-b2572e9ae9dc req-e297ba53-4dd5-4132-b724-118919461797 service nova] Lock "c7fbe35b-4794-4eb9-8033-923247064458-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:56:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f6f12b09-6914-4e0b-97b7-b2572e9ae9dc req-e297ba53-4dd5-4132-b724-118919461797 service nova] Lock "c7fbe35b-4794-4eb9-8033-923247064458-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:56:36 user nova-compute[75100]: DEBUG nova.compute.manager [req-f6f12b09-6914-4e0b-97b7-b2572e9ae9dc req-e297ba53-4dd5-4132-b724-118919461797 service nova] [instance: c7fbe35b-4794-4eb9-8033-923247064458] No waiting events found dispatching network-vif-plugged-54a1b80b-3910-4ab8-a694-88989c4b6f4e {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:56:36 user nova-compute[75100]: WARNING nova.compute.manager [req-f6f12b09-6914-4e0b-97b7-b2572e9ae9dc req-e297ba53-4dd5-4132-b724-118919461797 service nova] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Received unexpected event network-vif-plugged-54a1b80b-3910-4ab8-a694-88989c4b6f4e for instance with vm_state active and task_state rebuilding.
Nov 10 17:56:36 user nova-compute[75100]: DEBUG nova.compute.manager [req-f6f12b09-6914-4e0b-97b7-b2572e9ae9dc req-e297ba53-4dd5-4132-b724-118919461797 service nova] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Received event network-vif-plugged-6e9b2058-6104-4f6c-8c72-f5f15d0d116b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:56:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f6f12b09-6914-4e0b-97b7-b2572e9ae9dc req-e297ba53-4dd5-4132-b724-118919461797 service nova] Acquiring lock "eb430407-f836-4510-899f-a5f5d60c73f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:56:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f6f12b09-6914-4e0b-97b7-b2572e9ae9dc req-e297ba53-4dd5-4132-b724-118919461797 service nova] Lock "eb430407-f836-4510-899f-a5f5d60c73f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:56:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f6f12b09-6914-4e0b-97b7-b2572e9ae9dc req-e297ba53-4dd5-4132-b724-118919461797 service nova] Lock "eb430407-f836-4510-899f-a5f5d60c73f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:56:36 user nova-compute[75100]: DEBUG nova.compute.manager [req-f6f12b09-6914-4e0b-97b7-b2572e9ae9dc req-e297ba53-4dd5-4132-b724-118919461797 service nova] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] No waiting events found dispatching network-vif-plugged-6e9b2058-6104-4f6c-8c72-f5f15d0d116b {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:56:36 user nova-compute[75100]: WARNING nova.compute.manager [req-f6f12b09-6914-4e0b-97b7-b2572e9ae9dc req-e297ba53-4dd5-4132-b724-118919461797 service nova] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Received unexpected event network-vif-plugged-6e9b2058-6104-4f6c-8c72-f5f15d0d116b for instance with vm_state resized and task_state resize_reverting.
Nov 10 17:56:36 user nova-compute[75100]: DEBUG nova.compute.manager [req-f6f12b09-6914-4e0b-97b7-b2572e9ae9dc req-e297ba53-4dd5-4132-b724-118919461797 service nova] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Received event network-vif-plugged-6e9b2058-6104-4f6c-8c72-f5f15d0d116b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:56:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f6f12b09-6914-4e0b-97b7-b2572e9ae9dc req-e297ba53-4dd5-4132-b724-118919461797 service nova] Acquiring lock "eb430407-f836-4510-899f-a5f5d60c73f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:56:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f6f12b09-6914-4e0b-97b7-b2572e9ae9dc req-e297ba53-4dd5-4132-b724-118919461797 service nova] Lock "eb430407-f836-4510-899f-a5f5d60c73f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:56:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f6f12b09-6914-4e0b-97b7-b2572e9ae9dc req-e297ba53-4dd5-4132-b724-118919461797 service nova] Lock "eb430407-f836-4510-899f-a5f5d60c73f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:56:36 user nova-compute[75100]: DEBUG nova.compute.manager [req-f6f12b09-6914-4e0b-97b7-b2572e9ae9dc req-e297ba53-4dd5-4132-b724-118919461797 service nova] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] No waiting events found dispatching network-vif-plugged-6e9b2058-6104-4f6c-8c72-f5f15d0d116b {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:56:36 user nova-compute[75100]: WARNING nova.compute.manager [req-f6f12b09-6914-4e0b-97b7-b2572e9ae9dc req-e297ba53-4dd5-4132-b724-118919461797 service nova] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Received unexpected event network-vif-plugged-6e9b2058-6104-4f6c-8c72-f5f15d0d116b for instance with vm_state resized and task_state resize_reverting.
Nov 10 17:56:36 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Successfully detached device vdb from instance c7fbe35b-4794-4eb9-8033-923247064458 from the persistent domain config.
Nov 10 17:56:36 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 17:56:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, {'target_iqn': 'iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gzFeJSLW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 17:56:36 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 10 17:56:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 17:56:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 17:56:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:36 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[71639504-7399-458d-84db-fc5ee7c71068]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 17:56:36 user nova-compute[75100]: No targets found.
Nov 10 17:56:36 user nova-compute[75100]: iSNS:
Nov 10 17:56:36 user nova-compute[75100]: No targets found.
Nov 10 17:56:36 user nova-compute[75100]: STATIC:
Nov 10 17:56:36 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c
Nov 10 17:56:36 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 17:56:36 user nova-compute[75100]:                 Iface Name: default
Nov 10 17:56:36 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54
Nov 10 17:56:36 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 17:56:36 user nova-compute[75100]:                 Iface Name: default
Nov 10 17:56:36 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308
Nov 10 17:56:36 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 17:56:36 user nova-compute[75100]:                 Iface Name: default
Nov 10 17:56:36 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652
Nov 10 17:56:36 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 17:56:36 user nova-compute[75100]:                 Iface Name: default
Nov 10 17:56:36 user nova-compute[75100]: FIRMWARE:
Nov 10 17:56:36 user nova-compute[75100]: No targets found.
Nov 10 17:56:36 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:56:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 17:56:36 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 17:56:36 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 17:56:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 17:56:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:36 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[81dd75f9-c77a-4cb5-8d41-f973d4a83af6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:36 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[071036b2-f1df-424a-874a-81d82cd4e3b2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)
Nov 10 17:56:36 user nova-compute[75100]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)
Nov 10 17:56:36 user nova-compute[75100]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 (non-flash)
Nov 10 17:56:36 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c (non-flash)
Nov 10 17:56:36 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:56:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)
Nov 10 17:56:36 user nova-compute[75100]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)
Nov 10 17:56:36 user nova-compute[75100]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 (non-flash)
Nov 10 17:56:36 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c (non-flash)
Nov 10 17:56:36 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 17:56:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3bc78b880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308'): ({'sdc'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 17:56:36 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Removing single pathed devices sdc {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 17:56:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:36 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[48baec65-9037-4574-9c66-2155ca6ee869]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:36 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e300670a-21e6-4f10-a23f-17ac575df73d]: (4, ('ok\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:36 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Flushing IO for device /dev/sdc {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 17:56:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:36 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5f6dd5-21d3-476c-9f77-04125c2b9ed2]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:36 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 17:56:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:36 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[24efb217-4446-49f3-ab83-8f5a320e72f9]: (4, ('1', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:36 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 17:56:36 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] SCSI volumes sdc have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 17:56:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 17:56:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:36 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd815fd9-b7ab-432e-b0d2-21cffe946cff]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:56:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 -p 172.16.0.220:3260 --logout {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:36 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef172cb-b4d7-4a14-b08b-ee9111feaa60]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308, portal: 172.16.0.220,3260]
Nov 10 17:56:36 user nova-compute[75100]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308, portal: 172.16.0.220,3260] successful.
Nov 10 17:56:36 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:56:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 -p 172.16.0.220:3260 --op delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3709680a-2eda-44b4-b0b0-ac87f728f706]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:56:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 17:56:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] <== disconnect_volume: return (338ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 17:56:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 17:56:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:56:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:56:37 user nova-compute[75100]: DEBUG nova.objects.instance [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lazy-loading 'pci_requests' on Instance uuid 61e73913-30a5-4eaa-9bc0-6e17a0288035 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:56:37 user nova-compute[75100]: DEBUG nova.objects.instance [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lazy-loading 'numa_topology' on Instance uuid 61e73913-30a5-4eaa-9bc0-6e17a0288035 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:56:37 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 17:56:37 user nova-compute[75100]: INFO nova.compute.claims [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Claim successful on node user
Nov 10 17:56:38 user nova-compute[75100]: DEBUG nova.compute.manager [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 17:56:38 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Instance running successfully.
Nov 10 17:56:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] finish_revert_migration finished successfully. {{(pid=75100) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 10 17:56:38 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:56:38 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:56:38 user nova-compute[75100]: INFO nova.compute.manager [None req-e8a4d920-62c4-4ed6-befd-716007df9e52 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Updating instance to original state: 'active'
Nov 10 17:56:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.625s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:56:38 user nova-compute[75100]: INFO nova.network.neutron [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Updating port 5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 10 17:56:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Acquiring lock "refresh_cache-61e73913-30a5-4eaa-9bc0-6e17a0288035" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:56:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Acquired lock "refresh_cache-61e73913-30a5-4eaa-9bc0-6e17a0288035" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:56:39 user nova-compute[75100]: DEBUG nova.network.neutron [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 17:56:39 user nova-compute[75100]: DEBUG nova.compute.manager [req-d192fce4-5058-4dd3-a64e-05a1bc2be2ce req-5cf51d7d-499f-4749-9848-5ebc89cbb520 service nova] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Received event network-changed-5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:56:39 user nova-compute[75100]: DEBUG nova.compute.manager [req-d192fce4-5058-4dd3-a64e-05a1bc2be2ce req-5cf51d7d-499f-4749-9848-5ebc89cbb520 service nova] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Refreshing instance network info cache due to event network-changed-5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 17:56:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d192fce4-5058-4dd3-a64e-05a1bc2be2ce req-5cf51d7d-499f-4749-9848-5ebc89cbb520 service nova] Acquiring lock "refresh_cache-61e73913-30a5-4eaa-9bc0-6e17a0288035" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:56:39 user nova-compute[75100]: DEBUG nova.network.neutron [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Updating instance_info_cache with network_info: [{"id": "5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c", "address": "fa:16:3e:75:69:61", "network": {"id": "7a78ac5d-8f24-436d-9cb9-05f4efecb101", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-476509015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae38bb92c5474a578f3827bdae12cd74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e7d8cb1-7f", "ovs_interfaceid": "5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:56:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Releasing lock "refresh_cache-61e73913-30a5-4eaa-9bc0-6e17a0288035" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:56:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 17:56:39 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Creating image(s)
Nov 10 17:56:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Acquiring lock "/opt/stack/data/nova/instances/61e73913-30a5-4eaa-9bc0-6e17a0288035/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:56:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "/opt/stack/data/nova/instances/61e73913-30a5-4eaa-9bc0-6e17a0288035/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:56:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "/opt/stack/data/nova/instances/61e73913-30a5-4eaa-9bc0-6e17a0288035/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:56:39 user nova-compute[75100]: DEBUG nova.objects.instance [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lazy-loading 'trusted_certs' on Instance uuid 61e73913-30a5-4eaa-9bc0-6e17a0288035 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:56:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d192fce4-5058-4dd3-a64e-05a1bc2be2ce req-5cf51d7d-499f-4749-9848-5ebc89cbb520 service nova] Acquired lock "refresh_cache-61e73913-30a5-4eaa-9bc0-6e17a0288035" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:56:39 user nova-compute[75100]: DEBUG nova.network.neutron [req-d192fce4-5058-4dd3-a64e-05a1bc2be2ce req-5cf51d7d-499f-4749-9848-5ebc89cbb520 service nova] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Refreshing network info cache for port 5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 17:56:39 user nova-compute[75100]: DEBUG nova.objects.base [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Object Instance<61e73913-30a5-4eaa-9bc0-6e17a0288035> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 17:56:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Acquiring lock "32b0d5f28832cb638516d0f6fa49f7e7c143221f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:56:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "32b0d5f28832cb638516d0f6fa49f7e7c143221f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:56:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/32b0d5f28832cb638516d0f6fa49f7e7c143221f.part --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/32b0d5f28832cb638516d0f6fa49f7e7c143221f.part --force-share --output=json" returned: 0 in 0.194s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:41 user nova-compute[75100]: DEBUG nova.virt.images [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] 0a7539df-e92a-4f1e-a032-730dd60e763f was qcow2, converting to raw {{(pid=75100) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 10 17:56:41 user nova-compute[75100]: DEBUG nova.privsep.utils [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75100) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 17:56:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/32b0d5f28832cb638516d0f6fa49f7e7c143221f.part /opt/stack/data/nova/instances/_base/32b0d5f28832cb638516d0f6fa49f7e7c143221f.converted {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/32b0d5f28832cb638516d0f6fa49f7e7c143221f.part /opt/stack/data/nova/instances/_base/32b0d5f28832cb638516d0f6fa49f7e7c143221f.converted" returned: 0 in 0.295s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/32b0d5f28832cb638516d0f6fa49f7e7c143221f.converted --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:41 user nova-compute[75100]: DEBUG nova.network.neutron [req-d192fce4-5058-4dd3-a64e-05a1bc2be2ce req-5cf51d7d-499f-4749-9848-5ebc89cbb520 service nova] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Updated VIF entry in instance network info cache for port 5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 17:56:41 user nova-compute[75100]: DEBUG nova.network.neutron [req-d192fce4-5058-4dd3-a64e-05a1bc2be2ce req-5cf51d7d-499f-4749-9848-5ebc89cbb520 service nova] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Updating instance_info_cache with network_info: [{"id": "5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c", "address": "fa:16:3e:75:69:61", "network": {"id": "7a78ac5d-8f24-436d-9cb9-05f4efecb101", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-476509015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae38bb92c5474a578f3827bdae12cd74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e7d8cb1-7f", "ovs_interfaceid": "5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:56:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d192fce4-5058-4dd3-a64e-05a1bc2be2ce req-5cf51d7d-499f-4749-9848-5ebc89cbb520 service nova] Releasing lock "refresh_cache-61e73913-30a5-4eaa-9bc0-6e17a0288035" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:56:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/32b0d5f28832cb638516d0f6fa49f7e7c143221f.converted --force-share --output=json" returned: 0 in 0.208s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "32b0d5f28832cb638516d0f6fa49f7e7c143221f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.690s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:56:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/32b0d5f28832cb638516d0f6fa49f7e7c143221f --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/32b0d5f28832cb638516d0f6fa49f7e7c143221f --force-share --output=json" returned: 0 in 0.181s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Acquiring lock "32b0d5f28832cb638516d0f6fa49f7e7c143221f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:56:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "32b0d5f28832cb638516d0f6fa49f7e7c143221f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:56:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/32b0d5f28832cb638516d0f6fa49f7e7c143221f --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/32b0d5f28832cb638516d0f6fa49f7e7c143221f --force-share --output=json" returned: 0 in 0.212s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/32b0d5f28832cb638516d0f6fa49f7e7c143221f,backing_fmt=raw /opt/stack/data/nova/instances/61e73913-30a5-4eaa-9bc0-6e17a0288035/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/32b0d5f28832cb638516d0f6fa49f7e7c143221f,backing_fmt=raw /opt/stack/data/nova/instances/61e73913-30a5-4eaa-9bc0-6e17a0288035/disk 1073741824" returned: 0 in 0.050s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "32b0d5f28832cb638516d0f6fa49f7e7c143221f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:56:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/32b0d5f28832cb638516d0f6fa49f7e7c143221f --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/32b0d5f28832cb638516d0f6fa49f7e7c143221f --force-share --output=json" returned: 0 in 0.227s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:42 user nova-compute[75100]: DEBUG nova.objects.instance [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lazy-loading 'migration_context' on Instance uuid 61e73913-30a5-4eaa-9bc0-6e17a0288035 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:56:42 user nova-compute[75100]: DEBUG nova.objects.base [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Object Instance<61e73913-30a5-4eaa-9bc0-6e17a0288035> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 17:56:42 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Rebasing disk image.
Nov 10 17:56:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.181s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 -F raw /opt/stack/data/nova/instances/61e73913-30a5-4eaa-9bc0-6e17a0288035/disk {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 -F raw /opt/stack/data/nova/instances/61e73913-30a5-4eaa-9bc0-6e17a0288035/disk" returned: 0 in 2.464s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:44 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 17:56:44 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Ensure instance console log exists: /opt/stack/data/nova/instances/61e73913-30a5-4eaa-9bc0-6e17a0288035/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 17:56:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:56:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:56:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:56:44 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Start _get_guest_xml network_info=[{"id": "5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c", "address": "fa:16:3e:75:69:61", "network": {"id": "7a78ac5d-8f24-436d-9cb9-05f4efecb101", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-476509015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae38bb92c5474a578f3827bdae12cd74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e7d8cb1-7f", "ovs_interfaceid": "5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='00cd7aa036f6864f646fee9d7029cabc',container_format='bare',created_at=2023-11-10T17:54:14Z,direct_url=<?>,disk_format='qcow2',id=0a7539df-e92a-4f1e-a032-730dd60e763f,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-887105111-shelved',owner='ae38bb92c5474a578f3827bdae12cd74',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-10T17:54:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'e3cc5321-4d40-49ee-885c-700e14741732'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BSWFveum', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '61e73913-30a5-4eaa-9bc0-6e17a0288035', 'attached_at': '', 'detached_at': '', 'volume_id': '6ccb0564-db0c-4906-ba81-08ec9b05c5a7', 'serial': '6ccb0564-db0c-4906-ba81-08ec9b05c5a7'}, 'mount_device': '/dev/vdc', 'attachment_id': '67a12b68-8a50-4321-925a-c0e97becee1e', 'device_type': 'disk', 'guest_format': None, 'boot_index': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 17:56:44 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:56:44 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:56:44 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 17:56:44 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 17:56:44 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 17:56:44 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 17:56:44 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 17:56:44 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T17:40:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='00cd7aa036f6864f646fee9d7029cabc',container_format='bare',created_at=2023-11-10T17:54:14Z,direct_url=<?>,disk_format='qcow2',id=0a7539df-e92a-4f1e-a032-730dd60e763f,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-887105111-shelved',owner='ae38bb92c5474a578f3827bdae12cd74',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-10T17:54:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 17:56:44 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 17:56:44 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 17:56:44 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 17:56:44 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 17:56:44 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 17:56:44 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 17:56:44 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 17:56:44 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 17:56:44 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 17:56:44 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 17:56:44 user nova-compute[75100]: DEBUG nova.objects.instance [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lazy-loading 'vcpu_model' on Instance uuid 61e73913-30a5-4eaa-9bc0-6e17a0288035 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:56:44 user nova-compute[75100]: DEBUG nova.objects.base [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Object Instance<61e73913-30a5-4eaa-9bc0-6e17a0288035> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 17:56:45 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 17:56:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BSWFveum', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 17:56:45 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 17:56:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 17:56:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 17:56:45 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 17:56:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 17:56:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 17:56:45 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 17:56:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7 -p 172.16.0.220:3260 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7 -p 172.16.0.220:3260" returned: 21 in 0.081s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:45 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f9bcfc-9a52-4b69-8276-9c775dff49ec]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 17:56:45 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:56:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:45 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2007e286-b7d9-4d15-b274-4f3ce89989ae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7] added\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7] added
Nov 10 17:56:45 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:56:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:45 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e44c97-9ed0-488c-a971-04e63da2ae70]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:56:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:45 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0db8f7-ce56-43f5-8184-6017fbe293ba]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:56:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BSWFveum {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BSWFveum" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:45 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a99c45-6fa6-4a23-88fd-2e21908064ca]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BSWFveum'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:56:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:45 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b24af55-05eb-4935-91be-c545336362d2]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:56:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:45 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaae35b4-f1b9-4774-b26a-09fddd0282e5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)
Nov 10 17:56:45 user nova-compute[75100]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)
Nov 10 17:56:45 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c (non-flash)
Nov 10 17:56:45 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:56:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)
Nov 10 17:56:45 user nova-compute[75100]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)
Nov 10 17:56:45 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c (non-flash)
Nov 10 17:56:45 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 17:56:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7 -p 172.16.0.220:3260 --login {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:45 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[519fc798-dae2-485a-bcf1-bda7620cb690]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7, portal: 172.16.0.220,3260]
Nov 10 17:56:45 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7, portal: 172.16.0.220,3260] successful.
Nov 10 17:56:45 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:56:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:45 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[71358baa-ec47-4af2-a5b0-b6ac88978195]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:56:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:45 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17f0b7e-05eb-458f-bf90-4bc45df7cdd9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)
Nov 10 17:56:45 user nova-compute[75100]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)
Nov 10 17:56:45 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c (non-flash)
Nov 10 17:56:45 user nova-compute[75100]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7 (non-flash)
Nov 10 17:56:45 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:56:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)
Nov 10 17:56:45 user nova-compute[75100]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)
Nov 10 17:56:45 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c (non-flash)
Nov 10 17:56:45 user nova-compute[75100]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7 (non-flash)
Nov 10 17:56:45 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 17:56:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.362s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 17:56:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 17:56:45 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 17:56:45 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 17:56:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:45 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3750370e-a132-4c95-84dd-5bc30a336491]: (4, ('- - 0', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:45 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: None {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 17:56:46 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 17:56:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BSWFveum', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 17:56:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.392s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 17:56:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] <== connect_volume: return (1393ms) {'type': 'block', 'scsi_wwn': '23862653161613364', 'path': '/dev/sdc'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 17:56:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23862653161613364', 'path': '/dev/sdc'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 17:56:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T17:52:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-887105111',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-887105111',id=21,image_ref='0a7539df-e92a-4f1e-a032-730dd60e763f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1379432359',keypairs=<?>,launch_index=0,launched_at=2023-11-10T17:52:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ae38bb92c5474a578f3827bdae12cd74',ramdisk_id='',reservation_id='r-w7bzktq8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2073508773',owner_user_name='tempest-AttachVolumeShelveTestJSON-2073508773-project-member',shelved_at='2023-11-10T17:54:20.483356',shelved_host='user',shelved_image_id='0a7539df-e92a-4f1e-a032-730dd60e763f'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:56:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='805917c846f34264b51388bfd9a8413f',uuid=61e73913-30a5-4eaa-9bc0-6e17a0288035,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c", "address": "fa:16:3e:75:69:61", "network": {"id": "7a78ac5d-8f24-436d-9cb9-05f4efecb101", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-476509015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae38bb92c5474a578f3827bdae12cd74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e7d8cb1-7f", "ovs_interfaceid": "5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 17:56:46 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Converting VIF {"id": "5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c", "address": "fa:16:3e:75:69:61", "network": {"id": "7a78ac5d-8f24-436d-9cb9-05f4efecb101", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-476509015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae38bb92c5474a578f3827bdae12cd74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e7d8cb1-7f", "ovs_interfaceid": "5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:56:46 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:69:61,bridge_name='br-int',has_traffic_filtering=True,id=5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c,network=Network(7a78ac5d-8f24-436d-9cb9-05f4efecb101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e7d8cb1-7f') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:56:46 user nova-compute[75100]: DEBUG nova.objects.instance [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lazy-loading 'pci_devices' on Instance uuid 61e73913-30a5-4eaa-9bc0-6e17a0288035 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:56:46 user nova-compute[75100]: DEBUG nova.objects.base [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Object Instance<61e73913-30a5-4eaa-9bc0-6e17a0288035> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 17:56:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] End _get_guest_xml xml=<domain type="kvm">
Nov 10 17:56:46 user nova-compute[75100]:   <uuid>61e73913-30a5-4eaa-9bc0-6e17a0288035</uuid>
Nov 10 17:56:46 user nova-compute[75100]:   <name>instance-00000015</name>
Nov 10 17:56:46 user nova-compute[75100]:   <memory>524288</memory>
Nov 10 17:56:46 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 10 17:56:46 user nova-compute[75100]:   <metadata>
Nov 10 17:56:46 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 17:56:46 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 10 17:56:46 user nova-compute[75100]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-887105111</nova:name>
Nov 10 17:56:46 user nova-compute[75100]:       <nova:creationTime>2023-11-10 17:56:44</nova:creationTime>
Nov 10 17:56:46 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 10 17:56:46 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 10 17:56:46 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 10 17:56:46 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 10 17:56:46 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 17:56:46 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 10 17:56:46 user nova-compute[75100]:       </nova:flavor>
Nov 10 17:56:46 user nova-compute[75100]:       <nova:owner>
Nov 10 17:56:46 user nova-compute[75100]:         <nova:user uuid="805917c846f34264b51388bfd9a8413f">tempest-AttachVolumeShelveTestJSON-2073508773-project-member</nova:user>
Nov 10 17:56:46 user nova-compute[75100]:         <nova:project uuid="ae38bb92c5474a578f3827bdae12cd74">tempest-AttachVolumeShelveTestJSON-2073508773</nova:project>
Nov 10 17:56:46 user nova-compute[75100]:       </nova:owner>
Nov 10 17:56:46 user nova-compute[75100]:       <nova:root type="image" uuid="0a7539df-e92a-4f1e-a032-730dd60e763f"/>
Nov 10 17:56:46 user nova-compute[75100]:       <nova:ports>
Nov 10 17:56:46 user nova-compute[75100]:         <nova:port uuid="5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c">
Nov 10 17:56:46 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 10 17:56:46 user nova-compute[75100]:         </nova:port>
Nov 10 17:56:46 user nova-compute[75100]:       </nova:ports>
Nov 10 17:56:46 user nova-compute[75100]:     </nova:instance>
Nov 10 17:56:46 user nova-compute[75100]:   </metadata>
Nov 10 17:56:46 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 10 17:56:46 user nova-compute[75100]:     <system>
Nov 10 17:56:46 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 17:56:46 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 10 17:56:46 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 10 17:56:46 user nova-compute[75100]:       <entry name="serial">61e73913-30a5-4eaa-9bc0-6e17a0288035</entry>
Nov 10 17:56:46 user nova-compute[75100]:       <entry name="uuid">61e73913-30a5-4eaa-9bc0-6e17a0288035</entry>
Nov 10 17:56:46 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 10 17:56:46 user nova-compute[75100]:     </system>
Nov 10 17:56:46 user nova-compute[75100]:   </sysinfo>
Nov 10 17:56:46 user nova-compute[75100]:   <os>
Nov 10 17:56:46 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 17:56:46 user nova-compute[75100]:     <boot dev="hd"/>
Nov 10 17:56:46 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 10 17:56:46 user nova-compute[75100]:   </os>
Nov 10 17:56:46 user nova-compute[75100]:   <features>
Nov 10 17:56:46 user nova-compute[75100]:     <acpi/>
Nov 10 17:56:46 user nova-compute[75100]:     <apic/>
Nov 10 17:56:46 user nova-compute[75100]:     <vmcoreinfo/>
Nov 10 17:56:46 user nova-compute[75100]:   </features>
Nov 10 17:56:46 user nova-compute[75100]:   <clock offset="utc">
Nov 10 17:56:46 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 17:56:46 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 17:56:46 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 10 17:56:46 user nova-compute[75100]:   </clock>
Nov 10 17:56:46 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 10 17:56:46 user nova-compute[75100]:     <model>Nehalem</model>
Nov 10 17:56:46 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 17:56:46 user nova-compute[75100]:   </cpu>
Nov 10 17:56:46 user nova-compute[75100]:   <devices>
Nov 10 17:56:46 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 10 17:56:46 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 17:56:46 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/61e73913-30a5-4eaa-9bc0-6e17a0288035/disk"/>
Nov 10 17:56:46 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 10 17:56:46 user nova-compute[75100]:     </disk>
Nov 10 17:56:46 user nova-compute[75100]:     <disk type="block" device="disk">
Nov 10 17:56:46 user nova-compute[75100]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 17:56:46 user nova-compute[75100]:       <source dev="/dev/sdc"/>
Nov 10 17:56:46 user nova-compute[75100]:       <target dev="vdc" bus="virtio"/>
Nov 10 17:56:46 user nova-compute[75100]:       <serial>6ccb0564-db0c-4906-ba81-08ec9b05c5a7</serial>
Nov 10 17:56:46 user nova-compute[75100]:     </disk>
Nov 10 17:56:46 user nova-compute[75100]:     <interface type="ethernet">
Nov 10 17:56:46 user nova-compute[75100]:       <mac address="fa:16:3e:75:69:61"/>
Nov 10 17:56:46 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:56:46 user nova-compute[75100]:       <mtu size="1442"/>
Nov 10 17:56:46 user nova-compute[75100]:       <target dev="tap5e7d8cb1-7f"/>
Nov 10 17:56:46 user nova-compute[75100]:     </interface>
Nov 10 17:56:46 user nova-compute[75100]:     <serial type="pty">
Nov 10 17:56:46 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/61e73913-30a5-4eaa-9bc0-6e17a0288035/console.log" append="off"/>
Nov 10 17:56:46 user nova-compute[75100]:     </serial>
Nov 10 17:56:46 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 17:56:46 user nova-compute[75100]:     <video>
Nov 10 17:56:46 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:56:46 user nova-compute[75100]:     </video>
Nov 10 17:56:46 user nova-compute[75100]:     <rng model="virtio">
Nov 10 17:56:46 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 10 17:56:46 user nova-compute[75100]:     </rng>
Nov 10 17:56:46 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 10 17:56:46 user nova-compute[75100]:     <memballoon model="virtio">
Nov 10 17:56:46 user nova-compute[75100]:       <stats period="10"/>
Nov 10 17:56:46 user nova-compute[75100]:     </memballoon>
Nov 10 17:56:46 user nova-compute[75100]:   </devices>
Nov 10 17:56:46 user nova-compute[75100]: </domain>
Nov 10 17:56:46 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 17:56:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T17:52:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-887105111',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-887105111',id=21,image_ref='0a7539df-e92a-4f1e-a032-730dd60e763f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1379432359',keypairs=<?>,launch_index=0,launched_at=2023-11-10T17:52:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ae38bb92c5474a578f3827bdae12cd74',ramdisk_id='',reservation_id='r-w7bzktq8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2073508773',owner_user_name='tempest-AttachVolumeShelveTestJSON-2073508773-project-member',shelved_at='2023-11-10T17:54:20.483356',shelved_host='user',shelved_image_id='0a7539df-e92a-4f1e-a032-730dd60e763f'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:56:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='805917c846f34264b51388bfd9a8413f',uuid=61e73913-30a5-4eaa-9bc0-6e17a0288035,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c", "address": "fa:16:3e:75:69:61", "network": {"id": "7a78ac5d-8f24-436d-9cb9-05f4efecb101", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-476509015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae38bb92c5474a578f3827bdae12cd74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e7d8cb1-7f", "ovs_interfaceid": "5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 17:56:46 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Converting VIF {"id": "5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c", "address": "fa:16:3e:75:69:61", "network": {"id": "7a78ac5d-8f24-436d-9cb9-05f4efecb101", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-476509015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae38bb92c5474a578f3827bdae12cd74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e7d8cb1-7f", "ovs_interfaceid": "5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:56:46 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:69:61,bridge_name='br-int',has_traffic_filtering=True,id=5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c,network=Network(7a78ac5d-8f24-436d-9cb9-05f4efecb101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e7d8cb1-7f') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:56:46 user nova-compute[75100]: DEBUG os_vif [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:69:61,bridge_name='br-int',has_traffic_filtering=True,id=5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c,network=Network(7a78ac5d-8f24-436d-9cb9-05f4efecb101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e7d8cb1-7f') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 17:56:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:56:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 17:56:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f1205a18-83eb-5e79-94fb-6d63bb89cd0c', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:56:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:56:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5e7d8cb1-7f, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:56:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5e7d8cb1-7f, col_values=(('qos', UUID('7cb498cf-55b8-448c-a1f5-1cbf5bd0d7b8')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:56:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5e7d8cb1-7f, col_values=(('external_ids', {'iface-id': '5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:69:61', 'vm-uuid': '61e73913-30a5-4eaa-9bc0-6e17a0288035'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:56:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:56:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:46 user nova-compute[75100]: INFO os_vif [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:69:61,bridge_name='br-int',has_traffic_filtering=True,id=5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c,network=Network(7a78ac5d-8f24-436d-9cb9-05f4efecb101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e7d8cb1-7f')
Nov 10 17:56:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 17:56:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 17:56:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] No VIF found with MAC fa:16:3e:75:69:61, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG nova.compute.manager [req-ad98821d-6458-4a9a-9ef4-5291c07014f5 req-39aaf933-7a17-4a7f-b913-25b9433acef0 service nova] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Received event network-vif-plugged-5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ad98821d-6458-4a9a-9ef4-5291c07014f5 req-39aaf933-7a17-4a7f-b913-25b9433acef0 service nova] Acquiring lock "61e73913-30a5-4eaa-9bc0-6e17a0288035-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ad98821d-6458-4a9a-9ef4-5291c07014f5 req-39aaf933-7a17-4a7f-b913-25b9433acef0 service nova] Lock "61e73913-30a5-4eaa-9bc0-6e17a0288035-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ad98821d-6458-4a9a-9ef4-5291c07014f5 req-39aaf933-7a17-4a7f-b913-25b9433acef0 service nova] Lock "61e73913-30a5-4eaa-9bc0-6e17a0288035-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG nova.compute.manager [req-ad98821d-6458-4a9a-9ef4-5291c07014f5 req-39aaf933-7a17-4a7f-b913-25b9433acef0 service nova] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] No waiting events found dispatching network-vif-plugged-5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:56:48 user nova-compute[75100]: WARNING nova.compute.manager [req-ad98821d-6458-4a9a-9ef4-5291c07014f5 req-39aaf933-7a17-4a7f-b913-25b9433acef0 service nova] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Received unexpected event network-vif-plugged-5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c for instance with vm_state shelved_offloaded and task_state spawning.
Nov 10 17:56:48 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Instance destroyed successfully.
Nov 10 17:56:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:53:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-843010782',display_name='tempest-ServerActionsTestOtherA-server-523741731',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-843010782',id=24,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiOZtaw5osdCG7Z7OltXtNzbXyV1FVC6Yjpxvw/cDI+myaYVJpvsg9jfQJ1xjf+l5X7jK/9ICsmh5wP1Dm3CArptdAr7p9gmRDbitYb+wjwjgZ+DGtTIty8caL67y+u8g==',key_name='tempest-keypair-1694465190',keypairs=<?>,launch_index=0,launched_at=2023-11-10T17:53:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ce7bb141ef59487dbb2ce6243c5002af',ramdisk_id='',reservation_id='r-pq63h9x0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1364670684',owner_user_name='tempest-ServerActionsTestOtherA-1364670684-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:56:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f4df424af2343a2a27e869502651216',uuid=c7fbe35b-4794-4eb9-8033-923247064458,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "54a1b80b-3910-4ab8-a694-88989c4b6f4e", "address": "fa:16:3e:d3:5e:89", "network": {"id": "bf1edb58-ef26-40ca-8ec9-853fa05de13d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1416469583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7bb141ef59487dbb2ce6243c5002af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54a1b80b-39", "ovs_interfaceid": "54a1b80b-3910-4ab8-a694-88989c4b6f4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Converting VIF {"id": "54a1b80b-3910-4ab8-a694-88989c4b6f4e", "address": "fa:16:3e:d3:5e:89", "network": {"id": "bf1edb58-ef26-40ca-8ec9-853fa05de13d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1416469583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7bb141ef59487dbb2ce6243c5002af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54a1b80b-39", "ovs_interfaceid": "54a1b80b-3910-4ab8-a694-88989c4b6f4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:5e:89,bridge_name='br-int',has_traffic_filtering=True,id=54a1b80b-3910-4ab8-a694-88989c4b6f4e,network=Network(bf1edb58-ef26-40ca-8ec9-853fa05de13d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54a1b80b-39') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG os_vif [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:5e:89,bridge_name='br-int',has_traffic_filtering=True,id=54a1b80b-3910-4ab8-a694-88989c4b6f4e,network=Network(bf1edb58-ef26-40ca-8ec9-853fa05de13d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54a1b80b-39') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap54a1b80b-39, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7bab61e3-ac9a-422b-b04f-07bcf06f6bc7) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:48 user nova-compute[75100]: INFO os_vif [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:5e:89,bridge_name='br-int',has_traffic_filtering=True,id=54a1b80b-3910-4ab8-a694-88989c4b6f4e,network=Network(bf1edb58-ef26-40ca-8ec9-853fa05de13d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54a1b80b-39')
Nov 10 17:56:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, {'target_iqn': 'iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gzFeJSLW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 17:56:48 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 10 17:56:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad73d6c8-2e3c-484d-bca4-d31ff7dd1a37]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 17:56:48 user nova-compute[75100]: No targets found.
Nov 10 17:56:48 user nova-compute[75100]: iSNS:
Nov 10 17:56:48 user nova-compute[75100]: No targets found.
Nov 10 17:56:48 user nova-compute[75100]: STATIC:
Nov 10 17:56:48 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c
Nov 10 17:56:48 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 17:56:48 user nova-compute[75100]:                 Iface Name: default
Nov 10 17:56:48 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54
Nov 10 17:56:48 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 17:56:48 user nova-compute[75100]:                 Iface Name: default
Nov 10 17:56:48 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652
Nov 10 17:56:48 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 17:56:48 user nova-compute[75100]:                 Iface Name: default
Nov 10 17:56:48 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7
Nov 10 17:56:48 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 17:56:48 user nova-compute[75100]:                 Iface Name: default
Nov 10 17:56:48 user nova-compute[75100]: FIRMWARE:
Nov 10 17:56:48 user nova-compute[75100]: No targets found.
Nov 10 17:56:48 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 17:56:48 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 17:56:48 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e78647-a15e-4642-acc4-8e1b868de7bc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94affa4-6985-428e-9ace-3e935249588f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)
Nov 10 17:56:48 user nova-compute[75100]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)
Nov 10 17:56:48 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c (non-flash)
Nov 10 17:56:48 user nova-compute[75100]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7 (non-flash)
Nov 10 17:56:48 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)
Nov 10 17:56:48 user nova-compute[75100]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)
Nov 10 17:56:48 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c (non-flash)
Nov 10 17:56:48 user nova-compute[75100]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7 (non-flash)
Nov 10 17:56:48 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3bc63b640>, {}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Disconnecting from: [] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.112s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] <== disconnect_volume: return (113ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 17:56:48 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Deleting instance files /opt/stack/data/nova/instances/c7fbe35b-4794-4eb9-8033-923247064458_del
Nov 10 17:56:48 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Deletion of /opt/stack/data/nova/instances/c7fbe35b-4794-4eb9-8033-923247064458_del complete
Nov 10 17:56:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG nova.compute.manager [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 17:56:48 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Creating image(s)
Nov 10 17:56:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Did not create local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Ensure instance console log exists: /opt/stack/data/nova/instances/6d227210-c4df-4aa7-9969-70fa137aeb63/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Start _get_guest_xml network_info=[{"id": "230f2661-361c-4699-8dbc-fac4fbc6b612", "address": "fa:16:3e:9d:d1:eb", "network": {"id": "2a85480b-f67d-4ef1-b967-3e93af57d7c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1717495768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9cd441a46aa4a579feff608d6ff9bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap230f2661-36", "ovs_interfaceid": "230f2661-361c-4699-8dbc-fac4fbc6b612", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IcpQGmha', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6d227210-c4df-4aa7-9969-70fa137aeb63', 'attached_at': '', 'detached_at': '', 'volume_id': 'e6c2e35c-41f9-4c5b-92da-f29547ae8b00', 'serial': 'e6c2e35c-41f9-4c5b-92da-f29547ae8b00'}, 'mount_device': '/dev/vda', 'attachment_id': 'c0d9201b-4229-4c42-ae66-54ba8ffccbec', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 17:56:48 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:56:48 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:56:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T17:40:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IcpQGmha', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 17:56:48 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 17:56:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 17:56:48 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 17:56:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 17:56:48 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 17:56:48 user nova-compute[75100]: INFO nova.virt.block_device [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Booting with volume 0280d371-2779-450b-9c9a-c5adde034308 at /dev/vdb
Nov 10 17:56:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 -p 172.16.0.220:3260 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e729c38-ac9c-4d06-91a3-7b4373d6ad76]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 17:56:48 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:56:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 -p 172.16.0.220:3260 --interface default --op new {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:49 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac6154d-5ca1-466b-aafe-640c6c60fe26]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00] added\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00] added
Nov 10 17:56:49 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:56:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:49 user nova-compute[75100]: DEBUG os_brick.utils [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 17:56:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:49 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[93172027-2131-4e22-a049-75dfac572459]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:56:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:49 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e1ee36-7dcb-40ee-a8e5-0e5e30b1c7f7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90b1a229568f\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:49 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7034bac-2a6a-4b8c-8fae-fbdc594b33fc]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:56:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IcpQGmha {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:49 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f178cb-1b45-42b6-9986-32de94a6f4cd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IcpQGmha" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:49 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54388c3-08cf-41f4-842f-e71657a01284]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IcpQGmha'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:56:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:49 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ff6bb9-2005-4930-b06f-177327673dd5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:49 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9b341d-4ebf-4cd6-b59a-010c1b7312e9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 17:56:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:49 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1d8b08-1b1e-4de7-82c6-8cec273d6b4a]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 17:56:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:56:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 17:56:49 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 17:56:49 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc1b40a-b41e-4298-8905-a2de22f3b77b]: (4, '') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 17:56:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 17:56:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 17:56:49 user nova-compute[75100]: DEBUG os_brick.utils [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90b1a229568f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 17:56:49 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Updating existing volume attachment record: 7e3c395c-9477-41c8-9c2f-7ca9011e5240 {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 17:56:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:49 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[397b917a-8f1d-437e-a77b-e09a23ef334d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)
Nov 10 17:56:49 user nova-compute[75100]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)
Nov 10 17:56:49 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c (non-flash)
Nov 10 17:56:49 user nova-compute[75100]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7 (non-flash)
Nov 10 17:56:49 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:56:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)
Nov 10 17:56:49 user nova-compute[75100]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)
Nov 10 17:56:49 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c (non-flash)
Nov 10 17:56:49 user nova-compute[75100]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7 (non-flash)
Nov 10 17:56:49 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 17:56:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 -p 172.16.0.220:3260 --login {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:49 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b993f2bf-77d4-474f-bebd-645ef917dcab]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00, portal: 172.16.0.220,3260]
Nov 10 17:56:49 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00, portal: 172.16.0.220,3260] successful.
Nov 10 17:56:49 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:56:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:49 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f57f51-0a66-409f-a62b-52b3cf2c6a48]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:56:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:49 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69686b9-886c-4e9a-bdcc-861ee4d2d403]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)
Nov 10 17:56:49 user nova-compute[75100]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)
Nov 10 17:56:49 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c (non-flash)
Nov 10 17:56:49 user nova-compute[75100]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7 (non-flash)
Nov 10 17:56:49 user nova-compute[75100]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 (non-flash)
Nov 10 17:56:49 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:56:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)
Nov 10 17:56:49 user nova-compute[75100]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)
Nov 10 17:56:49 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c (non-flash)
Nov 10 17:56:49 user nova-compute[75100]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7 (non-flash)
Nov 10 17:56:49 user nova-compute[75100]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 (non-flash)
Nov 10 17:56:49 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 17:56:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.363s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 17:56:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 17:56:49 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] HCTL ('37', '-', '-', 0) found on session 18 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 17:56:49 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 17:56:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:56:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:56:49 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[599eb18f-40c9-448e-b4d3-744be62a275a]: (4, ('- - 0', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:56:49 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Searching for a device in session 18 and hctl ['37', '*', '*', 0] yield: None {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 17:56:50 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Searching for a device in session 18 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 17:56:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IcpQGmha', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 17:56:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.394s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 17:56:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] <== connect_volume: return (1395ms) {'type': 'block', 'scsi_wwn': '26332343139323336', 'path': '/dev/sdf'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 17:56:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332343139323336', 'path': '/dev/sdf'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 17:56:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:56:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-473634604',display_name='tempest-TestVolumeBootPattern-volume-backed-server-473634604',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-473634604',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNEPnfsKEClTnO54Fzmppfii5WSNUfYlhFhSjY5PIcufKxG5x9205njSFdJlW/YYw8zCojWPvd/7gs5JdwnurdLPyd6c3p4UiBE02/b4badlIlzVaaBXQyK8bjAAt0vl+w==',key_name='tempest-keypair-790104153',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9cd441a46aa4a579feff608d6ff9bb4',ramdisk_id='',reservation_id='r-petbrs0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-706331648',owner_user_name='tempest-TestVolumeBootPattern-706331648-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:56:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='323c5738ca424a379f666b4ca60825ac',uuid=6d227210-c4df-4aa7-9969-70fa137aeb63,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "230f2661-361c-4699-8dbc-fac4fbc6b612", "address": "fa:16:3e:9d:d1:eb", "network": {"id": "2a85480b-f67d-4ef1-b967-3e93af57d7c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1717495768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9cd441a46aa4a579feff608d6ff9bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap230f2661-36", "ovs_interfaceid": "230f2661-361c-4699-8dbc-fac4fbc6b612", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 17:56:50 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Converting VIF {"id": "230f2661-361c-4699-8dbc-fac4fbc6b612", "address": "fa:16:3e:9d:d1:eb", "network": {"id": "2a85480b-f67d-4ef1-b967-3e93af57d7c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1717495768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9cd441a46aa4a579feff608d6ff9bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap230f2661-36", "ovs_interfaceid": "230f2661-361c-4699-8dbc-fac4fbc6b612", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:56:50 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:d1:eb,bridge_name='br-int',has_traffic_filtering=True,id=230f2661-361c-4699-8dbc-fac4fbc6b612,network=Network(2a85480b-f67d-4ef1-b967-3e93af57d7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap230f2661-36') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:56:50 user nova-compute[75100]: DEBUG nova.objects.instance [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lazy-loading 'pci_devices' on Instance uuid 6d227210-c4df-4aa7-9969-70fa137aeb63 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:56:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] End _get_guest_xml xml=<domain type="kvm">
Nov 10 17:56:50 user nova-compute[75100]:   <uuid>6d227210-c4df-4aa7-9969-70fa137aeb63</uuid>
Nov 10 17:56:50 user nova-compute[75100]:   <name>instance-0000001b</name>
Nov 10 17:56:50 user nova-compute[75100]:   <memory>524288</memory>
Nov 10 17:56:50 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 10 17:56:50 user nova-compute[75100]:   <metadata>
Nov 10 17:56:50 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 17:56:50 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 10 17:56:50 user nova-compute[75100]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-473634604</nova:name>
Nov 10 17:56:50 user nova-compute[75100]:       <nova:creationTime>2023-11-10 17:56:48</nova:creationTime>
Nov 10 17:56:50 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 10 17:56:50 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 10 17:56:50 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 10 17:56:50 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 10 17:56:50 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 17:56:50 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 10 17:56:50 user nova-compute[75100]:       </nova:flavor>
Nov 10 17:56:50 user nova-compute[75100]:       <nova:owner>
Nov 10 17:56:50 user nova-compute[75100]:         <nova:user uuid="323c5738ca424a379f666b4ca60825ac">tempest-TestVolumeBootPattern-706331648-project-member</nova:user>
Nov 10 17:56:50 user nova-compute[75100]:         <nova:project uuid="b9cd441a46aa4a579feff608d6ff9bb4">tempest-TestVolumeBootPattern-706331648</nova:project>
Nov 10 17:56:50 user nova-compute[75100]:       </nova:owner>
Nov 10 17:56:50 user nova-compute[75100]:       <nova:ports>
Nov 10 17:56:50 user nova-compute[75100]:         <nova:port uuid="230f2661-361c-4699-8dbc-fac4fbc6b612">
Nov 10 17:56:50 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 10 17:56:50 user nova-compute[75100]:         </nova:port>
Nov 10 17:56:50 user nova-compute[75100]:       </nova:ports>
Nov 10 17:56:50 user nova-compute[75100]:     </nova:instance>
Nov 10 17:56:50 user nova-compute[75100]:   </metadata>
Nov 10 17:56:50 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 10 17:56:50 user nova-compute[75100]:     <system>
Nov 10 17:56:50 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 17:56:50 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 10 17:56:50 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 10 17:56:50 user nova-compute[75100]:       <entry name="serial">6d227210-c4df-4aa7-9969-70fa137aeb63</entry>
Nov 10 17:56:50 user nova-compute[75100]:       <entry name="uuid">6d227210-c4df-4aa7-9969-70fa137aeb63</entry>
Nov 10 17:56:50 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 10 17:56:50 user nova-compute[75100]:     </system>
Nov 10 17:56:50 user nova-compute[75100]:   </sysinfo>
Nov 10 17:56:50 user nova-compute[75100]:   <os>
Nov 10 17:56:50 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 17:56:50 user nova-compute[75100]:     <boot dev="hd"/>
Nov 10 17:56:50 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 10 17:56:50 user nova-compute[75100]:   </os>
Nov 10 17:56:50 user nova-compute[75100]:   <features>
Nov 10 17:56:50 user nova-compute[75100]:     <acpi/>
Nov 10 17:56:50 user nova-compute[75100]:     <apic/>
Nov 10 17:56:50 user nova-compute[75100]:     <vmcoreinfo/>
Nov 10 17:56:50 user nova-compute[75100]:   </features>
Nov 10 17:56:50 user nova-compute[75100]:   <clock offset="utc">
Nov 10 17:56:50 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 17:56:50 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 17:56:50 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 10 17:56:50 user nova-compute[75100]:   </clock>
Nov 10 17:56:50 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 10 17:56:50 user nova-compute[75100]:     <model>Nehalem</model>
Nov 10 17:56:50 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 17:56:50 user nova-compute[75100]:   </cpu>
Nov 10 17:56:50 user nova-compute[75100]:   <devices>
Nov 10 17:56:50 user nova-compute[75100]:     <disk type="block" device="disk">
Nov 10 17:56:50 user nova-compute[75100]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 17:56:50 user nova-compute[75100]:       <source dev="/dev/sdf"/>
Nov 10 17:56:50 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 10 17:56:50 user nova-compute[75100]:       <serial>e6c2e35c-41f9-4c5b-92da-f29547ae8b00</serial>
Nov 10 17:56:50 user nova-compute[75100]:     </disk>
Nov 10 17:56:50 user nova-compute[75100]:     <interface type="ethernet">
Nov 10 17:56:50 user nova-compute[75100]:       <mac address="fa:16:3e:9d:d1:eb"/>
Nov 10 17:56:50 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:56:50 user nova-compute[75100]:       <mtu size="1442"/>
Nov 10 17:56:50 user nova-compute[75100]:       <target dev="tap230f2661-36"/>
Nov 10 17:56:50 user nova-compute[75100]:     </interface>
Nov 10 17:56:50 user nova-compute[75100]:     <serial type="pty">
Nov 10 17:56:50 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/6d227210-c4df-4aa7-9969-70fa137aeb63/console.log" append="off"/>
Nov 10 17:56:50 user nova-compute[75100]:     </serial>
Nov 10 17:56:50 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 17:56:50 user nova-compute[75100]:     <video>
Nov 10 17:56:50 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:56:50 user nova-compute[75100]:     </video>
Nov 10 17:56:50 user nova-compute[75100]:     <rng model="virtio">
Nov 10 17:56:50 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 10 17:56:50 user nova-compute[75100]:     </rng>
Nov 10 17:56:50 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 10 17:56:50 user nova-compute[75100]:     <memballoon model="virtio">
Nov 10 17:56:50 user nova-compute[75100]:       <stats period="10"/>
Nov 10 17:56:50 user nova-compute[75100]:     </memballoon>
Nov 10 17:56:50 user nova-compute[75100]:   </devices>
Nov 10 17:56:50 user nova-compute[75100]: </domain>
Nov 10 17:56:50 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 17:56:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:56:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-473634604',display_name='tempest-TestVolumeBootPattern-volume-backed-server-473634604',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-473634604',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNEPnfsKEClTnO54Fzmppfii5WSNUfYlhFhSjY5PIcufKxG5x9205njSFdJlW/YYw8zCojWPvd/7gs5JdwnurdLPyd6c3p4UiBE02/b4badlIlzVaaBXQyK8bjAAt0vl+w==',key_name='tempest-keypair-790104153',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9cd441a46aa4a579feff608d6ff9bb4',ramdisk_id='',reservation_id='r-petbrs0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-706331648',owner_user_name='tempest-TestVolumeBootPattern-706331648-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:56:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='323c5738ca424a379f666b4ca60825ac',uuid=6d227210-c4df-4aa7-9969-70fa137aeb63,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "230f2661-361c-4699-8dbc-fac4fbc6b612", "address": "fa:16:3e:9d:d1:eb", "network": {"id": "2a85480b-f67d-4ef1-b967-3e93af57d7c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1717495768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9cd441a46aa4a579feff608d6ff9bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap230f2661-36", "ovs_interfaceid": "230f2661-361c-4699-8dbc-fac4fbc6b612", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 17:56:50 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Converting VIF {"id": "230f2661-361c-4699-8dbc-fac4fbc6b612", "address": "fa:16:3e:9d:d1:eb", "network": {"id": "2a85480b-f67d-4ef1-b967-3e93af57d7c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1717495768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9cd441a46aa4a579feff608d6ff9bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap230f2661-36", "ovs_interfaceid": "230f2661-361c-4699-8dbc-fac4fbc6b612", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:56:50 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:d1:eb,bridge_name='br-int',has_traffic_filtering=True,id=230f2661-361c-4699-8dbc-fac4fbc6b612,network=Network(2a85480b-f67d-4ef1-b967-3e93af57d7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap230f2661-36') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:56:50 user nova-compute[75100]: DEBUG os_vif [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:d1:eb,bridge_name='br-int',has_traffic_filtering=True,id=230f2661-361c-4699-8dbc-fac4fbc6b612,network=Network(2a85480b-f67d-4ef1-b967-3e93af57d7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap230f2661-36') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 17:56:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:56:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 17:56:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '79b641aa-dd42-5deb-b184-5215eb74d69f', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:56:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap230f2661-36, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:56:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap230f2661-36, col_values=(('qos', UUID('b4de74dc-4dc4-4536-8543-3502e5a32908')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:56:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap230f2661-36, col_values=(('external_ids', {'iface-id': '230f2661-361c-4699-8dbc-fac4fbc6b612', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:d1:eb', 'vm-uuid': '6d227210-c4df-4aa7-9969-70fa137aeb63'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:56:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:56:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:50 user nova-compute[75100]: INFO os_vif [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:d1:eb,bridge_name='br-int',has_traffic_filtering=True,id=230f2661-361c-4699-8dbc-fac4fbc6b612,network=Network(2a85480b-f67d-4ef1-b967-3e93af57d7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap230f2661-36')
Nov 10 17:56:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 17:56:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] No VIF found with MAC fa:16:3e:9d:d1:eb, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 17:56:50 user nova-compute[75100]: DEBUG nova.compute.manager [req-c8e8e903-935f-459c-9ca0-675018fddb76 req-1267e45d-d94c-4041-84c5-bb13b5674c46 service nova] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Received event network-vif-plugged-5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:56:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c8e8e903-935f-459c-9ca0-675018fddb76 req-1267e45d-d94c-4041-84c5-bb13b5674c46 service nova] Acquiring lock "61e73913-30a5-4eaa-9bc0-6e17a0288035-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:56:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c8e8e903-935f-459c-9ca0-675018fddb76 req-1267e45d-d94c-4041-84c5-bb13b5674c46 service nova] Lock "61e73913-30a5-4eaa-9bc0-6e17a0288035-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:56:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c8e8e903-935f-459c-9ca0-675018fddb76 req-1267e45d-d94c-4041-84c5-bb13b5674c46 service nova] Lock "61e73913-30a5-4eaa-9bc0-6e17a0288035-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:56:50 user nova-compute[75100]: DEBUG nova.compute.manager [req-c8e8e903-935f-459c-9ca0-675018fddb76 req-1267e45d-d94c-4041-84c5-bb13b5674c46 service nova] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] No waiting events found dispatching network-vif-plugged-5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:56:50 user nova-compute[75100]: WARNING nova.compute.manager [req-c8e8e903-935f-459c-9ca0-675018fddb76 req-1267e45d-d94c-4041-84c5-bb13b5674c46 service nova] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Received unexpected event network-vif-plugged-5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c for instance with vm_state shelved_offloaded and task_state spawning.
Nov 10 17:56:50 user nova-compute[75100]: DEBUG nova.compute.manager [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 17:56:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 17:56:50 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Instance spawned successfully.
Nov 10 17:56:50 user nova-compute[75100]: DEBUG nova.compute.manager [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 17:56:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1e663502-3969-40dd-8206-a8639054af03 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "61e73913-30a5-4eaa-9bc0-6e17a0288035" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 43.398s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:56:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:52 user nova-compute[75100]: DEBUG nova.compute.manager [req-5efa5a41-92cd-4e8e-8627-e9f3d02caafb req-2e90d8d3-e8b6-4478-a6f5-c5f856e4a1e6 service nova] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Received event network-vif-plugged-230f2661-361c-4699-8dbc-fac4fbc6b612 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:56:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5efa5a41-92cd-4e8e-8627-e9f3d02caafb req-2e90d8d3-e8b6-4478-a6f5-c5f856e4a1e6 service nova] Acquiring lock "6d227210-c4df-4aa7-9969-70fa137aeb63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:56:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5efa5a41-92cd-4e8e-8627-e9f3d02caafb req-2e90d8d3-e8b6-4478-a6f5-c5f856e4a1e6 service nova] Lock "6d227210-c4df-4aa7-9969-70fa137aeb63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:56:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5efa5a41-92cd-4e8e-8627-e9f3d02caafb req-2e90d8d3-e8b6-4478-a6f5-c5f856e4a1e6 service nova] Lock "6d227210-c4df-4aa7-9969-70fa137aeb63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:56:52 user nova-compute[75100]: DEBUG nova.compute.manager [req-5efa5a41-92cd-4e8e-8627-e9f3d02caafb req-2e90d8d3-e8b6-4478-a6f5-c5f856e4a1e6 service nova] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] No waiting events found dispatching network-vif-plugged-230f2661-361c-4699-8dbc-fac4fbc6b612 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:56:52 user nova-compute[75100]: WARNING nova.compute.manager [req-5efa5a41-92cd-4e8e-8627-e9f3d02caafb req-2e90d8d3-e8b6-4478-a6f5-c5f856e4a1e6 service nova] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Received unexpected event network-vif-plugged-230f2661-361c-4699-8dbc-fac4fbc6b612 for instance with vm_state building and task_state spawning.
Nov 10 17:56:52 user nova-compute[75100]: DEBUG nova.compute.manager [req-5efa5a41-92cd-4e8e-8627-e9f3d02caafb req-2e90d8d3-e8b6-4478-a6f5-c5f856e4a1e6 service nova] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Received event network-vif-plugged-230f2661-361c-4699-8dbc-fac4fbc6b612 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:56:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5efa5a41-92cd-4e8e-8627-e9f3d02caafb req-2e90d8d3-e8b6-4478-a6f5-c5f856e4a1e6 service nova] Acquiring lock "6d227210-c4df-4aa7-9969-70fa137aeb63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:56:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5efa5a41-92cd-4e8e-8627-e9f3d02caafb req-2e90d8d3-e8b6-4478-a6f5-c5f856e4a1e6 service nova] Lock "6d227210-c4df-4aa7-9969-70fa137aeb63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:56:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5efa5a41-92cd-4e8e-8627-e9f3d02caafb req-2e90d8d3-e8b6-4478-a6f5-c5f856e4a1e6 service nova] Lock "6d227210-c4df-4aa7-9969-70fa137aeb63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:56:52 user nova-compute[75100]: DEBUG nova.compute.manager [req-5efa5a41-92cd-4e8e-8627-e9f3d02caafb req-2e90d8d3-e8b6-4478-a6f5-c5f856e4a1e6 service nova] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] No waiting events found dispatching network-vif-plugged-230f2661-361c-4699-8dbc-fac4fbc6b612 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:56:52 user nova-compute[75100]: WARNING nova.compute.manager [req-5efa5a41-92cd-4e8e-8627-e9f3d02caafb req-2e90d8d3-e8b6-4478-a6f5-c5f856e4a1e6 service nova] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Received unexpected event network-vif-plugged-230f2661-361c-4699-8dbc-fac4fbc6b612 for instance with vm_state building and task_state spawning.
Nov 10 17:56:54 user nova-compute[75100]: DEBUG nova.compute.manager [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 17:56:54 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 17:56:54 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Instance spawned successfully.
Nov 10 17:56:54 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 17:56:54 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:56:54 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:56:54 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:56:54 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:56:54 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:56:54 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:56:54 user nova-compute[75100]: INFO nova.compute.manager [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Took 5.24 seconds to spawn the instance on the hypervisor.
Nov 10 17:56:54 user nova-compute[75100]: DEBUG nova.compute.manager [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 17:56:54 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:54 user nova-compute[75100]: INFO nova.compute.manager [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Took 48.72 seconds to build instance.
Nov 10 17:56:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fcdc05df-7741-48d6-a9b5-177d2f243f03 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "6d227210-c4df-4aa7-9969-70fa137aeb63" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 48.891s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:56:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:56:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a0c7460e-1559-4be0-8f76-5c27855d9b48 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Acquiring lock "6140056a-ced1-4240-a11a-795a260adf46" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:57:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a0c7460e-1559-4be0-8f76-5c27855d9b48 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Lock "6140056a-ced1-4240-a11a-795a260adf46" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:57:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a0c7460e-1559-4be0-8f76-5c27855d9b48 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Acquiring lock "6140056a-ced1-4240-a11a-795a260adf46-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:57:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a0c7460e-1559-4be0-8f76-5c27855d9b48 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Lock "6140056a-ced1-4240-a11a-795a260adf46-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:57:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a0c7460e-1559-4be0-8f76-5c27855d9b48 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Lock "6140056a-ced1-4240-a11a-795a260adf46-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:57:06 user nova-compute[75100]: INFO nova.compute.manager [None req-a0c7460e-1559-4be0-8f76-5c27855d9b48 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 6140056a-ced1-4240-a11a-795a260adf46] Terminating instance
Nov 10 17:57:06 user nova-compute[75100]: DEBUG nova.compute.manager [None req-a0c7460e-1559-4be0-8f76-5c27855d9b48 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 6140056a-ced1-4240-a11a-795a260adf46] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 17:57:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:06 user nova-compute[75100]: DEBUG nova.compute.manager [req-9188e532-c383-44ec-a9d8-d5bae095cc8a req-e7c13267-5454-4830-99de-1ef4448d9ce0 service nova] [instance: 6140056a-ced1-4240-a11a-795a260adf46] Received event network-vif-unplugged-5a0341df-e2e2-42f8-8b6e-35376780584e {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:57:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9188e532-c383-44ec-a9d8-d5bae095cc8a req-e7c13267-5454-4830-99de-1ef4448d9ce0 service nova] Acquiring lock "6140056a-ced1-4240-a11a-795a260adf46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:57:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9188e532-c383-44ec-a9d8-d5bae095cc8a req-e7c13267-5454-4830-99de-1ef4448d9ce0 service nova] Lock "6140056a-ced1-4240-a11a-795a260adf46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:57:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9188e532-c383-44ec-a9d8-d5bae095cc8a req-e7c13267-5454-4830-99de-1ef4448d9ce0 service nova] Lock "6140056a-ced1-4240-a11a-795a260adf46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:57:06 user nova-compute[75100]: DEBUG nova.compute.manager [req-9188e532-c383-44ec-a9d8-d5bae095cc8a req-e7c13267-5454-4830-99de-1ef4448d9ce0 service nova] [instance: 6140056a-ced1-4240-a11a-795a260adf46] No waiting events found dispatching network-vif-unplugged-5a0341df-e2e2-42f8-8b6e-35376780584e {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:57:06 user nova-compute[75100]: DEBUG nova.compute.manager [req-9188e532-c383-44ec-a9d8-d5bae095cc8a req-e7c13267-5454-4830-99de-1ef4448d9ce0 service nova] [instance: 6140056a-ced1-4240-a11a-795a260adf46] Received event network-vif-unplugged-5a0341df-e2e2-42f8-8b6e-35376780584e for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 17:57:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:06 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 6140056a-ced1-4240-a11a-795a260adf46] Instance destroyed successfully.
Nov 10 17:57:06 user nova-compute[75100]: DEBUG nova.objects.instance [None req-a0c7460e-1559-4be0-8f76-5c27855d9b48 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Lazy-loading 'resources' on Instance uuid 6140056a-ced1-4240-a11a-795a260adf46 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:57:06 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-a0c7460e-1559-4be0-8f76-5c27855d9b48 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:55:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1436541398',display_name='tempest-ServersNegativeTestJSON-server-1436541398',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1436541398',id=25,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T17:55:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fc3d8aa64c704f45b08bdb0f1ecb2c90',ramdisk_id='',reservation_id='r-1fvxw6z3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1166274989',owner_user_name='tempest-ServersNegativeTestJSON-1166274989-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T17:55:24Z,user_data=None,user_id='624efcea1cd1402d93c86d77c1424307',uuid=6140056a-ced1-4240-a11a-795a260adf46,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a0341df-e2e2-42f8-8b6e-35376780584e", "address": "fa:16:3e:4b:82:f1", "network": {"id": "879f9f54-7640-4384-b28f-7d8d38d7f74f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1830593335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc3d8aa64c704f45b08bdb0f1ecb2c90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a0341df-e2", "ovs_interfaceid": "5a0341df-e2e2-42f8-8b6e-35376780584e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 17:57:06 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-a0c7460e-1559-4be0-8f76-5c27855d9b48 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Converting VIF {"id": "5a0341df-e2e2-42f8-8b6e-35376780584e", "address": "fa:16:3e:4b:82:f1", "network": {"id": "879f9f54-7640-4384-b28f-7d8d38d7f74f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1830593335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc3d8aa64c704f45b08bdb0f1ecb2c90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a0341df-e2", "ovs_interfaceid": "5a0341df-e2e2-42f8-8b6e-35376780584e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:57:06 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-a0c7460e-1559-4be0-8f76-5c27855d9b48 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:82:f1,bridge_name='br-int',has_traffic_filtering=True,id=5a0341df-e2e2-42f8-8b6e-35376780584e,network=Network(879f9f54-7640-4384-b28f-7d8d38d7f74f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a0341df-e2') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:57:06 user nova-compute[75100]: DEBUG os_vif [None req-a0c7460e-1559-4be0-8f76-5c27855d9b48 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:82:f1,bridge_name='br-int',has_traffic_filtering=True,id=5a0341df-e2e2-42f8-8b6e-35376780584e,network=Network(879f9f54-7640-4384-b28f-7d8d38d7f74f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a0341df-e2') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 17:57:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5a0341df-e2, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:57:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:57:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=50708581-3593-43fc-88ed-4f5aab7d73e2) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:57:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:57:06 user nova-compute[75100]: INFO os_vif [None req-a0c7460e-1559-4be0-8f76-5c27855d9b48 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:82:f1,bridge_name='br-int',has_traffic_filtering=True,id=5a0341df-e2e2-42f8-8b6e-35376780584e,network=Network(879f9f54-7640-4384-b28f-7d8d38d7f74f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a0341df-e2')
Nov 10 17:57:06 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-a0c7460e-1559-4be0-8f76-5c27855d9b48 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 6140056a-ced1-4240-a11a-795a260adf46] Deleting instance files /opt/stack/data/nova/instances/6140056a-ced1-4240-a11a-795a260adf46_del
Nov 10 17:57:06 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-a0c7460e-1559-4be0-8f76-5c27855d9b48 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 6140056a-ced1-4240-a11a-795a260adf46] Deletion of /opt/stack/data/nova/instances/6140056a-ced1-4240-a11a-795a260adf46_del complete
Nov 10 17:57:06 user nova-compute[75100]: INFO nova.compute.manager [None req-a0c7460e-1559-4be0-8f76-5c27855d9b48 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 6140056a-ced1-4240-a11a-795a260adf46] Took 0.79 seconds to destroy the instance on the hypervisor.
Nov 10 17:57:06 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-a0c7460e-1559-4be0-8f76-5c27855d9b48 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 17:57:06 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: 6140056a-ced1-4240-a11a-795a260adf46] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 17:57:06 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 6140056a-ced1-4240-a11a-795a260adf46] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 17:57:07 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 6140056a-ced1-4240-a11a-795a260adf46] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:57:07 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: 6140056a-ced1-4240-a11a-795a260adf46] Took 0.64 seconds to deallocate network for instance.
Nov 10 17:57:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a0c7460e-1559-4be0-8f76-5c27855d9b48 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:57:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a0c7460e-1559-4be0-8f76-5c27855d9b48 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:57:08 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-a0c7460e-1559-4be0-8f76-5c27855d9b48 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:57:08 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-a0c7460e-1559-4be0-8f76-5c27855d9b48 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:57:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a0c7460e-1559-4be0-8f76-5c27855d9b48 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.532s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:57:08 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-a0c7460e-1559-4be0-8f76-5c27855d9b48 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Deleted allocations for instance 6140056a-ced1-4240-a11a-795a260adf46
Nov 10 17:57:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a0c7460e-1559-4be0-8f76-5c27855d9b48 tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Lock "6140056a-ced1-4240-a11a-795a260adf46" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.212s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:57:08 user nova-compute[75100]: DEBUG nova.compute.manager [req-5a99c452-400e-4275-9101-cb41ee952510 req-c708f6bd-d0e6-4952-b579-a7ad4648efc4 service nova] [instance: 6140056a-ced1-4240-a11a-795a260adf46] Received event network-vif-plugged-5a0341df-e2e2-42f8-8b6e-35376780584e {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:57:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5a99c452-400e-4275-9101-cb41ee952510 req-c708f6bd-d0e6-4952-b579-a7ad4648efc4 service nova] Acquiring lock "6140056a-ced1-4240-a11a-795a260adf46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:57:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5a99c452-400e-4275-9101-cb41ee952510 req-c708f6bd-d0e6-4952-b579-a7ad4648efc4 service nova] Lock "6140056a-ced1-4240-a11a-795a260adf46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:57:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5a99c452-400e-4275-9101-cb41ee952510 req-c708f6bd-d0e6-4952-b579-a7ad4648efc4 service nova] Lock "6140056a-ced1-4240-a11a-795a260adf46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:57:08 user nova-compute[75100]: DEBUG nova.compute.manager [req-5a99c452-400e-4275-9101-cb41ee952510 req-c708f6bd-d0e6-4952-b579-a7ad4648efc4 service nova] [instance: 6140056a-ced1-4240-a11a-795a260adf46] No waiting events found dispatching network-vif-plugged-5a0341df-e2e2-42f8-8b6e-35376780584e {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:57:08 user nova-compute[75100]: WARNING nova.compute.manager [req-5a99c452-400e-4275-9101-cb41ee952510 req-c708f6bd-d0e6-4952-b579-a7ad4648efc4 service nova] [instance: 6140056a-ced1-4240-a11a-795a260adf46] Received unexpected event network-vif-plugged-5a0341df-e2e2-42f8-8b6e-35376780584e for instance with vm_state deleted and task_state None.
Nov 10 17:57:08 user nova-compute[75100]: DEBUG nova.compute.manager [req-5a99c452-400e-4275-9101-cb41ee952510 req-c708f6bd-d0e6-4952-b579-a7ad4648efc4 service nova] [instance: 6140056a-ced1-4240-a11a-795a260adf46] Received event network-vif-deleted-5a0341df-e2e2-42f8-8b6e-35376780584e {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:57:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:16 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:57:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:17 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:57:18 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 17:57:18 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Creating image(s)
Nov 10 17:57:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Acquiring lock "/opt/stack/data/nova/instances/c7fbe35b-4794-4eb9-8033-923247064458/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:57:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "/opt/stack/data/nova/instances/c7fbe35b-4794-4eb9-8033-923247064458/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:57:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "/opt/stack/data/nova/instances/c7fbe35b-4794-4eb9-8033-923247064458/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:57:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:57:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.198s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:57:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Acquiring lock "818b9e28e061d41a38d903968b229be2ed9ba520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:57:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:57:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:57:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.177s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:57:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/c7fbe35b-4794-4eb9-8033-923247064458/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:57:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/c7fbe35b-4794-4eb9-8033-923247064458/disk 1073741824" returned: 0 in 0.048s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:57:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:57:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:57:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.182s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:57:18 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c7fbe35b-4794-4eb9-8033-923247064458/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 17:57:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7fbe35b-4794-4eb9-8033-923247064458/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7fbe35b-4794-4eb9-8033-923247064458/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Cannot resize image /opt/stack/data/nova/instances/c7fbe35b-4794-4eb9-8033-923247064458/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Ensure instance console log exists: /opt/stack/data/nova/instances/c7fbe35b-4794-4eb9-8033-923247064458/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Start _get_guest_xml network_info=[{"id": "54a1b80b-3910-4ab8-a694-88989c4b6f4e", "address": "fa:16:3e:d3:5e:89", "network": {"id": "bf1edb58-ef26-40ca-8ec9-853fa05de13d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1416469583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7bb141ef59487dbb2ce6243c5002af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54a1b80b-39", "ovs_interfaceid": "54a1b80b-3910-4ab8-a694-88989c4b6f4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'e3cc5321-4d40-49ee-885c-700e14741732'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gzFeJSLW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c7fbe35b-4794-4eb9-8033-923247064458', 'attached_at': '', 'detached_at': '', 'volume_id': '0280d371-2779-450b-9c9a-c5adde034308', 'serial': '0280d371-2779-450b-9c9a-c5adde034308'}, 'mount_device': '/dev/vdb', 'attachment_id': '7e3c395c-9477-41c8-9c2f-7ca9011e5240', 'device_type': 'disk', 'guest_format': None, 'boot_index': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 17:57:19 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 10 17:57:19 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 10 17:57:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T17:40:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG nova.objects.instance [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lazy-loading 'vcpu_model' on Instance uuid c7fbe35b-4794-4eb9-8033-923247064458 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gzFeJSLW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 17:57:19 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 10 17:57:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 17:57:19 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 10 17:57:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 17:57:19 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 17:57:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 -p 172.16.0.220:3260 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[477a15c5-7911-4ae0-9cc3-b8d6acbfd117]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 17:57:19 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 -p 172.16.0.220:3260 --interface default --op new {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a49d86-f3b9-4638-a0a5-293a1daaefe1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308] added\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308] added
Nov 10 17:57:19 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b253433a-8b1c-4221-af70-f95ba91cd377]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a046ec22-110a-4ca2-951d-e82179b582cb]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gzFeJSLW {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gzFeJSLW" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba962b54-d5be-4c9c-810a-2b27f18c04b0]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gzFeJSLW'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e920c6b-2712-4872-8c83-1fcde9add919]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7f5352-f80d-48b0-a381-64282a3c11c7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)
Nov 10 17:57:19 user nova-compute[75100]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)
Nov 10 17:57:19 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c (non-flash)
Nov 10 17:57:19 user nova-compute[75100]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7 (non-flash)
Nov 10 17:57:19 user nova-compute[75100]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 (non-flash)
Nov 10 17:57:19 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)
Nov 10 17:57:19 user nova-compute[75100]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)
Nov 10 17:57:19 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c (non-flash)
Nov 10 17:57:19 user nova-compute[75100]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7 (non-flash)
Nov 10 17:57:19 user nova-compute[75100]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 (non-flash)
Nov 10 17:57:19 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 -p 172.16.0.220:3260 --login {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5169a34-aee0-46f4-b063-ff20af5cc89d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308, portal: 172.16.0.220,3260]
Nov 10 17:57:19 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308, portal: 172.16.0.220,3260] successful.
Nov 10 17:57:19 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[200fe6f9-be01-4166-b998-f71fd53080f6]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91945d2-d9d8-40d3-b711-87e66eb6201c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)
Nov 10 17:57:19 user nova-compute[75100]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)
Nov 10 17:57:19 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c (non-flash)
Nov 10 17:57:19 user nova-compute[75100]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7 (non-flash)
Nov 10 17:57:19 user nova-compute[75100]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 (non-flash)
Nov 10 17:57:19 user nova-compute[75100]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 (non-flash)
Nov 10 17:57:19 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)
Nov 10 17:57:19 user nova-compute[75100]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)
Nov 10 17:57:19 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c (non-flash)
Nov 10 17:57:19 user nova-compute[75100]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7 (non-flash)
Nov 10 17:57:19 user nova-compute[75100]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 (non-flash)
Nov 10 17:57:19 user nova-compute[75100]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 (non-flash)
Nov 10 17:57:19 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] HCTL ('38', '-', '-', 0) found on session 19 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[60797527-58ae-40a7-8212-ea33f01e53b7]: (4, ('- - 0', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Searching for a device in session 19 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 17:57:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gzFeJSLW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 17:57:20 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:57:20 user nova-compute[75100]: INFO nova.compute.manager [None req-9b31aaec-ca89-446d-8441-33acff84ac52 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Unrescuing
Nov 10 17:57:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9b31aaec-ca89-446d-8441-33acff84ac52 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Acquiring lock "refresh_cache-9033f537-bdeb-412c-9337-4ad86f4467b2" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:57:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9b31aaec-ca89-446d-8441-33acff84ac52 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Acquired lock "refresh_cache-9033f537-bdeb-412c-9337-4ad86f4467b2" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:57:20 user nova-compute[75100]: DEBUG nova.network.neutron [None req-9b31aaec-ca89-446d-8441-33acff84ac52 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 17:57:20 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 17:57:20 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '23966643664316166', 'path': '/dev/sdg'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 17:57:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966643664316166', 'path': '/dev/sdg'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 17:57:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T17:53:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-843010782',display_name='tempest-ServerActionsTestOtherA-server-523741731',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-843010782',id=24,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiOZtaw5osdCG7Z7OltXtNzbXyV1FVC6Yjpxvw/cDI+myaYVJpvsg9jfQJ1xjf+l5X7jK/9ICsmh5wP1Dm3CArptdAr7p9gmRDbitYb+wjwjgZ+DGtTIty8caL67y+u8g==',key_name='tempest-keypair-1694465190',keypairs=<?>,launch_index=0,launched_at=2023-11-10T17:53:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ce7bb141ef59487dbb2ce6243c5002af',ramdisk_id='',reservation_id='r-pq63h9x0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1364670684',owner_user_name='tempest-ServerActionsTestOtherA-1364670684-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:56:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f4df424af2343a2a27e869502651216',uuid=c7fbe35b-4794-4eb9-8033-923247064458,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "54a1b80b-3910-4ab8-a694-88989c4b6f4e", "address": "fa:16:3e:d3:5e:89", "network": {"id": "bf1edb58-ef26-40ca-8ec9-853fa05de13d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1416469583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7bb141ef59487dbb2ce6243c5002af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54a1b80b-39", "ovs_interfaceid": "54a1b80b-3910-4ab8-a694-88989c4b6f4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 17:57:20 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Converting VIF {"id": "54a1b80b-3910-4ab8-a694-88989c4b6f4e", "address": "fa:16:3e:d3:5e:89", "network": {"id": "bf1edb58-ef26-40ca-8ec9-853fa05de13d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1416469583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7bb141ef59487dbb2ce6243c5002af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54a1b80b-39", "ovs_interfaceid": "54a1b80b-3910-4ab8-a694-88989c4b6f4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:57:20 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:5e:89,bridge_name='br-int',has_traffic_filtering=True,id=54a1b80b-3910-4ab8-a694-88989c4b6f4e,network=Network(bf1edb58-ef26-40ca-8ec9-853fa05de13d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54a1b80b-39') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:57:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] End _get_guest_xml xml=<domain type="kvm">
Nov 10 17:57:20 user nova-compute[75100]:   <uuid>c7fbe35b-4794-4eb9-8033-923247064458</uuid>
Nov 10 17:57:20 user nova-compute[75100]:   <name>instance-00000018</name>
Nov 10 17:57:20 user nova-compute[75100]:   <memory>524288</memory>
Nov 10 17:57:20 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 10 17:57:20 user nova-compute[75100]:   <metadata>
Nov 10 17:57:20 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 17:57:20 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 10 17:57:20 user nova-compute[75100]:       <nova:name>tempest-ServerActionsTestOtherA-server-523741731</nova:name>
Nov 10 17:57:20 user nova-compute[75100]:       <nova:creationTime>2023-11-10 17:57:19</nova:creationTime>
Nov 10 17:57:20 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 10 17:57:20 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 10 17:57:20 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 10 17:57:20 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 10 17:57:20 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 17:57:20 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 10 17:57:20 user nova-compute[75100]:       </nova:flavor>
Nov 10 17:57:20 user nova-compute[75100]:       <nova:owner>
Nov 10 17:57:20 user nova-compute[75100]:         <nova:user uuid="9f4df424af2343a2a27e869502651216">tempest-ServerActionsTestOtherA-1364670684-project-member</nova:user>
Nov 10 17:57:20 user nova-compute[75100]:         <nova:project uuid="ce7bb141ef59487dbb2ce6243c5002af">tempest-ServerActionsTestOtherA-1364670684</nova:project>
Nov 10 17:57:20 user nova-compute[75100]:       </nova:owner>
Nov 10 17:57:20 user nova-compute[75100]:       <nova:root type="image" uuid="e3cc5321-4d40-49ee-885c-700e14741732"/>
Nov 10 17:57:20 user nova-compute[75100]:       <nova:ports>
Nov 10 17:57:20 user nova-compute[75100]:         <nova:port uuid="54a1b80b-3910-4ab8-a694-88989c4b6f4e">
Nov 10 17:57:20 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 10 17:57:20 user nova-compute[75100]:         </nova:port>
Nov 10 17:57:20 user nova-compute[75100]:       </nova:ports>
Nov 10 17:57:20 user nova-compute[75100]:     </nova:instance>
Nov 10 17:57:20 user nova-compute[75100]:   </metadata>
Nov 10 17:57:20 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 10 17:57:20 user nova-compute[75100]:     <system>
Nov 10 17:57:20 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 17:57:20 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 10 17:57:20 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 10 17:57:20 user nova-compute[75100]:       <entry name="serial">c7fbe35b-4794-4eb9-8033-923247064458</entry>
Nov 10 17:57:20 user nova-compute[75100]:       <entry name="uuid">c7fbe35b-4794-4eb9-8033-923247064458</entry>
Nov 10 17:57:20 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 10 17:57:20 user nova-compute[75100]:     </system>
Nov 10 17:57:20 user nova-compute[75100]:   </sysinfo>
Nov 10 17:57:20 user nova-compute[75100]:   <os>
Nov 10 17:57:20 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 17:57:20 user nova-compute[75100]:     <boot dev="hd"/>
Nov 10 17:57:20 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 10 17:57:20 user nova-compute[75100]:   </os>
Nov 10 17:57:20 user nova-compute[75100]:   <features>
Nov 10 17:57:20 user nova-compute[75100]:     <acpi/>
Nov 10 17:57:20 user nova-compute[75100]:     <apic/>
Nov 10 17:57:20 user nova-compute[75100]:     <vmcoreinfo/>
Nov 10 17:57:20 user nova-compute[75100]:   </features>
Nov 10 17:57:20 user nova-compute[75100]:   <clock offset="utc">
Nov 10 17:57:20 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 17:57:20 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 17:57:20 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 10 17:57:20 user nova-compute[75100]:   </clock>
Nov 10 17:57:20 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 10 17:57:20 user nova-compute[75100]:     <model>Nehalem</model>
Nov 10 17:57:20 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 17:57:20 user nova-compute[75100]:   </cpu>
Nov 10 17:57:20 user nova-compute[75100]:   <devices>
Nov 10 17:57:20 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 10 17:57:20 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 17:57:20 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/c7fbe35b-4794-4eb9-8033-923247064458/disk"/>
Nov 10 17:57:20 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 10 17:57:20 user nova-compute[75100]:     </disk>
Nov 10 17:57:20 user nova-compute[75100]:     <disk type="block" device="disk">
Nov 10 17:57:20 user nova-compute[75100]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 17:57:20 user nova-compute[75100]:       <source dev="/dev/sdg"/>
Nov 10 17:57:20 user nova-compute[75100]:       <target dev="vdb" bus="virtio"/>
Nov 10 17:57:20 user nova-compute[75100]:       <serial>0280d371-2779-450b-9c9a-c5adde034308</serial>
Nov 10 17:57:20 user nova-compute[75100]:     </disk>
Nov 10 17:57:20 user nova-compute[75100]:     <interface type="ethernet">
Nov 10 17:57:20 user nova-compute[75100]:       <mac address="fa:16:3e:d3:5e:89"/>
Nov 10 17:57:20 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:57:20 user nova-compute[75100]:       <mtu size="1442"/>
Nov 10 17:57:20 user nova-compute[75100]:       <target dev="tap54a1b80b-39"/>
Nov 10 17:57:20 user nova-compute[75100]:     </interface>
Nov 10 17:57:20 user nova-compute[75100]:     <serial type="pty">
Nov 10 17:57:20 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/c7fbe35b-4794-4eb9-8033-923247064458/console.log" append="off"/>
Nov 10 17:57:20 user nova-compute[75100]:     </serial>
Nov 10 17:57:20 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 17:57:20 user nova-compute[75100]:     <video>
Nov 10 17:57:20 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:57:20 user nova-compute[75100]:     </video>
Nov 10 17:57:20 user nova-compute[75100]:     <rng model="virtio">
Nov 10 17:57:20 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 10 17:57:20 user nova-compute[75100]:     </rng>
Nov 10 17:57:20 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 10 17:57:20 user nova-compute[75100]:     <memballoon model="virtio">
Nov 10 17:57:20 user nova-compute[75100]:       <stats period="10"/>
Nov 10 17:57:20 user nova-compute[75100]:     </memballoon>
Nov 10 17:57:20 user nova-compute[75100]:   </devices>
Nov 10 17:57:20 user nova-compute[75100]: </domain>
Nov 10 17:57:20 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 17:57:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T17:53:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-843010782',display_name='tempest-ServerActionsTestOtherA-server-523741731',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-843010782',id=24,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiOZtaw5osdCG7Z7OltXtNzbXyV1FVC6Yjpxvw/cDI+myaYVJpvsg9jfQJ1xjf+l5X7jK/9ICsmh5wP1Dm3CArptdAr7p9gmRDbitYb+wjwjgZ+DGtTIty8caL67y+u8g==',key_name='tempest-keypair-1694465190',keypairs=<?>,launch_index=0,launched_at=2023-11-10T17:53:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ce7bb141ef59487dbb2ce6243c5002af',ramdisk_id='',reservation_id='r-pq63h9x0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1364670684',owner_user_name='tempest-ServerActionsTestOtherA-1364670684-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:56:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f4df424af2343a2a27e869502651216',uuid=c7fbe35b-4794-4eb9-8033-923247064458,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "54a1b80b-3910-4ab8-a694-88989c4b6f4e", "address": "fa:16:3e:d3:5e:89", "network": {"id": "bf1edb58-ef26-40ca-8ec9-853fa05de13d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1416469583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7bb141ef59487dbb2ce6243c5002af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54a1b80b-39", "ovs_interfaceid": "54a1b80b-3910-4ab8-a694-88989c4b6f4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 17:57:20 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Converting VIF {"id": "54a1b80b-3910-4ab8-a694-88989c4b6f4e", "address": "fa:16:3e:d3:5e:89", "network": {"id": "bf1edb58-ef26-40ca-8ec9-853fa05de13d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1416469583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7bb141ef59487dbb2ce6243c5002af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54a1b80b-39", "ovs_interfaceid": "54a1b80b-3910-4ab8-a694-88989c4b6f4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:57:20 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:5e:89,bridge_name='br-int',has_traffic_filtering=True,id=54a1b80b-3910-4ab8-a694-88989c4b6f4e,network=Network(bf1edb58-ef26-40ca-8ec9-853fa05de13d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54a1b80b-39') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:57:20 user nova-compute[75100]: DEBUG os_vif [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:5e:89,bridge_name='br-int',has_traffic_filtering=True,id=54a1b80b-3910-4ab8-a694-88989c4b6f4e,network=Network(bf1edb58-ef26-40ca-8ec9-853fa05de13d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54a1b80b-39') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 17:57:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:57:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 17:57:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1a10deb3-8aa8-595c-b9d7-35e0d243e513', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:57:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:57:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap54a1b80b-39, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:57:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap54a1b80b-39, col_values=(('qos', UUID('ca969030-c0d7-4e9e-b182-b15156481de5')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:57:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap54a1b80b-39, col_values=(('external_ids', {'iface-id': '54a1b80b-3910-4ab8-a694-88989c4b6f4e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:5e:89', 'vm-uuid': 'c7fbe35b-4794-4eb9-8033-923247064458'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:57:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:57:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:20 user nova-compute[75100]: INFO os_vif [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:5e:89,bridge_name='br-int',has_traffic_filtering=True,id=54a1b80b-3910-4ab8-a694-88989c4b6f4e,network=Network(bf1edb58-ef26-40ca-8ec9-853fa05de13d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54a1b80b-39')
Nov 10 17:57:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 17:57:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 17:57:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] No VIF found with MAC fa:16:3e:d3:5e:89, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 17:57:20 user nova-compute[75100]: DEBUG nova.network.neutron [None req-9b31aaec-ca89-446d-8441-33acff84ac52 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Updating instance_info_cache with network_info: [{"id": "4c49d1d4-dba2-478e-80b6-94e012439af6", "address": "fa:16:3e:01:6b:43", "network": {"id": "26a554fe-9a5e-40c0-9981-5ac084c9ea73", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-269663495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19755f3e634fdfbd562c33fbfa2a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c49d1d4-db", "ovs_interfaceid": "4c49d1d4-dba2-478e-80b6-94e012439af6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:57:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9b31aaec-ca89-446d-8441-33acff84ac52 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Releasing lock "refresh_cache-9033f537-bdeb-412c-9337-4ad86f4467b2" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:57:20 user nova-compute[75100]: DEBUG nova.objects.instance [None req-9b31aaec-ca89-446d-8441-33acff84ac52 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lazy-loading 'flavor' on Instance uuid 9033f537-bdeb-412c-9337-4ad86f4467b2 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:57:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:21 user nova-compute[75100]: DEBUG nova.compute.manager [req-8a93d934-7c8d-41a7-8062-7e28a9ef9603 req-6fb86842-e70f-4156-b276-388b1d1d0d82 service nova] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Received event network-vif-unplugged-4c49d1d4-dba2-478e-80b6-94e012439af6 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:57:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8a93d934-7c8d-41a7-8062-7e28a9ef9603 req-6fb86842-e70f-4156-b276-388b1d1d0d82 service nova] Acquiring lock "9033f537-bdeb-412c-9337-4ad86f4467b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:57:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8a93d934-7c8d-41a7-8062-7e28a9ef9603 req-6fb86842-e70f-4156-b276-388b1d1d0d82 service nova] Lock "9033f537-bdeb-412c-9337-4ad86f4467b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:57:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8a93d934-7c8d-41a7-8062-7e28a9ef9603 req-6fb86842-e70f-4156-b276-388b1d1d0d82 service nova] Lock "9033f537-bdeb-412c-9337-4ad86f4467b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:57:21 user nova-compute[75100]: DEBUG nova.compute.manager [req-8a93d934-7c8d-41a7-8062-7e28a9ef9603 req-6fb86842-e70f-4156-b276-388b1d1d0d82 service nova] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] No waiting events found dispatching network-vif-unplugged-4c49d1d4-dba2-478e-80b6-94e012439af6 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:57:21 user nova-compute[75100]: WARNING nova.compute.manager [req-8a93d934-7c8d-41a7-8062-7e28a9ef9603 req-6fb86842-e70f-4156-b276-388b1d1d0d82 service nova] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Received unexpected event network-vif-unplugged-4c49d1d4-dba2-478e-80b6-94e012439af6 for instance with vm_state rescued and task_state unrescuing.
Nov 10 17:57:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:21 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Instance destroyed successfully.
Nov 10 17:57:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:22 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:57:22 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:57:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:57:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:57:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:57:22 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 17:57:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:23 user nova-compute[75100]: DEBUG nova.compute.manager [req-bcefea05-f15f-4a8c-93cd-d38f8ed0671a req-e249d1f7-8f9b-426f-8a87-e40a758fcb46 service nova] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Received event network-vif-plugged-4c49d1d4-dba2-478e-80b6-94e012439af6 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:57:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-bcefea05-f15f-4a8c-93cd-d38f8ed0671a req-e249d1f7-8f9b-426f-8a87-e40a758fcb46 service nova] Acquiring lock "9033f537-bdeb-412c-9337-4ad86f4467b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:57:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-bcefea05-f15f-4a8c-93cd-d38f8ed0671a req-e249d1f7-8f9b-426f-8a87-e40a758fcb46 service nova] Lock "9033f537-bdeb-412c-9337-4ad86f4467b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:57:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-bcefea05-f15f-4a8c-93cd-d38f8ed0671a req-e249d1f7-8f9b-426f-8a87-e40a758fcb46 service nova] Lock "9033f537-bdeb-412c-9337-4ad86f4467b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:57:23 user nova-compute[75100]: DEBUG nova.compute.manager [req-bcefea05-f15f-4a8c-93cd-d38f8ed0671a req-e249d1f7-8f9b-426f-8a87-e40a758fcb46 service nova] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] No waiting events found dispatching network-vif-plugged-4c49d1d4-dba2-478e-80b6-94e012439af6 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:57:23 user nova-compute[75100]: WARNING nova.compute.manager [req-bcefea05-f15f-4a8c-93cd-d38f8ed0671a req-e249d1f7-8f9b-426f-8a87-e40a758fcb46 service nova] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Received unexpected event network-vif-plugged-4c49d1d4-dba2-478e-80b6-94e012439af6 for instance with vm_state rescued and task_state unrescuing.
Nov 10 17:57:23 user nova-compute[75100]: DEBUG nova.compute.manager [req-bcefea05-f15f-4a8c-93cd-d38f8ed0671a req-e249d1f7-8f9b-426f-8a87-e40a758fcb46 service nova] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Received event network-vif-plugged-54a1b80b-3910-4ab8-a694-88989c4b6f4e {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:57:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-bcefea05-f15f-4a8c-93cd-d38f8ed0671a req-e249d1f7-8f9b-426f-8a87-e40a758fcb46 service nova] Acquiring lock "c7fbe35b-4794-4eb9-8033-923247064458-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:57:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-bcefea05-f15f-4a8c-93cd-d38f8ed0671a req-e249d1f7-8f9b-426f-8a87-e40a758fcb46 service nova] Lock "c7fbe35b-4794-4eb9-8033-923247064458-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:57:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-bcefea05-f15f-4a8c-93cd-d38f8ed0671a req-e249d1f7-8f9b-426f-8a87-e40a758fcb46 service nova] Lock "c7fbe35b-4794-4eb9-8033-923247064458-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:57:23 user nova-compute[75100]: DEBUG nova.compute.manager [req-bcefea05-f15f-4a8c-93cd-d38f8ed0671a req-e249d1f7-8f9b-426f-8a87-e40a758fcb46 service nova] [instance: c7fbe35b-4794-4eb9-8033-923247064458] No waiting events found dispatching network-vif-plugged-54a1b80b-3910-4ab8-a694-88989c4b6f4e {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:57:23 user nova-compute[75100]: WARNING nova.compute.manager [req-bcefea05-f15f-4a8c-93cd-d38f8ed0671a req-e249d1f7-8f9b-426f-8a87-e40a758fcb46 service nova] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Received unexpected event network-vif-plugged-54a1b80b-3910-4ab8-a694-88989c4b6f4e for instance with vm_state active and task_state rebuild_spawning.
Nov 10 17:57:23 user nova-compute[75100]: DEBUG nova.compute.manager [req-bcefea05-f15f-4a8c-93cd-d38f8ed0671a req-e249d1f7-8f9b-426f-8a87-e40a758fcb46 service nova] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Received event network-vif-plugged-54a1b80b-3910-4ab8-a694-88989c4b6f4e {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:57:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-bcefea05-f15f-4a8c-93cd-d38f8ed0671a req-e249d1f7-8f9b-426f-8a87-e40a758fcb46 service nova] Acquiring lock "c7fbe35b-4794-4eb9-8033-923247064458-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:57:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-bcefea05-f15f-4a8c-93cd-d38f8ed0671a req-e249d1f7-8f9b-426f-8a87-e40a758fcb46 service nova] Lock "c7fbe35b-4794-4eb9-8033-923247064458-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:57:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-bcefea05-f15f-4a8c-93cd-d38f8ed0671a req-e249d1f7-8f9b-426f-8a87-e40a758fcb46 service nova] Lock "c7fbe35b-4794-4eb9-8033-923247064458-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:57:23 user nova-compute[75100]: DEBUG nova.compute.manager [req-bcefea05-f15f-4a8c-93cd-d38f8ed0671a req-e249d1f7-8f9b-426f-8a87-e40a758fcb46 service nova] [instance: c7fbe35b-4794-4eb9-8033-923247064458] No waiting events found dispatching network-vif-plugged-54a1b80b-3910-4ab8-a694-88989c4b6f4e {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:57:23 user nova-compute[75100]: WARNING nova.compute.manager [req-bcefea05-f15f-4a8c-93cd-d38f8ed0671a req-e249d1f7-8f9b-426f-8a87-e40a758fcb46 service nova] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Received unexpected event network-vif-plugged-54a1b80b-3910-4ab8-a694-88989c4b6f4e for instance with vm_state active and task_state rebuild_spawning.
Nov 10 17:57:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61d3862-5be7-45cc-95a0-88124ac1725d/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:57:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61d3862-5be7-45cc-95a0-88124ac1725d/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:57:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61d3862-5be7-45cc-95a0-88124ac1725d/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:57:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61d3862-5be7-45cc-95a0-88124ac1725d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:57:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:57:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:57:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:57:25 user nova-compute[75100]: DEBUG nova.compute.manager [req-e26bfba5-99d0-4189-ad32-3a3662bd172a req-cb75585b-0357-4661-96d8-d126c0d02dbe service nova] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Received event network-vif-plugged-4c49d1d4-dba2-478e-80b6-94e012439af6 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:57:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-e26bfba5-99d0-4189-ad32-3a3662bd172a req-cb75585b-0357-4661-96d8-d126c0d02dbe service nova] Acquiring lock "9033f537-bdeb-412c-9337-4ad86f4467b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:57:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-e26bfba5-99d0-4189-ad32-3a3662bd172a req-cb75585b-0357-4661-96d8-d126c0d02dbe service nova] Lock "9033f537-bdeb-412c-9337-4ad86f4467b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:57:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-e26bfba5-99d0-4189-ad32-3a3662bd172a req-cb75585b-0357-4661-96d8-d126c0d02dbe service nova] Lock "9033f537-bdeb-412c-9337-4ad86f4467b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:57:25 user nova-compute[75100]: DEBUG nova.compute.manager [req-e26bfba5-99d0-4189-ad32-3a3662bd172a req-cb75585b-0357-4661-96d8-d126c0d02dbe service nova] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] No waiting events found dispatching network-vif-plugged-4c49d1d4-dba2-478e-80b6-94e012439af6 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:57:25 user nova-compute[75100]: WARNING nova.compute.manager [req-e26bfba5-99d0-4189-ad32-3a3662bd172a req-cb75585b-0357-4661-96d8-d126c0d02dbe service nova] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Received unexpected event network-vif-plugged-4c49d1d4-dba2-478e-80b6-94e012439af6 for instance with vm_state rescued and task_state unrescuing.
Nov 10 17:57:25 user nova-compute[75100]: DEBUG nova.compute.manager [req-e26bfba5-99d0-4189-ad32-3a3662bd172a req-cb75585b-0357-4661-96d8-d126c0d02dbe service nova] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Received event network-vif-plugged-4c49d1d4-dba2-478e-80b6-94e012439af6 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:57:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-e26bfba5-99d0-4189-ad32-3a3662bd172a req-cb75585b-0357-4661-96d8-d126c0d02dbe service nova] Acquiring lock "9033f537-bdeb-412c-9337-4ad86f4467b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:57:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-e26bfba5-99d0-4189-ad32-3a3662bd172a req-cb75585b-0357-4661-96d8-d126c0d02dbe service nova] Lock "9033f537-bdeb-412c-9337-4ad86f4467b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:57:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-e26bfba5-99d0-4189-ad32-3a3662bd172a req-cb75585b-0357-4661-96d8-d126c0d02dbe service nova] Lock "9033f537-bdeb-412c-9337-4ad86f4467b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:57:25 user nova-compute[75100]: DEBUG nova.compute.manager [req-e26bfba5-99d0-4189-ad32-3a3662bd172a req-cb75585b-0357-4661-96d8-d126c0d02dbe service nova] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] No waiting events found dispatching network-vif-plugged-4c49d1d4-dba2-478e-80b6-94e012439af6 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:57:25 user nova-compute[75100]: WARNING nova.compute.manager [req-e26bfba5-99d0-4189-ad32-3a3662bd172a req-cb75585b-0357-4661-96d8-d126c0d02dbe service nova] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Received unexpected event network-vif-plugged-4c49d1d4-dba2-478e-80b6-94e012439af6 for instance with vm_state rescued and task_state unrescuing.
Nov 10 17:57:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:57:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/989f3ce5-067b-45e4-a2e5-445024e13202/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:57:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/989f3ce5-067b-45e4-a2e5-445024e13202/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:57:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/989f3ce5-067b-45e4-a2e5-445024e13202/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:57:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/989f3ce5-067b-45e4-a2e5-445024e13202/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:57:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2f4288-da43-4bf3-9ef4-fd53961fe74c/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:57:25 user nova-compute[75100]: DEBUG nova.compute.manager [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 17:57:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 17:57:25 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Instance spawned successfully.
Nov 10 17:57:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 17:57:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:57:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:57:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:57:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:57:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:57:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:57:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2f4288-da43-4bf3-9ef4-fd53961fe74c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:57:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2f4288-da43-4bf3-9ef4-fd53961fe74c/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:57:25 user nova-compute[75100]: DEBUG nova.compute.manager [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 17:57:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:57:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:57:26 user nova-compute[75100]: DEBUG nova.objects.instance [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75100) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 10 17:57:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2f4288-da43-4bf3-9ef4-fd53961fe74c/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:57:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:57:26 user nova-compute[75100]: DEBUG nova.compute.manager [None req-9b31aaec-ca89-446d-8441-33acff84ac52 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 17:57:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6a6a08ca-5221-480e-8578-f415e62eb3b1 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.154s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:57:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:57:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:57:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] Acquiring lock "81e579a0-93f3-4989-b47f-f12f8b296a62" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:57:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] Lock "81e579a0-93f3-4989-b47f-f12f8b296a62" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:57:26 user nova-compute[75100]: DEBUG nova.compute.manager [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] [instance: 81e579a0-93f3-4989-b47f-f12f8b296a62] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 17:57:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:57:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:57:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:57:26 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 17:57:26 user nova-compute[75100]: INFO nova.compute.claims [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] [instance: 81e579a0-93f3-4989-b47f-f12f8b296a62] Claim successful on node user
Nov 10 17:57:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 17:57:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7fbe35b-4794-4eb9-8033-923247064458/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:57:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7fbe35b-4794-4eb9-8033-923247064458/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:57:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7fbe35b-4794-4eb9-8033-923247064458/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:57:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7fbe35b-4794-4eb9-8033-923247064458/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:57:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 17:57:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e73913-30a5-4eaa-9bc0-6e17a0288035/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:57:27 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:57:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e73913-30a5-4eaa-9bc0-6e17a0288035/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:57:27 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:57:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e73913-30a5-4eaa-9bc0-6e17a0288035/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:57:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.679s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:57:27 user nova-compute[75100]: DEBUG nova.compute.manager [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] [instance: 81e579a0-93f3-4989-b47f-f12f8b296a62] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 17:57:27 user nova-compute[75100]: DEBUG nova.compute.manager [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] [instance: 81e579a0-93f3-4989-b47f-f12f8b296a62] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 17:57:27 user nova-compute[75100]: DEBUG nova.network.neutron [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] [instance: 81e579a0-93f3-4989-b47f-f12f8b296a62] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 17:57:27 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] [instance: 81e579a0-93f3-4989-b47f-f12f8b296a62] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 17:57:27 user nova-compute[75100]: DEBUG nova.compute.manager [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] [instance: 81e579a0-93f3-4989-b47f-f12f8b296a62] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 17:57:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e73913-30a5-4eaa-9bc0-6e17a0288035/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:57:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 17:57:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:57:27 user nova-compute[75100]: DEBUG nova.compute.manager [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] [instance: 81e579a0-93f3-4989-b47f-f12f8b296a62] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 17:57:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] [instance: 81e579a0-93f3-4989-b47f-f12f8b296a62] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 17:57:27 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] [instance: 81e579a0-93f3-4989-b47f-f12f8b296a62] Creating image(s)
Nov 10 17:57:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] Acquiring lock "/opt/stack/data/nova/instances/81e579a0-93f3-4989-b47f-f12f8b296a62/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:57:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] Lock "/opt/stack/data/nova/instances/81e579a0-93f3-4989-b47f-f12f8b296a62/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:57:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] Lock "/opt/stack/data/nova/instances/81e579a0-93f3-4989-b47f-f12f8b296a62/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:57:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:57:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:57:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:57:27 user nova-compute[75100]: DEBUG nova.policy [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cdc2d8dc446846ee85e698cd1f056294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea8af95f4f5f417a854d2e60aeebbbe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 17:57:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.191s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:57:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] Acquiring lock "818b9e28e061d41a38d903968b229be2ed9ba520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:57:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:57:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:57:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:57:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 17:57:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:57:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.191s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:57:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/81e579a0-93f3-4989-b47f-f12f8b296a62/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:57:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/81e579a0-93f3-4989-b47f-f12f8b296a62/disk 1073741824" returned: 0 in 0.049s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:57:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:57:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:57:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk.rescue --force-share --output=json" returned: 0 in 0.227s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:57:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:57:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.175s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:57:28 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] Checking if we can resize image /opt/stack/data/nova/instances/81e579a0-93f3-4989-b47f-f12f8b296a62/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 17:57:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81e579a0-93f3-4989-b47f-f12f8b296a62/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:57:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:57:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:57:28 user nova-compute[75100]: DEBUG nova.network.neutron [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] [instance: 81e579a0-93f3-4989-b47f-f12f8b296a62] Successfully created port: c3f32695-0b6f-431f-8539-981f044d7198 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 17:57:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81e579a0-93f3-4989-b47f-f12f8b296a62/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:57:28 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] Cannot resize image /opt/stack/data/nova/instances/81e579a0-93f3-4989-b47f-f12f8b296a62/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 17:57:28 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] [instance: 81e579a0-93f3-4989-b47f-f12f8b296a62] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 17:57:28 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] [instance: 81e579a0-93f3-4989-b47f-f12f8b296a62] Ensure instance console log exists: /opt/stack/data/nova/instances/81e579a0-93f3-4989-b47f-f12f8b296a62/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 17:57:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:57:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:57:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:57:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:57:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:57:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:57:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:57:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:57:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:57:28 user nova-compute[75100]: DEBUG nova.network.neutron [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] [instance: 81e579a0-93f3-4989-b47f-f12f8b296a62] Successfully updated port: c3f32695-0b6f-431f-8539-981f044d7198 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 17:57:28 user nova-compute[75100]: DEBUG nova.compute.manager [req-22ec7e38-06ed-4136-87e8-847eaa76ccfe req-835b7b2f-8cde-4bb7-b61c-a17089b834eb service nova] [instance: 81e579a0-93f3-4989-b47f-f12f8b296a62] Received event network-changed-c3f32695-0b6f-431f-8539-981f044d7198 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:57:28 user nova-compute[75100]: DEBUG nova.compute.manager [req-22ec7e38-06ed-4136-87e8-847eaa76ccfe req-835b7b2f-8cde-4bb7-b61c-a17089b834eb service nova] [instance: 81e579a0-93f3-4989-b47f-f12f8b296a62] Refreshing instance network info cache due to event network-changed-c3f32695-0b6f-431f-8539-981f044d7198. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 17:57:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-22ec7e38-06ed-4136-87e8-847eaa76ccfe req-835b7b2f-8cde-4bb7-b61c-a17089b834eb service nova] Acquiring lock "refresh_cache-81e579a0-93f3-4989-b47f-f12f8b296a62" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:57:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-22ec7e38-06ed-4136-87e8-847eaa76ccfe req-835b7b2f-8cde-4bb7-b61c-a17089b834eb service nova] Acquired lock "refresh_cache-81e579a0-93f3-4989-b47f-f12f8b296a62" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:57:28 user nova-compute[75100]: DEBUG nova.network.neutron [req-22ec7e38-06ed-4136-87e8-847eaa76ccfe req-835b7b2f-8cde-4bb7-b61c-a17089b834eb service nova] [instance: 81e579a0-93f3-4989-b47f-f12f8b296a62] Refreshing network info cache for port c3f32695-0b6f-431f-8539-981f044d7198 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 17:57:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] Acquiring lock "refresh_cache-81e579a0-93f3-4989-b47f-f12f8b296a62" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:57:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:57:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 17:57:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adf9e657-d366-4afd-a752-87e69b73eb81/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:57:29 user nova-compute[75100]: DEBUG nova.network.neutron [req-22ec7e38-06ed-4136-87e8-847eaa76ccfe req-835b7b2f-8cde-4bb7-b61c-a17089b834eb service nova] [instance: 81e579a0-93f3-4989-b47f-f12f8b296a62] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 17:57:29 user nova-compute[75100]: DEBUG nova.network.neutron [req-22ec7e38-06ed-4136-87e8-847eaa76ccfe req-835b7b2f-8cde-4bb7-b61c-a17089b834eb service nova] [instance: 81e579a0-93f3-4989-b47f-f12f8b296a62] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:57:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-22ec7e38-06ed-4136-87e8-847eaa76ccfe req-835b7b2f-8cde-4bb7-b61c-a17089b834eb service nova] Releasing lock "refresh_cache-81e579a0-93f3-4989-b47f-f12f8b296a62" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:57:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] Acquired lock "refresh_cache-81e579a0-93f3-4989-b47f-f12f8b296a62" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:57:29 user nova-compute[75100]: DEBUG nova.network.neutron [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] [instance: 81e579a0-93f3-4989-b47f-f12f8b296a62] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 17:57:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adf9e657-d366-4afd-a752-87e69b73eb81/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:57:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adf9e657-d366-4afd-a752-87e69b73eb81/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:57:29 user nova-compute[75100]: DEBUG nova.network.neutron [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] [instance: 81e579a0-93f3-4989-b47f-f12f8b296a62] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 17:57:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adf9e657-d366-4afd-a752-87e69b73eb81/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:57:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9033f537-bdeb-412c-9337-4ad86f4467b2/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:57:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9033f537-bdeb-412c-9337-4ad86f4467b2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:57:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9033f537-bdeb-412c-9337-4ad86f4467b2/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:57:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9033f537-bdeb-412c-9337-4ad86f4467b2/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:57:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 17:57:30 user nova-compute[75100]: DEBUG nova.network.neutron [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] [instance: 81e579a0-93f3-4989-b47f-f12f8b296a62] Updating instance_info_cache with network_info: [{"id": "c3f32695-0b6f-431f-8539-981f044d7198", "address": "fa:16:3e:44:60:7a", "network": {"id": "fe6ad35f-a7af-4931-a127-5ff8c9cf91df", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "cabf2ee94c5f40fa840ed5664129268a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3f32695-0b", "ovs_interfaceid": "c3f32695-0b6f-431f-8539-981f044d7198", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:57:30 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:57:30 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:57:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Hypervisor/Node resource view: name=user free_ram=6919MB free_disk=24.311813354492188GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 17:57:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:57:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:57:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] Releasing lock "refresh_cache-81e579a0-93f3-4989-b47f-f12f8b296a62" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:57:30 user nova-compute[75100]: DEBUG nova.compute.manager [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] [instance: 81e579a0-93f3-4989-b47f-f12f8b296a62] Instance network_info: |[{"id": "c3f32695-0b6f-431f-8539-981f044d7198", "address": "fa:16:3e:44:60:7a", "network": {"id": "fe6ad35f-a7af-4931-a127-5ff8c9cf91df", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "cabf2ee94c5f40fa840ed5664129268a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3f32695-0b", "ovs_interfaceid": "c3f32695-0b6f-431f-8539-981f044d7198", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 17:57:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] [instance: 81e579a0-93f3-4989-b47f-f12f8b296a62] Start _get_guest_xml network_info=[{"id": "c3f32695-0b6f-431f-8539-981f044d7198", "address": "fa:16:3e:44:60:7a", "network": {"id": "fe6ad35f-a7af-4931-a127-5ff8c9cf91df", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "cabf2ee94c5f40fa840ed5664129268a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3f32695-0b", "ovs_interfaceid": "c3f32695-0b6f-431f-8539-981f044d7198", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'e3cc5321-4d40-49ee-885c-700e14741732'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 17:57:30 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:57:30 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:57:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 17:57:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 17:57:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 17:57:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 17:57:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 17:57:30 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T17:40:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 17:57:30 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 17:57:30 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 17:57:30 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 17:57:30 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 17:57:30 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 17:57:30 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 17:57:30 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 17:57:30 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 17:57:30 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 17:57:30 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 17:57:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:57:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-677819265',display_name='tempest-VolumesNegativeTest-instance-677819265',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-677819265',id=29,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea8af95f4f5f417a854d2e60aeebbbe3',ramdisk_id='',reservation_id='r-0vxg60gp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1633160930',owner_user_name='tempest-VolumesNegativeTest-1633160930-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:57:27Z,user_data=None,user_id='cdc2d8dc446846ee85e698cd1f056294',uuid=81e579a0-93f3-4989-b47f-f12f8b296a62,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3f32695-0b6f-431f-8539-981f044d7198", "address": "fa:16:3e:44:60:7a", "network": {"id": "fe6ad35f-a7af-4931-a127-5ff8c9cf91df", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "cabf2ee94c5f40fa840ed5664129268a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3f32695-0b", "ovs_interfaceid": "c3f32695-0b6f-431f-8539-981f044d7198", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 17:57:30 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] Converting VIF {"id": "c3f32695-0b6f-431f-8539-981f044d7198", "address": "fa:16:3e:44:60:7a", "network": {"id": "fe6ad35f-a7af-4931-a127-5ff8c9cf91df", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "cabf2ee94c5f40fa840ed5664129268a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3f32695-0b", "ovs_interfaceid": "c3f32695-0b6f-431f-8539-981f044d7198", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:57:30 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:60:7a,bridge_name='br-int',has_traffic_filtering=True,id=c3f32695-0b6f-431f-8539-981f044d7198,network=Network(fe6ad35f-a7af-4931-a127-5ff8c9cf91df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3f32695-0b') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:57:30 user nova-compute[75100]: DEBUG nova.objects.instance [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] Lazy-loading 'pci_devices' on Instance uuid 81e579a0-93f3-4989-b47f-f12f8b296a62 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:57:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] [instance: 81e579a0-93f3-4989-b47f-f12f8b296a62] End _get_guest_xml xml=<domain type="kvm">
Nov 10 17:57:30 user nova-compute[75100]:   <uuid>81e579a0-93f3-4989-b47f-f12f8b296a62</uuid>
Nov 10 17:57:30 user nova-compute[75100]:   <name>instance-0000001d</name>
Nov 10 17:57:30 user nova-compute[75100]:   <memory>524288</memory>
Nov 10 17:57:30 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 10 17:57:30 user nova-compute[75100]:   <metadata>
Nov 10 17:57:30 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 17:57:30 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 10 17:57:30 user nova-compute[75100]:       <nova:name>tempest-VolumesNegativeTest-instance-677819265</nova:name>
Nov 10 17:57:30 user nova-compute[75100]:       <nova:creationTime>2023-11-10 17:57:30</nova:creationTime>
Nov 10 17:57:30 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 10 17:57:30 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 10 17:57:30 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 10 17:57:30 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 10 17:57:30 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 17:57:30 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 10 17:57:30 user nova-compute[75100]:       </nova:flavor>
Nov 10 17:57:30 user nova-compute[75100]:       <nova:owner>
Nov 10 17:57:30 user nova-compute[75100]:         <nova:user uuid="cdc2d8dc446846ee85e698cd1f056294">tempest-VolumesNegativeTest-1633160930-project-member</nova:user>
Nov 10 17:57:30 user nova-compute[75100]:         <nova:project uuid="ea8af95f4f5f417a854d2e60aeebbbe3">tempest-VolumesNegativeTest-1633160930</nova:project>
Nov 10 17:57:30 user nova-compute[75100]:       </nova:owner>
Nov 10 17:57:30 user nova-compute[75100]:       <nova:root type="image" uuid="e3cc5321-4d40-49ee-885c-700e14741732"/>
Nov 10 17:57:30 user nova-compute[75100]:       <nova:ports>
Nov 10 17:57:30 user nova-compute[75100]:         <nova:port uuid="c3f32695-0b6f-431f-8539-981f044d7198">
Nov 10 17:57:30 user nova-compute[75100]:           <nova:ip type="fixed" address="192.168.233.224" ipVersion="4"/>
Nov 10 17:57:30 user nova-compute[75100]:         </nova:port>
Nov 10 17:57:30 user nova-compute[75100]:       </nova:ports>
Nov 10 17:57:30 user nova-compute[75100]:     </nova:instance>
Nov 10 17:57:30 user nova-compute[75100]:   </metadata>
Nov 10 17:57:30 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 10 17:57:30 user nova-compute[75100]:     <system>
Nov 10 17:57:30 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 17:57:30 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 10 17:57:30 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 10 17:57:30 user nova-compute[75100]:       <entry name="serial">81e579a0-93f3-4989-b47f-f12f8b296a62</entry>
Nov 10 17:57:30 user nova-compute[75100]:       <entry name="uuid">81e579a0-93f3-4989-b47f-f12f8b296a62</entry>
Nov 10 17:57:30 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 10 17:57:30 user nova-compute[75100]:     </system>
Nov 10 17:57:30 user nova-compute[75100]:   </sysinfo>
Nov 10 17:57:30 user nova-compute[75100]:   <os>
Nov 10 17:57:30 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 17:57:30 user nova-compute[75100]:     <boot dev="hd"/>
Nov 10 17:57:30 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 10 17:57:30 user nova-compute[75100]:   </os>
Nov 10 17:57:30 user nova-compute[75100]:   <features>
Nov 10 17:57:30 user nova-compute[75100]:     <acpi/>
Nov 10 17:57:30 user nova-compute[75100]:     <apic/>
Nov 10 17:57:30 user nova-compute[75100]:     <vmcoreinfo/>
Nov 10 17:57:30 user nova-compute[75100]:   </features>
Nov 10 17:57:30 user nova-compute[75100]:   <clock offset="utc">
Nov 10 17:57:30 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 17:57:30 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 17:57:30 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 10 17:57:30 user nova-compute[75100]:   </clock>
Nov 10 17:57:30 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 10 17:57:30 user nova-compute[75100]:     <model>Nehalem</model>
Nov 10 17:57:30 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 17:57:30 user nova-compute[75100]:   </cpu>
Nov 10 17:57:30 user nova-compute[75100]:   <devices>
Nov 10 17:57:30 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 10 17:57:30 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 17:57:30 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/81e579a0-93f3-4989-b47f-f12f8b296a62/disk"/>
Nov 10 17:57:30 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 10 17:57:30 user nova-compute[75100]:     </disk>
Nov 10 17:57:30 user nova-compute[75100]:     <interface type="ethernet">
Nov 10 17:57:30 user nova-compute[75100]:       <mac address="fa:16:3e:44:60:7a"/>
Nov 10 17:57:30 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:57:30 user nova-compute[75100]:       <mtu size="1442"/>
Nov 10 17:57:30 user nova-compute[75100]:       <target dev="tapc3f32695-0b"/>
Nov 10 17:57:30 user nova-compute[75100]:     </interface>
Nov 10 17:57:30 user nova-compute[75100]:     <serial type="pty">
Nov 10 17:57:30 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/81e579a0-93f3-4989-b47f-f12f8b296a62/console.log" append="off"/>
Nov 10 17:57:30 user nova-compute[75100]:     </serial>
Nov 10 17:57:30 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 17:57:30 user nova-compute[75100]:     <video>
Nov 10 17:57:30 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:57:30 user nova-compute[75100]:     </video>
Nov 10 17:57:30 user nova-compute[75100]:     <rng model="virtio">
Nov 10 17:57:30 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 10 17:57:30 user nova-compute[75100]:     </rng>
Nov 10 17:57:30 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 10 17:57:30 user nova-compute[75100]:     <memballoon model="virtio">
Nov 10 17:57:30 user nova-compute[75100]:       <stats period="10"/>
Nov 10 17:57:30 user nova-compute[75100]:     </memballoon>
Nov 10 17:57:30 user nova-compute[75100]:   </devices>
Nov 10 17:57:30 user nova-compute[75100]: </domain>
Nov 10 17:57:30 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 17:57:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:57:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-677819265',display_name='tempest-VolumesNegativeTest-instance-677819265',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-677819265',id=29,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea8af95f4f5f417a854d2e60aeebbbe3',ramdisk_id='',reservation_id='r-0vxg60gp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1633160930',owner_user_name='tempest-VolumesNegativeTest-1633160930-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:57:27Z,user_data=None,user_id='cdc2d8dc446846ee85e698cd1f056294',uuid=81e579a0-93f3-4989-b47f-f12f8b296a62,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3f32695-0b6f-431f-8539-981f044d7198", "address": "fa:16:3e:44:60:7a", "network": {"id": "fe6ad35f-a7af-4931-a127-5ff8c9cf91df", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "cabf2ee94c5f40fa840ed5664129268a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3f32695-0b", "ovs_interfaceid": "c3f32695-0b6f-431f-8539-981f044d7198", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 17:57:30 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] Converting VIF {"id": "c3f32695-0b6f-431f-8539-981f044d7198", "address": "fa:16:3e:44:60:7a", "network": {"id": "fe6ad35f-a7af-4931-a127-5ff8c9cf91df", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "cabf2ee94c5f40fa840ed5664129268a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3f32695-0b", "ovs_interfaceid": "c3f32695-0b6f-431f-8539-981f044d7198", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:57:30 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:60:7a,bridge_name='br-int',has_traffic_filtering=True,id=c3f32695-0b6f-431f-8539-981f044d7198,network=Network(fe6ad35f-a7af-4931-a127-5ff8c9cf91df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3f32695-0b') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:57:30 user nova-compute[75100]: DEBUG os_vif [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:60:7a,bridge_name='br-int',has_traffic_filtering=True,id=c3f32695-0b6f-431f-8539-981f044d7198,network=Network(fe6ad35f-a7af-4931-a127-5ff8c9cf91df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3f32695-0b') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 17:57:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:57:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 17:57:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0b70a266-33ab-5322-904d-ec9a6324b078', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:57:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:57:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc3f32695-0b, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:57:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc3f32695-0b, col_values=(('qos', UUID('d1cd7fdd-b70c-40d8-857e-d52b382cb616')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:57:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc3f32695-0b, col_values=(('external_ids', {'iface-id': 'c3f32695-0b6f-431f-8539-981f044d7198', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:60:7a', 'vm-uuid': '81e579a0-93f3-4989-b47f-f12f8b296a62'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:57:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:57:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:30 user nova-compute[75100]: INFO os_vif [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:60:7a,bridge_name='br-int',has_traffic_filtering=True,id=c3f32695-0b6f-431f-8539-981f044d7198,network=Network(fe6ad35f-a7af-4931-a127-5ff8c9cf91df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3f32695-0b')
Nov 10 17:57:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance c19fc271-a248-4631-a11f-89b7ed73bf85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:57:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:57:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 3e14de19-540d-4dc2-a058-6874d8d14478 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:57:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance d61d3862-5be7-45cc-95a0-88124ac1725d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:57:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:57:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance e6de4626-f097-43b7-8e56-a08415e7d74a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:57:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 9033f537-bdeb-412c-9337-4ad86f4467b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:57:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 989f3ce5-067b-45e4-a2e5-445024e13202 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:57:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance c7fbe35b-4794-4eb9-8033-923247064458 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:57:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance eb430407-f836-4510-899f-a5f5d60c73f3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:57:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance adf9e657-d366-4afd-a752-87e69b73eb81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:57:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 6d227210-c4df-4aa7-9969-70fa137aeb63 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:57:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance ca2f4288-da43-4bf3-9ef4-fd53961fe74c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:57:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 61e73913-30a5-4eaa-9bc0-6e17a0288035 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:57:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 81e579a0-93f3-4989-b47f-f12f8b296a62 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:57:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 17:57:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=13GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 17:57:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 17:57:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] No VIF found with MAC fa:16:3e:44:60:7a, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 17:57:30 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:57:30 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:57:31 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 17:57:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.679s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:57:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:32 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:57:32 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:57:32 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 17:57:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "refresh_cache-b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:57:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquired lock "refresh_cache-b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:57:32 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 17:57:32 user nova-compute[75100]: DEBUG nova.compute.manager [req-674327a8-0c27-4870-97fa-34207a00e841 req-1af0b03a-93f6-464a-9c42-6e0784002b88 service nova] [instance: 81e579a0-93f3-4989-b47f-f12f8b296a62] Received event network-vif-plugged-c3f32695-0b6f-431f-8539-981f044d7198 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:57:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-674327a8-0c27-4870-97fa-34207a00e841 req-1af0b03a-93f6-464a-9c42-6e0784002b88 service nova] Acquiring lock "81e579a0-93f3-4989-b47f-f12f8b296a62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:57:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-674327a8-0c27-4870-97fa-34207a00e841 req-1af0b03a-93f6-464a-9c42-6e0784002b88 service nova] Lock "81e579a0-93f3-4989-b47f-f12f8b296a62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:57:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-674327a8-0c27-4870-97fa-34207a00e841 req-1af0b03a-93f6-464a-9c42-6e0784002b88 service nova] Lock "81e579a0-93f3-4989-b47f-f12f8b296a62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:57:32 user nova-compute[75100]: DEBUG nova.compute.manager [req-674327a8-0c27-4870-97fa-34207a00e841 req-1af0b03a-93f6-464a-9c42-6e0784002b88 service nova] [instance: 81e579a0-93f3-4989-b47f-f12f8b296a62] No waiting events found dispatching network-vif-plugged-c3f32695-0b6f-431f-8539-981f044d7198 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:57:32 user nova-compute[75100]: WARNING nova.compute.manager [req-674327a8-0c27-4870-97fa-34207a00e841 req-1af0b03a-93f6-464a-9c42-6e0784002b88 service nova] [instance: 81e579a0-93f3-4989-b47f-f12f8b296a62] Received unexpected event network-vif-plugged-c3f32695-0b6f-431f-8539-981f044d7198 for instance with vm_state building and task_state spawning.
Nov 10 17:57:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:32 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Updating instance_info_cache with network_info: [{"id": "be620d2e-a2ea-49fe-9205-68101009027b", "address": "fa:16:3e:2d:37:4e", "network": {"id": "26a554fe-9a5e-40c0-9981-5ac084c9ea73", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-269663495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19755f3e634fdfbd562c33fbfa2a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe620d2e-a2", "ovs_interfaceid": "be620d2e-a2ea-49fe-9205-68101009027b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:57:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Releasing lock "refresh_cache-b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:57:32 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 17:57:32 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:57:32 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:57:32 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 17:57:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:34 user nova-compute[75100]: DEBUG nova.compute.manager [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] [instance: 81e579a0-93f3-4989-b47f-f12f8b296a62] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 17:57:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] [instance: 81e579a0-93f3-4989-b47f-f12f8b296a62] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 17:57:34 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 81e579a0-93f3-4989-b47f-f12f8b296a62] Instance spawned successfully.
Nov 10 17:57:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] [instance: 81e579a0-93f3-4989-b47f-f12f8b296a62] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 17:57:34 user nova-compute[75100]: DEBUG nova.compute.manager [req-fa900c96-04d2-45ab-8e27-2e266df3c569 req-7dcbf0a6-072f-42a3-8ba2-27f1809f0fb2 service nova] [instance: 81e579a0-93f3-4989-b47f-f12f8b296a62] Received event network-vif-plugged-c3f32695-0b6f-431f-8539-981f044d7198 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:57:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-fa900c96-04d2-45ab-8e27-2e266df3c569 req-7dcbf0a6-072f-42a3-8ba2-27f1809f0fb2 service nova] Acquiring lock "81e579a0-93f3-4989-b47f-f12f8b296a62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:57:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-fa900c96-04d2-45ab-8e27-2e266df3c569 req-7dcbf0a6-072f-42a3-8ba2-27f1809f0fb2 service nova] Lock "81e579a0-93f3-4989-b47f-f12f8b296a62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:57:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-fa900c96-04d2-45ab-8e27-2e266df3c569 req-7dcbf0a6-072f-42a3-8ba2-27f1809f0fb2 service nova] Lock "81e579a0-93f3-4989-b47f-f12f8b296a62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:57:34 user nova-compute[75100]: DEBUG nova.compute.manager [req-fa900c96-04d2-45ab-8e27-2e266df3c569 req-7dcbf0a6-072f-42a3-8ba2-27f1809f0fb2 service nova] [instance: 81e579a0-93f3-4989-b47f-f12f8b296a62] No waiting events found dispatching network-vif-plugged-c3f32695-0b6f-431f-8539-981f044d7198 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:57:34 user nova-compute[75100]: WARNING nova.compute.manager [req-fa900c96-04d2-45ab-8e27-2e266df3c569 req-7dcbf0a6-072f-42a3-8ba2-27f1809f0fb2 service nova] [instance: 81e579a0-93f3-4989-b47f-f12f8b296a62] Received unexpected event network-vif-plugged-c3f32695-0b6f-431f-8539-981f044d7198 for instance with vm_state building and task_state spawning.
Nov 10 17:57:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] [instance: 81e579a0-93f3-4989-b47f-f12f8b296a62] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:57:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] [instance: 81e579a0-93f3-4989-b47f-f12f8b296a62] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:57:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] [instance: 81e579a0-93f3-4989-b47f-f12f8b296a62] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:57:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] [instance: 81e579a0-93f3-4989-b47f-f12f8b296a62] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:57:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] [instance: 81e579a0-93f3-4989-b47f-f12f8b296a62] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:57:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] [instance: 81e579a0-93f3-4989-b47f-f12f8b296a62] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:57:34 user nova-compute[75100]: INFO nova.compute.manager [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] [instance: 81e579a0-93f3-4989-b47f-f12f8b296a62] Took 6.85 seconds to spawn the instance on the hypervisor.
Nov 10 17:57:34 user nova-compute[75100]: DEBUG nova.compute.manager [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] [instance: 81e579a0-93f3-4989-b47f-f12f8b296a62] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 17:57:34 user nova-compute[75100]: INFO nova.compute.manager [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] [instance: 81e579a0-93f3-4989-b47f-f12f8b296a62] Took 7.94 seconds to build instance.
Nov 10 17:57:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8c920110-a00a-472d-b552-79977d0dde9f tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] Lock "81e579a0-93f3-4989-b47f-f12f8b296a62" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.075s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:57:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-53c767c5-94bb-4ef9-97df-075980c0ef9e tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Acquiring lock "e6de4626-f097-43b7-8e56-a08415e7d74a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:57:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-53c767c5-94bb-4ef9-97df-075980c0ef9e tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lock "e6de4626-f097-43b7-8e56-a08415e7d74a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:57:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-53c767c5-94bb-4ef9-97df-075980c0ef9e tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Acquiring lock "e6de4626-f097-43b7-8e56-a08415e7d74a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:57:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-53c767c5-94bb-4ef9-97df-075980c0ef9e tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lock "e6de4626-f097-43b7-8e56-a08415e7d74a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:57:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-53c767c5-94bb-4ef9-97df-075980c0ef9e tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lock "e6de4626-f097-43b7-8e56-a08415e7d74a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:57:37 user nova-compute[75100]: INFO nova.compute.manager [None req-53c767c5-94bb-4ef9-97df-075980c0ef9e tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Terminating instance
Nov 10 17:57:37 user nova-compute[75100]: DEBUG nova.compute.manager [None req-53c767c5-94bb-4ef9-97df-075980c0ef9e tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 17:57:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:38 user nova-compute[75100]: DEBUG nova.compute.manager [req-8fb96a71-e674-46b9-886b-b808e94319ef req-e6465a1c-78a1-499e-97de-163ea6af8134 service nova] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Received event network-vif-unplugged-d3d11e2e-7099-4c6e-aa65-53f953ce4571 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:57:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8fb96a71-e674-46b9-886b-b808e94319ef req-e6465a1c-78a1-499e-97de-163ea6af8134 service nova] Acquiring lock "e6de4626-f097-43b7-8e56-a08415e7d74a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:57:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8fb96a71-e674-46b9-886b-b808e94319ef req-e6465a1c-78a1-499e-97de-163ea6af8134 service nova] Lock "e6de4626-f097-43b7-8e56-a08415e7d74a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:57:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8fb96a71-e674-46b9-886b-b808e94319ef req-e6465a1c-78a1-499e-97de-163ea6af8134 service nova] Lock "e6de4626-f097-43b7-8e56-a08415e7d74a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:57:38 user nova-compute[75100]: DEBUG nova.compute.manager [req-8fb96a71-e674-46b9-886b-b808e94319ef req-e6465a1c-78a1-499e-97de-163ea6af8134 service nova] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] No waiting events found dispatching network-vif-unplugged-d3d11e2e-7099-4c6e-aa65-53f953ce4571 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:57:38 user nova-compute[75100]: DEBUG nova.compute.manager [req-8fb96a71-e674-46b9-886b-b808e94319ef req-e6465a1c-78a1-499e-97de-163ea6af8134 service nova] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Received event network-vif-unplugged-d3d11e2e-7099-4c6e-aa65-53f953ce4571 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 17:57:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:38 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Instance destroyed successfully.
Nov 10 17:57:38 user nova-compute[75100]: DEBUG nova.objects.instance [None req-53c767c5-94bb-4ef9-97df-075980c0ef9e tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lazy-loading 'resources' on Instance uuid e6de4626-f097-43b7-8e56-a08415e7d74a {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:57:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-53c767c5-94bb-4ef9-97df-075980c0ef9e tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:51:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1499114588',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1499114588',id=19,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T17:54:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='72c970a503d74d32a1e2b71f086649fd',ramdisk_id='',reservation_id='r-2rik8cbf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2001759307',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T17:55:52Z,user_data=None,user_id='b79cb22ab5774ce8991f237bd2204555',uuid=e6de4626-f097-43b7-8e56-a08415e7d74a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d3d11e2e-7099-4c6e-aa65-53f953ce4571", "address": "fa:16:3e:86:a7:41", "network": {"id": "f240fae3-3d7b-4b6e-b04f-18550ab4d0a3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1007355777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c970a503d74d32a1e2b71f086649fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d11e2e-70", "ovs_interfaceid": "d3d11e2e-7099-4c6e-aa65-53f953ce4571", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 17:57:38 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-53c767c5-94bb-4ef9-97df-075980c0ef9e tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Converting VIF {"id": "d3d11e2e-7099-4c6e-aa65-53f953ce4571", "address": "fa:16:3e:86:a7:41", "network": {"id": "f240fae3-3d7b-4b6e-b04f-18550ab4d0a3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1007355777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c970a503d74d32a1e2b71f086649fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d11e2e-70", "ovs_interfaceid": "d3d11e2e-7099-4c6e-aa65-53f953ce4571", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:57:38 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-53c767c5-94bb-4ef9-97df-075980c0ef9e tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:a7:41,bridge_name='br-int',has_traffic_filtering=True,id=d3d11e2e-7099-4c6e-aa65-53f953ce4571,network=Network(f240fae3-3d7b-4b6e-b04f-18550ab4d0a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3d11e2e-70') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:57:38 user nova-compute[75100]: DEBUG os_vif [None req-53c767c5-94bb-4ef9-97df-075980c0ef9e tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:a7:41,bridge_name='br-int',has_traffic_filtering=True,id=d3d11e2e-7099-4c6e-aa65-53f953ce4571,network=Network(f240fae3-3d7b-4b6e-b04f-18550ab4d0a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3d11e2e-70') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 17:57:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd3d11e2e-70, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:57:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:57:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8a740c1f-7ce0-4cc1-b886-10da24303d4a) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:57:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:57:38 user nova-compute[75100]: INFO os_vif [None req-53c767c5-94bb-4ef9-97df-075980c0ef9e tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:a7:41,bridge_name='br-int',has_traffic_filtering=True,id=d3d11e2e-7099-4c6e-aa65-53f953ce4571,network=Network(f240fae3-3d7b-4b6e-b04f-18550ab4d0a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3d11e2e-70')
Nov 10 17:57:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53c767c5-94bb-4ef9-97df-075980c0ef9e tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 17:57:38 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c767c5-94bb-4ef9-97df-075980c0ef9e tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, {'target_iqn': 'iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wLIchQgb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 17:57:38 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-53c767c5-94bb-4ef9-97df-075980c0ef9e tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 17:57:38 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-53c767c5-94bb-4ef9-97df-075980c0ef9e tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 17:57:38 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-53c767c5-94bb-4ef9-97df-075980c0ef9e tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 17:57:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:57:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:57:38 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0a73df-fe6a-4955-8a1f-59c2d724e42a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:57:38 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c767c5-94bb-4ef9-97df-075980c0ef9e tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 17:57:38 user nova-compute[75100]: No targets found.
Nov 10 17:57:38 user nova-compute[75100]: iSNS:
Nov 10 17:57:38 user nova-compute[75100]: No targets found.
Nov 10 17:57:38 user nova-compute[75100]: STATIC:
Nov 10 17:57:38 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c
Nov 10 17:57:38 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 17:57:38 user nova-compute[75100]:                 Iface Name: default
Nov 10 17:57:38 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54
Nov 10 17:57:38 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 17:57:38 user nova-compute[75100]:                 Iface Name: default
Nov 10 17:57:38 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308
Nov 10 17:57:38 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 17:57:38 user nova-compute[75100]:                 Iface Name: default
Nov 10 17:57:38 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652
Nov 10 17:57:38 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 17:57:38 user nova-compute[75100]:                 Iface Name: default
Nov 10 17:57:38 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00
Nov 10 17:57:38 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 17:57:38 user nova-compute[75100]:                 Iface Name: default
Nov 10 17:57:38 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7
Nov 10 17:57:38 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 17:57:38 user nova-compute[75100]:                 Iface Name: default
Nov 10 17:57:38 user nova-compute[75100]: FIRMWARE:
Nov 10 17:57:38 user nova-compute[75100]: No targets found.
Nov 10 17:57:38 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:57:38 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c767c5-94bb-4ef9-97df-075980c0ef9e tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 17:57:38 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 17:57:38 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 17:57:38 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c767c5-94bb-4ef9-97df-075980c0ef9e tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 17:57:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:57:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:57:38 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[05482bb2-7ba7-4819-b1c0-5c40a085c8e9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:57:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:57:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:57:38 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce2c6fc-ba31-45e3-b53c-321ae931ec1f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:57:38 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c767c5-94bb-4ef9-97df-075980c0ef9e tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)
Nov 10 17:57:38 user nova-compute[75100]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)
Nov 10 17:57:38 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c (non-flash)
Nov 10 17:57:38 user nova-compute[75100]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7 (non-flash)
Nov 10 17:57:38 user nova-compute[75100]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 (non-flash)
Nov 10 17:57:38 user nova-compute[75100]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 (non-flash)
Nov 10 17:57:38 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:57:38 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c767c5-94bb-4ef9-97df-075980c0ef9e tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 (non-flash)
Nov 10 17:57:38 user nova-compute[75100]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)
Nov 10 17:57:38 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c (non-flash)
Nov 10 17:57:38 user nova-compute[75100]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7 (non-flash)
Nov 10 17:57:38 user nova-compute[75100]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 (non-flash)
Nov 10 17:57:38 user nova-compute[75100]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 (non-flash)
Nov 10 17:57:38 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 17:57:38 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c767c5-94bb-4ef9-97df-075980c0ef9e tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa398653250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54'): ({'sdb'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 17:57:38 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-53c767c5-94bb-4ef9-97df-075980c0ef9e tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Removing single pathed devices sdb {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 17:57:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:57:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:57:38 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6ca625-7c26-4534-b05f-c916fa72aee5]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:57:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:57:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:57:38 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0fa378d-a053-436b-997c-f57e4b9480ec]: (4, ('ok\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:57:38 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-53c767c5-94bb-4ef9-97df-075980c0ef9e tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Flushing IO for device /dev/sdb {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 17:57:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:57:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:57:38 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a8d7d87-3182-44dc-ae64-d7816cd0490d]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:57:38 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-53c767c5-94bb-4ef9-97df-075980c0ef9e tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 17:57:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:57:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:57:38 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d204ba-6f38-4fa1-a626-6b51cfc2e1b7]: (4, ('1', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:57:38 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-53c767c5-94bb-4ef9-97df-075980c0ef9e tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 17:57:38 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-53c767c5-94bb-4ef9-97df-075980c0ef9e tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 17:57:39 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c767c5-94bb-4ef9-97df-075980c0ef9e tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 17:57:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:57:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:57:39 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a0d4f4-de3f-4c62-96bd-c30248105e8b]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:57:39 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c767c5-94bb-4ef9-97df-075980c0ef9e tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:57:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 -p 172.16.0.220:3260 --logout {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:57:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 -p 172.16.0.220:3260 --logout" returned: 0 in 0.097s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:57:39 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[188d8cb7-2be0-4a37-8d7e-51d29d0a09d8]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:57:39 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c767c5-94bb-4ef9-97df-075980c0ef9e tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54, portal: 172.16.0.220,3260]
Nov 10 17:57:39 user nova-compute[75100]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54, portal: 172.16.0.220,3260] successful.
Nov 10 17:57:39 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:57:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 -p 172.16.0.220:3260 --op delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:57:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16fd9f0d-185d-41af-af44-5f52fbfe3c54 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:57:39 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2738f6eb-c9d1-4557-86ed-f51619193a1c]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:57:39 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c767c5-94bb-4ef9-97df-075980c0ef9e tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:57:39 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-53c767c5-94bb-4ef9-97df-075980c0ef9e tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.385s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 17:57:39 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c767c5-94bb-4ef9-97df-075980c0ef9e tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] <== disconnect_volume: return (387ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 17:57:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53c767c5-94bb-4ef9-97df-075980c0ef9e tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 17:57:39 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-53c767c5-94bb-4ef9-97df-075980c0ef9e tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Deleting instance files /opt/stack/data/nova/instances/e6de4626-f097-43b7-8e56-a08415e7d74a_del
Nov 10 17:57:39 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-53c767c5-94bb-4ef9-97df-075980c0ef9e tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Deletion of /opt/stack/data/nova/instances/e6de4626-f097-43b7-8e56-a08415e7d74a_del complete
Nov 10 17:57:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:39 user nova-compute[75100]: INFO nova.compute.manager [None req-53c767c5-94bb-4ef9-97df-075980c0ef9e tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Took 1.27 seconds to destroy the instance on the hypervisor.
Nov 10 17:57:39 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-53c767c5-94bb-4ef9-97df-075980c0ef9e tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 17:57:39 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 17:57:39 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 17:57:39 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:57:39 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Took 0.54 seconds to deallocate network for instance.
Nov 10 17:57:40 user nova-compute[75100]: DEBUG nova.compute.manager [req-221b1e55-cdce-4c9e-a0fa-e98fa407d6e7 req-8c92b877-1fe6-4eed-b07d-98ae16ebad26 service nova] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Received event network-vif-plugged-d3d11e2e-7099-4c6e-aa65-53f953ce4571 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:57:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-221b1e55-cdce-4c9e-a0fa-e98fa407d6e7 req-8c92b877-1fe6-4eed-b07d-98ae16ebad26 service nova] Acquiring lock "e6de4626-f097-43b7-8e56-a08415e7d74a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:57:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-221b1e55-cdce-4c9e-a0fa-e98fa407d6e7 req-8c92b877-1fe6-4eed-b07d-98ae16ebad26 service nova] Lock "e6de4626-f097-43b7-8e56-a08415e7d74a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:57:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-221b1e55-cdce-4c9e-a0fa-e98fa407d6e7 req-8c92b877-1fe6-4eed-b07d-98ae16ebad26 service nova] Lock "e6de4626-f097-43b7-8e56-a08415e7d74a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:57:40 user nova-compute[75100]: DEBUG nova.compute.manager [req-221b1e55-cdce-4c9e-a0fa-e98fa407d6e7 req-8c92b877-1fe6-4eed-b07d-98ae16ebad26 service nova] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] No waiting events found dispatching network-vif-plugged-d3d11e2e-7099-4c6e-aa65-53f953ce4571 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:57:40 user nova-compute[75100]: WARNING nova.compute.manager [req-221b1e55-cdce-4c9e-a0fa-e98fa407d6e7 req-8c92b877-1fe6-4eed-b07d-98ae16ebad26 service nova] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Received unexpected event network-vif-plugged-d3d11e2e-7099-4c6e-aa65-53f953ce4571 for instance with vm_state active and task_state deleting.
Nov 10 17:57:40 user nova-compute[75100]: DEBUG nova.compute.manager [req-221b1e55-cdce-4c9e-a0fa-e98fa407d6e7 req-8c92b877-1fe6-4eed-b07d-98ae16ebad26 service nova] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Received event network-vif-deleted-d3d11e2e-7099-4c6e-aa65-53f953ce4571 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:57:40 user nova-compute[75100]: INFO nova.compute.manager [None req-53c767c5-94bb-4ef9-97df-075980c0ef9e tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: e6de4626-f097-43b7-8e56-a08415e7d74a] Took 1.15 seconds to detach 1 volumes for instance.
Nov 10 17:57:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-53c767c5-94bb-4ef9-97df-075980c0ef9e tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:57:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-53c767c5-94bb-4ef9-97df-075980c0ef9e tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:57:41 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-53c767c5-94bb-4ef9-97df-075980c0ef9e tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:57:41 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-53c767c5-94bb-4ef9-97df-075980c0ef9e tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:57:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-53c767c5-94bb-4ef9-97df-075980c0ef9e tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.538s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:57:41 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-53c767c5-94bb-4ef9-97df-075980c0ef9e tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Deleted allocations for instance e6de4626-f097-43b7-8e56-a08415e7d74a
Nov 10 17:57:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-53c767c5-94bb-4ef9-97df-075980c0ef9e tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lock "e6de4626-f097-43b7-8e56-a08415e7d74a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.690s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:57:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:47 user nova-compute[75100]: DEBUG nova.compute.manager [req-1a133ccc-b71a-45e3-8e89-09ca89bb5c5e req-23fe176c-7c83-4be7-a641-649b73f4768e service nova] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Received event network-changed-aaf05601-502a-464f-b119-d4fcc50001ab {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:57:47 user nova-compute[75100]: DEBUG nova.compute.manager [req-1a133ccc-b71a-45e3-8e89-09ca89bb5c5e req-23fe176c-7c83-4be7-a641-649b73f4768e service nova] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Refreshing instance network info cache due to event network-changed-aaf05601-502a-464f-b119-d4fcc50001ab. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 17:57:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-1a133ccc-b71a-45e3-8e89-09ca89bb5c5e req-23fe176c-7c83-4be7-a641-649b73f4768e service nova] Acquiring lock "refresh_cache-adf9e657-d366-4afd-a752-87e69b73eb81" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:57:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-1a133ccc-b71a-45e3-8e89-09ca89bb5c5e req-23fe176c-7c83-4be7-a641-649b73f4768e service nova] Acquired lock "refresh_cache-adf9e657-d366-4afd-a752-87e69b73eb81" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:57:47 user nova-compute[75100]: DEBUG nova.network.neutron [req-1a133ccc-b71a-45e3-8e89-09ca89bb5c5e req-23fe176c-7c83-4be7-a641-649b73f4768e service nova] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Refreshing network info cache for port aaf05601-502a-464f-b119-d4fcc50001ab {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 17:57:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-159f09fb-3530-4917-91f7-43910e664dce tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Acquiring lock "adf9e657-d366-4afd-a752-87e69b73eb81" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:57:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-159f09fb-3530-4917-91f7-43910e664dce tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lock "adf9e657-d366-4afd-a752-87e69b73eb81" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:57:48 user nova-compute[75100]: DEBUG nova.objects.instance [None req-159f09fb-3530-4917-91f7-43910e664dce tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lazy-loading 'flavor' on Instance uuid adf9e657-d366-4afd-a752-87e69b73eb81 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:57:48 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-159f09fb-3530-4917-91f7-43910e664dce tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Ignoring supplied device name: /dev/vdb
Nov 10 17:57:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-159f09fb-3530-4917-91f7-43910e664dce tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lock "adf9e657-d366-4afd-a752-87e69b73eb81" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:57:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-159f09fb-3530-4917-91f7-43910e664dce tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Acquiring lock "adf9e657-d366-4afd-a752-87e69b73eb81" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:57:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-159f09fb-3530-4917-91f7-43910e664dce tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lock "adf9e657-d366-4afd-a752-87e69b73eb81" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:57:48 user nova-compute[75100]: INFO nova.compute.manager [None req-159f09fb-3530-4917-91f7-43910e664dce tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Attaching volume 73be880b-b3af-4d74-831e-5d346119350d to /dev/vdb
Nov 10 17:57:48 user nova-compute[75100]: DEBUG nova.network.neutron [req-1a133ccc-b71a-45e3-8e89-09ca89bb5c5e req-23fe176c-7c83-4be7-a641-649b73f4768e service nova] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Updated VIF entry in instance network info cache for port aaf05601-502a-464f-b119-d4fcc50001ab. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 17:57:48 user nova-compute[75100]: DEBUG nova.network.neutron [req-1a133ccc-b71a-45e3-8e89-09ca89bb5c5e req-23fe176c-7c83-4be7-a641-649b73f4768e service nova] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Updating instance_info_cache with network_info: [{"id": "aaf05601-502a-464f-b119-d4fcc50001ab", "address": "fa:16:3e:12:d5:10", "network": {"id": "fa38ae2b-75a1-4312-9b92-462a4240d792", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-822691382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27994d50bda0480f8964e687ed76805c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaf05601-50", "ovs_interfaceid": "aaf05601-502a-464f-b119-d4fcc50001ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:57:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-1a133ccc-b71a-45e3-8e89-09ca89bb5c5e req-23fe176c-7c83-4be7-a641-649b73f4768e service nova] Releasing lock "refresh_cache-adf9e657-d366-4afd-a752-87e69b73eb81" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:57:48 user nova-compute[75100]: DEBUG os_brick.utils [None req-159f09fb-3530-4917-91f7-43910e664dce tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 17:57:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:57:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:57:48 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e79e1de-ea0b-4041-921f-b7ac05f4a24a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90b1a229568f\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:57:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:57:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:57:48 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[020975f7-0b7d-4296-846b-bae86f9b8af9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:57:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:57:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:57:48 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c16a0c-fb72-41a8-8a32-2b25a5451c1e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:57:48 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[40cb81fd-2d96-4029-bcfa-35ef1f4d92f2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:57:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-159f09fb-3530-4917-91f7-43910e664dce tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:57:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-159f09fb-3530-4917-91f7-43910e664dce tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 17:57:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-159f09fb-3530-4917-91f7-43910e664dce tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 17:57:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:57:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 17:57:48 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 17:57:48 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8cd74d-6c18-4e66-946c-0b199d67b6db]: (4, '') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:57:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-159f09fb-3530-4917-91f7-43910e664dce tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 17:57:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-159f09fb-3530-4917-91f7-43910e664dce tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 17:57:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-159f09fb-3530-4917-91f7-43910e664dce tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 17:57:48 user nova-compute[75100]: DEBUG os_brick.utils [None req-159f09fb-3530-4917-91f7-43910e664dce tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90b1a229568f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 17:57:48 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-159f09fb-3530-4917-91f7-43910e664dce tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Updating existing volume attachment record: 6c2fd361-567c-4923-aa26-f0c0808c23b8 {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 17:57:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:54 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:56 user nova-compute[75100]: DEBUG nova.compute.manager [req-daafc300-42ca-4d1e-9985-fbac5fff5094 req-c4e2216e-bd7a-4b1e-9a66-46b7789f966b service nova] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Received event network-changed-230f2661-361c-4699-8dbc-fac4fbc6b612 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:57:56 user nova-compute[75100]: DEBUG nova.compute.manager [req-daafc300-42ca-4d1e-9985-fbac5fff5094 req-c4e2216e-bd7a-4b1e-9a66-46b7789f966b service nova] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Refreshing instance network info cache due to event network-changed-230f2661-361c-4699-8dbc-fac4fbc6b612. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 17:57:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-daafc300-42ca-4d1e-9985-fbac5fff5094 req-c4e2216e-bd7a-4b1e-9a66-46b7789f966b service nova] Acquiring lock "refresh_cache-6d227210-c4df-4aa7-9969-70fa137aeb63" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:57:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-daafc300-42ca-4d1e-9985-fbac5fff5094 req-c4e2216e-bd7a-4b1e-9a66-46b7789f966b service nova] Acquired lock "refresh_cache-6d227210-c4df-4aa7-9969-70fa137aeb63" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:57:56 user nova-compute[75100]: DEBUG nova.network.neutron [req-daafc300-42ca-4d1e-9985-fbac5fff5094 req-c4e2216e-bd7a-4b1e-9a66-46b7789f966b service nova] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Refreshing network info cache for port 230f2661-361c-4699-8dbc-fac4fbc6b612 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 17:57:57 user nova-compute[75100]: DEBUG nova.network.neutron [req-daafc300-42ca-4d1e-9985-fbac5fff5094 req-c4e2216e-bd7a-4b1e-9a66-46b7789f966b service nova] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Updated VIF entry in instance network info cache for port 230f2661-361c-4699-8dbc-fac4fbc6b612. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 17:57:57 user nova-compute[75100]: DEBUG nova.network.neutron [req-daafc300-42ca-4d1e-9985-fbac5fff5094 req-c4e2216e-bd7a-4b1e-9a66-46b7789f966b service nova] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Updating instance_info_cache with network_info: [{"id": "230f2661-361c-4699-8dbc-fac4fbc6b612", "address": "fa:16:3e:9d:d1:eb", "network": {"id": "2a85480b-f67d-4ef1-b967-3e93af57d7c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1717495768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9cd441a46aa4a579feff608d6ff9bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap230f2661-36", "ovs_interfaceid": "230f2661-361c-4699-8dbc-fac4fbc6b612", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:57:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-daafc300-42ca-4d1e-9985-fbac5fff5094 req-c4e2216e-bd7a-4b1e-9a66-46b7789f966b service nova] Releasing lock "refresh_cache-6d227210-c4df-4aa7-9969-70fa137aeb63" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:57:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8f8effb6-c3db-4613-82e4-10dc4b48fecc tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Acquiring lock "61e73913-30a5-4eaa-9bc0-6e17a0288035" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:57:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8f8effb6-c3db-4613-82e4-10dc4b48fecc tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "61e73913-30a5-4eaa-9bc0-6e17a0288035" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:57:57 user nova-compute[75100]: INFO nova.compute.manager [None req-8f8effb6-c3db-4613-82e4-10dc4b48fecc tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Detaching volume 6ccb0564-db0c-4906-ba81-08ec9b05c5a7
Nov 10 17:57:57 user nova-compute[75100]: INFO nova.virt.block_device [None req-8f8effb6-c3db-4613-82e4-10dc4b48fecc tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Attempting to driver detach volume 6ccb0564-db0c-4906-ba81-08ec9b05c5a7 from mountpoint /dev/vdc
Nov 10 17:57:57 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8f8effb6-c3db-4613-82e4-10dc4b48fecc tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Attempting to detach device vdc from instance 61e73913-30a5-4eaa-9bc0-6e17a0288035 from the persistent domain config. {{(pid=75100) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 17:57:57 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-8f8effb6-c3db-4613-82e4-10dc4b48fecc tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 17:57:57 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 17:57:57 user nova-compute[75100]:   <source dev="/dev/sdc"/>
Nov 10 17:57:57 user nova-compute[75100]:   <target dev="vdc" bus="virtio"/>
Nov 10 17:57:57 user nova-compute[75100]:   <serial>6ccb0564-db0c-4906-ba81-08ec9b05c5a7</serial>
Nov 10 17:57:57 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 10 17:57:57 user nova-compute[75100]: </disk>
Nov 10 17:57:57 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 17:57:57 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-8f8effb6-c3db-4613-82e4-10dc4b48fecc tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Successfully detached device vdc from instance 61e73913-30a5-4eaa-9bc0-6e17a0288035 from the persistent domain config.
Nov 10 17:57:57 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8f8effb6-c3db-4613-82e4-10dc4b48fecc tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 61e73913-30a5-4eaa-9bc0-6e17a0288035 from the live domain config. {{(pid=75100) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 17:57:57 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-8f8effb6-c3db-4613-82e4-10dc4b48fecc tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 17:57:57 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 17:57:57 user nova-compute[75100]:   <source dev="/dev/sdc"/>
Nov 10 17:57:57 user nova-compute[75100]:   <target dev="vdc" bus="virtio"/>
Nov 10 17:57:57 user nova-compute[75100]:   <serial>6ccb0564-db0c-4906-ba81-08ec9b05c5a7</serial>
Nov 10 17:57:57 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 10 17:57:57 user nova-compute[75100]: </disk>
Nov 10 17:57:57 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 17:57:58 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8f8effb6-c3db-4613-82e4-10dc4b48fecc tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 61e73913-30a5-4eaa-9bc0-6e17a0288035 {{(pid=75100) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 17:57:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:57:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:58:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:58:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:58:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0caf0b64-62e1-4fe4-b4f5-981bad940e85 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Acquiring lock "ca2f4288-da43-4bf3-9ef4-fd53961fe74c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:58:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0caf0b64-62e1-4fe4-b4f5-981bad940e85 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "ca2f4288-da43-4bf3-9ef4-fd53961fe74c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:58:08 user nova-compute[75100]: DEBUG nova.objects.instance [None req-0caf0b64-62e1-4fe4-b4f5-981bad940e85 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lazy-loading 'flavor' on Instance uuid ca2f4288-da43-4bf3-9ef4-fd53961fe74c {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:58:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0caf0b64-62e1-4fe4-b4f5-981bad940e85 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "ca2f4288-da43-4bf3-9ef4-fd53961fe74c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:58:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0caf0b64-62e1-4fe4-b4f5-981bad940e85 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Acquiring lock "ca2f4288-da43-4bf3-9ef4-fd53961fe74c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:58:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0caf0b64-62e1-4fe4-b4f5-981bad940e85 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "ca2f4288-da43-4bf3-9ef4-fd53961fe74c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:58:08 user nova-compute[75100]: INFO nova.compute.manager [None req-0caf0b64-62e1-4fe4-b4f5-981bad940e85 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Attaching volume eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 to /dev/vdb
Nov 10 17:58:08 user nova-compute[75100]: DEBUG os_brick.utils [None req-0caf0b64-62e1-4fe4-b4f5-981bad940e85 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 17:58:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:08 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1943962e-dcc7-44b0-aea6-e8d318137ca8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90b1a229568f\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:58:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:08 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[128b00a4-8ae4-49b5-84fa-813c388602d5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:58:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:08 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1800f0d-1592-4d38-85d9-d0163b2998af]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:58:08 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[af728201-12d5-4072-8e87-bd3809d95230]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:58:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-0caf0b64-62e1-4fe4-b4f5-981bad940e85 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-0caf0b64-62e1-4fe4-b4f5-981bad940e85 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 17:58:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0caf0b64-62e1-4fe4-b4f5-981bad940e85 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 17:58:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 17:58:08 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 17:58:08 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6090309-11ff-4855-927f-bb7bc4376bff]: (4, '') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:58:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-0caf0b64-62e1-4fe4-b4f5-981bad940e85 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 17:58:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-0caf0b64-62e1-4fe4-b4f5-981bad940e85 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 17:58:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-0caf0b64-62e1-4fe4-b4f5-981bad940e85 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 17:58:08 user nova-compute[75100]: DEBUG os_brick.utils [None req-0caf0b64-62e1-4fe4-b4f5-981bad940e85 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90b1a229568f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 17:58:08 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-0caf0b64-62e1-4fe4-b4f5-981bad940e85 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Updating existing volume attachment record: 2b0e88bb-2ff6-48ad-9613-cf646d28c22f {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 17:58:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:58:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Acquiring lock "228aa1b0-1868-4bfe-b322-ca6a6406375c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:58:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "228aa1b0-1868-4bfe-b322-ca6a6406375c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:58:12 user nova-compute[75100]: DEBUG nova.compute.manager [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 17:58:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:58:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:58:12 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 17:58:12 user nova-compute[75100]: INFO nova.compute.claims [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] Claim successful on node user
Nov 10 17:58:13 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:58:13 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:58:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.508s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:58:13 user nova-compute[75100]: DEBUG nova.compute.manager [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 17:58:13 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 17:58:13 user nova-compute[75100]: DEBUG nova.compute.manager [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 17:58:13 user nova-compute[75100]: DEBUG nova.network.neutron [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 17:58:13 user nova-compute[75100]: DEBUG nova.compute.manager [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 17:58:13 user nova-compute[75100]: INFO nova.virt.block_device [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] Booting with volume snapshot 5e5b20b7-f436-4925-bfba-280d26b3cf9f at /dev/vda
Nov 10 17:58:13 user nova-compute[75100]: DEBUG nova.policy [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '323c5738ca424a379f666b4ca60825ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd441a46aa4a579feff608d6ff9bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 17:58:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:58:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:58:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 17:58:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:58:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:58:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:58:14 user nova-compute[75100]: DEBUG nova.network.neutron [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] Successfully created port: 10571181-1571-456a-9203-1d0d366c7d4b {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 17:58:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:58:14 user nova-compute[75100]: DEBUG nova.network.neutron [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] Successfully updated port: 10571181-1571-456a-9203-1d0d366c7d4b {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 17:58:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Acquiring lock "refresh_cache-228aa1b0-1868-4bfe-b322-ca6a6406375c" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:58:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Acquired lock "refresh_cache-228aa1b0-1868-4bfe-b322-ca6a6406375c" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:58:14 user nova-compute[75100]: DEBUG nova.network.neutron [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 17:58:14 user nova-compute[75100]: DEBUG nova.compute.manager [req-da3d83b4-dc78-4bad-ba12-b273de3ec3b0 req-46056740-d4bb-4839-a78f-0a84da69db6f service nova] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] Received event network-changed-10571181-1571-456a-9203-1d0d366c7d4b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:58:14 user nova-compute[75100]: DEBUG nova.compute.manager [req-da3d83b4-dc78-4bad-ba12-b273de3ec3b0 req-46056740-d4bb-4839-a78f-0a84da69db6f service nova] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] Refreshing instance network info cache due to event network-changed-10571181-1571-456a-9203-1d0d366c7d4b. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 17:58:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-da3d83b4-dc78-4bad-ba12-b273de3ec3b0 req-46056740-d4bb-4839-a78f-0a84da69db6f service nova] Acquiring lock "refresh_cache-228aa1b0-1868-4bfe-b322-ca6a6406375c" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:58:14 user nova-compute[75100]: DEBUG nova.network.neutron [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 17:58:15 user nova-compute[75100]: DEBUG nova.network.neutron [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] Updating instance_info_cache with network_info: [{"id": "10571181-1571-456a-9203-1d0d366c7d4b", "address": "fa:16:3e:ad:2f:f1", "network": {"id": "2a85480b-f67d-4ef1-b967-3e93af57d7c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1717495768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9cd441a46aa4a579feff608d6ff9bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10571181-15", "ovs_interfaceid": "10571181-1571-456a-9203-1d0d366c7d4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:58:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Releasing lock "refresh_cache-228aa1b0-1868-4bfe-b322-ca6a6406375c" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:58:15 user nova-compute[75100]: DEBUG nova.compute.manager [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] Instance network_info: |[{"id": "10571181-1571-456a-9203-1d0d366c7d4b", "address": "fa:16:3e:ad:2f:f1", "network": {"id": "2a85480b-f67d-4ef1-b967-3e93af57d7c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1717495768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9cd441a46aa4a579feff608d6ff9bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10571181-15", "ovs_interfaceid": "10571181-1571-456a-9203-1d0d366c7d4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 17:58:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-da3d83b4-dc78-4bad-ba12-b273de3ec3b0 req-46056740-d4bb-4839-a78f-0a84da69db6f service nova] Acquired lock "refresh_cache-228aa1b0-1868-4bfe-b322-ca6a6406375c" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:58:15 user nova-compute[75100]: DEBUG nova.network.neutron [req-da3d83b4-dc78-4bad-ba12-b273de3ec3b0 req-46056740-d4bb-4839-a78f-0a84da69db6f service nova] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] Refreshing network info cache for port 10571181-1571-456a-9203-1d0d366c7d4b {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 17:58:15 user nova-compute[75100]: DEBUG nova.network.neutron [req-da3d83b4-dc78-4bad-ba12-b273de3ec3b0 req-46056740-d4bb-4839-a78f-0a84da69db6f service nova] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] Updated VIF entry in instance network info cache for port 10571181-1571-456a-9203-1d0d366c7d4b. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 17:58:15 user nova-compute[75100]: DEBUG nova.network.neutron [req-da3d83b4-dc78-4bad-ba12-b273de3ec3b0 req-46056740-d4bb-4839-a78f-0a84da69db6f service nova] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] Updating instance_info_cache with network_info: [{"id": "10571181-1571-456a-9203-1d0d366c7d4b", "address": "fa:16:3e:ad:2f:f1", "network": {"id": "2a85480b-f67d-4ef1-b967-3e93af57d7c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1717495768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9cd441a46aa4a579feff608d6ff9bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10571181-15", "ovs_interfaceid": "10571181-1571-456a-9203-1d0d366c7d4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:58:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-da3d83b4-dc78-4bad-ba12-b273de3ec3b0 req-46056740-d4bb-4839-a78f-0a84da69db6f service nova] Releasing lock "refresh_cache-228aa1b0-1868-4bfe-b322-ca6a6406375c" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:58:17 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:58:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:58:18 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-8f8effb6-c3db-4613-82e4-10dc4b48fecc tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 61e73913-30a5-4eaa-9bc0-6e17a0288035 is timed out.
Nov 10 17:58:18 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-8f8effb6-c3db-4613-82e4-10dc4b48fecc tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Successfully detached device vdc from instance 61e73913-30a5-4eaa-9bc0-6e17a0288035 from the live domain config.
Nov 10 17:58:18 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f8effb6-c3db-4613-82e4-10dc4b48fecc tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 17:58:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8effb6-c3db-4613-82e4-10dc4b48fecc tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, {'target_iqn': 'iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BSWFveum', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 17:58:18 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-8f8effb6-c3db-4613-82e4-10dc4b48fecc tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 17:58:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-8f8effb6-c3db-4613-82e4-10dc4b48fecc tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 17:58:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-8f8effb6-c3db-4613-82e4-10dc4b48fecc tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 17:58:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:18 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc0e953-58cd-472f-a382-c1a18369cf79]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:58:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8effb6-c3db-4613-82e4-10dc4b48fecc tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 17:58:18 user nova-compute[75100]: No targets found.
Nov 10 17:58:18 user nova-compute[75100]: iSNS:
Nov 10 17:58:18 user nova-compute[75100]: No targets found.
Nov 10 17:58:18 user nova-compute[75100]: STATIC:
Nov 10 17:58:18 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c
Nov 10 17:58:18 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 17:58:18 user nova-compute[75100]:                 Iface Name: default
Nov 10 17:58:18 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308
Nov 10 17:58:18 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 17:58:18 user nova-compute[75100]:                 Iface Name: default
Nov 10 17:58:18 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652
Nov 10 17:58:18 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 17:58:18 user nova-compute[75100]:                 Iface Name: default
Nov 10 17:58:18 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00
Nov 10 17:58:18 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 17:58:18 user nova-compute[75100]:                 Iface Name: default
Nov 10 17:58:18 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7
Nov 10 17:58:18 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 17:58:18 user nova-compute[75100]:                 Iface Name: default
Nov 10 17:58:18 user nova-compute[75100]: FIRMWARE:
Nov 10 17:58:18 user nova-compute[75100]: No targets found.
Nov 10 17:58:18 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:58:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8effb6-c3db-4613-82e4-10dc4b48fecc tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 17:58:18 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 17:58:18 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 17:58:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8effb6-c3db-4613-82e4-10dc4b48fecc tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 17:58:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:18 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9653423-09ee-4024-9d49-8eb16fc0010b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:58:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:18 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b342c5-591b-451d-aa2e-60bc76c269bb]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:58:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8effb6-c3db-4613-82e4-10dc4b48fecc tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)
Nov 10 17:58:18 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c (non-flash)
Nov 10 17:58:18 user nova-compute[75100]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7 (non-flash)
Nov 10 17:58:18 user nova-compute[75100]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 (non-flash)
Nov 10 17:58:18 user nova-compute[75100]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 (non-flash)
Nov 10 17:58:18 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:58:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8effb6-c3db-4613-82e4-10dc4b48fecc tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)
Nov 10 17:58:18 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c (non-flash)
Nov 10 17:58:18 user nova-compute[75100]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7 (non-flash)
Nov 10 17:58:18 user nova-compute[75100]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 (non-flash)
Nov 10 17:58:18 user nova-compute[75100]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 (non-flash)
Nov 10 17:58:18 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 17:58:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8effb6-c3db-4613-82e4-10dc4b48fecc tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3987548b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7'): ({'sdc'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 17:58:18 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-8f8effb6-c3db-4613-82e4-10dc4b48fecc tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Removing single pathed devices sdc {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 17:58:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:18 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:58:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:18 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9634950d-4469-45c3-b416-45af83f61a52]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:58:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:18 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6e2aa7-9c4c-4b33-a636-42cb1b289e58]: (4, ('ok\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:58:18 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-8f8effb6-c3db-4613-82e4-10dc4b48fecc tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Flushing IO for device /dev/sdc {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 17:58:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:18 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[635a1eb9-4e86-4dbb-a1f3-308621ce054f]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:58:18 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-8f8effb6-c3db-4613-82e4-10dc4b48fecc tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 17:58:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:18 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23e0b13-6c66-49a8-b63a-921a3a60e747]: (4, ('1', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:58:18 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-8f8effb6-c3db-4613-82e4-10dc4b48fecc tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 17:58:18 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-8f8effb6-c3db-4613-82e4-10dc4b48fecc tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] SCSI volumes sdc have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 17:58:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8effb6-c3db-4613-82e4-10dc4b48fecc tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 17:58:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:18 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8830f1d-c26e-4767-8f5f-90daba93cf57]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:58:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8effb6-c3db-4613-82e4-10dc4b48fecc tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:58:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7 -p 172.16.0.220:3260 --logout {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:18 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1f466d-8bc4-486f-85a9-65df6eacac8e]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:58:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8effb6-c3db-4613-82e4-10dc4b48fecc tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7, portal: 172.16.0.220,3260]
Nov 10 17:58:18 user nova-compute[75100]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7, portal: 172.16.0.220,3260] successful.
Nov 10 17:58:18 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:58:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7 -p 172.16.0.220:3260 --op delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ccb0564-db0c-4906-ba81-08ec9b05c5a7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:18 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[45cd49e5-79a1-43d3-86a6-0de878ae1749]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:58:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8effb6-c3db-4613-82e4-10dc4b48fecc tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:58:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-8f8effb6-c3db-4613-82e4-10dc4b48fecc tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 17:58:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8effb6-c3db-4613-82e4-10dc4b48fecc tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] <== disconnect_volume: return (339ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 17:58:18 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f8effb6-c3db-4613-82e4-10dc4b48fecc tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 17:58:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:58:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:58:19 user nova-compute[75100]: DEBUG nova.objects.instance [None req-8f8effb6-c3db-4613-82e4-10dc4b48fecc tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lazy-loading 'flavor' on Instance uuid 61e73913-30a5-4eaa-9bc0-6e17a0288035 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:58:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8f8effb6-c3db-4613-82e4-10dc4b48fecc tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "61e73913-30a5-4eaa-9bc0-6e17a0288035" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.994s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:58:19 user nova-compute[75100]: DEBUG os_brick.utils [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 17:58:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:19 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3670678e-b8ab-49ae-9323-588b2c8a1f43]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90b1a229568f\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:58:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:19 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2742271-b4cb-4dc9-9fd1-b671c7735cd7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:58:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:19 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1bdf6d4-e3e8-45c1-9fb6-67353689310b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:58:19 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4803fe9-39be-43e5-b81c-e0357918c8b3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:58:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 17:58:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 17:58:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 17:58:19 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 17:58:19 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d657f768-8e90-436d-ac43-3a29e40af147]: (4, '') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:58:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 17:58:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 17:58:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 17:58:19 user nova-compute[75100]: DEBUG os_brick.utils [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90b1a229568f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 17:58:19 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] Updating existing volume attachment record: e104e48d-ef90-4fc2-8ace-23ada343581a {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 17:58:22 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:58:23 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:58:23 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:58:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:58:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:58:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:58:23 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 17:58:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61d3862-5be7-45cc-95a0-88124ac1725d/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61d3862-5be7-45cc-95a0-88124ac1725d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61d3862-5be7-45cc-95a0-88124ac1725d/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:58:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61d3862-5be7-45cc-95a0-88124ac1725d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81e579a0-93f3-4989-b47f-f12f8b296a62/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81e579a0-93f3-4989-b47f-f12f8b296a62/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81e579a0-93f3-4989-b47f-f12f8b296a62/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81e579a0-93f3-4989-b47f-f12f8b296a62/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/989f3ce5-067b-45e4-a2e5-445024e13202/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/989f3ce5-067b-45e4-a2e5-445024e13202/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/989f3ce5-067b-45e4-a2e5-445024e13202/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/989f3ce5-067b-45e4-a2e5-445024e13202/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2f4288-da43-4bf3-9ef4-fd53961fe74c/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2f4288-da43-4bf3-9ef4-fd53961fe74c/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2f4288-da43-4bf3-9ef4-fd53961fe74c/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2f4288-da43-4bf3-9ef4-fd53961fe74c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7fbe35b-4794-4eb9-8033-923247064458/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7fbe35b-4794-4eb9-8033-923247064458/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7fbe35b-4794-4eb9-8033-923247064458/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7fbe35b-4794-4eb9-8033-923247064458/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 17:58:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e73913-30a5-4eaa-9bc0-6e17a0288035/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e73913-30a5-4eaa-9bc0-6e17a0288035/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e73913-30a5-4eaa-9bc0-6e17a0288035/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e73913-30a5-4eaa-9bc0-6e17a0288035/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 17:58:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:28 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 17:58:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adf9e657-d366-4afd-a752-87e69b73eb81/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adf9e657-d366-4afd-a752-87e69b73eb81/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adf9e657-d366-4afd-a752-87e69b73eb81/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adf9e657-d366-4afd-a752-87e69b73eb81/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9033f537-bdeb-412c-9337-4ad86f4467b2/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:58:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e36815be-ac8c-422c-bfee-b40d1348aaac tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Acquiring lock "d61d3862-5be7-45cc-95a0-88124ac1725d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:58:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e36815be-ac8c-422c-bfee-b40d1348aaac tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lock "d61d3862-5be7-45cc-95a0-88124ac1725d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:58:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e36815be-ac8c-422c-bfee-b40d1348aaac tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Acquiring lock "d61d3862-5be7-45cc-95a0-88124ac1725d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:58:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e36815be-ac8c-422c-bfee-b40d1348aaac tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lock "d61d3862-5be7-45cc-95a0-88124ac1725d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:58:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e36815be-ac8c-422c-bfee-b40d1348aaac tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lock "d61d3862-5be7-45cc-95a0-88124ac1725d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:58:28 user nova-compute[75100]: INFO nova.compute.manager [None req-e36815be-ac8c-422c-bfee-b40d1348aaac tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] Terminating instance
Nov 10 17:58:28 user nova-compute[75100]: DEBUG nova.compute.manager [None req-e36815be-ac8c-422c-bfee-b40d1348aaac tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 17:58:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9033f537-bdeb-412c-9337-4ad86f4467b2/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9033f537-bdeb-412c-9337-4ad86f4467b2/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:58:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:58:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9033f537-bdeb-412c-9337-4ad86f4467b2/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 17:58:29 user nova-compute[75100]: DEBUG nova.compute.manager [req-d981ce14-0a09-4d41-a7ac-1db6765a5f4d req-60add63b-ae61-4685-bb38-db0f07bf6f5a service nova] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] Received event network-vif-unplugged-27667bd1-cc0b-47d7-9e63-5fcc05f8bca7 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:58:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d981ce14-0a09-4d41-a7ac-1db6765a5f4d req-60add63b-ae61-4685-bb38-db0f07bf6f5a service nova] Acquiring lock "d61d3862-5be7-45cc-95a0-88124ac1725d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:58:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d981ce14-0a09-4d41-a7ac-1db6765a5f4d req-60add63b-ae61-4685-bb38-db0f07bf6f5a service nova] Lock "d61d3862-5be7-45cc-95a0-88124ac1725d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:58:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d981ce14-0a09-4d41-a7ac-1db6765a5f4d req-60add63b-ae61-4685-bb38-db0f07bf6f5a service nova] Lock "d61d3862-5be7-45cc-95a0-88124ac1725d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:58:29 user nova-compute[75100]: DEBUG nova.compute.manager [req-d981ce14-0a09-4d41-a7ac-1db6765a5f4d req-60add63b-ae61-4685-bb38-db0f07bf6f5a service nova] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] No waiting events found dispatching network-vif-unplugged-27667bd1-cc0b-47d7-9e63-5fcc05f8bca7 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:58:29 user nova-compute[75100]: DEBUG nova.compute.manager [req-d981ce14-0a09-4d41-a7ac-1db6765a5f4d req-60add63b-ae61-4685-bb38-db0f07bf6f5a service nova] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] Received event network-vif-unplugged-27667bd1-cc0b-47d7-9e63-5fcc05f8bca7 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 17:58:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:58:29 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] Instance destroyed successfully.
Nov 10 17:58:29 user nova-compute[75100]: DEBUG nova.objects.instance [None req-e36815be-ac8c-422c-bfee-b40d1348aaac tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lazy-loading 'resources' on Instance uuid d61d3862-5be7-45cc-95a0-88124ac1725d {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:58:29 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:58:29 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:58:29 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Hypervisor/Node resource view: name=user free_ram=6652MB free_disk=24.242565155029297GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 17:58:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:58:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:58:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-e36815be-ac8c-422c-bfee-b40d1348aaac tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:48:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2109608051',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2109608051',id=14,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T17:48:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='72c970a503d74d32a1e2b71f086649fd',ramdisk_id='',reservation_id='r-l39eqerz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2001759307',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T17:50:12Z,user_data=None,user_id='b79cb22ab5774ce8991f237bd2204555',uuid=d61d3862-5be7-45cc-95a0-88124ac1725d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27667bd1-cc0b-47d7-9e63-5fcc05f8bca7", "address": "fa:16:3e:2e:83:6b", "network": {"id": "f240fae3-3d7b-4b6e-b04f-18550ab4d0a3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1007355777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c970a503d74d32a1e2b71f086649fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27667bd1-cc", "ovs_interfaceid": "27667bd1-cc0b-47d7-9e63-5fcc05f8bca7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 17:58:29 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-e36815be-ac8c-422c-bfee-b40d1348aaac tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Converting VIF {"id": "27667bd1-cc0b-47d7-9e63-5fcc05f8bca7", "address": "fa:16:3e:2e:83:6b", "network": {"id": "f240fae3-3d7b-4b6e-b04f-18550ab4d0a3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1007355777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c970a503d74d32a1e2b71f086649fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27667bd1-cc", "ovs_interfaceid": "27667bd1-cc0b-47d7-9e63-5fcc05f8bca7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:58:29 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-e36815be-ac8c-422c-bfee-b40d1348aaac tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:83:6b,bridge_name='br-int',has_traffic_filtering=True,id=27667bd1-cc0b-47d7-9e63-5fcc05f8bca7,network=Network(f240fae3-3d7b-4b6e-b04f-18550ab4d0a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27667bd1-cc') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:58:29 user nova-compute[75100]: DEBUG os_vif [None req-e36815be-ac8c-422c-bfee-b40d1348aaac tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:83:6b,bridge_name='br-int',has_traffic_filtering=True,id=27667bd1-cc0b-47d7-9e63-5fcc05f8bca7,network=Network(f240fae3-3d7b-4b6e-b04f-18550ab4d0a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27667bd1-cc') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 17:58:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:58:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap27667bd1-cc, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:58:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:58:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:58:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=62f6e962-5abc-4075-8765-f6d9b7ee3cb9) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:58:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:58:29 user nova-compute[75100]: INFO os_vif [None req-e36815be-ac8c-422c-bfee-b40d1348aaac tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:83:6b,bridge_name='br-int',has_traffic_filtering=True,id=27667bd1-cc0b-47d7-9e63-5fcc05f8bca7,network=Network(f240fae3-3d7b-4b6e-b04f-18550ab4d0a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27667bd1-cc')
Nov 10 17:58:29 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-e36815be-ac8c-422c-bfee-b40d1348aaac tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] Deleting instance files /opt/stack/data/nova/instances/d61d3862-5be7-45cc-95a0-88124ac1725d_del
Nov 10 17:58:29 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-e36815be-ac8c-422c-bfee-b40d1348aaac tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] Deletion of /opt/stack/data/nova/instances/d61d3862-5be7-45cc-95a0-88124ac1725d_del complete
Nov 10 17:58:29 user nova-compute[75100]: INFO nova.compute.manager [None req-e36815be-ac8c-422c-bfee-b40d1348aaac tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] Took 1.10 seconds to destroy the instance on the hypervisor.
Nov 10 17:58:29 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-e36815be-ac8c-422c-bfee-b40d1348aaac tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 17:58:29 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 17:58:29 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 17:58:29 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance c19fc271-a248-4631-a11f-89b7ed73bf85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:58:29 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:58:29 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 3e14de19-540d-4dc2-a058-6874d8d14478 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:58:29 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance d61d3862-5be7-45cc-95a0-88124ac1725d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:58:29 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:58:29 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 9033f537-bdeb-412c-9337-4ad86f4467b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:58:29 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 989f3ce5-067b-45e4-a2e5-445024e13202 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:58:29 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance c7fbe35b-4794-4eb9-8033-923247064458 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:58:29 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance eb430407-f836-4510-899f-a5f5d60c73f3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:58:29 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance adf9e657-d366-4afd-a752-87e69b73eb81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:58:29 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 6d227210-c4df-4aa7-9969-70fa137aeb63 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:58:29 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance ca2f4288-da43-4bf3-9ef4-fd53961fe74c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:58:29 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 61e73913-30a5-4eaa-9bc0-6e17a0288035 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:58:29 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 81e579a0-93f3-4989-b47f-f12f8b296a62 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:58:29 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 228aa1b0-1868-4bfe-b322-ca6a6406375c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:58:29 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 17:58:29 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=13GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 17:58:30 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:58:30 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] Took 0.44 seconds to deallocate network for instance.
Nov 10 17:58:30 user nova-compute[75100]: DEBUG nova.compute.manager [req-fa7427b6-76bf-4bfa-aa6d-b41997229db3 req-070ade36-4340-43e3-bca0-dbf3cafed960 service nova] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] Received event network-vif-deleted-27667bd1-cc0b-47d7-9e63-5fcc05f8bca7 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:58:30 user nova-compute[75100]: INFO nova.compute.manager [req-fa7427b6-76bf-4bfa-aa6d-b41997229db3 req-070ade36-4340-43e3-bca0-dbf3cafed960 service nova] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] Neutron deleted interface 27667bd1-cc0b-47d7-9e63-5fcc05f8bca7; detaching it from the instance and deleting it from the info cache
Nov 10 17:58:30 user nova-compute[75100]: DEBUG nova.network.neutron [req-fa7427b6-76bf-4bfa-aa6d-b41997229db3 req-070ade36-4340-43e3-bca0-dbf3cafed960 service nova] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:58:30 user nova-compute[75100]: DEBUG nova.compute.manager [req-fa7427b6-76bf-4bfa-aa6d-b41997229db3 req-070ade36-4340-43e3-bca0-dbf3cafed960 service nova] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] Detach interface failed, port_id=27667bd1-cc0b-47d7-9e63-5fcc05f8bca7, reason: Instance d61d3862-5be7-45cc-95a0-88124ac1725d could not be found. {{(pid=75100) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 17:58:30 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:58:30 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:58:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 17:58:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.687s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:58:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e36815be-ac8c-422c-bfee-b40d1348aaac tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:58:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e36815be-ac8c-422c-bfee-b40d1348aaac tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:58:30 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-e36815be-ac8c-422c-bfee-b40d1348aaac tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:58:30 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-e36815be-ac8c-422c-bfee-b40d1348aaac tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:58:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e36815be-ac8c-422c-bfee-b40d1348aaac tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.459s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:58:30 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-e36815be-ac8c-422c-bfee-b40d1348aaac tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Deleted allocations for instance d61d3862-5be7-45cc-95a0-88124ac1725d
Nov 10 17:58:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e36815be-ac8c-422c-bfee-b40d1348aaac tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lock "d61d3862-5be7-45cc-95a0-88124ac1725d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.246s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:58:31 user nova-compute[75100]: DEBUG nova.compute.manager [req-adf854d8-3759-4bc8-9dd1-77273793677b req-8e66e450-4904-436b-b859-26438f6e96a8 service nova] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] Received event network-vif-plugged-27667bd1-cc0b-47d7-9e63-5fcc05f8bca7 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:58:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-adf854d8-3759-4bc8-9dd1-77273793677b req-8e66e450-4904-436b-b859-26438f6e96a8 service nova] Acquiring lock "d61d3862-5be7-45cc-95a0-88124ac1725d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:58:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-adf854d8-3759-4bc8-9dd1-77273793677b req-8e66e450-4904-436b-b859-26438f6e96a8 service nova] Lock "d61d3862-5be7-45cc-95a0-88124ac1725d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:58:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-adf854d8-3759-4bc8-9dd1-77273793677b req-8e66e450-4904-436b-b859-26438f6e96a8 service nova] Lock "d61d3862-5be7-45cc-95a0-88124ac1725d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:58:31 user nova-compute[75100]: DEBUG nova.compute.manager [req-adf854d8-3759-4bc8-9dd1-77273793677b req-8e66e450-4904-436b-b859-26438f6e96a8 service nova] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] No waiting events found dispatching network-vif-plugged-27667bd1-cc0b-47d7-9e63-5fcc05f8bca7 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:58:31 user nova-compute[75100]: WARNING nova.compute.manager [req-adf854d8-3759-4bc8-9dd1-77273793677b req-8e66e450-4904-436b-b859-26438f6e96a8 service nova] [instance: d61d3862-5be7-45cc-95a0-88124ac1725d] Received unexpected event network-vif-plugged-27667bd1-cc0b-47d7-9e63-5fcc05f8bca7 for instance with vm_state deleted and task_state None.
Nov 10 17:58:31 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:58:31 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:58:31 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:58:31 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 17:58:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "refresh_cache-3e14de19-540d-4dc2-a058-6874d8d14478" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:58:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquired lock "refresh_cache-3e14de19-540d-4dc2-a058-6874d8d14478" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:58:31 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 17:58:31 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Updating instance_info_cache with network_info: [{"id": "d3f47ac6-ad90-4589-b41e-798c6fe6d5cf", "address": "fa:16:3e:b3:84:ec", "network": {"id": "26a554fe-9a5e-40c0-9981-5ac084c9ea73", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-269663495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19755f3e634fdfbd562c33fbfa2a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3f47ac6-ad", "ovs_interfaceid": "d3f47ac6-ad90-4589-b41e-798c6fe6d5cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:58:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Releasing lock "refresh_cache-3e14de19-540d-4dc2-a058-6874d8d14478" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:58:31 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 17:58:31 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:58:31 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:58:31 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 17:58:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:58:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:58:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:58:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 17:58:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:58:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:58:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:58:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:58:45 user nova-compute[75100]: DEBUG nova.compute.manager [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 17:58:45 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 17:58:45 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] Creating image(s)
Nov 10 17:58:45 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] Did not create local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 17:58:45 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] Ensure instance console log exists: /opt/stack/data/nova/instances/228aa1b0-1868-4bfe-b322-ca6a6406375c/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 17:58:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:58:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:58:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:58:45 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] Start _get_guest_xml network_info=[{"id": "10571181-1571-456a-9203-1d0d366c7d4b", "address": "fa:16:3e:ad:2f:f1", "network": {"id": "2a85480b-f67d-4ef1-b967-3e93af57d7c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1717495768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9cd441a46aa4a579feff608d6ff9bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10571181-15", "ovs_interfaceid": "10571181-1571-456a-9203-1d0d366c7d4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-10T17:57:58Z,direct_url=<?>,disk_format='qcow2',id=5f3f0476-bd83-4765-b188-0fde7282f60e,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-2032808659',owner='b9cd441a46aa4a579feff608d6ff9bb4',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-10T17:58:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HgnaOwLf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '228aa1b0-1868-4bfe-b322-ca6a6406375c', 'attached_at': '', 'detached_at': '', 'volume_id': 'a8ca8713-4e07-4d54-83ec-76250f93d7a5', 'serial': 'a8ca8713-4e07-4d54-83ec-76250f93d7a5'}, 'mount_device': '/dev/vda', 'attachment_id': 'e104e48d-ef90-4fc2-8ace-23ada343581a', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 17:58:45 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:58:45 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:58:45 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 17:58:45 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 17:58:45 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 17:58:45 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 17:58:45 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 17:58:45 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T17:40:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-10T17:57:58Z,direct_url=<?>,disk_format='qcow2',id=5f3f0476-bd83-4765-b188-0fde7282f60e,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-2032808659',owner='b9cd441a46aa4a579feff608d6ff9bb4',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-10T17:58:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 17:58:45 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 17:58:45 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 17:58:45 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 17:58:45 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 17:58:45 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 17:58:45 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 17:58:45 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 17:58:45 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 17:58:45 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 17:58:45 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 17:58:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 17:58:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HgnaOwLf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 17:58:46 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 17:58:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 17:58:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 17:58:46 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 17:58:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 17:58:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 17:58:46 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 17:58:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5 -p 172.16.0.220:3260 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c1b245-358c-4925-a508-142a738e4849]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:58:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 17:58:46 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:58:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b38bc5-d63d-401c-8903-9ca0f4b0ec96]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5] added\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:58:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5] added
Nov 10 17:58:46 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:58:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f003502d-fee1-481b-b026-7e5645cf2aed]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:58:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:58:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2198f7-ecb4-46c1-9b0b-0646b14fb3ab]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:58:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:58:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HgnaOwLf {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HgnaOwLf" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe9e059-bff1-4073-9901-70fd49ba2b87]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:58:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HgnaOwLf'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:58:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee613756-0c03-4c7c-bf94-e614cb421182]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:58:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:58:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[35bf510b-0e27-4cd5-bceb-e72b2cf467b7]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:58:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)
Nov 10 17:58:46 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c (non-flash)
Nov 10 17:58:46 user nova-compute[75100]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 (non-flash)
Nov 10 17:58:46 user nova-compute[75100]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 (non-flash)
Nov 10 17:58:46 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:58:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)
Nov 10 17:58:46 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c (non-flash)
Nov 10 17:58:46 user nova-compute[75100]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 (non-flash)
Nov 10 17:58:46 user nova-compute[75100]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 (non-flash)
Nov 10 17:58:46 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 17:58:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5 -p 172.16.0.220:3260 --login {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec80d52-b8de-4ff4-b7af-75ef0a086448]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:58:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5, portal: 172.16.0.220,3260]
Nov 10 17:58:46 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5, portal: 172.16.0.220,3260] successful.
Nov 10 17:58:46 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:58:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc458abd-260c-474b-b714-f44b30dfb345]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:58:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:58:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60c6b88-db3e-4352-a294-45f6c3b863bd]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:58:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)
Nov 10 17:58:46 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c (non-flash)
Nov 10 17:58:46 user nova-compute[75100]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 (non-flash)
Nov 10 17:58:46 user nova-compute[75100]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 (non-flash)
Nov 10 17:58:46 user nova-compute[75100]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5 (non-flash)
Nov 10 17:58:46 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:58:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)
Nov 10 17:58:46 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c (non-flash)
Nov 10 17:58:46 user nova-compute[75100]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 (non-flash)
Nov 10 17:58:46 user nova-compute[75100]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 (non-flash)
Nov 10 17:58:46 user nova-compute[75100]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5 (non-flash)
Nov 10 17:58:46 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 17:58:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 17:58:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 17:58:46 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 17:58:46 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 17:58:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[bacc9c95-6275-4c7d-8d46-8f8b04663f84]: (4, ('- - 0', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:58:46 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: None {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 17:58:47 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 17:58:47 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HgnaOwLf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 17:58:47 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 17:58:47 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '26135333335386330', 'path': '/dev/sdb'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 17:58:47 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135333335386330', 'path': '/dev/sdb'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 17:58:47 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:58:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-762638311',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-762638311',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-762638311',id=30,image_ref='5f3f0476-bd83-4765-b188-0fde7282f60e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP1tgXebT/VtzFglQudO5uoI1y8sMY9Z7MfjG9qtb+fywGZjxbnFOIdJkwn5zR/GpBRtpj9GXujRNNRsDxpGTHFMgSUyIXJY1PQdz9lntMk4PXgtIp6X3l1x7kk36FrFMw==',key_name='tempest-keypair-1149578534',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9cd441a46aa4a579feff608d6ff9bb4',ramdisk_id='',reservation_id='r-107hzbei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-706331648',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-706331648-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-706331648',owner_user_name='tempest-TestVolumeBootPattern-706331648-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:58:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='323c5738ca424a379f666b4ca60825ac',uuid=228aa1b0-1868-4bfe-b322-ca6a6406375c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10571181-1571-456a-9203-1d0d366c7d4b", "address": "fa:16:3e:ad:2f:f1", "network": {"id": "2a85480b-f67d-4ef1-b967-3e93af57d7c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1717495768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9cd441a46aa4a579feff608d6ff9bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10571181-15", "ovs_interfaceid": "10571181-1571-456a-9203-1d0d366c7d4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 17:58:47 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Converting VIF {"id": "10571181-1571-456a-9203-1d0d366c7d4b", "address": "fa:16:3e:ad:2f:f1", "network": {"id": "2a85480b-f67d-4ef1-b967-3e93af57d7c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1717495768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9cd441a46aa4a579feff608d6ff9bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10571181-15", "ovs_interfaceid": "10571181-1571-456a-9203-1d0d366c7d4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:58:47 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:2f:f1,bridge_name='br-int',has_traffic_filtering=True,id=10571181-1571-456a-9203-1d0d366c7d4b,network=Network(2a85480b-f67d-4ef1-b967-3e93af57d7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10571181-15') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:58:47 user nova-compute[75100]: DEBUG nova.objects.instance [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lazy-loading 'pci_devices' on Instance uuid 228aa1b0-1868-4bfe-b322-ca6a6406375c {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:58:47 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] End _get_guest_xml xml=<domain type="kvm">
Nov 10 17:58:47 user nova-compute[75100]:   <uuid>228aa1b0-1868-4bfe-b322-ca6a6406375c</uuid>
Nov 10 17:58:47 user nova-compute[75100]:   <name>instance-0000001e</name>
Nov 10 17:58:47 user nova-compute[75100]:   <memory>524288</memory>
Nov 10 17:58:47 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 10 17:58:47 user nova-compute[75100]:   <metadata>
Nov 10 17:58:47 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 17:58:47 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 10 17:58:47 user nova-compute[75100]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-762638311</nova:name>
Nov 10 17:58:47 user nova-compute[75100]:       <nova:creationTime>2023-11-10 17:58:45</nova:creationTime>
Nov 10 17:58:47 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 10 17:58:47 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 10 17:58:47 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 10 17:58:47 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 10 17:58:47 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 17:58:47 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 10 17:58:47 user nova-compute[75100]:       </nova:flavor>
Nov 10 17:58:47 user nova-compute[75100]:       <nova:owner>
Nov 10 17:58:47 user nova-compute[75100]:         <nova:user uuid="323c5738ca424a379f666b4ca60825ac">tempest-TestVolumeBootPattern-706331648-project-member</nova:user>
Nov 10 17:58:47 user nova-compute[75100]:         <nova:project uuid="b9cd441a46aa4a579feff608d6ff9bb4">tempest-TestVolumeBootPattern-706331648</nova:project>
Nov 10 17:58:47 user nova-compute[75100]:       </nova:owner>
Nov 10 17:58:47 user nova-compute[75100]:       <nova:root type="image" uuid="5f3f0476-bd83-4765-b188-0fde7282f60e"/>
Nov 10 17:58:47 user nova-compute[75100]:       <nova:ports>
Nov 10 17:58:47 user nova-compute[75100]:         <nova:port uuid="10571181-1571-456a-9203-1d0d366c7d4b">
Nov 10 17:58:47 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 10 17:58:47 user nova-compute[75100]:         </nova:port>
Nov 10 17:58:47 user nova-compute[75100]:       </nova:ports>
Nov 10 17:58:47 user nova-compute[75100]:     </nova:instance>
Nov 10 17:58:47 user nova-compute[75100]:   </metadata>
Nov 10 17:58:47 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 10 17:58:47 user nova-compute[75100]:     <system>
Nov 10 17:58:47 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 17:58:47 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 10 17:58:47 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 10 17:58:47 user nova-compute[75100]:       <entry name="serial">228aa1b0-1868-4bfe-b322-ca6a6406375c</entry>
Nov 10 17:58:47 user nova-compute[75100]:       <entry name="uuid">228aa1b0-1868-4bfe-b322-ca6a6406375c</entry>
Nov 10 17:58:47 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 10 17:58:47 user nova-compute[75100]:     </system>
Nov 10 17:58:47 user nova-compute[75100]:   </sysinfo>
Nov 10 17:58:47 user nova-compute[75100]:   <os>
Nov 10 17:58:47 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 17:58:47 user nova-compute[75100]:     <boot dev="hd"/>
Nov 10 17:58:47 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 10 17:58:47 user nova-compute[75100]:   </os>
Nov 10 17:58:47 user nova-compute[75100]:   <features>
Nov 10 17:58:47 user nova-compute[75100]:     <acpi/>
Nov 10 17:58:47 user nova-compute[75100]:     <apic/>
Nov 10 17:58:47 user nova-compute[75100]:     <vmcoreinfo/>
Nov 10 17:58:47 user nova-compute[75100]:   </features>
Nov 10 17:58:47 user nova-compute[75100]:   <clock offset="utc">
Nov 10 17:58:47 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 17:58:47 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 17:58:47 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 10 17:58:47 user nova-compute[75100]:   </clock>
Nov 10 17:58:47 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 10 17:58:47 user nova-compute[75100]:     <model>Nehalem</model>
Nov 10 17:58:47 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 17:58:47 user nova-compute[75100]:   </cpu>
Nov 10 17:58:47 user nova-compute[75100]:   <devices>
Nov 10 17:58:47 user nova-compute[75100]:     <disk type="block" device="disk">
Nov 10 17:58:47 user nova-compute[75100]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 17:58:47 user nova-compute[75100]:       <source dev="/dev/sdb"/>
Nov 10 17:58:47 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 10 17:58:47 user nova-compute[75100]:       <serial>a8ca8713-4e07-4d54-83ec-76250f93d7a5</serial>
Nov 10 17:58:47 user nova-compute[75100]:     </disk>
Nov 10 17:58:47 user nova-compute[75100]:     <interface type="ethernet">
Nov 10 17:58:47 user nova-compute[75100]:       <mac address="fa:16:3e:ad:2f:f1"/>
Nov 10 17:58:47 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:58:47 user nova-compute[75100]:       <mtu size="1442"/>
Nov 10 17:58:47 user nova-compute[75100]:       <target dev="tap10571181-15"/>
Nov 10 17:58:47 user nova-compute[75100]:     </interface>
Nov 10 17:58:47 user nova-compute[75100]:     <serial type="pty">
Nov 10 17:58:47 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/228aa1b0-1868-4bfe-b322-ca6a6406375c/console.log" append="off"/>
Nov 10 17:58:47 user nova-compute[75100]:     </serial>
Nov 10 17:58:47 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 17:58:47 user nova-compute[75100]:     <video>
Nov 10 17:58:47 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:58:47 user nova-compute[75100]:     </video>
Nov 10 17:58:47 user nova-compute[75100]:     <rng model="virtio">
Nov 10 17:58:47 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 10 17:58:47 user nova-compute[75100]:     </rng>
Nov 10 17:58:47 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 10 17:58:47 user nova-compute[75100]:     <memballoon model="virtio">
Nov 10 17:58:47 user nova-compute[75100]:       <stats period="10"/>
Nov 10 17:58:47 user nova-compute[75100]:     </memballoon>
Nov 10 17:58:47 user nova-compute[75100]:   </devices>
Nov 10 17:58:47 user nova-compute[75100]: </domain>
Nov 10 17:58:47 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 17:58:47 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:58:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-762638311',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-762638311',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-762638311',id=30,image_ref='5f3f0476-bd83-4765-b188-0fde7282f60e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP1tgXebT/VtzFglQudO5uoI1y8sMY9Z7MfjG9qtb+fywGZjxbnFOIdJkwn5zR/GpBRtpj9GXujRNNRsDxpGTHFMgSUyIXJY1PQdz9lntMk4PXgtIp6X3l1x7kk36FrFMw==',key_name='tempest-keypair-1149578534',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9cd441a46aa4a579feff608d6ff9bb4',ramdisk_id='',reservation_id='r-107hzbei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-706331648',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-706331648-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-706331648',owner_user_name='tempest-TestVolumeBootPattern-706331648-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:58:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='323c5738ca424a379f666b4ca60825ac',uuid=228aa1b0-1868-4bfe-b322-ca6a6406375c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10571181-1571-456a-9203-1d0d366c7d4b", "address": "fa:16:3e:ad:2f:f1", "network": {"id": "2a85480b-f67d-4ef1-b967-3e93af57d7c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1717495768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9cd441a46aa4a579feff608d6ff9bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10571181-15", "ovs_interfaceid": "10571181-1571-456a-9203-1d0d366c7d4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 17:58:47 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Converting VIF {"id": "10571181-1571-456a-9203-1d0d366c7d4b", "address": "fa:16:3e:ad:2f:f1", "network": {"id": "2a85480b-f67d-4ef1-b967-3e93af57d7c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1717495768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9cd441a46aa4a579feff608d6ff9bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10571181-15", "ovs_interfaceid": "10571181-1571-456a-9203-1d0d366c7d4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:58:47 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:2f:f1,bridge_name='br-int',has_traffic_filtering=True,id=10571181-1571-456a-9203-1d0d366c7d4b,network=Network(2a85480b-f67d-4ef1-b967-3e93af57d7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10571181-15') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:58:47 user nova-compute[75100]: DEBUG os_vif [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:2f:f1,bridge_name='br-int',has_traffic_filtering=True,id=10571181-1571-456a-9203-1d0d366c7d4b,network=Network(2a85480b-f67d-4ef1-b967-3e93af57d7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10571181-15') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 17:58:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:58:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:58:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 17:58:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:58:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3294710b-a0fc-5c3e-8141-778f04837e93', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:58:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:58:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:58:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap10571181-15, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:58:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap10571181-15, col_values=(('qos', UUID('8126919b-b7d2-4470-84e3-324f2fe59df9')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:58:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap10571181-15, col_values=(('external_ids', {'iface-id': '10571181-1571-456a-9203-1d0d366c7d4b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:2f:f1', 'vm-uuid': '228aa1b0-1868-4bfe-b322-ca6a6406375c'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:58:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:58:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:58:47 user nova-compute[75100]: INFO os_vif [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:2f:f1,bridge_name='br-int',has_traffic_filtering=True,id=10571181-1571-456a-9203-1d0d366c7d4b,network=Network(2a85480b-f67d-4ef1-b967-3e93af57d7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10571181-15')
Nov 10 17:58:47 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 17:58:47 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] No VIF found with MAC fa:16:3e:ad:2f:f1, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 17:58:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-07c1cf14-cdb7-4248-bf2a-6507f9685af1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Acquiring lock "61e73913-30a5-4eaa-9bc0-6e17a0288035" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:58:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-07c1cf14-cdb7-4248-bf2a-6507f9685af1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "61e73913-30a5-4eaa-9bc0-6e17a0288035" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:58:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-07c1cf14-cdb7-4248-bf2a-6507f9685af1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Acquiring lock "61e73913-30a5-4eaa-9bc0-6e17a0288035-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:58:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-07c1cf14-cdb7-4248-bf2a-6507f9685af1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "61e73913-30a5-4eaa-9bc0-6e17a0288035-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:58:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-07c1cf14-cdb7-4248-bf2a-6507f9685af1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "61e73913-30a5-4eaa-9bc0-6e17a0288035-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:58:47 user nova-compute[75100]: INFO nova.compute.manager [None req-07c1cf14-cdb7-4248-bf2a-6507f9685af1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Terminating instance
Nov 10 17:58:47 user nova-compute[75100]: DEBUG nova.compute.manager [None req-07c1cf14-cdb7-4248-bf2a-6507f9685af1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 17:58:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:58:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:58:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:58:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:58:48 user nova-compute[75100]: DEBUG nova.compute.manager [req-3576d3cf-e979-44b7-940c-fd711cb9000a req-46e287f1-e426-40cb-9aa4-2c4e336913fc service nova] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Received event network-vif-unplugged-5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:58:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3576d3cf-e979-44b7-940c-fd711cb9000a req-46e287f1-e426-40cb-9aa4-2c4e336913fc service nova] Acquiring lock "61e73913-30a5-4eaa-9bc0-6e17a0288035-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:58:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3576d3cf-e979-44b7-940c-fd711cb9000a req-46e287f1-e426-40cb-9aa4-2c4e336913fc service nova] Lock "61e73913-30a5-4eaa-9bc0-6e17a0288035-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:58:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3576d3cf-e979-44b7-940c-fd711cb9000a req-46e287f1-e426-40cb-9aa4-2c4e336913fc service nova] Lock "61e73913-30a5-4eaa-9bc0-6e17a0288035-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:58:48 user nova-compute[75100]: DEBUG nova.compute.manager [req-3576d3cf-e979-44b7-940c-fd711cb9000a req-46e287f1-e426-40cb-9aa4-2c4e336913fc service nova] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] No waiting events found dispatching network-vif-unplugged-5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:58:48 user nova-compute[75100]: DEBUG nova.compute.manager [req-3576d3cf-e979-44b7-940c-fd711cb9000a req-46e287f1-e426-40cb-9aa4-2c4e336913fc service nova] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Received event network-vif-unplugged-5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 17:58:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:58:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:58:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:58:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:58:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:58:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:58:49 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Instance destroyed successfully.
Nov 10 17:58:49 user nova-compute[75100]: DEBUG nova.objects.instance [None req-07c1cf14-cdb7-4248-bf2a-6507f9685af1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lazy-loading 'resources' on Instance uuid 61e73913-30a5-4eaa-9bc0-6e17a0288035 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:58:49 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-07c1cf14-cdb7-4248-bf2a-6507f9685af1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T17:52:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-887105111',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-887105111',id=21,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBt2k7JxeVDSCQYts3sglUNOlb3MEWalyA8Gt0mz8JaQfSywhdMWdKSG8xorXGHO9nRL4EecdmVdPAfYdrz5N1fvzulYNxG/vm6Llz3SnJfNeh1Mc8m59tlOvf70gw1Adw==',key_name='tempest-keypair-1379432359',keypairs=<?>,launch_index=0,launched_at=2023-11-10T17:56:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ae38bb92c5474a578f3827bdae12cd74',ramdisk_id='',reservation_id='r-w7bzktq8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2073508773',owner_user_name='tempest-AttachVolumeShelveTestJSON-2073508773-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T17:56:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='805917c846f34264b51388bfd9a8413f',uuid=61e73913-30a5-4eaa-9bc0-6e17a0288035,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c", "address": "fa:16:3e:75:69:61", "network": {"id": "7a78ac5d-8f24-436d-9cb9-05f4efecb101", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-476509015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae38bb92c5474a578f3827bdae12cd74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e7d8cb1-7f", "ovs_interfaceid": "5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 17:58:49 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-07c1cf14-cdb7-4248-bf2a-6507f9685af1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Converting VIF {"id": "5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c", "address": "fa:16:3e:75:69:61", "network": {"id": "7a78ac5d-8f24-436d-9cb9-05f4efecb101", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-476509015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae38bb92c5474a578f3827bdae12cd74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e7d8cb1-7f", "ovs_interfaceid": "5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:58:49 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-07c1cf14-cdb7-4248-bf2a-6507f9685af1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:69:61,bridge_name='br-int',has_traffic_filtering=True,id=5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c,network=Network(7a78ac5d-8f24-436d-9cb9-05f4efecb101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e7d8cb1-7f') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:58:49 user nova-compute[75100]: DEBUG os_vif [None req-07c1cf14-cdb7-4248-bf2a-6507f9685af1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:69:61,bridge_name='br-int',has_traffic_filtering=True,id=5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c,network=Network(7a78ac5d-8f24-436d-9cb9-05f4efecb101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e7d8cb1-7f') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 17:58:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:58:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5e7d8cb1-7f, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:58:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:58:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:58:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:58:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:58:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:58:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7cb498cf-55b8-448c-a1f5-1cbf5bd0d7b8) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:58:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:58:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:58:49 user nova-compute[75100]: INFO os_vif [None req-07c1cf14-cdb7-4248-bf2a-6507f9685af1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:69:61,bridge_name='br-int',has_traffic_filtering=True,id=5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c,network=Network(7a78ac5d-8f24-436d-9cb9-05f4efecb101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e7d8cb1-7f')
Nov 10 17:58:49 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-07c1cf14-cdb7-4248-bf2a-6507f9685af1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Deleting instance files /opt/stack/data/nova/instances/61e73913-30a5-4eaa-9bc0-6e17a0288035_del
Nov 10 17:58:49 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-07c1cf14-cdb7-4248-bf2a-6507f9685af1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Deletion of /opt/stack/data/nova/instances/61e73913-30a5-4eaa-9bc0-6e17a0288035_del complete
Nov 10 17:58:49 user nova-compute[75100]: INFO nova.compute.manager [None req-07c1cf14-cdb7-4248-bf2a-6507f9685af1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Took 1.33 seconds to destroy the instance on the hypervisor.
Nov 10 17:58:49 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-07c1cf14-cdb7-4248-bf2a-6507f9685af1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 17:58:49 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 17:58:49 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 17:58:49 user nova-compute[75100]: DEBUG nova.compute.manager [req-cf5645b2-cafa-4023-bdf6-c1aa3cbde4d5 req-5034d126-f00e-4a70-8a24-9f9b40af4850 service nova] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] Received event network-vif-plugged-10571181-1571-456a-9203-1d0d366c7d4b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:58:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cf5645b2-cafa-4023-bdf6-c1aa3cbde4d5 req-5034d126-f00e-4a70-8a24-9f9b40af4850 service nova] Acquiring lock "228aa1b0-1868-4bfe-b322-ca6a6406375c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:58:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cf5645b2-cafa-4023-bdf6-c1aa3cbde4d5 req-5034d126-f00e-4a70-8a24-9f9b40af4850 service nova] Lock "228aa1b0-1868-4bfe-b322-ca6a6406375c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:58:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cf5645b2-cafa-4023-bdf6-c1aa3cbde4d5 req-5034d126-f00e-4a70-8a24-9f9b40af4850 service nova] Lock "228aa1b0-1868-4bfe-b322-ca6a6406375c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:58:49 user nova-compute[75100]: DEBUG nova.compute.manager [req-cf5645b2-cafa-4023-bdf6-c1aa3cbde4d5 req-5034d126-f00e-4a70-8a24-9f9b40af4850 service nova] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] No waiting events found dispatching network-vif-plugged-10571181-1571-456a-9203-1d0d366c7d4b {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:58:49 user nova-compute[75100]: WARNING nova.compute.manager [req-cf5645b2-cafa-4023-bdf6-c1aa3cbde4d5 req-5034d126-f00e-4a70-8a24-9f9b40af4850 service nova] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] Received unexpected event network-vif-plugged-10571181-1571-456a-9203-1d0d366c7d4b for instance with vm_state building and task_state spawning.
Nov 10 17:58:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-afa4010d-9120-46c4-a797-9a2a56f083b0 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Acquiring lock "eb430407-f836-4510-899f-a5f5d60c73f3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:58:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-afa4010d-9120-46c4-a797-9a2a56f083b0 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Lock "eb430407-f836-4510-899f-a5f5d60c73f3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:58:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-afa4010d-9120-46c4-a797-9a2a56f083b0 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Acquiring lock "eb430407-f836-4510-899f-a5f5d60c73f3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:58:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-afa4010d-9120-46c4-a797-9a2a56f083b0 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Lock "eb430407-f836-4510-899f-a5f5d60c73f3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.003s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:58:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-afa4010d-9120-46c4-a797-9a2a56f083b0 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Lock "eb430407-f836-4510-899f-a5f5d60c73f3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:58:49 user nova-compute[75100]: INFO nova.compute.manager [None req-afa4010d-9120-46c4-a797-9a2a56f083b0 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Terminating instance
Nov 10 17:58:49 user nova-compute[75100]: DEBUG nova.compute.manager [None req-afa4010d-9120-46c4-a797-9a2a56f083b0 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 17:58:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:58:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:58:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:58:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:58:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:58:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:58:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:58:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:58:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG nova.compute.manager [req-34172b90-063e-4fd5-8a97-e8ecea399708 req-e85314e4-07c9-4d47-aaee-710503d3d107 service nova] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Received event network-vif-plugged-5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-34172b90-063e-4fd5-8a97-e8ecea399708 req-e85314e4-07c9-4d47-aaee-710503d3d107 service nova] Acquiring lock "61e73913-30a5-4eaa-9bc0-6e17a0288035-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-34172b90-063e-4fd5-8a97-e8ecea399708 req-e85314e4-07c9-4d47-aaee-710503d3d107 service nova] Lock "61e73913-30a5-4eaa-9bc0-6e17a0288035-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-34172b90-063e-4fd5-8a97-e8ecea399708 req-e85314e4-07c9-4d47-aaee-710503d3d107 service nova] Lock "61e73913-30a5-4eaa-9bc0-6e17a0288035-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG nova.compute.manager [req-34172b90-063e-4fd5-8a97-e8ecea399708 req-e85314e4-07c9-4d47-aaee-710503d3d107 service nova] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] No waiting events found dispatching network-vif-plugged-5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:58:50 user nova-compute[75100]: WARNING nova.compute.manager [req-34172b90-063e-4fd5-8a97-e8ecea399708 req-e85314e4-07c9-4d47-aaee-710503d3d107 service nova] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Received unexpected event network-vif-plugged-5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c for instance with vm_state active and task_state deleting.
Nov 10 17:58:50 user nova-compute[75100]: DEBUG nova.compute.manager [req-34172b90-063e-4fd5-8a97-e8ecea399708 req-e85314e4-07c9-4d47-aaee-710503d3d107 service nova] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Received event network-vif-plugged-5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-34172b90-063e-4fd5-8a97-e8ecea399708 req-e85314e4-07c9-4d47-aaee-710503d3d107 service nova] Acquiring lock "61e73913-30a5-4eaa-9bc0-6e17a0288035-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-34172b90-063e-4fd5-8a97-e8ecea399708 req-e85314e4-07c9-4d47-aaee-710503d3d107 service nova] Lock "61e73913-30a5-4eaa-9bc0-6e17a0288035-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-34172b90-063e-4fd5-8a97-e8ecea399708 req-e85314e4-07c9-4d47-aaee-710503d3d107 service nova] Lock "61e73913-30a5-4eaa-9bc0-6e17a0288035-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG nova.compute.manager [req-34172b90-063e-4fd5-8a97-e8ecea399708 req-e85314e4-07c9-4d47-aaee-710503d3d107 service nova] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] No waiting events found dispatching network-vif-plugged-5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:58:50 user nova-compute[75100]: WARNING nova.compute.manager [req-34172b90-063e-4fd5-8a97-e8ecea399708 req-e85314e4-07c9-4d47-aaee-710503d3d107 service nova] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Received unexpected event network-vif-plugged-5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c for instance with vm_state active and task_state deleting.
Nov 10 17:58:50 user nova-compute[75100]: DEBUG nova.compute.manager [req-34172b90-063e-4fd5-8a97-e8ecea399708 req-e85314e4-07c9-4d47-aaee-710503d3d107 service nova] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Received event network-vif-plugged-5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-34172b90-063e-4fd5-8a97-e8ecea399708 req-e85314e4-07c9-4d47-aaee-710503d3d107 service nova] Acquiring lock "61e73913-30a5-4eaa-9bc0-6e17a0288035-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-34172b90-063e-4fd5-8a97-e8ecea399708 req-e85314e4-07c9-4d47-aaee-710503d3d107 service nova] Lock "61e73913-30a5-4eaa-9bc0-6e17a0288035-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-34172b90-063e-4fd5-8a97-e8ecea399708 req-e85314e4-07c9-4d47-aaee-710503d3d107 service nova] Lock "61e73913-30a5-4eaa-9bc0-6e17a0288035-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG nova.compute.manager [req-34172b90-063e-4fd5-8a97-e8ecea399708 req-e85314e4-07c9-4d47-aaee-710503d3d107 service nova] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] No waiting events found dispatching network-vif-plugged-5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:58:50 user nova-compute[75100]: WARNING nova.compute.manager [req-34172b90-063e-4fd5-8a97-e8ecea399708 req-e85314e4-07c9-4d47-aaee-710503d3d107 service nova] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Received unexpected event network-vif-plugged-5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c for instance with vm_state active and task_state deleting.
Nov 10 17:58:50 user nova-compute[75100]: DEBUG nova.compute.manager [req-34172b90-063e-4fd5-8a97-e8ecea399708 req-e85314e4-07c9-4d47-aaee-710503d3d107 service nova] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Received event network-vif-unplugged-5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-34172b90-063e-4fd5-8a97-e8ecea399708 req-e85314e4-07c9-4d47-aaee-710503d3d107 service nova] Acquiring lock "61e73913-30a5-4eaa-9bc0-6e17a0288035-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-34172b90-063e-4fd5-8a97-e8ecea399708 req-e85314e4-07c9-4d47-aaee-710503d3d107 service nova] Lock "61e73913-30a5-4eaa-9bc0-6e17a0288035-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-34172b90-063e-4fd5-8a97-e8ecea399708 req-e85314e4-07c9-4d47-aaee-710503d3d107 service nova] Lock "61e73913-30a5-4eaa-9bc0-6e17a0288035-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG nova.compute.manager [req-34172b90-063e-4fd5-8a97-e8ecea399708 req-e85314e4-07c9-4d47-aaee-710503d3d107 service nova] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] No waiting events found dispatching network-vif-unplugged-5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG nova.compute.manager [req-34172b90-063e-4fd5-8a97-e8ecea399708 req-e85314e4-07c9-4d47-aaee-710503d3d107 service nova] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Received event network-vif-unplugged-5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG nova.compute.manager [req-34172b90-063e-4fd5-8a97-e8ecea399708 req-e85314e4-07c9-4d47-aaee-710503d3d107 service nova] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Received event network-vif-plugged-5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-34172b90-063e-4fd5-8a97-e8ecea399708 req-e85314e4-07c9-4d47-aaee-710503d3d107 service nova] Acquiring lock "61e73913-30a5-4eaa-9bc0-6e17a0288035-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-34172b90-063e-4fd5-8a97-e8ecea399708 req-e85314e4-07c9-4d47-aaee-710503d3d107 service nova] Lock "61e73913-30a5-4eaa-9bc0-6e17a0288035-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-34172b90-063e-4fd5-8a97-e8ecea399708 req-e85314e4-07c9-4d47-aaee-710503d3d107 service nova] Lock "61e73913-30a5-4eaa-9bc0-6e17a0288035-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG nova.compute.manager [req-34172b90-063e-4fd5-8a97-e8ecea399708 req-e85314e4-07c9-4d47-aaee-710503d3d107 service nova] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] No waiting events found dispatching network-vif-plugged-5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:58:50 user nova-compute[75100]: WARNING nova.compute.manager [req-34172b90-063e-4fd5-8a97-e8ecea399708 req-e85314e4-07c9-4d47-aaee-710503d3d107 service nova] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Received unexpected event network-vif-plugged-5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c for instance with vm_state active and task_state deleting.
Nov 10 17:58:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:58:50 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Instance destroyed successfully.
Nov 10 17:58:50 user nova-compute[75100]: DEBUG nova.objects.instance [None req-afa4010d-9120-46c4-a797-9a2a56f083b0 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Lazy-loading 'resources' on Instance uuid eb430407-f836-4510-899f-a5f5d60c73f3 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-afa4010d-9120-46c4-a797-9a2a56f083b0 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:49:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1267762012',display_name='tempest-ServerActionsTestOtherB-server-1267762012',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1267762012',id=16,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDPSiJ0FfbNgNhKoheve47DT1uQV1oaC9CdV5NhlB12KyXHFwXlJCN0xOr09naWU21Nb1dG7o7w/ZzPU0YohVQI5ip5k2vJ5Db3SiA/LtLwk+OdOmsxEc+IoKJ74LTBECw==',key_name='tempest-keypair-1684715830',keypairs=<?>,launch_index=0,launched_at=2023-11-10T17:56:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e95560897fb46258db0ecd7dc7b9294',ramdisk_id='',reservation_id='r-55f5hxbc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1027676823',owner_user_name='tempest-ServerActionsTestOtherB-1027676823-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T17:56:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da45741ccb5d4b00a0784d7ef9063243',uuid=eb430407-f836-4510-899f-a5f5d60c73f3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6e9b2058-6104-4f6c-8c72-f5f15d0d116b", "address": "fa:16:3e:2f:11:f6", "network": {"id": "f67bc940-2f01-4255-b12e-427ffcd7e4e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-977195248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e95560897fb46258db0ecd7dc7b9294", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9b2058-61", "ovs_interfaceid": "6e9b2058-6104-4f6c-8c72-f5f15d0d116b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-afa4010d-9120-46c4-a797-9a2a56f083b0 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Converting VIF {"id": "6e9b2058-6104-4f6c-8c72-f5f15d0d116b", "address": "fa:16:3e:2f:11:f6", "network": {"id": "f67bc940-2f01-4255-b12e-427ffcd7e4e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-977195248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e95560897fb46258db0ecd7dc7b9294", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9b2058-61", "ovs_interfaceid": "6e9b2058-6104-4f6c-8c72-f5f15d0d116b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-afa4010d-9120-46c4-a797-9a2a56f083b0 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:11:f6,bridge_name='br-int',has_traffic_filtering=True,id=6e9b2058-6104-4f6c-8c72-f5f15d0d116b,network=Network(f67bc940-2f01-4255-b12e-427ffcd7e4e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e9b2058-61') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG os_vif [None req-afa4010d-9120-46c4-a797-9a2a56f083b0 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:11:f6,bridge_name='br-int',has_traffic_filtering=True,id=6e9b2058-6104-4f6c-8c72-f5f15d0d116b,network=Network(f67bc940-2f01-4255-b12e-427ffcd7e4e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e9b2058-61') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6e9b2058-61, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8aa337c6-9017-471b-850a-2b66529c9669) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:58:50 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Took 1.27 seconds to deallocate network for instance.
Nov 10 17:58:50 user nova-compute[75100]: INFO os_vif [None req-afa4010d-9120-46c4-a797-9a2a56f083b0 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:11:f6,bridge_name='br-int',has_traffic_filtering=True,id=6e9b2058-6104-4f6c-8c72-f5f15d0d116b,network=Network(f67bc940-2f01-4255-b12e-427ffcd7e4e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e9b2058-61')
Nov 10 17:58:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afa4010d-9120-46c4-a797-9a2a56f083b0 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa4010d-9120-46c4-a797-9a2a56f083b0 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, {'target_iqn': 'iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xESYIPuD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 17:58:50 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-afa4010d-9120-46c4-a797-9a2a56f083b0 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 17:58:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-afa4010d-9120-46c4-a797-9a2a56f083b0 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-afa4010d-9120-46c4-a797-9a2a56f083b0 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2615647-f20e-4838-a794-51497e0e9f74]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa4010d-9120-46c4-a797-9a2a56f083b0 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 17:58:50 user nova-compute[75100]: No targets found.
Nov 10 17:58:50 user nova-compute[75100]: iSNS:
Nov 10 17:58:50 user nova-compute[75100]: No targets found.
Nov 10 17:58:50 user nova-compute[75100]: STATIC:
Nov 10 17:58:50 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5
Nov 10 17:58:50 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 17:58:50 user nova-compute[75100]:                 Iface Name: default
Nov 10 17:58:50 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c
Nov 10 17:58:50 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 17:58:50 user nova-compute[75100]:                 Iface Name: default
Nov 10 17:58:50 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308
Nov 10 17:58:50 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 17:58:50 user nova-compute[75100]:                 Iface Name: default
Nov 10 17:58:50 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652
Nov 10 17:58:50 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 17:58:50 user nova-compute[75100]:                 Iface Name: default
Nov 10 17:58:50 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00
Nov 10 17:58:50 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 17:58:50 user nova-compute[75100]:                 Iface Name: default
Nov 10 17:58:50 user nova-compute[75100]: FIRMWARE:
Nov 10 17:58:50 user nova-compute[75100]: No targets found.
Nov 10 17:58:50 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa4010d-9120-46c4-a797-9a2a56f083b0 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 17:58:50 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 17:58:50 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa4010d-9120-46c4-a797-9a2a56f083b0 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG nova.compute.manager [req-1fd12c54-ef52-433f-a8f7-e5fef70bb733 req-f93c1796-bee2-4f7a-822f-f307724fe046 service nova] [instance: 61e73913-30a5-4eaa-9bc0-6e17a0288035] Received event network-vif-deleted-5e7d8cb1-7fbd-41f3-8f05-6ee9d4d4300c {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-07c1cf14-cdb7-4248-bf2a-6507f9685af1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-07c1cf14-cdb7-4248-bf2a-6507f9685af1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.032s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ac7fed-cf4c-410e-b57c-57c883af01d5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce5dd2d-411c-4b68-832e-f6201fbc966d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa4010d-9120-46c4-a797-9a2a56f083b0 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)
Nov 10 17:58:50 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c (non-flash)
Nov 10 17:58:50 user nova-compute[75100]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 (non-flash)
Nov 10 17:58:50 user nova-compute[75100]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 (non-flash)
Nov 10 17:58:50 user nova-compute[75100]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5 (non-flash)
Nov 10 17:58:50 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa4010d-9120-46c4-a797-9a2a56f083b0 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)
Nov 10 17:58:50 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c (non-flash)
Nov 10 17:58:50 user nova-compute[75100]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 (non-flash)
Nov 10 17:58:50 user nova-compute[75100]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 (non-flash)
Nov 10 17:58:50 user nova-compute[75100]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5 (non-flash)
Nov 10 17:58:50 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa4010d-9120-46c4-a797-9a2a56f083b0 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3986b0ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c'): ({'sde'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-afa4010d-9120-46c4-a797-9a2a56f083b0 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Removing single pathed devices sde {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0610f04e-f7e0-4e5f-95e9-91c6bd70f470]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[009d8ff9-e8a1-42e1-90a1-b61f2685b141]: (4, ('ok\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-afa4010d-9120-46c4-a797-9a2a56f083b0 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Flushing IO for device /dev/sde {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a262b14b-a3e4-4a3e-961b-2664c55f33cb]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-afa4010d-9120-46c4-a797-9a2a56f083b0 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.053s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6a7751-c370-4a8b-a1c3-da237a35a617]: (4, ('1', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-afa4010d-9120-46c4-a797-9a2a56f083b0 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-afa4010d-9120-46c4-a797-9a2a56f083b0 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] SCSI volumes sde have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa4010d-9120-46c4-a797-9a2a56f083b0 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ec163f-463e-4990-9019-73c13657cb3d]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa4010d-9120-46c4-a797-9a2a56f083b0 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c -p 172.16.0.220:3260 --logout {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c -p 172.16.0.220:3260 --logout" returned: 0 in 0.116s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4470076d-ff3a-452d-841d-d3c05098adb2]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:58:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa4010d-9120-46c4-a797-9a2a56f083b0 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c, portal: 172.16.0.220,3260]
Nov 10 17:58:51 user nova-compute[75100]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c, portal: 172.16.0.220,3260] successful.
Nov 10 17:58:51 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:58:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c -p 172.16.0.220:3260 --op delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba96bee-27d3-48fc-9caf-f8932bf96d0c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:51 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a5cb088-5a89-4088-ba7d-e1932ecaff56]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:58:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa4010d-9120-46c4-a797-9a2a56f083b0 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:58:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-afa4010d-9120-46c4-a797-9a2a56f083b0 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.454s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 17:58:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa4010d-9120-46c4-a797-9a2a56f083b0 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] <== disconnect_volume: return (456ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 17:58:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afa4010d-9120-46c4-a797-9a2a56f083b0 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 17:58:51 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-afa4010d-9120-46c4-a797-9a2a56f083b0 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Deleting instance files /opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3_del
Nov 10 17:58:51 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-afa4010d-9120-46c4-a797-9a2a56f083b0 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Deletion of /opt/stack/data/nova/instances/eb430407-f836-4510-899f-a5f5d60c73f3_del complete
Nov 10 17:58:51 user nova-compute[75100]: INFO nova.compute.manager [None req-afa4010d-9120-46c4-a797-9a2a56f083b0 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Took 1.54 seconds to destroy the instance on the hypervisor.
Nov 10 17:58:51 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-afa4010d-9120-46c4-a797-9a2a56f083b0 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 17:58:51 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 17:58:51 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 17:58:51 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-07c1cf14-cdb7-4248-bf2a-6507f9685af1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:58:51 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-07c1cf14-cdb7-4248-bf2a-6507f9685af1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:58:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-07c1cf14-cdb7-4248-bf2a-6507f9685af1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.596s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:58:51 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-07c1cf14-cdb7-4248-bf2a-6507f9685af1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Deleted allocations for instance 61e73913-30a5-4eaa-9bc0-6e17a0288035
Nov 10 17:58:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-07c1cf14-cdb7-4248-bf2a-6507f9685af1 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "61e73913-30a5-4eaa-9bc0-6e17a0288035" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.605s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:58:51 user nova-compute[75100]: DEBUG nova.compute.manager [req-4db199ad-167d-47d7-bec6-1c827f803599 req-04e7260e-cdb5-4b84-ad02-c3ac7d880490 service nova] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] Received event network-vif-plugged-10571181-1571-456a-9203-1d0d366c7d4b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:58:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4db199ad-167d-47d7-bec6-1c827f803599 req-04e7260e-cdb5-4b84-ad02-c3ac7d880490 service nova] Acquiring lock "228aa1b0-1868-4bfe-b322-ca6a6406375c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:58:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4db199ad-167d-47d7-bec6-1c827f803599 req-04e7260e-cdb5-4b84-ad02-c3ac7d880490 service nova] Lock "228aa1b0-1868-4bfe-b322-ca6a6406375c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:58:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4db199ad-167d-47d7-bec6-1c827f803599 req-04e7260e-cdb5-4b84-ad02-c3ac7d880490 service nova] Lock "228aa1b0-1868-4bfe-b322-ca6a6406375c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:58:51 user nova-compute[75100]: DEBUG nova.compute.manager [req-4db199ad-167d-47d7-bec6-1c827f803599 req-04e7260e-cdb5-4b84-ad02-c3ac7d880490 service nova] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] No waiting events found dispatching network-vif-plugged-10571181-1571-456a-9203-1d0d366c7d4b {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:58:51 user nova-compute[75100]: WARNING nova.compute.manager [req-4db199ad-167d-47d7-bec6-1c827f803599 req-04e7260e-cdb5-4b84-ad02-c3ac7d880490 service nova] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] Received unexpected event network-vif-plugged-10571181-1571-456a-9203-1d0d366c7d4b for instance with vm_state building and task_state spawning.
Nov 10 17:58:51 user nova-compute[75100]: DEBUG nova.compute.manager [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 17:58:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 17:58:51 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] Instance spawned successfully.
Nov 10 17:58:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 17:58:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:58:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:58:51 user nova-compute[75100]: INFO nova.compute.manager [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] Took 5.85 seconds to spawn the instance on the hypervisor.
Nov 10 17:58:51 user nova-compute[75100]: DEBUG nova.compute.manager [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 17:58:51 user nova-compute[75100]: INFO nova.compute.manager [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] Took 39.32 seconds to build instance.
Nov 10 17:58:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b9ee5838-b2d3-485c-86b3-cc0369096101 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "228aa1b0-1868-4bfe-b322-ca6a6406375c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 39.425s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:58:52 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:58:52 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Took 0.90 seconds to deallocate network for instance.
Nov 10 17:58:52 user nova-compute[75100]: DEBUG nova.compute.manager [req-5ab2b545-99ea-43e2-aa9c-d2304772690e req-9275e0e6-1364-455e-bbf9-c7f93f1b43a5 service nova] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Received event network-vif-unplugged-6e9b2058-6104-4f6c-8c72-f5f15d0d116b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:58:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5ab2b545-99ea-43e2-aa9c-d2304772690e req-9275e0e6-1364-455e-bbf9-c7f93f1b43a5 service nova] Acquiring lock "eb430407-f836-4510-899f-a5f5d60c73f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:58:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5ab2b545-99ea-43e2-aa9c-d2304772690e req-9275e0e6-1364-455e-bbf9-c7f93f1b43a5 service nova] Lock "eb430407-f836-4510-899f-a5f5d60c73f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:58:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5ab2b545-99ea-43e2-aa9c-d2304772690e req-9275e0e6-1364-455e-bbf9-c7f93f1b43a5 service nova] Lock "eb430407-f836-4510-899f-a5f5d60c73f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:58:52 user nova-compute[75100]: DEBUG nova.compute.manager [req-5ab2b545-99ea-43e2-aa9c-d2304772690e req-9275e0e6-1364-455e-bbf9-c7f93f1b43a5 service nova] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] No waiting events found dispatching network-vif-unplugged-6e9b2058-6104-4f6c-8c72-f5f15d0d116b {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:58:52 user nova-compute[75100]: DEBUG nova.compute.manager [req-5ab2b545-99ea-43e2-aa9c-d2304772690e req-9275e0e6-1364-455e-bbf9-c7f93f1b43a5 service nova] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Received event network-vif-unplugged-6e9b2058-6104-4f6c-8c72-f5f15d0d116b for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 17:58:52 user nova-compute[75100]: DEBUG nova.compute.manager [req-5ab2b545-99ea-43e2-aa9c-d2304772690e req-9275e0e6-1364-455e-bbf9-c7f93f1b43a5 service nova] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Received event network-vif-plugged-6e9b2058-6104-4f6c-8c72-f5f15d0d116b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:58:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5ab2b545-99ea-43e2-aa9c-d2304772690e req-9275e0e6-1364-455e-bbf9-c7f93f1b43a5 service nova] Acquiring lock "eb430407-f836-4510-899f-a5f5d60c73f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:58:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5ab2b545-99ea-43e2-aa9c-d2304772690e req-9275e0e6-1364-455e-bbf9-c7f93f1b43a5 service nova] Lock "eb430407-f836-4510-899f-a5f5d60c73f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:58:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5ab2b545-99ea-43e2-aa9c-d2304772690e req-9275e0e6-1364-455e-bbf9-c7f93f1b43a5 service nova] Lock "eb430407-f836-4510-899f-a5f5d60c73f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:58:52 user nova-compute[75100]: DEBUG nova.compute.manager [req-5ab2b545-99ea-43e2-aa9c-d2304772690e req-9275e0e6-1364-455e-bbf9-c7f93f1b43a5 service nova] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] No waiting events found dispatching network-vif-plugged-6e9b2058-6104-4f6c-8c72-f5f15d0d116b {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:58:52 user nova-compute[75100]: WARNING nova.compute.manager [req-5ab2b545-99ea-43e2-aa9c-d2304772690e req-9275e0e6-1364-455e-bbf9-c7f93f1b43a5 service nova] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Received unexpected event network-vif-plugged-6e9b2058-6104-4f6c-8c72-f5f15d0d116b for instance with vm_state active and task_state deleting.
Nov 10 17:58:52 user nova-compute[75100]: DEBUG nova.compute.manager [req-5ab2b545-99ea-43e2-aa9c-d2304772690e req-9275e0e6-1364-455e-bbf9-c7f93f1b43a5 service nova] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Received event network-vif-deleted-6e9b2058-6104-4f6c-8c72-f5f15d0d116b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:58:53 user nova-compute[75100]: INFO nova.compute.manager [None req-afa4010d-9120-46c4-a797-9a2a56f083b0 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] [instance: eb430407-f836-4510-899f-a5f5d60c73f3] Took 1.03 seconds to detach 1 volumes for instance.
Nov 10 17:58:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-afa4010d-9120-46c4-a797-9a2a56f083b0 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:58:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-afa4010d-9120-46c4-a797-9a2a56f083b0 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:58:53 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-afa4010d-9120-46c4-a797-9a2a56f083b0 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:58:53 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-afa4010d-9120-46c4-a797-9a2a56f083b0 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:58:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-afa4010d-9120-46c4-a797-9a2a56f083b0 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.532s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:58:53 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-afa4010d-9120-46c4-a797-9a2a56f083b0 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Deleted allocations for instance eb430407-f836-4510-899f-a5f5d60c73f3
Nov 10 17:58:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-afa4010d-9120-46c4-a797-9a2a56f083b0 tempest-ServerActionsTestOtherB-1027676823 tempest-ServerActionsTestOtherB-1027676823-project-member] Lock "eb430407-f836-4510-899f-a5f5d60c73f3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.210s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:58:54 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:58:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:58:56 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-159f09fb-3530-4917-91f7-43910e664dce tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 17:58:56 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-159f09fb-3530-4917-91f7-43910e664dce tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pOYGWyaQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 17:58:56 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-159f09fb-3530-4917-91f7-43910e664dce tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 17:58:56 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-159f09fb-3530-4917-91f7-43910e664dce tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 17:58:56 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-159f09fb-3530-4917-91f7-43910e664dce tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 17:58:56 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-159f09fb-3530-4917-91f7-43910e664dce tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 17:58:56 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-159f09fb-3530-4917-91f7-43910e664dce tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 17:58:56 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-159f09fb-3530-4917-91f7-43910e664dce tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 17:58:56 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-159f09fb-3530-4917-91f7-43910e664dce tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 17:58:56 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d -p 172.16.0.220:3260 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:56 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:56 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[67800a52-ad3d-460d-abb7-9fe4ace75502]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:58:56 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-159f09fb-3530-4917-91f7-43910e664dce tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 17:58:56 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:58:56 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d -p 172.16.0.220:3260 --interface default --op new {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:56 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:56 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8555e8-1974-4f05-b3f5-ec70847cc1c4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d] added\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:58:56 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-159f09fb-3530-4917-91f7-43910e664dce tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d] added
Nov 10 17:58:56 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:58:56 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:56 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0caf0b64-62e1-4fe4-b4f5-981bad940e85 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 17:58:56 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0caf0b64-62e1-4fe4-b4f5-981bad940e85 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zlHmpLBc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 17:58:56 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-0caf0b64-62e1-4fe4-b4f5-981bad940e85 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 17:58:56 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-0caf0b64-62e1-4fe4-b4f5-981bad940e85 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 17:58:56 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:56 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfeedb4-3341-49cc-b4a1-1ac495873f21]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:58:56 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-159f09fb-3530-4917-91f7-43910e664dce tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:58:56 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:56 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:56 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[434cfdff-3374-45c9-8ada-a836a3f90095]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:58:56 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-159f09fb-3530-4917-91f7-43910e664dce tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:58:56 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pOYGWyaQ {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:56 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pOYGWyaQ" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:56 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[751f6bb1-ffd0-4d92-8320-75727e427918]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:58:56 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-159f09fb-3530-4917-91f7-43910e664dce tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pOYGWyaQ'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:58:56 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:56 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:56 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6273ee8e-4b71-4166-87ab-aae76c505d6b]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:58:56 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-159f09fb-3530-4917-91f7-43910e664dce tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:58:56 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:56 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:56 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1701bd1c-39d5-4d50-9c09-400e54cb773a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:58:56 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-159f09fb-3530-4917-91f7-43910e664dce tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)
Nov 10 17:58:56 user nova-compute[75100]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 (non-flash)
Nov 10 17:58:56 user nova-compute[75100]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 (non-flash)
Nov 10 17:58:56 user nova-compute[75100]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5 (non-flash)
Nov 10 17:58:56 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:58:56 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-159f09fb-3530-4917-91f7-43910e664dce tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)
Nov 10 17:58:56 user nova-compute[75100]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 (non-flash)
Nov 10 17:58:56 user nova-compute[75100]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 (non-flash)
Nov 10 17:58:56 user nova-compute[75100]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5 (non-flash)
Nov 10 17:58:56 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 17:58:56 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d -p 172.16.0.220:3260 --login {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:57 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[110d1f77-dfcc-4b52-b344-781255d64652]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:58:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-159f09fb-3530-4917-91f7-43910e664dce tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d, portal: 172.16.0.220,3260]
Nov 10 17:58:57 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d, portal: 172.16.0.220,3260] successful.
Nov 10 17:58:57 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:58:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:57 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e4bb78d-8ce9-465d-9794-d55405b8c842]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:58:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-159f09fb-3530-4917-91f7-43910e664dce tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:58:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:57 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf9b01e-fef3-4140-a068-b99c7139b9a0]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:58:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-159f09fb-3530-4917-91f7-43910e664dce tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)
Nov 10 17:58:57 user nova-compute[75100]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 (non-flash)
Nov 10 17:58:57 user nova-compute[75100]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 (non-flash)
Nov 10 17:58:57 user nova-compute[75100]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5 (non-flash)
Nov 10 17:58:57 user nova-compute[75100]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d (non-flash)
Nov 10 17:58:57 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:58:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-159f09fb-3530-4917-91f7-43910e664dce tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)
Nov 10 17:58:57 user nova-compute[75100]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 (non-flash)
Nov 10 17:58:57 user nova-compute[75100]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 (non-flash)
Nov 10 17:58:57 user nova-compute[75100]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5 (non-flash)
Nov 10 17:58:57 user nova-compute[75100]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d (non-flash)
Nov 10 17:58:57 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 17:58:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-159f09fb-3530-4917-91f7-43910e664dce tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 17:58:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-159f09fb-3530-4917-91f7-43910e664dce tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 17:58:57 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-159f09fb-3530-4917-91f7-43910e664dce tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] HCTL ('34', '-', '-', 0) found on session 21 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 17:58:57 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-159f09fb-3530-4917-91f7-43910e664dce tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 17:58:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:57 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7e5208-d08e-471b-8543-e151770b84b5]: (4, ('- - 0', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:58:57 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-159f09fb-3530-4917-91f7-43910e664dce tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 17:58:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-159f09fb-3530-4917-91f7-43910e664dce tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pOYGWyaQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 17:58:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-159f09fb-3530-4917-91f7-43910e664dce tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 17:58:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-159f09fb-3530-4917-91f7-43910e664dce tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '26466323465383331', 'path': '/dev/sdc'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 17:58:58 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-159f09fb-3530-4917-91f7-43910e664dce tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26466323465383331', 'path': '/dev/sdc'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 17:58:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-0caf0b64-62e1-4fe4-b4f5-981bad940e85 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.283s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 17:58:58 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-0caf0b64-62e1-4fe4-b4f5-981bad940e85 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 17:58:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-0caf0b64-62e1-4fe4-b4f5-981bad940e85 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 17:58:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-0caf0b64-62e1-4fe4-b4f5-981bad940e85 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 17:58:58 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-0caf0b64-62e1-4fe4-b4f5-981bad940e85 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 17:58:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 -p 172.16.0.220:3260 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:58 user nova-compute[75100]: DEBUG nova.objects.instance [None req-159f09fb-3530-4917-91f7-43910e664dce tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lazy-loading 'flavor' on Instance uuid adf9e657-d366-4afd-a752-87e69b73eb81 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:58:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:58 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8434e66f-c82c-4c3c-aad4-7f9c9c976325]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:58:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0caf0b64-62e1-4fe4-b4f5-981bad940e85 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 17:58:58 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:58:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:58 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-159f09fb-3530-4917-91f7-43910e664dce tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 17:58:58 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 17:58:58 user nova-compute[75100]:   <source dev="/dev/sdc"/>
Nov 10 17:58:58 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 17:58:58 user nova-compute[75100]:   <serial>73be880b-b3af-4d74-831e-5d346119350d</serial>
Nov 10 17:58:58 user nova-compute[75100]: </disk>
Nov 10 17:58:58 user nova-compute[75100]:  {{(pid=75100) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 17:58:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:58 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b80aecd-02d6-4961-87d2-36d889c4ef1c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0] added\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:58:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0caf0b64-62e1-4fe4-b4f5-981bad940e85 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0] added
Nov 10 17:58:58 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:58:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:58 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[453fcb2b-c22a-4b3e-b3cd-dbb1d73f0783]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:58:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0caf0b64-62e1-4fe4-b4f5-981bad940e85 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:58:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:58 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab03a3a5-5cd2-4601-9db3-029505849442]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:58:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0caf0b64-62e1-4fe4-b4f5-981bad940e85 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:58:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zlHmpLBc {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zlHmpLBc" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:58 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[075bb78d-d2e2-4da5-99d6-99c264d54a0f]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:58:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0caf0b64-62e1-4fe4-b4f5-981bad940e85 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zlHmpLBc'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:58:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:58 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e5e881-c12b-4f6e-b362-7ed592524a90]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:58:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0caf0b64-62e1-4fe4-b4f5-981bad940e85 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:58:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:58 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f248cf7-9135-437a-82f5-68214c40c2e7]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:58:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0caf0b64-62e1-4fe4-b4f5-981bad940e85 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)
Nov 10 17:58:58 user nova-compute[75100]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 (non-flash)
Nov 10 17:58:58 user nova-compute[75100]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 (non-flash)
Nov 10 17:58:58 user nova-compute[75100]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5 (non-flash)
Nov 10 17:58:58 user nova-compute[75100]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d (non-flash)
Nov 10 17:58:58 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:58:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0caf0b64-62e1-4fe4-b4f5-981bad940e85 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)
Nov 10 17:58:58 user nova-compute[75100]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 (non-flash)
Nov 10 17:58:58 user nova-compute[75100]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 (non-flash)
Nov 10 17:58:58 user nova-compute[75100]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5 (non-flash)
Nov 10 17:58:58 user nova-compute[75100]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d (non-flash)
Nov 10 17:58:58 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 17:58:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 -p 172.16.0.220:3260 --login {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:58 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e51d0c-ab1f-4d49-b360-b9009b26ff89]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:58:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0caf0b64-62e1-4fe4-b4f5-981bad940e85 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0, portal: 172.16.0.220,3260]
Nov 10 17:58:58 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0, portal: 172.16.0.220,3260] successful.
Nov 10 17:58:58 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:58:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:58 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c900bab1-9802-4afa-95d5-170f2911b6ed]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:58:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0caf0b64-62e1-4fe4-b4f5-981bad940e85 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:58:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:58 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42b0283-f6cf-41fc-980d-6918bb682020]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:58:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0caf0b64-62e1-4fe4-b4f5-981bad940e85 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)
Nov 10 17:58:58 user nova-compute[75100]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 (non-flash)
Nov 10 17:58:58 user nova-compute[75100]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 (non-flash)
Nov 10 17:58:58 user nova-compute[75100]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5 (non-flash)
Nov 10 17:58:58 user nova-compute[75100]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d (non-flash)
Nov 10 17:58:58 user nova-compute[75100]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 (non-flash)
Nov 10 17:58:58 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:58:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0caf0b64-62e1-4fe4-b4f5-981bad940e85 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)
Nov 10 17:58:58 user nova-compute[75100]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 (non-flash)
Nov 10 17:58:58 user nova-compute[75100]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 (non-flash)
Nov 10 17:58:58 user nova-compute[75100]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5 (non-flash)
Nov 10 17:58:58 user nova-compute[75100]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d (non-flash)
Nov 10 17:58:58 user nova-compute[75100]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 (non-flash)
Nov 10 17:58:58 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 17:58:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-0caf0b64-62e1-4fe4-b4f5-981bad940e85 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.338s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 17:58:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0caf0b64-62e1-4fe4-b4f5-981bad940e85 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 17:58:58 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-0caf0b64-62e1-4fe4-b4f5-981bad940e85 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] HCTL ('36', '-', '-', 0) found on session 22 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 17:58:58 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-0caf0b64-62e1-4fe4-b4f5-981bad940e85 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 17:58:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:58:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:58:58 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5dddfbd-60f8-4d14-81e9-9fb9813ee38b]: (4, ('- - 0', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:58:58 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-0caf0b64-62e1-4fe4-b4f5-981bad940e85 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Searching for a device in session 22 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 17:58:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0caf0b64-62e1-4fe4-b4f5-981bad940e85 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zlHmpLBc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 17:58:58 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-159f09fb-3530-4917-91f7-43910e664dce tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 17:58:58 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-159f09fb-3530-4917-91f7-43910e664dce tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 17:58:58 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-159f09fb-3530-4917-91f7-43910e664dce tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] No VIF found with MAC fa:16:3e:12:d5:10, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 17:58:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-159f09fb-3530-4917-91f7-43910e664dce tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lock "adf9e657-d366-4afd-a752-87e69b73eb81" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 70.643s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:58:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-0caf0b64-62e1-4fe4-b4f5-981bad940e85 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 17:58:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0caf0b64-62e1-4fe4-b4f5-981bad940e85 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] <== connect_volume: return (2663ms) {'type': 'block', 'scsi_wwn': '23536356564656562', 'path': '/dev/sde'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 17:58:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0caf0b64-62e1-4fe4-b4f5-981bad940e85 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23536356564656562', 'path': '/dev/sde'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 17:58:59 user nova-compute[75100]: DEBUG nova.objects.instance [None req-0caf0b64-62e1-4fe4-b4f5-981bad940e85 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lazy-loading 'flavor' on Instance uuid ca2f4288-da43-4bf3-9ef4-fd53961fe74c {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:58:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-0caf0b64-62e1-4fe4-b4f5-981bad940e85 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 17:58:59 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 17:58:59 user nova-compute[75100]:   <source dev="/dev/sde"/>
Nov 10 17:58:59 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 17:58:59 user nova-compute[75100]:   <serial>eb371cd8-f98e-4eb4-8047-76cc41e0d6d0</serial>
Nov 10 17:58:59 user nova-compute[75100]: </disk>
Nov 10 17:58:59 user nova-compute[75100]:  {{(pid=75100) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 17:59:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0caf0b64-62e1-4fe4-b4f5-981bad940e85 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 17:59:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0caf0b64-62e1-4fe4-b4f5-981bad940e85 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 17:59:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0caf0b64-62e1-4fe4-b4f5-981bad940e85 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] No VIF found with MAC fa:16:3e:e0:bd:a4, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 17:59:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0caf0b64-62e1-4fe4-b4f5-981bad940e85 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "ca2f4288-da43-4bf3-9ef4-fd53961fe74c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 51.756s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:59:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:59:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:12 user nova-compute[75100]: DEBUG nova.compute.manager [req-df5b33f0-eff3-4ae3-bfff-2bca4d8bfc67 req-9b14f2f2-9357-4688-982f-f4b7d054ba7b service nova] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Received event network-changed-4c49d1d4-dba2-478e-80b6-94e012439af6 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:59:12 user nova-compute[75100]: DEBUG nova.compute.manager [req-df5b33f0-eff3-4ae3-bfff-2bca4d8bfc67 req-9b14f2f2-9357-4688-982f-f4b7d054ba7b service nova] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Refreshing instance network info cache due to event network-changed-4c49d1d4-dba2-478e-80b6-94e012439af6. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 17:59:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-df5b33f0-eff3-4ae3-bfff-2bca4d8bfc67 req-9b14f2f2-9357-4688-982f-f4b7d054ba7b service nova] Acquiring lock "refresh_cache-9033f537-bdeb-412c-9337-4ad86f4467b2" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:59:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-df5b33f0-eff3-4ae3-bfff-2bca4d8bfc67 req-9b14f2f2-9357-4688-982f-f4b7d054ba7b service nova] Acquired lock "refresh_cache-9033f537-bdeb-412c-9337-4ad86f4467b2" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:59:12 user nova-compute[75100]: DEBUG nova.network.neutron [req-df5b33f0-eff3-4ae3-bfff-2bca4d8bfc67 req-9b14f2f2-9357-4688-982f-f4b7d054ba7b service nova] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Refreshing network info cache for port 4c49d1d4-dba2-478e-80b6-94e012439af6 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 17:59:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-42b37a1d-0f65-478a-a0dc-fdcf16648313 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Acquiring lock "9033f537-bdeb-412c-9337-4ad86f4467b2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:59:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-42b37a1d-0f65-478a-a0dc-fdcf16648313 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "9033f537-bdeb-412c-9337-4ad86f4467b2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:59:12 user nova-compute[75100]: INFO nova.compute.manager [None req-42b37a1d-0f65-478a-a0dc-fdcf16648313 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Detaching volume f802b50f-f3b6-4f97-a95e-f838ec169652
Nov 10 17:59:12 user nova-compute[75100]: DEBUG nova.network.neutron [req-df5b33f0-eff3-4ae3-bfff-2bca4d8bfc67 req-9b14f2f2-9357-4688-982f-f4b7d054ba7b service nova] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Updated VIF entry in instance network info cache for port 4c49d1d4-dba2-478e-80b6-94e012439af6. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 17:59:12 user nova-compute[75100]: DEBUG nova.network.neutron [req-df5b33f0-eff3-4ae3-bfff-2bca4d8bfc67 req-9b14f2f2-9357-4688-982f-f4b7d054ba7b service nova] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Updating instance_info_cache with network_info: [{"id": "4c49d1d4-dba2-478e-80b6-94e012439af6", "address": "fa:16:3e:01:6b:43", "network": {"id": "26a554fe-9a5e-40c0-9981-5ac084c9ea73", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-269663495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19755f3e634fdfbd562c33fbfa2a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c49d1d4-db", "ovs_interfaceid": "4c49d1d4-dba2-478e-80b6-94e012439af6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:59:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-df5b33f0-eff3-4ae3-bfff-2bca4d8bfc67 req-9b14f2f2-9357-4688-982f-f4b7d054ba7b service nova] Releasing lock "refresh_cache-9033f537-bdeb-412c-9337-4ad86f4467b2" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:59:12 user nova-compute[75100]: INFO nova.virt.block_device [None req-42b37a1d-0f65-478a-a0dc-fdcf16648313 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Attempting to driver detach volume f802b50f-f3b6-4f97-a95e-f838ec169652 from mountpoint /dev/vdb
Nov 10 17:59:12 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-42b37a1d-0f65-478a-a0dc-fdcf16648313 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Attempting to detach device vdb from instance 9033f537-bdeb-412c-9337-4ad86f4467b2 from the persistent domain config. {{(pid=75100) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 17:59:12 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-42b37a1d-0f65-478a-a0dc-fdcf16648313 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 17:59:12 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 17:59:12 user nova-compute[75100]:   <source dev="/dev/sdd"/>
Nov 10 17:59:12 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 17:59:12 user nova-compute[75100]:   <serial>f802b50f-f3b6-4f97-a95e-f838ec169652</serial>
Nov 10 17:59:12 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 17:59:12 user nova-compute[75100]: </disk>
Nov 10 17:59:12 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 17:59:12 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-42b37a1d-0f65-478a-a0dc-fdcf16648313 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Successfully detached device vdb from instance 9033f537-bdeb-412c-9337-4ad86f4467b2 from the persistent domain config.
Nov 10 17:59:12 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-42b37a1d-0f65-478a-a0dc-fdcf16648313 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9033f537-bdeb-412c-9337-4ad86f4467b2 from the live domain config. {{(pid=75100) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 17:59:12 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-42b37a1d-0f65-478a-a0dc-fdcf16648313 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 17:59:12 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 17:59:12 user nova-compute[75100]:   <source dev="/dev/sdd"/>
Nov 10 17:59:12 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 17:59:12 user nova-compute[75100]:   <serial>f802b50f-f3b6-4f97-a95e-f838ec169652</serial>
Nov 10 17:59:12 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 17:59:12 user nova-compute[75100]: </disk>
Nov 10 17:59:12 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 17:59:13 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-42b37a1d-0f65-478a-a0dc-fdcf16648313 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9033f537-bdeb-412c-9337-4ad86f4467b2 {{(pid=75100) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 17:59:14 user nova-compute[75100]: DEBUG nova.compute.manager [req-593d02f4-2a96-466c-8c7c-a40578529cab req-02b1c614-ff1c-4549-b425-c4866452d21e service nova] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Received event network-changed-4c49d1d4-dba2-478e-80b6-94e012439af6 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:59:14 user nova-compute[75100]: DEBUG nova.compute.manager [req-593d02f4-2a96-466c-8c7c-a40578529cab req-02b1c614-ff1c-4549-b425-c4866452d21e service nova] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Refreshing instance network info cache due to event network-changed-4c49d1d4-dba2-478e-80b6-94e012439af6. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 17:59:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-593d02f4-2a96-466c-8c7c-a40578529cab req-02b1c614-ff1c-4549-b425-c4866452d21e service nova] Acquiring lock "refresh_cache-9033f537-bdeb-412c-9337-4ad86f4467b2" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:59:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-593d02f4-2a96-466c-8c7c-a40578529cab req-02b1c614-ff1c-4549-b425-c4866452d21e service nova] Acquired lock "refresh_cache-9033f537-bdeb-412c-9337-4ad86f4467b2" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:59:14 user nova-compute[75100]: DEBUG nova.network.neutron [req-593d02f4-2a96-466c-8c7c-a40578529cab req-02b1c614-ff1c-4549-b425-c4866452d21e service nova] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Refreshing network info cache for port 4c49d1d4-dba2-478e-80b6-94e012439af6 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 17:59:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:14 user nova-compute[75100]: DEBUG nova.network.neutron [req-593d02f4-2a96-466c-8c7c-a40578529cab req-02b1c614-ff1c-4549-b425-c4866452d21e service nova] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Updated VIF entry in instance network info cache for port 4c49d1d4-dba2-478e-80b6-94e012439af6. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 17:59:14 user nova-compute[75100]: DEBUG nova.network.neutron [req-593d02f4-2a96-466c-8c7c-a40578529cab req-02b1c614-ff1c-4549-b425-c4866452d21e service nova] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Updating instance_info_cache with network_info: [{"id": "4c49d1d4-dba2-478e-80b6-94e012439af6", "address": "fa:16:3e:01:6b:43", "network": {"id": "26a554fe-9a5e-40c0-9981-5ac084c9ea73", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-269663495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19755f3e634fdfbd562c33fbfa2a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c49d1d4-db", "ovs_interfaceid": "4c49d1d4-dba2-478e-80b6-94e012439af6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:59:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-593d02f4-2a96-466c-8c7c-a40578529cab req-02b1c614-ff1c-4549-b425-c4866452d21e service nova] Releasing lock "refresh_cache-9033f537-bdeb-412c-9337-4ad86f4467b2" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:59:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:15 user nova-compute[75100]: DEBUG nova.compute.manager [req-2c411fe8-0f29-4deb-8e29-39001ba75c70 req-c7e1057b-927a-4d49-b0ef-f158e5c6ec8d service nova] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Received event network-changed-f33ff122-270e-4129-be5b-e67c0bc0708c {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:59:15 user nova-compute[75100]: DEBUG nova.compute.manager [req-2c411fe8-0f29-4deb-8e29-39001ba75c70 req-c7e1057b-927a-4d49-b0ef-f158e5c6ec8d service nova] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Refreshing instance network info cache due to event network-changed-f33ff122-270e-4129-be5b-e67c0bc0708c. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 17:59:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2c411fe8-0f29-4deb-8e29-39001ba75c70 req-c7e1057b-927a-4d49-b0ef-f158e5c6ec8d service nova] Acquiring lock "refresh_cache-ca2f4288-da43-4bf3-9ef4-fd53961fe74c" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:59:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2c411fe8-0f29-4deb-8e29-39001ba75c70 req-c7e1057b-927a-4d49-b0ef-f158e5c6ec8d service nova] Acquired lock "refresh_cache-ca2f4288-da43-4bf3-9ef4-fd53961fe74c" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:59:15 user nova-compute[75100]: DEBUG nova.network.neutron [req-2c411fe8-0f29-4deb-8e29-39001ba75c70 req-c7e1057b-927a-4d49-b0ef-f158e5c6ec8d service nova] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Refreshing network info cache for port f33ff122-270e-4129-be5b-e67c0bc0708c {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 17:59:16 user nova-compute[75100]: DEBUG nova.network.neutron [req-2c411fe8-0f29-4deb-8e29-39001ba75c70 req-c7e1057b-927a-4d49-b0ef-f158e5c6ec8d service nova] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Updated VIF entry in instance network info cache for port f33ff122-270e-4129-be5b-e67c0bc0708c. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 17:59:16 user nova-compute[75100]: DEBUG nova.network.neutron [req-2c411fe8-0f29-4deb-8e29-39001ba75c70 req-c7e1057b-927a-4d49-b0ef-f158e5c6ec8d service nova] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Updating instance_info_cache with network_info: [{"id": "f33ff122-270e-4129-be5b-e67c0bc0708c", "address": "fa:16:3e:e0:bd:a4", "network": {"id": "78d86418-c0e0-4cc2-8f4f-262f600f7d66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2054827063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19cfb454e59745bf9c77d7a7ede2bc0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33ff122-27", "ovs_interfaceid": "f33ff122-270e-4129-be5b-e67c0bc0708c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:59:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2c411fe8-0f29-4deb-8e29-39001ba75c70 req-c7e1057b-927a-4d49-b0ef-f158e5c6ec8d service nova] Releasing lock "refresh_cache-ca2f4288-da43-4bf3-9ef4-fd53961fe74c" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:59:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-197e8454-a1b6-460a-b6cf-6166aa623beb tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] Acquiring lock "81e579a0-93f3-4989-b47f-f12f8b296a62" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:59:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-197e8454-a1b6-460a-b6cf-6166aa623beb tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] Lock "81e579a0-93f3-4989-b47f-f12f8b296a62" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:59:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-197e8454-a1b6-460a-b6cf-6166aa623beb tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] Acquiring lock "81e579a0-93f3-4989-b47f-f12f8b296a62-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:59:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-197e8454-a1b6-460a-b6cf-6166aa623beb tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] Lock "81e579a0-93f3-4989-b47f-f12f8b296a62-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:59:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-197e8454-a1b6-460a-b6cf-6166aa623beb tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] Lock "81e579a0-93f3-4989-b47f-f12f8b296a62-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:59:16 user nova-compute[75100]: INFO nova.compute.manager [None req-197e8454-a1b6-460a-b6cf-6166aa623beb tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] [instance: 81e579a0-93f3-4989-b47f-f12f8b296a62] Terminating instance
Nov 10 17:59:16 user nova-compute[75100]: DEBUG nova.compute.manager [None req-197e8454-a1b6-460a-b6cf-6166aa623beb tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] [instance: 81e579a0-93f3-4989-b47f-f12f8b296a62] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 17:59:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:17 user nova-compute[75100]: DEBUG nova.compute.manager [req-ff631522-80fb-43c9-b344-a35cafd0c90e req-0beacc13-b47f-4986-b5c0-c25cf257079f service nova] [instance: 81e579a0-93f3-4989-b47f-f12f8b296a62] Received event network-vif-unplugged-c3f32695-0b6f-431f-8539-981f044d7198 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:59:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ff631522-80fb-43c9-b344-a35cafd0c90e req-0beacc13-b47f-4986-b5c0-c25cf257079f service nova] Acquiring lock "81e579a0-93f3-4989-b47f-f12f8b296a62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:59:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ff631522-80fb-43c9-b344-a35cafd0c90e req-0beacc13-b47f-4986-b5c0-c25cf257079f service nova] Lock "81e579a0-93f3-4989-b47f-f12f8b296a62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:59:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ff631522-80fb-43c9-b344-a35cafd0c90e req-0beacc13-b47f-4986-b5c0-c25cf257079f service nova] Lock "81e579a0-93f3-4989-b47f-f12f8b296a62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:59:17 user nova-compute[75100]: DEBUG nova.compute.manager [req-ff631522-80fb-43c9-b344-a35cafd0c90e req-0beacc13-b47f-4986-b5c0-c25cf257079f service nova] [instance: 81e579a0-93f3-4989-b47f-f12f8b296a62] No waiting events found dispatching network-vif-unplugged-c3f32695-0b6f-431f-8539-981f044d7198 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:59:17 user nova-compute[75100]: DEBUG nova.compute.manager [req-ff631522-80fb-43c9-b344-a35cafd0c90e req-0beacc13-b47f-4986-b5c0-c25cf257079f service nova] [instance: 81e579a0-93f3-4989-b47f-f12f8b296a62] Received event network-vif-unplugged-c3f32695-0b6f-431f-8539-981f044d7198 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 17:59:17 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 81e579a0-93f3-4989-b47f-f12f8b296a62] Instance destroyed successfully.
Nov 10 17:59:17 user nova-compute[75100]: DEBUG nova.objects.instance [None req-197e8454-a1b6-460a-b6cf-6166aa623beb tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] Lazy-loading 'resources' on Instance uuid 81e579a0-93f3-4989-b47f-f12f8b296a62 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:59:17 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-197e8454-a1b6-460a-b6cf-6166aa623beb tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:57:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-677819265',display_name='tempest-VolumesNegativeTest-instance-677819265',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-677819265',id=29,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T17:57:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ea8af95f4f5f417a854d2e60aeebbbe3',ramdisk_id='',reservation_id='r-0vxg60gp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1633160930',owner_user_name='tempest-VolumesNegativeTest-1633160930-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T17:57:34Z,user_data=None,user_id='cdc2d8dc446846ee85e698cd1f056294',uuid=81e579a0-93f3-4989-b47f-f12f8b296a62,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3f32695-0b6f-431f-8539-981f044d7198", "address": "fa:16:3e:44:60:7a", "network": {"id": "fe6ad35f-a7af-4931-a127-5ff8c9cf91df", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "cabf2ee94c5f40fa840ed5664129268a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3f32695-0b", "ovs_interfaceid": "c3f32695-0b6f-431f-8539-981f044d7198", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 17:59:17 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-197e8454-a1b6-460a-b6cf-6166aa623beb tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] Converting VIF {"id": "c3f32695-0b6f-431f-8539-981f044d7198", "address": "fa:16:3e:44:60:7a", "network": {"id": "fe6ad35f-a7af-4931-a127-5ff8c9cf91df", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "cabf2ee94c5f40fa840ed5664129268a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3f32695-0b", "ovs_interfaceid": "c3f32695-0b6f-431f-8539-981f044d7198", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:59:17 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-197e8454-a1b6-460a-b6cf-6166aa623beb tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:60:7a,bridge_name='br-int',has_traffic_filtering=True,id=c3f32695-0b6f-431f-8539-981f044d7198,network=Network(fe6ad35f-a7af-4931-a127-5ff8c9cf91df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3f32695-0b') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:59:17 user nova-compute[75100]: DEBUG os_vif [None req-197e8454-a1b6-460a-b6cf-6166aa623beb tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:60:7a,bridge_name='br-int',has_traffic_filtering=True,id=c3f32695-0b6f-431f-8539-981f044d7198,network=Network(fe6ad35f-a7af-4931-a127-5ff8c9cf91df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3f32695-0b') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 17:59:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc3f32695-0b, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:59:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:59:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d1cd7fdd-b70c-40d8-857e-d52b382cb616) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:59:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:59:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:17 user nova-compute[75100]: INFO os_vif [None req-197e8454-a1b6-460a-b6cf-6166aa623beb tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:60:7a,bridge_name='br-int',has_traffic_filtering=True,id=c3f32695-0b6f-431f-8539-981f044d7198,network=Network(fe6ad35f-a7af-4931-a127-5ff8c9cf91df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3f32695-0b')
Nov 10 17:59:17 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-197e8454-a1b6-460a-b6cf-6166aa623beb tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] [instance: 81e579a0-93f3-4989-b47f-f12f8b296a62] Deleting instance files /opt/stack/data/nova/instances/81e579a0-93f3-4989-b47f-f12f8b296a62_del
Nov 10 17:59:17 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-197e8454-a1b6-460a-b6cf-6166aa623beb tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] [instance: 81e579a0-93f3-4989-b47f-f12f8b296a62] Deletion of /opt/stack/data/nova/instances/81e579a0-93f3-4989-b47f-f12f8b296a62_del complete
Nov 10 17:59:17 user nova-compute[75100]: INFO nova.compute.manager [None req-197e8454-a1b6-460a-b6cf-6166aa623beb tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] [instance: 81e579a0-93f3-4989-b47f-f12f8b296a62] Took 0.72 seconds to destroy the instance on the hypervisor.
Nov 10 17:59:17 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-197e8454-a1b6-460a-b6cf-6166aa623beb tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 17:59:17 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: 81e579a0-93f3-4989-b47f-f12f8b296a62] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 17:59:17 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 81e579a0-93f3-4989-b47f-f12f8b296a62] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 17:59:18 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 81e579a0-93f3-4989-b47f-f12f8b296a62] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:59:18 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:59:18 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:59:18 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: 81e579a0-93f3-4989-b47f-f12f8b296a62] Took 0.65 seconds to deallocate network for instance.
Nov 10 17:59:18 user nova-compute[75100]: DEBUG nova.compute.manager [req-a50ca61e-a917-4e4d-9e5c-3dadf6d310f7 req-eba62a0e-d212-431d-8ac7-090462819696 service nova] [instance: 81e579a0-93f3-4989-b47f-f12f8b296a62] Received event network-vif-deleted-c3f32695-0b6f-431f-8539-981f044d7198 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:59:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-197e8454-a1b6-460a-b6cf-6166aa623beb tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:59:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-197e8454-a1b6-460a-b6cf-6166aa623beb tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:59:18 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-197e8454-a1b6-460a-b6cf-6166aa623beb tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:59:18 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-197e8454-a1b6-460a-b6cf-6166aa623beb tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:59:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-197e8454-a1b6-460a-b6cf-6166aa623beb tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.494s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:59:18 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-197e8454-a1b6-460a-b6cf-6166aa623beb tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] Deleted allocations for instance 81e579a0-93f3-4989-b47f-f12f8b296a62
Nov 10 17:59:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-197e8454-a1b6-460a-b6cf-6166aa623beb tempest-VolumesNegativeTest-1633160930 tempest-VolumesNegativeTest-1633160930-project-member] Lock "81e579a0-93f3-4989-b47f-f12f8b296a62" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.076s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:59:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:19 user nova-compute[75100]: DEBUG nova.compute.manager [req-4e577615-6f9b-4e98-bc3a-9f99527da97d req-a1dcab20-f9ca-4c47-a07b-3494aac331d2 service nova] [instance: 81e579a0-93f3-4989-b47f-f12f8b296a62] Received event network-vif-plugged-c3f32695-0b6f-431f-8539-981f044d7198 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:59:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4e577615-6f9b-4e98-bc3a-9f99527da97d req-a1dcab20-f9ca-4c47-a07b-3494aac331d2 service nova] Acquiring lock "81e579a0-93f3-4989-b47f-f12f8b296a62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:59:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4e577615-6f9b-4e98-bc3a-9f99527da97d req-a1dcab20-f9ca-4c47-a07b-3494aac331d2 service nova] Lock "81e579a0-93f3-4989-b47f-f12f8b296a62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:59:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4e577615-6f9b-4e98-bc3a-9f99527da97d req-a1dcab20-f9ca-4c47-a07b-3494aac331d2 service nova] Lock "81e579a0-93f3-4989-b47f-f12f8b296a62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:59:19 user nova-compute[75100]: DEBUG nova.compute.manager [req-4e577615-6f9b-4e98-bc3a-9f99527da97d req-a1dcab20-f9ca-4c47-a07b-3494aac331d2 service nova] [instance: 81e579a0-93f3-4989-b47f-f12f8b296a62] No waiting events found dispatching network-vif-plugged-c3f32695-0b6f-431f-8539-981f044d7198 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:59:19 user nova-compute[75100]: WARNING nova.compute.manager [req-4e577615-6f9b-4e98-bc3a-9f99527da97d req-a1dcab20-f9ca-4c47-a07b-3494aac331d2 service nova] [instance: 81e579a0-93f3-4989-b47f-f12f8b296a62] Received unexpected event network-vif-plugged-c3f32695-0b6f-431f-8539-981f044d7198 for instance with vm_state deleted and task_state None.
Nov 10 17:59:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-10863424-c0dd-4d36-9de0-27e8841f12da tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Acquiring lock "c19fc271-a248-4631-a11f-89b7ed73bf85" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:59:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-10863424-c0dd-4d36-9de0-27e8841f12da tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lock "c19fc271-a248-4631-a11f-89b7ed73bf85" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:59:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-10863424-c0dd-4d36-9de0-27e8841f12da tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Acquiring lock "c19fc271-a248-4631-a11f-89b7ed73bf85-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:59:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-10863424-c0dd-4d36-9de0-27e8841f12da tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lock "c19fc271-a248-4631-a11f-89b7ed73bf85-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:59:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-10863424-c0dd-4d36-9de0-27e8841f12da tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lock "c19fc271-a248-4631-a11f-89b7ed73bf85-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:59:19 user nova-compute[75100]: INFO nova.compute.manager [None req-10863424-c0dd-4d36-9de0-27e8841f12da tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Terminating instance
Nov 10 17:59:19 user nova-compute[75100]: DEBUG nova.compute.manager [None req-10863424-c0dd-4d36-9de0-27e8841f12da tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 17:59:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:20 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Instance destroyed successfully.
Nov 10 17:59:20 user nova-compute[75100]: DEBUG nova.objects.instance [None req-10863424-c0dd-4d36-9de0-27e8841f12da tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lazy-loading 'resources' on Instance uuid c19fc271-a248-4631-a11f-89b7ed73bf85 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:59:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-10863424-c0dd-4d36-9de0-27e8841f12da tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:44:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-871447999',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-871447999',id=1,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T17:44:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='72c970a503d74d32a1e2b71f086649fd',ramdisk_id='',reservation_id='r-m29zcg2f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2001759307',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T17:46:16Z,user_data=None,user_id='b79cb22ab5774ce8991f237bd2204555',uuid=c19fc271-a248-4631-a11f-89b7ed73bf85,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eedb3d8e-5619-4df9-aef9-bbc44db1dba9", "address": "fa:16:3e:ee:f9:3d", "network": {"id": "f240fae3-3d7b-4b6e-b04f-18550ab4d0a3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1007355777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c970a503d74d32a1e2b71f086649fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeedb3d8e-56", "ovs_interfaceid": "eedb3d8e-5619-4df9-aef9-bbc44db1dba9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 17:59:20 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-10863424-c0dd-4d36-9de0-27e8841f12da tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Converting VIF {"id": "eedb3d8e-5619-4df9-aef9-bbc44db1dba9", "address": "fa:16:3e:ee:f9:3d", "network": {"id": "f240fae3-3d7b-4b6e-b04f-18550ab4d0a3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1007355777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c970a503d74d32a1e2b71f086649fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeedb3d8e-56", "ovs_interfaceid": "eedb3d8e-5619-4df9-aef9-bbc44db1dba9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:59:20 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-10863424-c0dd-4d36-9de0-27e8841f12da tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:f9:3d,bridge_name='br-int',has_traffic_filtering=True,id=eedb3d8e-5619-4df9-aef9-bbc44db1dba9,network=Network(f240fae3-3d7b-4b6e-b04f-18550ab4d0a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeedb3d8e-56') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:59:20 user nova-compute[75100]: DEBUG os_vif [None req-10863424-c0dd-4d36-9de0-27e8841f12da tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:f9:3d,bridge_name='br-int',has_traffic_filtering=True,id=eedb3d8e-5619-4df9-aef9-bbc44db1dba9,network=Network(f240fae3-3d7b-4b6e-b04f-18550ab4d0a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeedb3d8e-56') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 17:59:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeedb3d8e-56, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:59:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0b3a976a-7130-4d99-8099-a924d8780f9f) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:59:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:59:20 user nova-compute[75100]: INFO os_vif [None req-10863424-c0dd-4d36-9de0-27e8841f12da tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:f9:3d,bridge_name='br-int',has_traffic_filtering=True,id=eedb3d8e-5619-4df9-aef9-bbc44db1dba9,network=Network(f240fae3-3d7b-4b6e-b04f-18550ab4d0a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeedb3d8e-56')
Nov 10 17:59:20 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-10863424-c0dd-4d36-9de0-27e8841f12da tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Deleting instance files /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85_del
Nov 10 17:59:20 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-10863424-c0dd-4d36-9de0-27e8841f12da tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Deletion of /opt/stack/data/nova/instances/c19fc271-a248-4631-a11f-89b7ed73bf85_del complete
Nov 10 17:59:20 user nova-compute[75100]: DEBUG nova.compute.manager [req-4f54be8a-c32f-497c-abd8-8c84a43a70a9 req-020ff62f-3d0f-4f7f-9803-99134247f971 service nova] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Received event network-changed-f33ff122-270e-4129-be5b-e67c0bc0708c {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:59:20 user nova-compute[75100]: DEBUG nova.compute.manager [req-4f54be8a-c32f-497c-abd8-8c84a43a70a9 req-020ff62f-3d0f-4f7f-9803-99134247f971 service nova] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Refreshing instance network info cache due to event network-changed-f33ff122-270e-4129-be5b-e67c0bc0708c. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 17:59:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4f54be8a-c32f-497c-abd8-8c84a43a70a9 req-020ff62f-3d0f-4f7f-9803-99134247f971 service nova] Acquiring lock "refresh_cache-ca2f4288-da43-4bf3-9ef4-fd53961fe74c" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:59:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4f54be8a-c32f-497c-abd8-8c84a43a70a9 req-020ff62f-3d0f-4f7f-9803-99134247f971 service nova] Acquired lock "refresh_cache-ca2f4288-da43-4bf3-9ef4-fd53961fe74c" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:59:20 user nova-compute[75100]: DEBUG nova.network.neutron [req-4f54be8a-c32f-497c-abd8-8c84a43a70a9 req-020ff62f-3d0f-4f7f-9803-99134247f971 service nova] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Refreshing network info cache for port f33ff122-270e-4129-be5b-e67c0bc0708c {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 17:59:20 user nova-compute[75100]: INFO nova.compute.manager [None req-10863424-c0dd-4d36-9de0-27e8841f12da tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 10 17:59:20 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-10863424-c0dd-4d36-9de0-27e8841f12da tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 17:59:20 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 17:59:20 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 17:59:20 user nova-compute[75100]: DEBUG nova.network.neutron [req-4f54be8a-c32f-497c-abd8-8c84a43a70a9 req-020ff62f-3d0f-4f7f-9803-99134247f971 service nova] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Updated VIF entry in instance network info cache for port f33ff122-270e-4129-be5b-e67c0bc0708c. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 17:59:20 user nova-compute[75100]: DEBUG nova.network.neutron [req-4f54be8a-c32f-497c-abd8-8c84a43a70a9 req-020ff62f-3d0f-4f7f-9803-99134247f971 service nova] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Updating instance_info_cache with network_info: [{"id": "f33ff122-270e-4129-be5b-e67c0bc0708c", "address": "fa:16:3e:e0:bd:a4", "network": {"id": "78d86418-c0e0-4cc2-8f4f-262f600f7d66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2054827063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19cfb454e59745bf9c77d7a7ede2bc0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33ff122-27", "ovs_interfaceid": "f33ff122-270e-4129-be5b-e67c0bc0708c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:59:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4f54be8a-c32f-497c-abd8-8c84a43a70a9 req-020ff62f-3d0f-4f7f-9803-99134247f971 service nova] Releasing lock "refresh_cache-ca2f4288-da43-4bf3-9ef4-fd53961fe74c" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:59:21 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:59:21 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Took 0.53 seconds to deallocate network for instance.
Nov 10 17:59:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-10863424-c0dd-4d36-9de0-27e8841f12da tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:59:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-10863424-c0dd-4d36-9de0-27e8841f12da tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:59:21 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-10863424-c0dd-4d36-9de0-27e8841f12da tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:59:21 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-10863424-c0dd-4d36-9de0-27e8841f12da tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:59:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-10863424-c0dd-4d36-9de0-27e8841f12da tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.415s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:59:21 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-10863424-c0dd-4d36-9de0-27e8841f12da tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Deleted allocations for instance c19fc271-a248-4631-a11f-89b7ed73bf85
Nov 10 17:59:21 user nova-compute[75100]: DEBUG nova.compute.manager [req-cf0e91c4-d20f-432d-b45f-ae38fc4cfbf5 req-46f13e6a-ce75-4ba7-8d47-4db5cbc0e87a service nova] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Received event network-vif-unplugged-eedb3d8e-5619-4df9-aef9-bbc44db1dba9 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:59:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cf0e91c4-d20f-432d-b45f-ae38fc4cfbf5 req-46f13e6a-ce75-4ba7-8d47-4db5cbc0e87a service nova] Acquiring lock "c19fc271-a248-4631-a11f-89b7ed73bf85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:59:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cf0e91c4-d20f-432d-b45f-ae38fc4cfbf5 req-46f13e6a-ce75-4ba7-8d47-4db5cbc0e87a service nova] Lock "c19fc271-a248-4631-a11f-89b7ed73bf85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:59:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cf0e91c4-d20f-432d-b45f-ae38fc4cfbf5 req-46f13e6a-ce75-4ba7-8d47-4db5cbc0e87a service nova] Lock "c19fc271-a248-4631-a11f-89b7ed73bf85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:59:21 user nova-compute[75100]: DEBUG nova.compute.manager [req-cf0e91c4-d20f-432d-b45f-ae38fc4cfbf5 req-46f13e6a-ce75-4ba7-8d47-4db5cbc0e87a service nova] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] No waiting events found dispatching network-vif-unplugged-eedb3d8e-5619-4df9-aef9-bbc44db1dba9 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:59:21 user nova-compute[75100]: WARNING nova.compute.manager [req-cf0e91c4-d20f-432d-b45f-ae38fc4cfbf5 req-46f13e6a-ce75-4ba7-8d47-4db5cbc0e87a service nova] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Received unexpected event network-vif-unplugged-eedb3d8e-5619-4df9-aef9-bbc44db1dba9 for instance with vm_state deleted and task_state None.
Nov 10 17:59:21 user nova-compute[75100]: DEBUG nova.compute.manager [req-cf0e91c4-d20f-432d-b45f-ae38fc4cfbf5 req-46f13e6a-ce75-4ba7-8d47-4db5cbc0e87a service nova] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Received event network-vif-plugged-eedb3d8e-5619-4df9-aef9-bbc44db1dba9 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:59:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cf0e91c4-d20f-432d-b45f-ae38fc4cfbf5 req-46f13e6a-ce75-4ba7-8d47-4db5cbc0e87a service nova] Acquiring lock "c19fc271-a248-4631-a11f-89b7ed73bf85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:59:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cf0e91c4-d20f-432d-b45f-ae38fc4cfbf5 req-46f13e6a-ce75-4ba7-8d47-4db5cbc0e87a service nova] Lock "c19fc271-a248-4631-a11f-89b7ed73bf85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:59:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cf0e91c4-d20f-432d-b45f-ae38fc4cfbf5 req-46f13e6a-ce75-4ba7-8d47-4db5cbc0e87a service nova] Lock "c19fc271-a248-4631-a11f-89b7ed73bf85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:59:21 user nova-compute[75100]: DEBUG nova.compute.manager [req-cf0e91c4-d20f-432d-b45f-ae38fc4cfbf5 req-46f13e6a-ce75-4ba7-8d47-4db5cbc0e87a service nova] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] No waiting events found dispatching network-vif-plugged-eedb3d8e-5619-4df9-aef9-bbc44db1dba9 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:59:21 user nova-compute[75100]: WARNING nova.compute.manager [req-cf0e91c4-d20f-432d-b45f-ae38fc4cfbf5 req-46f13e6a-ce75-4ba7-8d47-4db5cbc0e87a service nova] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Received unexpected event network-vif-plugged-eedb3d8e-5619-4df9-aef9-bbc44db1dba9 for instance with vm_state deleted and task_state None.
Nov 10 17:59:21 user nova-compute[75100]: DEBUG nova.compute.manager [req-cf0e91c4-d20f-432d-b45f-ae38fc4cfbf5 req-46f13e6a-ce75-4ba7-8d47-4db5cbc0e87a service nova] [instance: c19fc271-a248-4631-a11f-89b7ed73bf85] Received event network-vif-deleted-eedb3d8e-5619-4df9-aef9-bbc44db1dba9 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:59:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-10863424-c0dd-4d36-9de0-27e8841f12da tempest-ServerBootFromVolumeStableRescueTest-2001759307 tempest-ServerBootFromVolumeStableRescueTest-2001759307-project-member] Lock "c19fc271-a248-4631-a11f-89b7ed73bf85" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.029s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:59:23 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:59:23 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:59:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:24 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:59:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:59:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:59:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:59:24 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 17:59:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:59:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:59:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:59:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:59:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/989f3ce5-067b-45e4-a2e5-445024e13202/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:59:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/989f3ce5-067b-45e4-a2e5-445024e13202/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:59:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/989f3ce5-067b-45e4-a2e5-445024e13202/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:59:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/989f3ce5-067b-45e4-a2e5-445024e13202/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:59:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2f4288-da43-4bf3-9ef4-fd53961fe74c/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:59:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2f4288-da43-4bf3-9ef4-fd53961fe74c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:59:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2f4288-da43-4bf3-9ef4-fd53961fe74c/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:59:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2f4288-da43-4bf3-9ef4-fd53961fe74c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:59:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 17:59:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7fbe35b-4794-4eb9-8033-923247064458/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:59:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7fbe35b-4794-4eb9-8033-923247064458/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:59:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7fbe35b-4794-4eb9-8033-923247064458/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:59:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7fbe35b-4794-4eb9-8033-923247064458/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:59:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 17:59:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:59:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:59:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:59:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:59:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:59:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:59:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:59:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:59:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:59:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:59:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:59:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:59:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 17:59:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adf9e657-d366-4afd-a752-87e69b73eb81/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:59:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adf9e657-d366-4afd-a752-87e69b73eb81/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:59:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adf9e657-d366-4afd-a752-87e69b73eb81/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:59:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adf9e657-d366-4afd-a752-87e69b73eb81/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:59:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 17:59:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9033f537-bdeb-412c-9337-4ad86f4467b2/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:59:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9033f537-bdeb-412c-9337-4ad86f4467b2/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:59:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9033f537-bdeb-412c-9337-4ad86f4467b2/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:59:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9033f537-bdeb-412c-9337-4ad86f4467b2/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:59:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 17:59:28 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:59:28 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:59:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Hypervisor/Node resource view: name=user free_ram=7371MB free_disk=24.524452209472656GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 17:59:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:59:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:59:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:59:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 3e14de19-540d-4dc2-a058-6874d8d14478 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:59:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:59:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 9033f537-bdeb-412c-9337-4ad86f4467b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:59:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 989f3ce5-067b-45e4-a2e5-445024e13202 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:59:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance c7fbe35b-4794-4eb9-8033-923247064458 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:59:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance adf9e657-d366-4afd-a752-87e69b73eb81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:59:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 6d227210-c4df-4aa7-9969-70fa137aeb63 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:59:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance ca2f4288-da43-4bf3-9ef4-fd53961fe74c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:59:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 228aa1b0-1868-4bfe-b322-ca6a6406375c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:59:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 17:59:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 17:59:28 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:59:28 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:59:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 17:59:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.466s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:59:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:59:30 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:59:30 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:59:30 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 17:59:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "refresh_cache-22c021d9-c8e4-455d-8e2a-a9cdfbb38f75" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:59:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquired lock "refresh_cache-22c021d9-c8e4-455d-8e2a-a9cdfbb38f75" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:59:31 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 17:59:31 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Updating instance_info_cache with network_info: [{"id": "9855a14c-55c7-4a35-a4cc-7085dfbda684", "address": "fa:16:3e:02:b1:a1", "network": {"id": "bf1edb58-ef26-40ca-8ec9-853fa05de13d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1416469583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7bb141ef59487dbb2ce6243c5002af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9855a14c-55", "ovs_interfaceid": "9855a14c-55c7-4a35-a4cc-7085dfbda684", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:59:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Releasing lock "refresh_cache-22c021d9-c8e4-455d-8e2a-a9cdfbb38f75" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:59:31 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 17:59:31 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:59:31 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:59:31 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 17:59:33 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-42b37a1d-0f65-478a-a0dc-fdcf16648313 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9033f537-bdeb-412c-9337-4ad86f4467b2 is timed out.
Nov 10 17:59:33 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-42b37a1d-0f65-478a-a0dc-fdcf16648313 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Successfully detached device vdb from instance 9033f537-bdeb-412c-9337-4ad86f4467b2 from the live domain config.
Nov 10 17:59:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42b37a1d-0f65-478a-a0dc-fdcf16648313 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 17:59:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-42b37a1d-0f65-478a-a0dc-fdcf16648313 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, {'target_iqn': 'iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yjIaTUJi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 17:59:33 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-42b37a1d-0f65-478a-a0dc-fdcf16648313 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 17:59:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-42b37a1d-0f65-478a-a0dc-fdcf16648313 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 17:59:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-42b37a1d-0f65-478a-a0dc-fdcf16648313 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 17:59:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:59:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:59:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c539f585-fcaf-4184-965c-313712c5aeb0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:59:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-42b37a1d-0f65-478a-a0dc-fdcf16648313 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 17:59:33 user nova-compute[75100]: No targets found.
Nov 10 17:59:33 user nova-compute[75100]: iSNS:
Nov 10 17:59:33 user nova-compute[75100]: No targets found.
Nov 10 17:59:33 user nova-compute[75100]: STATIC:
Nov 10 17:59:33 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5
Nov 10 17:59:33 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 17:59:33 user nova-compute[75100]:                 Iface Name: default
Nov 10 17:59:33 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0
Nov 10 17:59:33 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 17:59:33 user nova-compute[75100]:                 Iface Name: default
Nov 10 17:59:33 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308
Nov 10 17:59:33 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 17:59:33 user nova-compute[75100]:                 Iface Name: default
Nov 10 17:59:33 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652
Nov 10 17:59:33 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 17:59:33 user nova-compute[75100]:                 Iface Name: default
Nov 10 17:59:33 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d
Nov 10 17:59:33 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 17:59:33 user nova-compute[75100]:                 Iface Name: default
Nov 10 17:59:33 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00
Nov 10 17:59:33 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 17:59:33 user nova-compute[75100]:                 Iface Name: default
Nov 10 17:59:33 user nova-compute[75100]: FIRMWARE:
Nov 10 17:59:33 user nova-compute[75100]: No targets found.
Nov 10 17:59:33 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:59:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-42b37a1d-0f65-478a-a0dc-fdcf16648313 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 17:59:33 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 17:59:33 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 17:59:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-42b37a1d-0f65-478a-a0dc-fdcf16648313 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 17:59:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:59:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:59:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c132eb8-4f72-4024-aaed-11884a94b88d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:59:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:59:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:59:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[17324a79-8ed5-44cc-bd96-c8efd65e6195]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:59:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-42b37a1d-0f65-478a-a0dc-fdcf16648313 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)
Nov 10 17:59:33 user nova-compute[75100]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 (non-flash)
Nov 10 17:59:33 user nova-compute[75100]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 (non-flash)
Nov 10 17:59:33 user nova-compute[75100]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5 (non-flash)
Nov 10 17:59:33 user nova-compute[75100]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d (non-flash)
Nov 10 17:59:33 user nova-compute[75100]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 (non-flash)
Nov 10 17:59:33 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:59:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-42b37a1d-0f65-478a-a0dc-fdcf16648313 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 (non-flash)
Nov 10 17:59:33 user nova-compute[75100]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 (non-flash)
Nov 10 17:59:33 user nova-compute[75100]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 (non-flash)
Nov 10 17:59:33 user nova-compute[75100]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5 (non-flash)
Nov 10 17:59:33 user nova-compute[75100]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d (non-flash)
Nov 10 17:59:33 user nova-compute[75100]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 (non-flash)
Nov 10 17:59:33 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 17:59:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-42b37a1d-0f65-478a-a0dc-fdcf16648313 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3bc5b5000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652'): ({'sdd'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 17:59:33 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-42b37a1d-0f65-478a-a0dc-fdcf16648313 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Removing single pathed devices sdd {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 17:59:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:59:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:59:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf27017a-5947-48aa-bd44-2d760e53d970]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:59:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:59:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:59:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9222a08a-d599-4e94-b1c7-419d0a04204d]: (4, ('ok\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:59:33 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-42b37a1d-0f65-478a-a0dc-fdcf16648313 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Flushing IO for device /dev/sdd {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 17:59:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:59:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:59:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f94046-4068-4187-b33b-bbd5f77e4a9e]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:59:33 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-42b37a1d-0f65-478a-a0dc-fdcf16648313 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 17:59:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:59:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:59:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d10b5ca-1cd2-412a-b437-0d33e612a292]: (4, ('1', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:59:33 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-42b37a1d-0f65-478a-a0dc-fdcf16648313 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 17:59:33 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-42b37a1d-0f65-478a-a0dc-fdcf16648313 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] SCSI volumes sdd have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 17:59:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-42b37a1d-0f65-478a-a0dc-fdcf16648313 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 17:59:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:59:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:59:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[56bd1909-eaeb-4a9c-b67d-144883fd985e]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:59:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-42b37a1d-0f65-478a-a0dc-fdcf16648313 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:59:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 -p 172.16.0.220:3260 --logout {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:59:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:59:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1037c420-7bff-4e79-ab08-458c34575454]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:59:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-42b37a1d-0f65-478a-a0dc-fdcf16648313 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652, portal: 172.16.0.220,3260]
Nov 10 17:59:33 user nova-compute[75100]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652, portal: 172.16.0.220,3260] successful.
Nov 10 17:59:33 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:59:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 -p 172.16.0.220:3260 --op delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:59:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f802b50f-f3b6-4f97-a95e-f838ec169652 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:59:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7789fae6-d493-4172-a16c-1022279e1a2a]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:59:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-42b37a1d-0f65-478a-a0dc-fdcf16648313 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:59:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-42b37a1d-0f65-478a-a0dc-fdcf16648313 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 17:59:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-42b37a1d-0f65-478a-a0dc-fdcf16648313 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] <== disconnect_volume: return (330ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 17:59:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42b37a1d-0f65-478a-a0dc-fdcf16648313 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 17:59:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:34 user nova-compute[75100]: DEBUG nova.objects.instance [None req-42b37a1d-0f65-478a-a0dc-fdcf16648313 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lazy-loading 'flavor' on Instance uuid 9033f537-bdeb-412c-9337-4ad86f4467b2 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:59:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-42b37a1d-0f65-478a-a0dc-fdcf16648313 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "9033f537-bdeb-412c-9337-4ad86f4467b2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.942s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:59:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Acquiring lock "ca2f4288-da43-4bf3-9ef4-fd53961fe74c" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:59:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "ca2f4288-da43-4bf3-9ef4-fd53961fe74c" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:59:39 user nova-compute[75100]: INFO nova.compute.manager [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Rebooting instance
Nov 10 17:59:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Acquiring lock "refresh_cache-ca2f4288-da43-4bf3-9ef4-fd53961fe74c" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:59:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Acquired lock "refresh_cache-ca2f4288-da43-4bf3-9ef4-fd53961fe74c" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:59:39 user nova-compute[75100]: DEBUG nova.network.neutron [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 17:59:40 user nova-compute[75100]: DEBUG nova.network.neutron [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Updating instance_info_cache with network_info: [{"id": "f33ff122-270e-4129-be5b-e67c0bc0708c", "address": "fa:16:3e:e0:bd:a4", "network": {"id": "78d86418-c0e0-4cc2-8f4f-262f600f7d66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2054827063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19cfb454e59745bf9c77d7a7ede2bc0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33ff122-27", "ovs_interfaceid": "f33ff122-270e-4129-be5b-e67c0bc0708c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:59:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Releasing lock "refresh_cache-ca2f4288-da43-4bf3-9ef4-fd53961fe74c" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:59:40 user nova-compute[75100]: DEBUG nova.compute.manager [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 17:59:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:40 user nova-compute[75100]: DEBUG nova.compute.manager [req-559e47ae-2212-4122-ae67-bc8bda74f66e req-64aa867b-2391-4289-a7d1-a37e41a13249 service nova] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Received event network-vif-unplugged-f33ff122-270e-4129-be5b-e67c0bc0708c {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:59:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-559e47ae-2212-4122-ae67-bc8bda74f66e req-64aa867b-2391-4289-a7d1-a37e41a13249 service nova] Acquiring lock "ca2f4288-da43-4bf3-9ef4-fd53961fe74c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:59:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-559e47ae-2212-4122-ae67-bc8bda74f66e req-64aa867b-2391-4289-a7d1-a37e41a13249 service nova] Lock "ca2f4288-da43-4bf3-9ef4-fd53961fe74c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:59:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-559e47ae-2212-4122-ae67-bc8bda74f66e req-64aa867b-2391-4289-a7d1-a37e41a13249 service nova] Lock "ca2f4288-da43-4bf3-9ef4-fd53961fe74c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:59:40 user nova-compute[75100]: DEBUG nova.compute.manager [req-559e47ae-2212-4122-ae67-bc8bda74f66e req-64aa867b-2391-4289-a7d1-a37e41a13249 service nova] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] No waiting events found dispatching network-vif-unplugged-f33ff122-270e-4129-be5b-e67c0bc0708c {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:59:40 user nova-compute[75100]: WARNING nova.compute.manager [req-559e47ae-2212-4122-ae67-bc8bda74f66e req-64aa867b-2391-4289-a7d1-a37e41a13249 service nova] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Received unexpected event network-vif-unplugged-f33ff122-270e-4129-be5b-e67c0bc0708c for instance with vm_state active and task_state reboot_started_hard.
Nov 10 17:59:41 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Instance destroyed successfully.
Nov 10 17:59:41 user nova-compute[75100]: DEBUG nova.objects.instance [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lazy-loading 'resources' on Instance uuid ca2f4288-da43-4bf3-9ef4-fd53961fe74c {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:56:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2141027010',display_name='tempest-TestMinimumBasicScenario-server-2141027010',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2141027010',id=28,image_ref='9aca461c-4c8d-4e01-96d9-5330997a3b2b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+9Ljzn6uNPZfvsGzjgf1rzPigyBeIjo1hMLKvKaNMvgjphzLJkq/N+5Rj1I8Bo9ee1XzM24XDugNOdWVPL1ENg5TesGhg9QW7vu/ykAEwYg59w+wwxgQEjuXd/8c6JAA==',key_name='tempest-TestMinimumBasicScenario-2102848825',keypairs=<?>,launch_index=0,launched_at=2023-11-10T17:56:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='19cfb454e59745bf9c77d7a7ede2bc0e',ramdisk_id='',reservation_id='r-nrbksuex',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9aca461c-4c8d-4e01-96d9-5330997a3b2b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-281006384',owner_user_name='tempest-TestMinimumBasicScenario-281006384-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T17:59:40Z,user_data=None,user_id='4d873ec5a11a4ccdb868fef673ffc568',uuid=ca2f4288-da43-4bf3-9ef4-fd53961fe74c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f33ff122-270e-4129-be5b-e67c0bc0708c", "address": "fa:16:3e:e0:bd:a4", "network": {"id": "78d86418-c0e0-4cc2-8f4f-262f600f7d66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2054827063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19cfb454e59745bf9c77d7a7ede2bc0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33ff122-27", "ovs_interfaceid": "f33ff122-270e-4129-be5b-e67c0bc0708c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Converting VIF {"id": "f33ff122-270e-4129-be5b-e67c0bc0708c", "address": "fa:16:3e:e0:bd:a4", "network": {"id": "78d86418-c0e0-4cc2-8f4f-262f600f7d66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2054827063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19cfb454e59745bf9c77d7a7ede2bc0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33ff122-27", "ovs_interfaceid": "f33ff122-270e-4129-be5b-e67c0bc0708c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:bd:a4,bridge_name='br-int',has_traffic_filtering=True,id=f33ff122-270e-4129-be5b-e67c0bc0708c,network=Network(78d86418-c0e0-4cc2-8f4f-262f600f7d66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf33ff122-27') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG os_vif [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:bd:a4,bridge_name='br-int',has_traffic_filtering=True,id=f33ff122-270e-4129-be5b-e67c0bc0708c,network=Network(78d86418-c0e0-4cc2-8f4f-262f600f7d66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf33ff122-27') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf33ff122-27, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bb681ae5-deb6-470e-be91-0994ea7e0628) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:41 user nova-compute[75100]: INFO os_vif [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:bd:a4,bridge_name='br-int',has_traffic_filtering=True,id=f33ff122-270e-4129-be5b-e67c0bc0708c,network=Network(78d86418-c0e0-4cc2-8f4f-262f600f7d66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf33ff122-27')
Nov 10 17:59:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, {'target_iqn': 'iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zlHmpLBc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 17:59:41 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 17:59:41 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b80fd80-cd78-47b3-940a-aad883a16d02]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 17:59:41 user nova-compute[75100]: No targets found.
Nov 10 17:59:41 user nova-compute[75100]: iSNS:
Nov 10 17:59:41 user nova-compute[75100]: No targets found.
Nov 10 17:59:41 user nova-compute[75100]: STATIC:
Nov 10 17:59:41 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5
Nov 10 17:59:41 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 17:59:41 user nova-compute[75100]:                 Iface Name: default
Nov 10 17:59:41 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0
Nov 10 17:59:41 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 17:59:41 user nova-compute[75100]:                 Iface Name: default
Nov 10 17:59:41 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308
Nov 10 17:59:41 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 17:59:41 user nova-compute[75100]:                 Iface Name: default
Nov 10 17:59:41 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d
Nov 10 17:59:41 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 17:59:41 user nova-compute[75100]:                 Iface Name: default
Nov 10 17:59:41 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00
Nov 10 17:59:41 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 17:59:41 user nova-compute[75100]:                 Iface Name: default
Nov 10 17:59:41 user nova-compute[75100]: FIRMWARE:
Nov 10 17:59:41 user nova-compute[75100]: No targets found.
Nov 10 17:59:41 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 17:59:41 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 17:59:41 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5636ff02-e156-4307-9d5d-3fba383ea935]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6c6be6-a7fc-4564-bfe1-5a3a602d11ca]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 (non-flash)
Nov 10 17:59:41 user nova-compute[75100]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 (non-flash)
Nov 10 17:59:41 user nova-compute[75100]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5 (non-flash)
Nov 10 17:59:41 user nova-compute[75100]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d (non-flash)
Nov 10 17:59:41 user nova-compute[75100]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 (non-flash)
Nov 10 17:59:41 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 (non-flash)
Nov 10 17:59:41 user nova-compute[75100]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 (non-flash)
Nov 10 17:59:41 user nova-compute[75100]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5 (non-flash)
Nov 10 17:59:41 user nova-compute[75100]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d (non-flash)
Nov 10 17:59:41 user nova-compute[75100]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 (non-flash)
Nov 10 17:59:41 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3dc2a4e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0'): ({'sde'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Removing single pathed devices sde {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4831012d-b7c5-4d5b-9c9d-484e8c1deaf2]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.026s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d21f822-59bc-42af-bb16-3008c2e3f4e9]: (4, ('ok\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Flushing IO for device /dev/sde {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[70084713-abd2-4d58-aa1c-b7c058770b85]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.050s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa06b52a-eae0-4840-9697-468263b8eaaa]: (4, ('1', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] SCSI volumes sde have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9252a5c3-0770-4d12-bfaf-d0df7a27fb1d]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 -p 172.16.0.220:3260 --logout {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d7ab65-fc61-4e22-b561-485776a0ddf7]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0, portal: 172.16.0.220,3260]
Nov 10 17:59:41 user nova-compute[75100]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0, portal: 172.16.0.220,3260] successful.
Nov 10 17:59:41 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 -p 172.16.0.220:3260 --op delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[184e490d-49e1-4395-9d7d-871b032fe985]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] <== disconnect_volume: return (353ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Start _get_guest_xml network_info=[{"id": "f33ff122-270e-4129-be5b-e67c0bc0708c", "address": "fa:16:3e:e0:bd:a4", "network": {"id": "78d86418-c0e0-4cc2-8f4f-262f600f7d66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2054827063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19cfb454e59745bf9c77d7a7ede2bc0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33ff122-27", "ovs_interfaceid": "f33ff122-270e-4129-be5b-e67c0bc0708c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=9aca461c-4c8d-4e01-96d9-5330997a3b2b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '9aca461c-4c8d-4e01-96d9-5330997a3b2b'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zlHmpLBc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'ca2f4288-da43-4bf3-9ef4-fd53961fe74c', 'attached_at': '', 'detached_at': '', 'volume_id': 'eb371cd8-f98e-4eb4-8047-76cc41e0d6d0', 'serial': 'eb371cd8-f98e-4eb4-8047-76cc41e0d6d0'}, 'mount_device': '/dev/vdb', 'attachment_id': '2b0e88bb-2ff6-48ad-9613-cf646d28c22f', 'device_type': 'disk', 'guest_format': None, 'boot_index': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 17:59:41 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:59:41 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:59:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T17:40:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=9aca461c-4c8d-4e01-96d9-5330997a3b2b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG nova.objects.instance [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lazy-loading 'vcpu_model' on Instance uuid ca2f4288-da43-4bf3-9ef4-fd53961fe74c {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG nova.objects.base [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Object Instance<ca2f4288-da43-4bf3-9ef4-fd53961fe74c> lazy-loaded attributes: resources,vcpu_model {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zlHmpLBc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 17:59:41 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 17:59:41 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 17:59:41 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 17:59:41 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 17:59:41 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 17:59:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 -p 172.16.0.220:3260 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[34174394-f52d-4aa8-9e1a-9e67e46dbc7f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 17:59:41 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c7124e-512c-4e27-a873-f029bb753b4e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0] added\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Acquiring lock "ce634a11-5628-4f1c-8437-95f26519d8a0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "ce634a11-5628-4f1c-8437-95f26519d8a0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0] added
Nov 10 17:59:41 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG nova.compute.manager [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd67dfc-ce60-4ccb-aead-81dfbcd1233a]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[148118fc-cbfd-4495-9e4a-310010c4b729]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zlHmpLBc {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zlHmpLBc" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd81393-4357-42eb-bbad-fe47ccc84a9b]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zlHmpLBc'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff65e852-7c02-445b-b219-5ce2f4791536]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 17:59:41 user nova-compute[75100]: INFO nova.compute.claims [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Claim successful on node user
Nov 10 17:59:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8bc3064-6a17-45e6-b8de-f8a05c0c8c0f]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 (non-flash)
Nov 10 17:59:41 user nova-compute[75100]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 (non-flash)
Nov 10 17:59:41 user nova-compute[75100]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5 (non-flash)
Nov 10 17:59:41 user nova-compute[75100]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d (non-flash)
Nov 10 17:59:41 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 (non-flash)
Nov 10 17:59:41 user nova-compute[75100]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 (non-flash)
Nov 10 17:59:41 user nova-compute[75100]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5 (non-flash)
Nov 10 17:59:41 user nova-compute[75100]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d (non-flash)
Nov 10 17:59:41 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 17:59:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 -p 172.16.0.220:3260 --login {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:59:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:59:42 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5b31e8-c376-4805-a9ed-d91970df1d05]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:59:42 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0, portal: 172.16.0.220,3260]
Nov 10 17:59:42 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0, portal: 172.16.0.220,3260] successful.
Nov 10 17:59:42 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:59:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:59:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:59:42 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f026606-5bed-443d-862e-0880dce95881]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:59:42 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:59:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:59:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:59:42 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33eb1a2-067c-4c4b-982a-bdbf55e6d93d]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:59:42 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 (non-flash)
Nov 10 17:59:42 user nova-compute[75100]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 (non-flash)
Nov 10 17:59:42 user nova-compute[75100]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5 (non-flash)
Nov 10 17:59:42 user nova-compute[75100]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d (non-flash)
Nov 10 17:59:42 user nova-compute[75100]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 (non-flash)
Nov 10 17:59:42 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:59:42 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 (non-flash)
Nov 10 17:59:42 user nova-compute[75100]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 (non-flash)
Nov 10 17:59:42 user nova-compute[75100]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5 (non-flash)
Nov 10 17:59:42 user nova-compute[75100]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d (non-flash)
Nov 10 17:59:42 user nova-compute[75100]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 (non-flash)
Nov 10 17:59:42 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 17:59:42 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 17:59:42 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 17:59:42 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] HCTL ('35', '-', '-', 0) found on session 23 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 17:59:42 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 17:59:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:59:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:59:42 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[afed0c8c-7631-45ef-a739-a6d9a8655cf9]: (4, ('- - 0', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:59:42 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Searching for a device in session 23 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 17:59:42 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zlHmpLBc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 17:59:42 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:59:42 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:59:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.525s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:59:42 user nova-compute[75100]: DEBUG nova.compute.manager [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 17:59:42 user nova-compute[75100]: DEBUG nova.compute.manager [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 17:59:42 user nova-compute[75100]: DEBUG nova.network.neutron [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 17:59:42 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 17:59:42 user nova-compute[75100]: DEBUG nova.compute.manager [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 17:59:42 user nova-compute[75100]: DEBUG nova.policy [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '805917c846f34264b51388bfd9a8413f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae38bb92c5474a578f3827bdae12cd74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 17:59:42 user nova-compute[75100]: DEBUG nova.compute.manager [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 17:59:42 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 17:59:42 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Creating image(s)
Nov 10 17:59:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Acquiring lock "/opt/stack/data/nova/instances/ce634a11-5628-4f1c-8437-95f26519d8a0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:59:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "/opt/stack/data/nova/instances/ce634a11-5628-4f1c-8437-95f26519d8a0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:59:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "/opt/stack/data/nova/instances/ce634a11-5628-4f1c-8437-95f26519d8a0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:59:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:59:42 user nova-compute[75100]: DEBUG nova.compute.manager [req-50414703-278c-4618-9721-681878934bc0 req-70082434-df86-42c9-a0b8-d2c28dd89c8d service nova] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Received event network-vif-plugged-f33ff122-270e-4129-be5b-e67c0bc0708c {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:59:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-50414703-278c-4618-9721-681878934bc0 req-70082434-df86-42c9-a0b8-d2c28dd89c8d service nova] Acquiring lock "ca2f4288-da43-4bf3-9ef4-fd53961fe74c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:59:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-50414703-278c-4618-9721-681878934bc0 req-70082434-df86-42c9-a0b8-d2c28dd89c8d service nova] Lock "ca2f4288-da43-4bf3-9ef4-fd53961fe74c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:59:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-50414703-278c-4618-9721-681878934bc0 req-70082434-df86-42c9-a0b8-d2c28dd89c8d service nova] Lock "ca2f4288-da43-4bf3-9ef4-fd53961fe74c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:59:42 user nova-compute[75100]: DEBUG nova.compute.manager [req-50414703-278c-4618-9721-681878934bc0 req-70082434-df86-42c9-a0b8-d2c28dd89c8d service nova] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] No waiting events found dispatching network-vif-plugged-f33ff122-270e-4129-be5b-e67c0bc0708c {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:59:42 user nova-compute[75100]: WARNING nova.compute.manager [req-50414703-278c-4618-9721-681878934bc0 req-70082434-df86-42c9-a0b8-d2c28dd89c8d service nova] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Received unexpected event network-vif-plugged-f33ff122-270e-4129-be5b-e67c0bc0708c for instance with vm_state active and task_state reboot_started_hard.
Nov 10 17:59:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.177s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:59:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Acquiring lock "818b9e28e061d41a38d903968b229be2ed9ba520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:59:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:59:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:59:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.182s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:59:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/ce634a11-5628-4f1c-8437-95f26519d8a0/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:59:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/ce634a11-5628-4f1c-8437-95f26519d8a0/disk 1073741824" returned: 0 in 0.055s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:59:43 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 17:59:43 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '23536356564656562', 'path': '/dev/sdd'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 17:59:43 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23536356564656562', 'path': '/dev/sdd'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 17:59:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:59:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:59:43 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:56:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2141027010',display_name='tempest-TestMinimumBasicScenario-server-2141027010',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2141027010',id=28,image_ref='9aca461c-4c8d-4e01-96d9-5330997a3b2b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+9Ljzn6uNPZfvsGzjgf1rzPigyBeIjo1hMLKvKaNMvgjphzLJkq/N+5Rj1I8Bo9ee1XzM24XDugNOdWVPL1ENg5TesGhg9QW7vu/ykAEwYg59w+wwxgQEjuXd/8c6JAA==',key_name='tempest-TestMinimumBasicScenario-2102848825',keypairs=<?>,launch_index=0,launched_at=2023-11-10T17:56:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='19cfb454e59745bf9c77d7a7ede2bc0e',ramdisk_id='',reservation_id='r-nrbksuex',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9aca461c-4c8d-4e01-96d9-5330997a3b2b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-281006384',owner_user_name='tempest-TestMinimumBasicScenario-281006384-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T17:59:40Z,user_data=None,user_id='4d873ec5a11a4ccdb868fef673ffc568',uuid=ca2f4288-da43-4bf3-9ef4-fd53961fe74c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f33ff122-270e-4129-be5b-e67c0bc0708c", "address": "fa:16:3e:e0:bd:a4", "network": {"id": "78d86418-c0e0-4cc2-8f4f-262f600f7d66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2054827063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19cfb454e59745bf9c77d7a7ede2bc0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33ff122-27", "ovs_interfaceid": "f33ff122-270e-4129-be5b-e67c0bc0708c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 17:59:43 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Converting VIF {"id": "f33ff122-270e-4129-be5b-e67c0bc0708c", "address": "fa:16:3e:e0:bd:a4", "network": {"id": "78d86418-c0e0-4cc2-8f4f-262f600f7d66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2054827063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19cfb454e59745bf9c77d7a7ede2bc0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33ff122-27", "ovs_interfaceid": "f33ff122-270e-4129-be5b-e67c0bc0708c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:59:43 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:bd:a4,bridge_name='br-int',has_traffic_filtering=True,id=f33ff122-270e-4129-be5b-e67c0bc0708c,network=Network(78d86418-c0e0-4cc2-8f4f-262f600f7d66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf33ff122-27') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:59:43 user nova-compute[75100]: DEBUG nova.objects.instance [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lazy-loading 'pci_devices' on Instance uuid ca2f4288-da43-4bf3-9ef4-fd53961fe74c {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:59:43 user nova-compute[75100]: DEBUG nova.network.neutron [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Successfully created port: 4c3793c8-de6c-4246-9a29-46ac085f065e {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 17:59:43 user nova-compute[75100]: DEBUG nova.objects.base [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Object Instance<ca2f4288-da43-4bf3-9ef4-fd53961fe74c> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 17:59:43 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] End _get_guest_xml xml=<domain type="kvm">
Nov 10 17:59:43 user nova-compute[75100]:   <uuid>ca2f4288-da43-4bf3-9ef4-fd53961fe74c</uuid>
Nov 10 17:59:43 user nova-compute[75100]:   <name>instance-0000001c</name>
Nov 10 17:59:43 user nova-compute[75100]:   <memory>524288</memory>
Nov 10 17:59:43 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 10 17:59:43 user nova-compute[75100]:   <metadata>
Nov 10 17:59:43 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 17:59:43 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 10 17:59:43 user nova-compute[75100]:       <nova:name>tempest-TestMinimumBasicScenario-server-2141027010</nova:name>
Nov 10 17:59:43 user nova-compute[75100]:       <nova:creationTime>2023-11-10 17:59:41</nova:creationTime>
Nov 10 17:59:43 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 10 17:59:43 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 10 17:59:43 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 10 17:59:43 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 10 17:59:43 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 17:59:43 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 10 17:59:43 user nova-compute[75100]:       </nova:flavor>
Nov 10 17:59:43 user nova-compute[75100]:       <nova:owner>
Nov 10 17:59:43 user nova-compute[75100]:         <nova:user uuid="4d873ec5a11a4ccdb868fef673ffc568">tempest-TestMinimumBasicScenario-281006384-project-member</nova:user>
Nov 10 17:59:43 user nova-compute[75100]:         <nova:project uuid="19cfb454e59745bf9c77d7a7ede2bc0e">tempest-TestMinimumBasicScenario-281006384</nova:project>
Nov 10 17:59:43 user nova-compute[75100]:       </nova:owner>
Nov 10 17:59:43 user nova-compute[75100]:       <nova:root type="image" uuid="9aca461c-4c8d-4e01-96d9-5330997a3b2b"/>
Nov 10 17:59:43 user nova-compute[75100]:       <nova:ports>
Nov 10 17:59:43 user nova-compute[75100]:         <nova:port uuid="f33ff122-270e-4129-be5b-e67c0bc0708c">
Nov 10 17:59:43 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 10 17:59:43 user nova-compute[75100]:         </nova:port>
Nov 10 17:59:43 user nova-compute[75100]:       </nova:ports>
Nov 10 17:59:43 user nova-compute[75100]:     </nova:instance>
Nov 10 17:59:43 user nova-compute[75100]:   </metadata>
Nov 10 17:59:43 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 10 17:59:43 user nova-compute[75100]:     <system>
Nov 10 17:59:43 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 17:59:43 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 10 17:59:43 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 10 17:59:43 user nova-compute[75100]:       <entry name="serial">ca2f4288-da43-4bf3-9ef4-fd53961fe74c</entry>
Nov 10 17:59:43 user nova-compute[75100]:       <entry name="uuid">ca2f4288-da43-4bf3-9ef4-fd53961fe74c</entry>
Nov 10 17:59:43 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 10 17:59:43 user nova-compute[75100]:     </system>
Nov 10 17:59:43 user nova-compute[75100]:   </sysinfo>
Nov 10 17:59:43 user nova-compute[75100]:   <os>
Nov 10 17:59:43 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 17:59:43 user nova-compute[75100]:     <boot dev="hd"/>
Nov 10 17:59:43 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 10 17:59:43 user nova-compute[75100]:   </os>
Nov 10 17:59:43 user nova-compute[75100]:   <features>
Nov 10 17:59:43 user nova-compute[75100]:     <acpi/>
Nov 10 17:59:43 user nova-compute[75100]:     <apic/>
Nov 10 17:59:43 user nova-compute[75100]:     <vmcoreinfo/>
Nov 10 17:59:43 user nova-compute[75100]:   </features>
Nov 10 17:59:43 user nova-compute[75100]:   <clock offset="utc">
Nov 10 17:59:43 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 17:59:43 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 17:59:43 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 10 17:59:43 user nova-compute[75100]:   </clock>
Nov 10 17:59:43 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 10 17:59:43 user nova-compute[75100]:     <model>Nehalem</model>
Nov 10 17:59:43 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 17:59:43 user nova-compute[75100]:   </cpu>
Nov 10 17:59:43 user nova-compute[75100]:   <devices>
Nov 10 17:59:43 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 10 17:59:43 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 17:59:43 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/ca2f4288-da43-4bf3-9ef4-fd53961fe74c/disk"/>
Nov 10 17:59:43 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 10 17:59:43 user nova-compute[75100]:     </disk>
Nov 10 17:59:43 user nova-compute[75100]:     <disk type="block" device="disk">
Nov 10 17:59:43 user nova-compute[75100]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 17:59:43 user nova-compute[75100]:       <source dev="/dev/sdd"/>
Nov 10 17:59:43 user nova-compute[75100]:       <target dev="vdb" bus="virtio"/>
Nov 10 17:59:43 user nova-compute[75100]:       <serial>eb371cd8-f98e-4eb4-8047-76cc41e0d6d0</serial>
Nov 10 17:59:43 user nova-compute[75100]:     </disk>
Nov 10 17:59:43 user nova-compute[75100]:     <interface type="ethernet">
Nov 10 17:59:43 user nova-compute[75100]:       <mac address="fa:16:3e:e0:bd:a4"/>
Nov 10 17:59:43 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:59:43 user nova-compute[75100]:       <mtu size="1442"/>
Nov 10 17:59:43 user nova-compute[75100]:       <target dev="tapf33ff122-27"/>
Nov 10 17:59:43 user nova-compute[75100]:     </interface>
Nov 10 17:59:43 user nova-compute[75100]:     <serial type="pty">
Nov 10 17:59:43 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/ca2f4288-da43-4bf3-9ef4-fd53961fe74c/console.log" append="off"/>
Nov 10 17:59:43 user nova-compute[75100]:     </serial>
Nov 10 17:59:43 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 17:59:43 user nova-compute[75100]:     <video>
Nov 10 17:59:43 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:59:43 user nova-compute[75100]:     </video>
Nov 10 17:59:43 user nova-compute[75100]:     <rng model="virtio">
Nov 10 17:59:43 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 10 17:59:43 user nova-compute[75100]:     </rng>
Nov 10 17:59:43 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 10 17:59:43 user nova-compute[75100]:     <memballoon model="virtio">
Nov 10 17:59:43 user nova-compute[75100]:       <stats period="10"/>
Nov 10 17:59:43 user nova-compute[75100]:     </memballoon>
Nov 10 17:59:43 user nova-compute[75100]:   </devices>
Nov 10 17:59:43 user nova-compute[75100]: </domain>
Nov 10 17:59:43 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 17:59:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2f4288-da43-4bf3-9ef4-fd53961fe74c/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:59:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.174s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:59:43 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ce634a11-5628-4f1c-8437-95f26519d8a0/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 17:59:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce634a11-5628-4f1c-8437-95f26519d8a0/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:59:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2f4288-da43-4bf3-9ef4-fd53961fe74c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:59:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2f4288-da43-4bf3-9ef4-fd53961fe74c/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:59:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce634a11-5628-4f1c-8437-95f26519d8a0/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:59:43 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Cannot resize image /opt/stack/data/nova/instances/ce634a11-5628-4f1c-8437-95f26519d8a0/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 17:59:43 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 17:59:43 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Ensure instance console log exists: /opt/stack/data/nova/instances/ce634a11-5628-4f1c-8437-95f26519d8a0/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 17:59:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:59:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:59:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:59:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2f4288-da43-4bf3-9ef4-fd53961fe74c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:59:43 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 17:59:43 user nova-compute[75100]: DEBUG nova.objects.instance [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lazy-loading 'trusted_certs' on Instance uuid ca2f4288-da43-4bf3-9ef4-fd53961fe74c {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:59:43 user nova-compute[75100]: DEBUG nova.objects.base [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Object Instance<ca2f4288-da43-4bf3-9ef4-fd53961fe74c> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 17:59:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c5090bf38fcf4e6c952dd13213f6cbb47fa74b36 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:59:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c5090bf38fcf4e6c952dd13213f6cbb47fa74b36 --force-share --output=json" returned: 0 in 0.189s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:59:43 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ca2f4288-da43-4bf3-9ef4-fd53961fe74c/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 17:59:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2f4288-da43-4bf3-9ef4-fd53961fe74c/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:59:43 user nova-compute[75100]: DEBUG nova.network.neutron [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Successfully updated port: 4c3793c8-de6c-4246-9a29-46ac085f065e {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 17:59:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Acquiring lock "refresh_cache-ce634a11-5628-4f1c-8437-95f26519d8a0" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:59:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Acquired lock "refresh_cache-ce634a11-5628-4f1c-8437-95f26519d8a0" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:59:43 user nova-compute[75100]: DEBUG nova.network.neutron [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 17:59:43 user nova-compute[75100]: DEBUG nova.compute.manager [req-6d5daafb-d3bc-44e0-9333-58039dc70f6e req-b905c823-9dea-47b2-9c61-84ea8e3b4e82 service nova] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Received event network-changed-4c3793c8-de6c-4246-9a29-46ac085f065e {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:59:43 user nova-compute[75100]: DEBUG nova.compute.manager [req-6d5daafb-d3bc-44e0-9333-58039dc70f6e req-b905c823-9dea-47b2-9c61-84ea8e3b4e82 service nova] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Refreshing instance network info cache due to event network-changed-4c3793c8-de6c-4246-9a29-46ac085f065e. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 17:59:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6d5daafb-d3bc-44e0-9333-58039dc70f6e req-b905c823-9dea-47b2-9c61-84ea8e3b4e82 service nova] Acquiring lock "refresh_cache-ce634a11-5628-4f1c-8437-95f26519d8a0" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:59:43 user nova-compute[75100]: DEBUG nova.network.neutron [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 17:59:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2f4288-da43-4bf3-9ef4-fd53961fe74c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:59:43 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Cannot resize image /opt/stack/data/nova/instances/ca2f4288-da43-4bf3-9ef4-fd53961fe74c/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 17:59:43 user nova-compute[75100]: DEBUG nova.objects.instance [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lazy-loading 'migration_context' on Instance uuid ca2f4288-da43-4bf3-9ef4-fd53961fe74c {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:59:43 user nova-compute[75100]: DEBUG nova.objects.base [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Object Instance<ca2f4288-da43-4bf3-9ef4-fd53961fe74c> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 17:59:43 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:56:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2141027010',display_name='tempest-TestMinimumBasicScenario-server-2141027010',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2141027010',id=28,image_ref='9aca461c-4c8d-4e01-96d9-5330997a3b2b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+9Ljzn6uNPZfvsGzjgf1rzPigyBeIjo1hMLKvKaNMvgjphzLJkq/N+5Rj1I8Bo9ee1XzM24XDugNOdWVPL1ENg5TesGhg9QW7vu/ykAEwYg59w+wwxgQEjuXd/8c6JAA==',key_name='tempest-TestMinimumBasicScenario-2102848825',keypairs=<?>,launch_index=0,launched_at=2023-11-10T17:56:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='19cfb454e59745bf9c77d7a7ede2bc0e',ramdisk_id='',reservation_id='r-nrbksuex',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9aca461c-4c8d-4e01-96d9-5330997a3b2b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-281006384',owner_user_name='tempest-TestMinimumBasicScenario-281006384-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:59:40Z,user_data=None,user_id='4d873ec5a11a4ccdb868fef673ffc568',uuid=ca2f4288-da43-4bf3-9ef4-fd53961fe74c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f33ff122-270e-4129-be5b-e67c0bc0708c", "address": "fa:16:3e:e0:bd:a4", "network": {"id": "78d86418-c0e0-4cc2-8f4f-262f600f7d66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2054827063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19cfb454e59745bf9c77d7a7ede2bc0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33ff122-27", "ovs_interfaceid": "f33ff122-270e-4129-be5b-e67c0bc0708c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 17:59:43 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Converting VIF {"id": "f33ff122-270e-4129-be5b-e67c0bc0708c", "address": "fa:16:3e:e0:bd:a4", "network": {"id": "78d86418-c0e0-4cc2-8f4f-262f600f7d66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2054827063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19cfb454e59745bf9c77d7a7ede2bc0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33ff122-27", "ovs_interfaceid": "f33ff122-270e-4129-be5b-e67c0bc0708c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:59:43 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:bd:a4,bridge_name='br-int',has_traffic_filtering=True,id=f33ff122-270e-4129-be5b-e67c0bc0708c,network=Network(78d86418-c0e0-4cc2-8f4f-262f600f7d66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf33ff122-27') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:59:43 user nova-compute[75100]: DEBUG os_vif [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:bd:a4,bridge_name='br-int',has_traffic_filtering=True,id=f33ff122-270e-4129-be5b-e67c0bc0708c,network=Network(78d86418-c0e0-4cc2-8f4f-262f600f7d66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf33ff122-27') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 17:59:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:59:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 17:59:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '492effb1-839f-5fc3-8b5c-0f7b7fe01d53', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:59:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:59:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf33ff122-27, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:59:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf33ff122-27, col_values=(('qos', UUID('a22051fe-ef10-4c0f-85f0-bde4ed4a4732')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:59:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf33ff122-27, col_values=(('external_ids', {'iface-id': 'f33ff122-270e-4129-be5b-e67c0bc0708c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:bd:a4', 'vm-uuid': 'ca2f4288-da43-4bf3-9ef4-fd53961fe74c'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:59:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:59:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:44 user nova-compute[75100]: INFO os_vif [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:bd:a4,bridge_name='br-int',has_traffic_filtering=True,id=f33ff122-270e-4129-be5b-e67c0bc0708c,network=Network(78d86418-c0e0-4cc2-8f4f-262f600f7d66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf33ff122-27')
Nov 10 17:59:44 user nova-compute[75100]: DEBUG nova.network.neutron [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Updating instance_info_cache with network_info: [{"id": "4c3793c8-de6c-4246-9a29-46ac085f065e", "address": "fa:16:3e:a0:b0:b8", "network": {"id": "7a78ac5d-8f24-436d-9cb9-05f4efecb101", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-476509015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae38bb92c5474a578f3827bdae12cd74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c3793c8-de", "ovs_interfaceid": "4c3793c8-de6c-4246-9a29-46ac085f065e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:59:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Releasing lock "refresh_cache-ce634a11-5628-4f1c-8437-95f26519d8a0" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:59:44 user nova-compute[75100]: DEBUG nova.compute.manager [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Instance network_info: |[{"id": "4c3793c8-de6c-4246-9a29-46ac085f065e", "address": "fa:16:3e:a0:b0:b8", "network": {"id": "7a78ac5d-8f24-436d-9cb9-05f4efecb101", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-476509015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae38bb92c5474a578f3827bdae12cd74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c3793c8-de", "ovs_interfaceid": "4c3793c8-de6c-4246-9a29-46ac085f065e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 17:59:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6d5daafb-d3bc-44e0-9333-58039dc70f6e req-b905c823-9dea-47b2-9c61-84ea8e3b4e82 service nova] Acquired lock "refresh_cache-ce634a11-5628-4f1c-8437-95f26519d8a0" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:59:44 user nova-compute[75100]: DEBUG nova.network.neutron [req-6d5daafb-d3bc-44e0-9333-58039dc70f6e req-b905c823-9dea-47b2-9c61-84ea8e3b4e82 service nova] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Refreshing network info cache for port 4c3793c8-de6c-4246-9a29-46ac085f065e {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 17:59:44 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Start _get_guest_xml network_info=[{"id": "4c3793c8-de6c-4246-9a29-46ac085f065e", "address": "fa:16:3e:a0:b0:b8", "network": {"id": "7a78ac5d-8f24-436d-9cb9-05f4efecb101", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-476509015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae38bb92c5474a578f3827bdae12cd74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c3793c8-de", "ovs_interfaceid": "4c3793c8-de6c-4246-9a29-46ac085f065e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'e3cc5321-4d40-49ee-885c-700e14741732'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 17:59:44 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:59:44 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:59:44 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 17:59:44 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 17:59:44 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 17:59:44 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 17:59:44 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 17:59:44 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T17:40:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 17:59:44 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 17:59:44 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 17:59:44 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 17:59:44 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 17:59:44 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 17:59:44 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 17:59:44 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 17:59:44 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 17:59:44 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 17:59:44 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 17:59:44 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:59:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-727841680',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-727841680',id=31,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNXJUSH8ImyQEQfIfFe1NG91+SubEBrWrTHrr4HPhH4qdxn71cE+Nbpwrengk/NgRguInZ4Ho95ee7g3Uxxbl34+PMj5HYderPpgNTv1f1rj1py60lD1qnogBB8DmNmDCg==',key_name='tempest-keypair-461573842',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae38bb92c5474a578f3827bdae12cd74',ramdisk_id='',reservation_id='r-i78hj9rl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2073508773',owner_user_name='tempest-AttachVolumeShelveTestJSON-2073508773-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:59:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='805917c846f34264b51388bfd9a8413f',uuid=ce634a11-5628-4f1c-8437-95f26519d8a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c3793c8-de6c-4246-9a29-46ac085f065e", "address": "fa:16:3e:a0:b0:b8", "network": {"id": "7a78ac5d-8f24-436d-9cb9-05f4efecb101", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-476509015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae38bb92c5474a578f3827bdae12cd74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c3793c8-de", "ovs_interfaceid": "4c3793c8-de6c-4246-9a29-46ac085f065e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 17:59:44 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Converting VIF {"id": "4c3793c8-de6c-4246-9a29-46ac085f065e", "address": "fa:16:3e:a0:b0:b8", "network": {"id": "7a78ac5d-8f24-436d-9cb9-05f4efecb101", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-476509015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae38bb92c5474a578f3827bdae12cd74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c3793c8-de", "ovs_interfaceid": "4c3793c8-de6c-4246-9a29-46ac085f065e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:59:44 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:b0:b8,bridge_name='br-int',has_traffic_filtering=True,id=4c3793c8-de6c-4246-9a29-46ac085f065e,network=Network(7a78ac5d-8f24-436d-9cb9-05f4efecb101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c3793c8-de') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:59:44 user nova-compute[75100]: DEBUG nova.objects.instance [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lazy-loading 'pci_devices' on Instance uuid ce634a11-5628-4f1c-8437-95f26519d8a0 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:59:44 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] End _get_guest_xml xml=<domain type="kvm">
Nov 10 17:59:44 user nova-compute[75100]:   <uuid>ce634a11-5628-4f1c-8437-95f26519d8a0</uuid>
Nov 10 17:59:44 user nova-compute[75100]:   <name>instance-0000001f</name>
Nov 10 17:59:44 user nova-compute[75100]:   <memory>524288</memory>
Nov 10 17:59:44 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 10 17:59:44 user nova-compute[75100]:   <metadata>
Nov 10 17:59:44 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 17:59:44 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 10 17:59:44 user nova-compute[75100]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-727841680</nova:name>
Nov 10 17:59:44 user nova-compute[75100]:       <nova:creationTime>2023-11-10 17:59:44</nova:creationTime>
Nov 10 17:59:44 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 10 17:59:44 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 10 17:59:44 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 10 17:59:44 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 10 17:59:44 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 17:59:44 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 10 17:59:44 user nova-compute[75100]:       </nova:flavor>
Nov 10 17:59:44 user nova-compute[75100]:       <nova:owner>
Nov 10 17:59:44 user nova-compute[75100]:         <nova:user uuid="805917c846f34264b51388bfd9a8413f">tempest-AttachVolumeShelveTestJSON-2073508773-project-member</nova:user>
Nov 10 17:59:44 user nova-compute[75100]:         <nova:project uuid="ae38bb92c5474a578f3827bdae12cd74">tempest-AttachVolumeShelveTestJSON-2073508773</nova:project>
Nov 10 17:59:44 user nova-compute[75100]:       </nova:owner>
Nov 10 17:59:44 user nova-compute[75100]:       <nova:root type="image" uuid="e3cc5321-4d40-49ee-885c-700e14741732"/>
Nov 10 17:59:44 user nova-compute[75100]:       <nova:ports>
Nov 10 17:59:44 user nova-compute[75100]:         <nova:port uuid="4c3793c8-de6c-4246-9a29-46ac085f065e">
Nov 10 17:59:44 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 10 17:59:44 user nova-compute[75100]:         </nova:port>
Nov 10 17:59:44 user nova-compute[75100]:       </nova:ports>
Nov 10 17:59:44 user nova-compute[75100]:     </nova:instance>
Nov 10 17:59:44 user nova-compute[75100]:   </metadata>
Nov 10 17:59:44 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 10 17:59:44 user nova-compute[75100]:     <system>
Nov 10 17:59:44 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 17:59:44 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 10 17:59:44 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 10 17:59:44 user nova-compute[75100]:       <entry name="serial">ce634a11-5628-4f1c-8437-95f26519d8a0</entry>
Nov 10 17:59:44 user nova-compute[75100]:       <entry name="uuid">ce634a11-5628-4f1c-8437-95f26519d8a0</entry>
Nov 10 17:59:44 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 10 17:59:44 user nova-compute[75100]:     </system>
Nov 10 17:59:44 user nova-compute[75100]:   </sysinfo>
Nov 10 17:59:44 user nova-compute[75100]:   <os>
Nov 10 17:59:44 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 17:59:44 user nova-compute[75100]:     <boot dev="hd"/>
Nov 10 17:59:44 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 10 17:59:44 user nova-compute[75100]:   </os>
Nov 10 17:59:44 user nova-compute[75100]:   <features>
Nov 10 17:59:44 user nova-compute[75100]:     <acpi/>
Nov 10 17:59:44 user nova-compute[75100]:     <apic/>
Nov 10 17:59:44 user nova-compute[75100]:     <vmcoreinfo/>
Nov 10 17:59:44 user nova-compute[75100]:   </features>
Nov 10 17:59:44 user nova-compute[75100]:   <clock offset="utc">
Nov 10 17:59:44 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 17:59:44 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 17:59:44 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 10 17:59:44 user nova-compute[75100]:   </clock>
Nov 10 17:59:44 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 10 17:59:44 user nova-compute[75100]:     <model>Nehalem</model>
Nov 10 17:59:44 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 17:59:44 user nova-compute[75100]:   </cpu>
Nov 10 17:59:44 user nova-compute[75100]:   <devices>
Nov 10 17:59:44 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 10 17:59:44 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 17:59:44 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/ce634a11-5628-4f1c-8437-95f26519d8a0/disk"/>
Nov 10 17:59:44 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 10 17:59:44 user nova-compute[75100]:     </disk>
Nov 10 17:59:44 user nova-compute[75100]:     <interface type="ethernet">
Nov 10 17:59:44 user nova-compute[75100]:       <mac address="fa:16:3e:a0:b0:b8"/>
Nov 10 17:59:44 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:59:44 user nova-compute[75100]:       <mtu size="1442"/>
Nov 10 17:59:44 user nova-compute[75100]:       <target dev="tap4c3793c8-de"/>
Nov 10 17:59:44 user nova-compute[75100]:     </interface>
Nov 10 17:59:44 user nova-compute[75100]:     <serial type="pty">
Nov 10 17:59:44 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/ce634a11-5628-4f1c-8437-95f26519d8a0/console.log" append="off"/>
Nov 10 17:59:44 user nova-compute[75100]:     </serial>
Nov 10 17:59:44 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 17:59:44 user nova-compute[75100]:     <video>
Nov 10 17:59:44 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 17:59:44 user nova-compute[75100]:     </video>
Nov 10 17:59:44 user nova-compute[75100]:     <rng model="virtio">
Nov 10 17:59:44 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 10 17:59:44 user nova-compute[75100]:     </rng>
Nov 10 17:59:44 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 10 17:59:44 user nova-compute[75100]:     <memballoon model="virtio">
Nov 10 17:59:44 user nova-compute[75100]:       <stats period="10"/>
Nov 10 17:59:44 user nova-compute[75100]:     </memballoon>
Nov 10 17:59:44 user nova-compute[75100]:   </devices>
Nov 10 17:59:44 user nova-compute[75100]: </domain>
Nov 10 17:59:44 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 17:59:44 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:59:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-727841680',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-727841680',id=31,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNXJUSH8ImyQEQfIfFe1NG91+SubEBrWrTHrr4HPhH4qdxn71cE+Nbpwrengk/NgRguInZ4Ho95ee7g3Uxxbl34+PMj5HYderPpgNTv1f1rj1py60lD1qnogBB8DmNmDCg==',key_name='tempest-keypair-461573842',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae38bb92c5474a578f3827bdae12cd74',ramdisk_id='',reservation_id='r-i78hj9rl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2073508773',owner_user_name='tempest-AttachVolumeShelveTestJSON-2073508773-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T17:59:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='805917c846f34264b51388bfd9a8413f',uuid=ce634a11-5628-4f1c-8437-95f26519d8a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c3793c8-de6c-4246-9a29-46ac085f065e", "address": "fa:16:3e:a0:b0:b8", "network": {"id": "7a78ac5d-8f24-436d-9cb9-05f4efecb101", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-476509015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae38bb92c5474a578f3827bdae12cd74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c3793c8-de", "ovs_interfaceid": "4c3793c8-de6c-4246-9a29-46ac085f065e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 17:59:44 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Converting VIF {"id": "4c3793c8-de6c-4246-9a29-46ac085f065e", "address": "fa:16:3e:a0:b0:b8", "network": {"id": "7a78ac5d-8f24-436d-9cb9-05f4efecb101", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-476509015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae38bb92c5474a578f3827bdae12cd74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c3793c8-de", "ovs_interfaceid": "4c3793c8-de6c-4246-9a29-46ac085f065e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:59:44 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:b0:b8,bridge_name='br-int',has_traffic_filtering=True,id=4c3793c8-de6c-4246-9a29-46ac085f065e,network=Network(7a78ac5d-8f24-436d-9cb9-05f4efecb101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c3793c8-de') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:59:44 user nova-compute[75100]: DEBUG os_vif [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:b0:b8,bridge_name='br-int',has_traffic_filtering=True,id=4c3793c8-de6c-4246-9a29-46ac085f065e,network=Network(7a78ac5d-8f24-436d-9cb9-05f4efecb101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c3793c8-de') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 17:59:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:59:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 17:59:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b9e20245-150f-5392-8614-badcb9c1d508', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:59:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:59:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4c3793c8-de, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:59:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4c3793c8-de, col_values=(('qos', UUID('fae1148e-54ba-4f7d-99b9-d4ab8eadf4b2')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:59:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4c3793c8-de, col_values=(('external_ids', {'iface-id': '4c3793c8-de6c-4246-9a29-46ac085f065e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:b0:b8', 'vm-uuid': 'ce634a11-5628-4f1c-8437-95f26519d8a0'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:59:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:59:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:44 user nova-compute[75100]: INFO os_vif [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:b0:b8,bridge_name='br-int',has_traffic_filtering=True,id=4c3793c8-de6c-4246-9a29-46ac085f065e,network=Network(7a78ac5d-8f24-436d-9cb9-05f4efecb101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c3793c8-de')
Nov 10 17:59:44 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 17:59:44 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] No VIF found with MAC fa:16:3e:a0:b0:b8, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 17:59:44 user nova-compute[75100]: DEBUG nova.network.neutron [req-6d5daafb-d3bc-44e0-9333-58039dc70f6e req-b905c823-9dea-47b2-9c61-84ea8e3b4e82 service nova] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Updated VIF entry in instance network info cache for port 4c3793c8-de6c-4246-9a29-46ac085f065e. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 17:59:44 user nova-compute[75100]: DEBUG nova.network.neutron [req-6d5daafb-d3bc-44e0-9333-58039dc70f6e req-b905c823-9dea-47b2-9c61-84ea8e3b4e82 service nova] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Updating instance_info_cache with network_info: [{"id": "4c3793c8-de6c-4246-9a29-46ac085f065e", "address": "fa:16:3e:a0:b0:b8", "network": {"id": "7a78ac5d-8f24-436d-9cb9-05f4efecb101", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-476509015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae38bb92c5474a578f3827bdae12cd74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c3793c8-de", "ovs_interfaceid": "4c3793c8-de6c-4246-9a29-46ac085f065e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:59:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6d5daafb-d3bc-44e0-9333-58039dc70f6e req-b905c823-9dea-47b2-9c61-84ea8e3b4e82 service nova] Releasing lock "refresh_cache-ce634a11-5628-4f1c-8437-95f26519d8a0" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:59:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:46 user nova-compute[75100]: DEBUG nova.compute.manager [req-0f0918fe-80f4-4b41-9248-da73a5956165 req-74394137-7970-45f6-acd5-6efe33ef8a03 service nova] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Received event network-vif-plugged-f33ff122-270e-4129-be5b-e67c0bc0708c {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:59:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0f0918fe-80f4-4b41-9248-da73a5956165 req-74394137-7970-45f6-acd5-6efe33ef8a03 service nova] Acquiring lock "ca2f4288-da43-4bf3-9ef4-fd53961fe74c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:59:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0f0918fe-80f4-4b41-9248-da73a5956165 req-74394137-7970-45f6-acd5-6efe33ef8a03 service nova] Lock "ca2f4288-da43-4bf3-9ef4-fd53961fe74c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:59:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0f0918fe-80f4-4b41-9248-da73a5956165 req-74394137-7970-45f6-acd5-6efe33ef8a03 service nova] Lock "ca2f4288-da43-4bf3-9ef4-fd53961fe74c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:59:46 user nova-compute[75100]: DEBUG nova.compute.manager [req-0f0918fe-80f4-4b41-9248-da73a5956165 req-74394137-7970-45f6-acd5-6efe33ef8a03 service nova] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] No waiting events found dispatching network-vif-plugged-f33ff122-270e-4129-be5b-e67c0bc0708c {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:59:46 user nova-compute[75100]: WARNING nova.compute.manager [req-0f0918fe-80f4-4b41-9248-da73a5956165 req-74394137-7970-45f6-acd5-6efe33ef8a03 service nova] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Received unexpected event network-vif-plugged-f33ff122-270e-4129-be5b-e67c0bc0708c for instance with vm_state active and task_state reboot_started_hard.
Nov 10 17:59:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:48 user nova-compute[75100]: DEBUG nova.compute.manager [req-af7c2241-1c21-442a-a925-494a85aef174 req-a70030ee-3d3f-4df3-bd49-e64d5d42d0bc service nova] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Received event network-vif-plugged-f33ff122-270e-4129-be5b-e67c0bc0708c {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:59:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-af7c2241-1c21-442a-a925-494a85aef174 req-a70030ee-3d3f-4df3-bd49-e64d5d42d0bc service nova] Acquiring lock "ca2f4288-da43-4bf3-9ef4-fd53961fe74c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:59:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-af7c2241-1c21-442a-a925-494a85aef174 req-a70030ee-3d3f-4df3-bd49-e64d5d42d0bc service nova] Lock "ca2f4288-da43-4bf3-9ef4-fd53961fe74c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:59:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-af7c2241-1c21-442a-a925-494a85aef174 req-a70030ee-3d3f-4df3-bd49-e64d5d42d0bc service nova] Lock "ca2f4288-da43-4bf3-9ef4-fd53961fe74c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:59:48 user nova-compute[75100]: DEBUG nova.compute.manager [req-af7c2241-1c21-442a-a925-494a85aef174 req-a70030ee-3d3f-4df3-bd49-e64d5d42d0bc service nova] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] No waiting events found dispatching network-vif-plugged-f33ff122-270e-4129-be5b-e67c0bc0708c {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:59:48 user nova-compute[75100]: WARNING nova.compute.manager [req-af7c2241-1c21-442a-a925-494a85aef174 req-a70030ee-3d3f-4df3-bd49-e64d5d42d0bc service nova] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Received unexpected event network-vif-plugged-f33ff122-270e-4129-be5b-e67c0bc0708c for instance with vm_state active and task_state reboot_started_hard.
Nov 10 17:59:48 user nova-compute[75100]: DEBUG nova.compute.manager [req-af7c2241-1c21-442a-a925-494a85aef174 req-a70030ee-3d3f-4df3-bd49-e64d5d42d0bc service nova] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Received event network-vif-plugged-4c3793c8-de6c-4246-9a29-46ac085f065e {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:59:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-af7c2241-1c21-442a-a925-494a85aef174 req-a70030ee-3d3f-4df3-bd49-e64d5d42d0bc service nova] Acquiring lock "ce634a11-5628-4f1c-8437-95f26519d8a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:59:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-af7c2241-1c21-442a-a925-494a85aef174 req-a70030ee-3d3f-4df3-bd49-e64d5d42d0bc service nova] Lock "ce634a11-5628-4f1c-8437-95f26519d8a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:59:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-af7c2241-1c21-442a-a925-494a85aef174 req-a70030ee-3d3f-4df3-bd49-e64d5d42d0bc service nova] Lock "ce634a11-5628-4f1c-8437-95f26519d8a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:59:48 user nova-compute[75100]: DEBUG nova.compute.manager [req-af7c2241-1c21-442a-a925-494a85aef174 req-a70030ee-3d3f-4df3-bd49-e64d5d42d0bc service nova] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] No waiting events found dispatching network-vif-plugged-4c3793c8-de6c-4246-9a29-46ac085f065e {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:59:48 user nova-compute[75100]: WARNING nova.compute.manager [req-af7c2241-1c21-442a-a925-494a85aef174 req-a70030ee-3d3f-4df3-bd49-e64d5d42d0bc service nova] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Received unexpected event network-vif-plugged-4c3793c8-de6c-4246-9a29-46ac085f065e for instance with vm_state building and task_state spawning.
Nov 10 17:59:48 user nova-compute[75100]: DEBUG nova.compute.manager [req-af7c2241-1c21-442a-a925-494a85aef174 req-a70030ee-3d3f-4df3-bd49-e64d5d42d0bc service nova] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Received event network-vif-plugged-4c3793c8-de6c-4246-9a29-46ac085f065e {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:59:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-af7c2241-1c21-442a-a925-494a85aef174 req-a70030ee-3d3f-4df3-bd49-e64d5d42d0bc service nova] Acquiring lock "ce634a11-5628-4f1c-8437-95f26519d8a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:59:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-af7c2241-1c21-442a-a925-494a85aef174 req-a70030ee-3d3f-4df3-bd49-e64d5d42d0bc service nova] Lock "ce634a11-5628-4f1c-8437-95f26519d8a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:59:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-af7c2241-1c21-442a-a925-494a85aef174 req-a70030ee-3d3f-4df3-bd49-e64d5d42d0bc service nova] Lock "ce634a11-5628-4f1c-8437-95f26519d8a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:59:48 user nova-compute[75100]: DEBUG nova.compute.manager [req-af7c2241-1c21-442a-a925-494a85aef174 req-a70030ee-3d3f-4df3-bd49-e64d5d42d0bc service nova] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] No waiting events found dispatching network-vif-plugged-4c3793c8-de6c-4246-9a29-46ac085f065e {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:59:48 user nova-compute[75100]: WARNING nova.compute.manager [req-af7c2241-1c21-442a-a925-494a85aef174 req-a70030ee-3d3f-4df3-bd49-e64d5d42d0bc service nova] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Received unexpected event network-vif-plugged-4c3793c8-de6c-4246-9a29-46ac085f065e for instance with vm_state building and task_state spawning.
Nov 10 17:59:49 user nova-compute[75100]: DEBUG nova.compute.manager [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 17:59:49 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 17:59:49 user nova-compute[75100]: DEBUG nova.compute.manager [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 17:59:49 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Instance spawned successfully.
Nov 10 17:59:49 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 17:59:49 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Instance rebooted successfully.
Nov 10 17:59:49 user nova-compute[75100]: DEBUG nova.compute.manager [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 17:59:49 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:59:49 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:59:49 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:59:49 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:59:49 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:59:49 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 17:59:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-38f79a48-76a9-4230-8dc9-55eb2fd28f50 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "ca2f4288-da43-4bf3-9ef4-fd53961fe74c" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 9.621s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:59:49 user nova-compute[75100]: INFO nova.compute.manager [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Took 6.66 seconds to spawn the instance on the hypervisor.
Nov 10 17:59:49 user nova-compute[75100]: DEBUG nova.compute.manager [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 17:59:49 user nova-compute[75100]: INFO nova.compute.manager [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Took 7.54 seconds to build instance.
Nov 10 17:59:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-00622e2d-4c6b-4cc9-b5a8-913e44f031f0 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "ce634a11-5628-4f1c-8437-95f26519d8a0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.638s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:59:54 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:54 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:59:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:00:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4bbcb178-4d1c-4e11-b7a1-6eb36e52317a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Acquiring lock "9033f537-bdeb-412c-9337-4ad86f4467b2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:00:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4bbcb178-4d1c-4e11-b7a1-6eb36e52317a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "9033f537-bdeb-412c-9337-4ad86f4467b2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:00:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4bbcb178-4d1c-4e11-b7a1-6eb36e52317a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Acquiring lock "9033f537-bdeb-412c-9337-4ad86f4467b2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:00:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4bbcb178-4d1c-4e11-b7a1-6eb36e52317a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "9033f537-bdeb-412c-9337-4ad86f4467b2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:00:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4bbcb178-4d1c-4e11-b7a1-6eb36e52317a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "9033f537-bdeb-412c-9337-4ad86f4467b2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:00:02 user nova-compute[75100]: INFO nova.compute.manager [None req-4bbcb178-4d1c-4e11-b7a1-6eb36e52317a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Terminating instance
Nov 10 18:00:02 user nova-compute[75100]: DEBUG nova.compute.manager [None req-4bbcb178-4d1c-4e11-b7a1-6eb36e52317a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 18:00:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:00:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:00:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:00:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:00:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-3cf85b31-677a-44f1-a231-0f4a47ca34c1 req-97517440-62c2-437f-baca-3b0f816e4594 service nova] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Received event network-vif-unplugged-4c49d1d4-dba2-478e-80b6-94e012439af6 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:00:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3cf85b31-677a-44f1-a231-0f4a47ca34c1 req-97517440-62c2-437f-baca-3b0f816e4594 service nova] Acquiring lock "9033f537-bdeb-412c-9337-4ad86f4467b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:00:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3cf85b31-677a-44f1-a231-0f4a47ca34c1 req-97517440-62c2-437f-baca-3b0f816e4594 service nova] Lock "9033f537-bdeb-412c-9337-4ad86f4467b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:00:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3cf85b31-677a-44f1-a231-0f4a47ca34c1 req-97517440-62c2-437f-baca-3b0f816e4594 service nova] Lock "9033f537-bdeb-412c-9337-4ad86f4467b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:00:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-3cf85b31-677a-44f1-a231-0f4a47ca34c1 req-97517440-62c2-437f-baca-3b0f816e4594 service nova] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] No waiting events found dispatching network-vif-unplugged-4c49d1d4-dba2-478e-80b6-94e012439af6 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:00:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-3cf85b31-677a-44f1-a231-0f4a47ca34c1 req-97517440-62c2-437f-baca-3b0f816e4594 service nova] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Received event network-vif-unplugged-4c49d1d4-dba2-478e-80b6-94e012439af6 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 18:00:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:00:03 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Instance destroyed successfully.
Nov 10 18:00:03 user nova-compute[75100]: DEBUG nova.objects.instance [None req-4bbcb178-4d1c-4e11-b7a1-6eb36e52317a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lazy-loading 'resources' on Instance uuid 9033f537-bdeb-412c-9337-4ad86f4467b2 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:00:03 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-4bbcb178-4d1c-4e11-b7a1-6eb36e52317a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:53:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-605414180',display_name='tempest-ServerRescueNegativeTestJSON-server-605414180',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-605414180',id=22,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK5WD1+eOwUzsX08cypzhrTma3HkbsN870zT0Y+QTvyZBNlyAR0CbepPOL0EczUTok0EEOnRf3EnHVqUySgcH39xQkMu9DxtypvjKKVzJormvnoofL9/MAfmhYPJK8lu1w==',key_name='tempest-keypair-2016670451',keypairs=<?>,launch_index=0,launched_at=2023-11-10T17:55:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6b19755f3e634fdfbd562c33fbfa2a88',ramdisk_id='',reservation_id='r-78y85sq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-783763036',owner_user_name='tempest-ServerRescueNegativeTestJSON-783763036-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T17:57:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8cdb9250e6c7459587e429a0aea577c6',uuid=9033f537-bdeb-412c-9337-4ad86f4467b2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c49d1d4-dba2-478e-80b6-94e012439af6", "address": "fa:16:3e:01:6b:43", "network": {"id": "26a554fe-9a5e-40c0-9981-5ac084c9ea73", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-269663495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19755f3e634fdfbd562c33fbfa2a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c49d1d4-db", "ovs_interfaceid": "4c49d1d4-dba2-478e-80b6-94e012439af6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 18:00:03 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-4bbcb178-4d1c-4e11-b7a1-6eb36e52317a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Converting VIF {"id": "4c49d1d4-dba2-478e-80b6-94e012439af6", "address": "fa:16:3e:01:6b:43", "network": {"id": "26a554fe-9a5e-40c0-9981-5ac084c9ea73", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-269663495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19755f3e634fdfbd562c33fbfa2a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c49d1d4-db", "ovs_interfaceid": "4c49d1d4-dba2-478e-80b6-94e012439af6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:00:03 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-4bbcb178-4d1c-4e11-b7a1-6eb36e52317a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:01:6b:43,bridge_name='br-int',has_traffic_filtering=True,id=4c49d1d4-dba2-478e-80b6-94e012439af6,network=Network(26a554fe-9a5e-40c0-9981-5ac084c9ea73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c49d1d4-db') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:00:03 user nova-compute[75100]: DEBUG os_vif [None req-4bbcb178-4d1c-4e11-b7a1-6eb36e52317a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:6b:43,bridge_name='br-int',has_traffic_filtering=True,id=4c49d1d4-dba2-478e-80b6-94e012439af6,network=Network(26a554fe-9a5e-40c0-9981-5ac084c9ea73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c49d1d4-db') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 18:00:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:00:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c49d1d4-db, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:00:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:00:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:00:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:00:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6f0e51f7-1031-4241-8dd8-6c57357a9641) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:00:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:00:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:00:03 user nova-compute[75100]: INFO os_vif [None req-4bbcb178-4d1c-4e11-b7a1-6eb36e52317a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:6b:43,bridge_name='br-int',has_traffic_filtering=True,id=4c49d1d4-dba2-478e-80b6-94e012439af6,network=Network(26a554fe-9a5e-40c0-9981-5ac084c9ea73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c49d1d4-db')
Nov 10 18:00:03 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-4bbcb178-4d1c-4e11-b7a1-6eb36e52317a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Deleting instance files /opt/stack/data/nova/instances/9033f537-bdeb-412c-9337-4ad86f4467b2_del
Nov 10 18:00:03 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-4bbcb178-4d1c-4e11-b7a1-6eb36e52317a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Deletion of /opt/stack/data/nova/instances/9033f537-bdeb-412c-9337-4ad86f4467b2_del complete
Nov 10 18:00:03 user nova-compute[75100]: INFO nova.compute.manager [None req-4bbcb178-4d1c-4e11-b7a1-6eb36e52317a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Took 1.04 seconds to destroy the instance on the hypervisor.
Nov 10 18:00:03 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-4bbcb178-4d1c-4e11-b7a1-6eb36e52317a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 18:00:03 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 18:00:03 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 18:00:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:00:04 user nova-compute[75100]: DEBUG nova.compute.manager [req-944f1637-e87f-43d4-bbe4-9fcffd3b8655 req-1a03d22c-84ab-40d0-84fc-860f0ceb11ed service nova] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] Received event network-changed-10571181-1571-456a-9203-1d0d366c7d4b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:00:04 user nova-compute[75100]: DEBUG nova.compute.manager [req-944f1637-e87f-43d4-bbe4-9fcffd3b8655 req-1a03d22c-84ab-40d0-84fc-860f0ceb11ed service nova] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] Refreshing instance network info cache due to event network-changed-10571181-1571-456a-9203-1d0d366c7d4b. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 18:00:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-944f1637-e87f-43d4-bbe4-9fcffd3b8655 req-1a03d22c-84ab-40d0-84fc-860f0ceb11ed service nova] Acquiring lock "refresh_cache-228aa1b0-1868-4bfe-b322-ca6a6406375c" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:00:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-944f1637-e87f-43d4-bbe4-9fcffd3b8655 req-1a03d22c-84ab-40d0-84fc-860f0ceb11ed service nova] Acquired lock "refresh_cache-228aa1b0-1868-4bfe-b322-ca6a6406375c" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:00:04 user nova-compute[75100]: DEBUG nova.network.neutron [req-944f1637-e87f-43d4-bbe4-9fcffd3b8655 req-1a03d22c-84ab-40d0-84fc-860f0ceb11ed service nova] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] Refreshing network info cache for port 10571181-1571-456a-9203-1d0d366c7d4b {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 18:00:05 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:00:05 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Took 1.30 seconds to deallocate network for instance.
Nov 10 18:00:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4bbcb178-4d1c-4e11-b7a1-6eb36e52317a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:00:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4bbcb178-4d1c-4e11-b7a1-6eb36e52317a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:00:05 user nova-compute[75100]: DEBUG nova.compute.manager [req-ccc5ddc4-3b91-44a4-b03c-dd0ba34ebe1d req-c9974916-5380-46fd-a020-3f3e95fccbab service nova] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Received event network-vif-plugged-4c49d1d4-dba2-478e-80b6-94e012439af6 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:00:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ccc5ddc4-3b91-44a4-b03c-dd0ba34ebe1d req-c9974916-5380-46fd-a020-3f3e95fccbab service nova] Acquiring lock "9033f537-bdeb-412c-9337-4ad86f4467b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:00:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ccc5ddc4-3b91-44a4-b03c-dd0ba34ebe1d req-c9974916-5380-46fd-a020-3f3e95fccbab service nova] Lock "9033f537-bdeb-412c-9337-4ad86f4467b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:00:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ccc5ddc4-3b91-44a4-b03c-dd0ba34ebe1d req-c9974916-5380-46fd-a020-3f3e95fccbab service nova] Lock "9033f537-bdeb-412c-9337-4ad86f4467b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:00:05 user nova-compute[75100]: DEBUG nova.compute.manager [req-ccc5ddc4-3b91-44a4-b03c-dd0ba34ebe1d req-c9974916-5380-46fd-a020-3f3e95fccbab service nova] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] No waiting events found dispatching network-vif-plugged-4c49d1d4-dba2-478e-80b6-94e012439af6 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:00:05 user nova-compute[75100]: WARNING nova.compute.manager [req-ccc5ddc4-3b91-44a4-b03c-dd0ba34ebe1d req-c9974916-5380-46fd-a020-3f3e95fccbab service nova] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Received unexpected event network-vif-plugged-4c49d1d4-dba2-478e-80b6-94e012439af6 for instance with vm_state deleted and task_state None.
Nov 10 18:00:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-aa1692c0-d16b-4d74-be60-2ae8fd146392 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Acquiring lock "228aa1b0-1868-4bfe-b322-ca6a6406375c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:00:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-aa1692c0-d16b-4d74-be60-2ae8fd146392 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "228aa1b0-1868-4bfe-b322-ca6a6406375c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:00:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-aa1692c0-d16b-4d74-be60-2ae8fd146392 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Acquiring lock "228aa1b0-1868-4bfe-b322-ca6a6406375c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:00:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-aa1692c0-d16b-4d74-be60-2ae8fd146392 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "228aa1b0-1868-4bfe-b322-ca6a6406375c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:00:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-aa1692c0-d16b-4d74-be60-2ae8fd146392 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "228aa1b0-1868-4bfe-b322-ca6a6406375c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:00:05 user nova-compute[75100]: INFO nova.compute.manager [None req-aa1692c0-d16b-4d74-be60-2ae8fd146392 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] Terminating instance
Nov 10 18:00:05 user nova-compute[75100]: DEBUG nova.compute.manager [None req-aa1692c0-d16b-4d74-be60-2ae8fd146392 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 18:00:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:00:05 user nova-compute[75100]: DEBUG nova.network.neutron [req-944f1637-e87f-43d4-bbe4-9fcffd3b8655 req-1a03d22c-84ab-40d0-84fc-860f0ceb11ed service nova] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] Updated VIF entry in instance network info cache for port 10571181-1571-456a-9203-1d0d366c7d4b. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 18:00:05 user nova-compute[75100]: DEBUG nova.network.neutron [req-944f1637-e87f-43d4-bbe4-9fcffd3b8655 req-1a03d22c-84ab-40d0-84fc-860f0ceb11ed service nova] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] Updating instance_info_cache with network_info: [{"id": "10571181-1571-456a-9203-1d0d366c7d4b", "address": "fa:16:3e:ad:2f:f1", "network": {"id": "2a85480b-f67d-4ef1-b967-3e93af57d7c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1717495768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9cd441a46aa4a579feff608d6ff9bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10571181-15", "ovs_interfaceid": "10571181-1571-456a-9203-1d0d366c7d4b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:00:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:00:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-944f1637-e87f-43d4-bbe4-9fcffd3b8655 req-1a03d22c-84ab-40d0-84fc-860f0ceb11ed service nova] Releasing lock "refresh_cache-228aa1b0-1868-4bfe-b322-ca6a6406375c" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:00:05 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-4bbcb178-4d1c-4e11-b7a1-6eb36e52317a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:00:05 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-4bbcb178-4d1c-4e11-b7a1-6eb36e52317a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:00:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4bbcb178-4d1c-4e11-b7a1-6eb36e52317a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.588s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:00:05 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-4bbcb178-4d1c-4e11-b7a1-6eb36e52317a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Deleted allocations for instance 9033f537-bdeb-412c-9337-4ad86f4467b2
Nov 10 18:00:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4bbcb178-4d1c-4e11-b7a1-6eb36e52317a tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "9033f537-bdeb-412c-9337-4ad86f4467b2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.151s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG nova.compute.manager [req-02f319f3-a2f0-453c-b8d0-9f019ccf0ca9 req-253dd56d-dcd4-4e94-9216-e3954e3c339e service nova] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] Received event network-vif-unplugged-10571181-1571-456a-9203-1d0d366c7d4b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-02f319f3-a2f0-453c-b8d0-9f019ccf0ca9 req-253dd56d-dcd4-4e94-9216-e3954e3c339e service nova] Acquiring lock "228aa1b0-1868-4bfe-b322-ca6a6406375c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-02f319f3-a2f0-453c-b8d0-9f019ccf0ca9 req-253dd56d-dcd4-4e94-9216-e3954e3c339e service nova] Lock "228aa1b0-1868-4bfe-b322-ca6a6406375c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-02f319f3-a2f0-453c-b8d0-9f019ccf0ca9 req-253dd56d-dcd4-4e94-9216-e3954e3c339e service nova] Lock "228aa1b0-1868-4bfe-b322-ca6a6406375c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG nova.compute.manager [req-02f319f3-a2f0-453c-b8d0-9f019ccf0ca9 req-253dd56d-dcd4-4e94-9216-e3954e3c339e service nova] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] No waiting events found dispatching network-vif-unplugged-10571181-1571-456a-9203-1d0d366c7d4b {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG nova.compute.manager [req-02f319f3-a2f0-453c-b8d0-9f019ccf0ca9 req-253dd56d-dcd4-4e94-9216-e3954e3c339e service nova] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] Received event network-vif-unplugged-10571181-1571-456a-9203-1d0d366c7d4b for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:00:06 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] Instance destroyed successfully.
Nov 10 18:00:06 user nova-compute[75100]: DEBUG nova.objects.instance [None req-aa1692c0-d16b-4d74-be60-2ae8fd146392 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lazy-loading 'resources' on Instance uuid 228aa1b0-1868-4bfe-b322-ca6a6406375c {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-aa1692c0-d16b-4d74-be60-2ae8fd146392 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:58:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-762638311',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-762638311',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-762638311',id=30,image_ref='5f3f0476-bd83-4765-b188-0fde7282f60e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP1tgXebT/VtzFglQudO5uoI1y8sMY9Z7MfjG9qtb+fywGZjxbnFOIdJkwn5zR/GpBRtpj9GXujRNNRsDxpGTHFMgSUyIXJY1PQdz9lntMk4PXgtIp6X3l1x7kk36FrFMw==',key_name='tempest-keypair-1149578534',keypairs=<?>,launch_index=0,launched_at=2023-11-10T17:58:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b9cd441a46aa4a579feff608d6ff9bb4',ramdisk_id='',reservation_id='r-107hzbei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-706331648',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-706331648-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-706331648',owner_user_name='tempest-TestVolumeBootPattern-706331648-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T17:58:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='323c5738ca424a379f666b4ca60825ac',uuid=228aa1b0-1868-4bfe-b322-ca6a6406375c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "10571181-1571-456a-9203-1d0d366c7d4b", "address": "fa:16:3e:ad:2f:f1", "network": {"id": "2a85480b-f67d-4ef1-b967-3e93af57d7c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1717495768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9cd441a46aa4a579feff608d6ff9bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10571181-15", "ovs_interfaceid": "10571181-1571-456a-9203-1d0d366c7d4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-aa1692c0-d16b-4d74-be60-2ae8fd146392 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Converting VIF {"id": "10571181-1571-456a-9203-1d0d366c7d4b", "address": "fa:16:3e:ad:2f:f1", "network": {"id": "2a85480b-f67d-4ef1-b967-3e93af57d7c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1717495768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9cd441a46aa4a579feff608d6ff9bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10571181-15", "ovs_interfaceid": "10571181-1571-456a-9203-1d0d366c7d4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-aa1692c0-d16b-4d74-be60-2ae8fd146392 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:2f:f1,bridge_name='br-int',has_traffic_filtering=True,id=10571181-1571-456a-9203-1d0d366c7d4b,network=Network(2a85480b-f67d-4ef1-b967-3e93af57d7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10571181-15') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG os_vif [None req-aa1692c0-d16b-4d74-be60-2ae8fd146392 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:2f:f1,bridge_name='br-int',has_traffic_filtering=True,id=10571181-1571-456a-9203-1d0d366c7d4b,network=Network(2a85480b-f67d-4ef1-b967-3e93af57d7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10571181-15') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap10571181-15, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8126919b-b7d2-4470-84e3-324f2fe59df9) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:00:06 user nova-compute[75100]: INFO os_vif [None req-aa1692c0-d16b-4d74-be60-2ae8fd146392 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:2f:f1,bridge_name='br-int',has_traffic_filtering=True,id=10571181-1571-456a-9203-1d0d366c7d4b,network=Network(2a85480b-f67d-4ef1-b967-3e93af57d7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10571181-15')
Nov 10 18:00:06 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa1692c0-d16b-4d74-be60-2ae8fd146392 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa1692c0-d16b-4d74-be60-2ae8fd146392 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, {'target_iqn': 'iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HgnaOwLf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:00:06 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-aa1692c0-d16b-4d74-be60-2ae8fd146392 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:00:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-aa1692c0-d16b-4d74-be60-2ae8fd146392 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-aa1692c0-d16b-4d74-be60-2ae8fd146392 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3503b2f-7708-48bb-abfb-a40e8798ae5a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa1692c0-d16b-4d74-be60-2ae8fd146392 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 18:00:06 user nova-compute[75100]: No targets found.
Nov 10 18:00:06 user nova-compute[75100]: iSNS:
Nov 10 18:00:06 user nova-compute[75100]: No targets found.
Nov 10 18:00:06 user nova-compute[75100]: STATIC:
Nov 10 18:00:06 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5
Nov 10 18:00:06 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:00:06 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:00:06 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0
Nov 10 18:00:06 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:00:06 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:00:06 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308
Nov 10 18:00:06 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:00:06 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:00:06 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d
Nov 10 18:00:06 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:00:06 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:00:06 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00
Nov 10 18:00:06 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:00:06 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:00:06 user nova-compute[75100]: FIRMWARE:
Nov 10 18:00:06 user nova-compute[75100]: No targets found.
Nov 10 18:00:06 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa1692c0-d16b-4d74-be60-2ae8fd146392 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 18:00:06 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 18:00:06 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa1692c0-d16b-4d74-be60-2ae8fd146392 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.032s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c95df707-ddbe-4083-9ffa-d400b28610a2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5ff811-7412-469f-8dfe-506ab0b6ab43]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa1692c0-d16b-4d74-be60-2ae8fd146392 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 (non-flash)
Nov 10 18:00:06 user nova-compute[75100]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 (non-flash)
Nov 10 18:00:06 user nova-compute[75100]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5 (non-flash)
Nov 10 18:00:06 user nova-compute[75100]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d (non-flash)
Nov 10 18:00:06 user nova-compute[75100]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 (non-flash)
Nov 10 18:00:06 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa1692c0-d16b-4d74-be60-2ae8fd146392 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 (non-flash)
Nov 10 18:00:06 user nova-compute[75100]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 (non-flash)
Nov 10 18:00:06 user nova-compute[75100]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5 (non-flash)
Nov 10 18:00:06 user nova-compute[75100]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d (non-flash)
Nov 10 18:00:06 user nova-compute[75100]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 (non-flash)
Nov 10 18:00:06 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa1692c0-d16b-4d74-be60-2ae8fd146392 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3e0197be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5'): ({'sdb'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-aa1692c0-d16b-4d74-be60-2ae8fd146392 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Removing single pathed devices sdb {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[743322a4-8596-4113-815c-747790b2cc09]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[817e1ce1-c0bc-436b-9406-29151fb193dd]: (4, ('ok\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-aa1692c0-d16b-4d74-be60-2ae8fd146392 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Flushing IO for device /dev/sdb {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d144f0-26e4-43fc-9d81-1a3736ee3a2b]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-aa1692c0-d16b-4d74-be60-2ae8fd146392 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0837e9cb-1ac6-43d7-a568-6f577e3232f0]: (4, ('1', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-aa1692c0-d16b-4d74-be60-2ae8fd146392 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-aa1692c0-d16b-4d74-be60-2ae8fd146392 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO5c33bf10-a53358c04b40fe97', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_5c33bf10', '/dev/disk/by-id/scsi-26135333335386330') {{(pid=86608) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[606befec-9265-4015-9b25-054e40d30472]: (4, None) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa1692c0-d16b-4d74-be60-2ae8fd146392 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef065369-fb9d-4f9e-838e-6ecfe75e9774]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa1692c0-d16b-4d74-be60-2ae8fd146392 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5 -p 172.16.0.220:3260 --logout {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[117ac19b-e106-43d4-b4a9-db3b9f7dd7bb]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa1692c0-d16b-4d74-be60-2ae8fd146392 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5, portal: 172.16.0.220,3260]
Nov 10 18:00:06 user nova-compute[75100]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5, portal: 172.16.0.220,3260] successful.
Nov 10 18:00:06 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5 -p 172.16.0.220:3260 --op delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8ca8713-4e07-4d54-83ec-76250f93d7a5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd84d6dc-a01f-4963-beac-4a4f3cd8d648]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa1692c0-d16b-4d74-be60-2ae8fd146392 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-aa1692c0-d16b-4d74-be60-2ae8fd146392 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.389s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa1692c0-d16b-4d74-be60-2ae8fd146392 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] <== disconnect_volume: return (391ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa1692c0-d16b-4d74-be60-2ae8fd146392 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 18:00:06 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-aa1692c0-d16b-4d74-be60-2ae8fd146392 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] Deleting instance files /opt/stack/data/nova/instances/228aa1b0-1868-4bfe-b322-ca6a6406375c_del
Nov 10 18:00:06 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-aa1692c0-d16b-4d74-be60-2ae8fd146392 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] Deletion of /opt/stack/data/nova/instances/228aa1b0-1868-4bfe-b322-ca6a6406375c_del complete
Nov 10 18:00:06 user nova-compute[75100]: DEBUG nova.compute.manager [req-f866255e-fc63-45e5-b44e-b84a70a054ba req-257d7f0b-26bd-4590-bd5f-456b33f104eb service nova] [instance: 9033f537-bdeb-412c-9337-4ad86f4467b2] Received event network-vif-deleted-4c49d1d4-dba2-478e-80b6-94e012439af6 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:00:06 user nova-compute[75100]: INFO nova.compute.manager [None req-aa1692c0-d16b-4d74-be60-2ae8fd146392 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] Took 1.30 seconds to destroy the instance on the hypervisor.
Nov 10 18:00:06 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-aa1692c0-d16b-4d74-be60-2ae8fd146392 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 18:00:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:00:08 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:00:08 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] Took 1.18 seconds to deallocate network for instance.
Nov 10 18:00:08 user nova-compute[75100]: DEBUG nova.compute.manager [req-a10f3908-64c0-4609-a5e7-650bd5e8bb58 req-6064b84f-5de4-489f-95d3-346bd86cefbb service nova] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] Received event network-vif-deleted-10571181-1571-456a-9203-1d0d366c7d4b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:00:08 user nova-compute[75100]: INFO nova.compute.manager [req-a10f3908-64c0-4609-a5e7-650bd5e8bb58 req-6064b84f-5de4-489f-95d3-346bd86cefbb service nova] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] Neutron deleted interface 10571181-1571-456a-9203-1d0d366c7d4b; detaching it from the instance and deleting it from the info cache
Nov 10 18:00:08 user nova-compute[75100]: DEBUG nova.network.neutron [req-a10f3908-64c0-4609-a5e7-650bd5e8bb58 req-6064b84f-5de4-489f-95d3-346bd86cefbb service nova] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:00:08 user nova-compute[75100]: DEBUG nova.compute.manager [req-a10f3908-64c0-4609-a5e7-650bd5e8bb58 req-6064b84f-5de4-489f-95d3-346bd86cefbb service nova] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] Detach interface failed, port_id=10571181-1571-456a-9203-1d0d366c7d4b, reason: Instance 228aa1b0-1868-4bfe-b322-ca6a6406375c could not be found. {{(pid=75100) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 18:00:08 user nova-compute[75100]: DEBUG nova.compute.manager [req-a383bae9-68fb-4841-917f-7ce6e58867c5 req-558bc537-ba14-49e4-b385-954ba78b9e73 service nova] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] Received event network-vif-plugged-10571181-1571-456a-9203-1d0d366c7d4b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:00:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a383bae9-68fb-4841-917f-7ce6e58867c5 req-558bc537-ba14-49e4-b385-954ba78b9e73 service nova] Acquiring lock "228aa1b0-1868-4bfe-b322-ca6a6406375c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:00:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a383bae9-68fb-4841-917f-7ce6e58867c5 req-558bc537-ba14-49e4-b385-954ba78b9e73 service nova] Lock "228aa1b0-1868-4bfe-b322-ca6a6406375c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:00:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a383bae9-68fb-4841-917f-7ce6e58867c5 req-558bc537-ba14-49e4-b385-954ba78b9e73 service nova] Lock "228aa1b0-1868-4bfe-b322-ca6a6406375c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:00:08 user nova-compute[75100]: DEBUG nova.compute.manager [req-a383bae9-68fb-4841-917f-7ce6e58867c5 req-558bc537-ba14-49e4-b385-954ba78b9e73 service nova] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] No waiting events found dispatching network-vif-plugged-10571181-1571-456a-9203-1d0d366c7d4b {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:00:08 user nova-compute[75100]: WARNING nova.compute.manager [req-a383bae9-68fb-4841-917f-7ce6e58867c5 req-558bc537-ba14-49e4-b385-954ba78b9e73 service nova] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] Received unexpected event network-vif-plugged-10571181-1571-456a-9203-1d0d366c7d4b for instance with vm_state active and task_state deleting.
Nov 10 18:00:09 user nova-compute[75100]: INFO nova.compute.manager [None req-aa1692c0-d16b-4d74-be60-2ae8fd146392 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] Took 1.13 seconds to detach 1 volumes for instance.
Nov 10 18:00:09 user nova-compute[75100]: DEBUG nova.compute.manager [None req-aa1692c0-d16b-4d74-be60-2ae8fd146392 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 228aa1b0-1868-4bfe-b322-ca6a6406375c] Deleting volume: a8ca8713-4e07-4d54-83ec-76250f93d7a5 {{(pid=75100) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 10 18:00:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:00:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-aa1692c0-d16b-4d74-be60-2ae8fd146392 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:00:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-aa1692c0-d16b-4d74-be60-2ae8fd146392 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:00:09 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-aa1692c0-d16b-4d74-be60-2ae8fd146392 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:00:09 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-aa1692c0-d16b-4d74-be60-2ae8fd146392 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:00:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-aa1692c0-d16b-4d74-be60-2ae8fd146392 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.457s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:00:09 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-aa1692c0-d16b-4d74-be60-2ae8fd146392 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Deleted allocations for instance 228aa1b0-1868-4bfe-b322-ca6a6406375c
Nov 10 18:00:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-aa1692c0-d16b-4d74-be60-2ae8fd146392 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "228aa1b0-1868-4bfe-b322-ca6a6406375c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.393s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:00:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:00:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:00:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:00:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a1784042-fd6a-4835-9634-9a0355a9374b tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Acquiring lock "c7fbe35b-4794-4eb9-8033-923247064458" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:00:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a1784042-fd6a-4835-9634-9a0355a9374b tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "c7fbe35b-4794-4eb9-8033-923247064458" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:00:16 user nova-compute[75100]: INFO nova.compute.manager [None req-a1784042-fd6a-4835-9634-9a0355a9374b tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Detaching volume 0280d371-2779-450b-9c9a-c5adde034308
Nov 10 18:00:16 user nova-compute[75100]: INFO nova.virt.block_device [None req-a1784042-fd6a-4835-9634-9a0355a9374b tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Attempting to driver detach volume 0280d371-2779-450b-9c9a-c5adde034308 from mountpoint /dev/vdb
Nov 10 18:00:16 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-a1784042-fd6a-4835-9634-9a0355a9374b tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Attempting to detach device vdb from instance c7fbe35b-4794-4eb9-8033-923247064458 from the persistent domain config. {{(pid=75100) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 18:00:16 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-a1784042-fd6a-4835-9634-9a0355a9374b tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 18:00:16 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:00:16 user nova-compute[75100]:   <source dev="/dev/sdg"/>
Nov 10 18:00:16 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 18:00:16 user nova-compute[75100]:   <serial>0280d371-2779-450b-9c9a-c5adde034308</serial>
Nov 10 18:00:16 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 10 18:00:16 user nova-compute[75100]: </disk>
Nov 10 18:00:16 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 18:00:16 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-a1784042-fd6a-4835-9634-9a0355a9374b tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Successfully detached device vdb from instance c7fbe35b-4794-4eb9-8033-923247064458 from the persistent domain config.
Nov 10 18:00:16 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-a1784042-fd6a-4835-9634-9a0355a9374b tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c7fbe35b-4794-4eb9-8033-923247064458 from the live domain config. {{(pid=75100) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 18:00:16 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-a1784042-fd6a-4835-9634-9a0355a9374b tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 18:00:16 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:00:16 user nova-compute[75100]:   <source dev="/dev/sdg"/>
Nov 10 18:00:16 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 18:00:16 user nova-compute[75100]:   <serial>0280d371-2779-450b-9c9a-c5adde034308</serial>
Nov 10 18:00:16 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 10 18:00:16 user nova-compute[75100]: </disk>
Nov 10 18:00:16 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 18:00:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:00:16 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-a1784042-fd6a-4835-9634-9a0355a9374b tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c7fbe35b-4794-4eb9-8033-923247064458 {{(pid=75100) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 18:00:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:00:19 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:00:19 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:00:20 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:00:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:00:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:00:24 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:00:24 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:00:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:00:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:00:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:00:24 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 18:00:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:00:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce634a11-5628-4f1c-8437-95f26519d8a0/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:00:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Acquiring lock "fcc2bfb6-fd6b-4229-9664-42f33b138444" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:00:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Lock "fcc2bfb6-fd6b-4229-9664-42f33b138444" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:00:24 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 18:00:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce634a11-5628-4f1c-8437-95f26519d8a0/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:00:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce634a11-5628-4f1c-8437-95f26519d8a0/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:00:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:00:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:00:24 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 18:00:24 user nova-compute[75100]: INFO nova.compute.claims [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Claim successful on node user
Nov 10 18:00:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce634a11-5628-4f1c-8437-95f26519d8a0/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:00:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:00:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:00:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:00:25 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:00:25 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:00:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:00:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/989f3ce5-067b-45e4-a2e5-445024e13202/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:00:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.575s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:00:25 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 18:00:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/989f3ce5-067b-45e4-a2e5-445024e13202/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:00:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/989f3ce5-067b-45e4-a2e5-445024e13202/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:00:25 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 18:00:25 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 18:00:25 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 18:00:25 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 18:00:25 user nova-compute[75100]: DEBUG nova.policy [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5ca4c02860b54cc68d0a7d1f6088cf8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2871e8755b32497d901be0f062fad858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 18:00:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/989f3ce5-067b-45e4-a2e5-445024e13202/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:00:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2f4288-da43-4bf3-9ef4-fd53961fe74c/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:00:25 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 18:00:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 18:00:25 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Creating image(s)
Nov 10 18:00:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Acquiring lock "/opt/stack/data/nova/instances/fcc2bfb6-fd6b-4229-9664-42f33b138444/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:00:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Lock "/opt/stack/data/nova/instances/fcc2bfb6-fd6b-4229-9664-42f33b138444/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:00:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Lock "/opt/stack/data/nova/instances/fcc2bfb6-fd6b-4229-9664-42f33b138444/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:00:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:00:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2f4288-da43-4bf3-9ef4-fd53961fe74c/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:00:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2f4288-da43-4bf3-9ef4-fd53961fe74c/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:00:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.206s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:00:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Acquiring lock "818b9e28e061d41a38d903968b229be2ed9ba520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:00:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:00:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:00:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2f4288-da43-4bf3-9ef4-fd53961fe74c/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:00:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 18:00:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7fbe35b-4794-4eb9-8033-923247064458/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:00:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.219s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:00:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/fcc2bfb6-fd6b-4229-9664-42f33b138444/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:00:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/fcc2bfb6-fd6b-4229-9664-42f33b138444/disk 1073741824" returned: 0 in 0.063s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:00:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:00:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:00:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:00:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.197s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:00:26 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fcc2bfb6-fd6b-4229-9664-42f33b138444/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 18:00:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc2bfb6-fd6b-4229-9664-42f33b138444/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:00:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7fbe35b-4794-4eb9-8033-923247064458/disk --force-share --output=json" returned: 0 in 0.344s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:00:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7fbe35b-4794-4eb9-8033-923247064458/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:00:26 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Successfully created port: 8c7dcf78-fc4a-4fcb-905e-ce75143a9450 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 18:00:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc2bfb6-fd6b-4229-9664-42f33b138444/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:00:26 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Cannot resize image /opt/stack/data/nova/instances/fcc2bfb6-fd6b-4229-9664-42f33b138444/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 18:00:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 18:00:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Ensure instance console log exists: /opt/stack/data/nova/instances/fcc2bfb6-fd6b-4229-9664-42f33b138444/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 18:00:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:00:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:00:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:00:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7fbe35b-4794-4eb9-8033-923247064458/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:00:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:00:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:00:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:00:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk.rescue --force-share --output=json" returned: 0 in 0.212s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:00:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:00:27 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Successfully updated port: 8c7dcf78-fc4a-4fcb-905e-ce75143a9450 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 18:00:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Acquiring lock "refresh_cache-fcc2bfb6-fd6b-4229-9664-42f33b138444" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:00:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Acquired lock "refresh_cache-fcc2bfb6-fd6b-4229-9664-42f33b138444" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:00:27 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 18:00:27 user nova-compute[75100]: DEBUG nova.compute.manager [req-a56f0baa-8086-4aad-aa4e-7bc5d4ceb247 req-f28ba293-1c11-4c71-82f5-33a6f7880ffe service nova] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Received event network-changed-8c7dcf78-fc4a-4fcb-905e-ce75143a9450 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:00:27 user nova-compute[75100]: DEBUG nova.compute.manager [req-a56f0baa-8086-4aad-aa4e-7bc5d4ceb247 req-f28ba293-1c11-4c71-82f5-33a6f7880ffe service nova] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Refreshing instance network info cache due to event network-changed-8c7dcf78-fc4a-4fcb-905e-ce75143a9450. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 18:00:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a56f0baa-8086-4aad-aa4e-7bc5d4ceb247 req-f28ba293-1c11-4c71-82f5-33a6f7880ffe service nova] Acquiring lock "refresh_cache-fcc2bfb6-fd6b-4229-9664-42f33b138444" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:00:27 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 18:00:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:00:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:00:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:00:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:00:27 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Updating instance_info_cache with network_info: [{"id": "8c7dcf78-fc4a-4fcb-905e-ce75143a9450", "address": "fa:16:3e:be:ec:38", "network": {"id": "20522623-c29d-44f8-9047-68dde7f763c1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1770250829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2871e8755b32497d901be0f062fad858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7dcf78-fc", "ovs_interfaceid": "8c7dcf78-fc4a-4fcb-905e-ce75143a9450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:00:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Releasing lock "refresh_cache-fcc2bfb6-fd6b-4229-9664-42f33b138444" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:00:27 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Instance network_info: |[{"id": "8c7dcf78-fc4a-4fcb-905e-ce75143a9450", "address": "fa:16:3e:be:ec:38", "network": {"id": "20522623-c29d-44f8-9047-68dde7f763c1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1770250829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2871e8755b32497d901be0f062fad858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7dcf78-fc", "ovs_interfaceid": "8c7dcf78-fc4a-4fcb-905e-ce75143a9450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 18:00:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a56f0baa-8086-4aad-aa4e-7bc5d4ceb247 req-f28ba293-1c11-4c71-82f5-33a6f7880ffe service nova] Acquired lock "refresh_cache-fcc2bfb6-fd6b-4229-9664-42f33b138444" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:00:27 user nova-compute[75100]: DEBUG nova.network.neutron [req-a56f0baa-8086-4aad-aa4e-7bc5d4ceb247 req-f28ba293-1c11-4c71-82f5-33a6f7880ffe service nova] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Refreshing network info cache for port 8c7dcf78-fc4a-4fcb-905e-ce75143a9450 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 18:00:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Start _get_guest_xml network_info=[{"id": "8c7dcf78-fc4a-4fcb-905e-ce75143a9450", "address": "fa:16:3e:be:ec:38", "network": {"id": "20522623-c29d-44f8-9047-68dde7f763c1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1770250829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2871e8755b32497d901be0f062fad858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7dcf78-fc", "ovs_interfaceid": "8c7dcf78-fc4a-4fcb-905e-ce75143a9450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'e3cc5321-4d40-49ee-885c-700e14741732'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 18:00:27 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:00:27 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:00:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 18:00:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 18:00:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 18:00:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 18:00:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 18:00:27 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T17:40:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 18:00:27 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 18:00:27 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 18:00:27 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 18:00:27 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 18:00:27 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 18:00:27 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 18:00:27 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 18:00:27 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 18:00:27 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 18:00:27 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 18:00:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:00:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1881005608',display_name='tempest-ServerStableDeviceRescueTest-server-1881005608',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1881005608',id=32,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDdFRCCVJjzF0al+SNDE7QVNwX8dpmNqM9NipR0GOwNcsjdYao4SsL1LfUC8C5UM4/qd1AeQBDezJxHm1binUeTwV3tWbJbrH4Uz3nBjNILZwiQ2cJMmyowJPFCnynvZfw==',key_name='tempest-keypair-1213048421',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2871e8755b32497d901be0f062fad858',ramdisk_id='',reservation_id='r-m01bxec1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-921350323',owner_user_name='tempest-ServerStableDeviceRescueTest-921350323-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T18:00:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ca4c02860b54cc68d0a7d1f6088cf8f',uuid=fcc2bfb6-fd6b-4229-9664-42f33b138444,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c7dcf78-fc4a-4fcb-905e-ce75143a9450", "address": "fa:16:3e:be:ec:38", "network": {"id": "20522623-c29d-44f8-9047-68dde7f763c1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1770250829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2871e8755b32497d901be0f062fad858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7dcf78-fc", "ovs_interfaceid": "8c7dcf78-fc4a-4fcb-905e-ce75143a9450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 18:00:27 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Converting VIF {"id": "8c7dcf78-fc4a-4fcb-905e-ce75143a9450", "address": "fa:16:3e:be:ec:38", "network": {"id": "20522623-c29d-44f8-9047-68dde7f763c1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1770250829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2871e8755b32497d901be0f062fad858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7dcf78-fc", "ovs_interfaceid": "8c7dcf78-fc4a-4fcb-905e-ce75143a9450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:00:27 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:ec:38,bridge_name='br-int',has_traffic_filtering=True,id=8c7dcf78-fc4a-4fcb-905e-ce75143a9450,network=Network(20522623-c29d-44f8-9047-68dde7f763c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c7dcf78-fc') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:00:27 user nova-compute[75100]: DEBUG nova.objects.instance [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Lazy-loading 'pci_devices' on Instance uuid fcc2bfb6-fd6b-4229-9664-42f33b138444 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:00:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] End _get_guest_xml xml=<domain type="kvm">
Nov 10 18:00:27 user nova-compute[75100]:   <uuid>fcc2bfb6-fd6b-4229-9664-42f33b138444</uuid>
Nov 10 18:00:27 user nova-compute[75100]:   <name>instance-00000020</name>
Nov 10 18:00:27 user nova-compute[75100]:   <memory>524288</memory>
Nov 10 18:00:27 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 10 18:00:27 user nova-compute[75100]:   <metadata>
Nov 10 18:00:27 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 18:00:27 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 10 18:00:27 user nova-compute[75100]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1881005608</nova:name>
Nov 10 18:00:27 user nova-compute[75100]:       <nova:creationTime>2023-11-10 18:00:27</nova:creationTime>
Nov 10 18:00:27 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 10 18:00:27 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 10 18:00:27 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 10 18:00:27 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 10 18:00:27 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 18:00:27 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 10 18:00:27 user nova-compute[75100]:       </nova:flavor>
Nov 10 18:00:27 user nova-compute[75100]:       <nova:owner>
Nov 10 18:00:27 user nova-compute[75100]:         <nova:user uuid="5ca4c02860b54cc68d0a7d1f6088cf8f">tempest-ServerStableDeviceRescueTest-921350323-project-member</nova:user>
Nov 10 18:00:27 user nova-compute[75100]:         <nova:project uuid="2871e8755b32497d901be0f062fad858">tempest-ServerStableDeviceRescueTest-921350323</nova:project>
Nov 10 18:00:27 user nova-compute[75100]:       </nova:owner>
Nov 10 18:00:27 user nova-compute[75100]:       <nova:root type="image" uuid="e3cc5321-4d40-49ee-885c-700e14741732"/>
Nov 10 18:00:27 user nova-compute[75100]:       <nova:ports>
Nov 10 18:00:27 user nova-compute[75100]:         <nova:port uuid="8c7dcf78-fc4a-4fcb-905e-ce75143a9450">
Nov 10 18:00:27 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 10 18:00:27 user nova-compute[75100]:         </nova:port>
Nov 10 18:00:27 user nova-compute[75100]:       </nova:ports>
Nov 10 18:00:27 user nova-compute[75100]:     </nova:instance>
Nov 10 18:00:27 user nova-compute[75100]:   </metadata>
Nov 10 18:00:27 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 10 18:00:27 user nova-compute[75100]:     <system>
Nov 10 18:00:27 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 18:00:27 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 10 18:00:27 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 10 18:00:27 user nova-compute[75100]:       <entry name="serial">fcc2bfb6-fd6b-4229-9664-42f33b138444</entry>
Nov 10 18:00:27 user nova-compute[75100]:       <entry name="uuid">fcc2bfb6-fd6b-4229-9664-42f33b138444</entry>
Nov 10 18:00:27 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 10 18:00:27 user nova-compute[75100]:     </system>
Nov 10 18:00:27 user nova-compute[75100]:   </sysinfo>
Nov 10 18:00:27 user nova-compute[75100]:   <os>
Nov 10 18:00:27 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 18:00:27 user nova-compute[75100]:     <boot dev="hd"/>
Nov 10 18:00:27 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 10 18:00:27 user nova-compute[75100]:   </os>
Nov 10 18:00:27 user nova-compute[75100]:   <features>
Nov 10 18:00:27 user nova-compute[75100]:     <acpi/>
Nov 10 18:00:27 user nova-compute[75100]:     <apic/>
Nov 10 18:00:27 user nova-compute[75100]:     <vmcoreinfo/>
Nov 10 18:00:27 user nova-compute[75100]:   </features>
Nov 10 18:00:27 user nova-compute[75100]:   <clock offset="utc">
Nov 10 18:00:27 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 18:00:27 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 18:00:27 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 10 18:00:27 user nova-compute[75100]:   </clock>
Nov 10 18:00:27 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 10 18:00:27 user nova-compute[75100]:     <model>Nehalem</model>
Nov 10 18:00:27 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 18:00:27 user nova-compute[75100]:   </cpu>
Nov 10 18:00:27 user nova-compute[75100]:   <devices>
Nov 10 18:00:27 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 10 18:00:27 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 18:00:27 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/fcc2bfb6-fd6b-4229-9664-42f33b138444/disk"/>
Nov 10 18:00:27 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 10 18:00:27 user nova-compute[75100]:     </disk>
Nov 10 18:00:27 user nova-compute[75100]:     <interface type="ethernet">
Nov 10 18:00:27 user nova-compute[75100]:       <mac address="fa:16:3e:be:ec:38"/>
Nov 10 18:00:27 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 18:00:27 user nova-compute[75100]:       <mtu size="1442"/>
Nov 10 18:00:27 user nova-compute[75100]:       <target dev="tap8c7dcf78-fc"/>
Nov 10 18:00:27 user nova-compute[75100]:     </interface>
Nov 10 18:00:27 user nova-compute[75100]:     <serial type="pty">
Nov 10 18:00:27 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/fcc2bfb6-fd6b-4229-9664-42f33b138444/console.log" append="off"/>
Nov 10 18:00:27 user nova-compute[75100]:     </serial>
Nov 10 18:00:27 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 18:00:27 user nova-compute[75100]:     <video>
Nov 10 18:00:27 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 18:00:27 user nova-compute[75100]:     </video>
Nov 10 18:00:27 user nova-compute[75100]:     <rng model="virtio">
Nov 10 18:00:27 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 10 18:00:27 user nova-compute[75100]:     </rng>
Nov 10 18:00:27 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 10 18:00:27 user nova-compute[75100]:     <memballoon model="virtio">
Nov 10 18:00:27 user nova-compute[75100]:       <stats period="10"/>
Nov 10 18:00:27 user nova-compute[75100]:     </memballoon>
Nov 10 18:00:27 user nova-compute[75100]:   </devices>
Nov 10 18:00:27 user nova-compute[75100]: </domain>
Nov 10 18:00:27 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 18:00:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:00:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1881005608',display_name='tempest-ServerStableDeviceRescueTest-server-1881005608',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1881005608',id=32,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDdFRCCVJjzF0al+SNDE7QVNwX8dpmNqM9NipR0GOwNcsjdYao4SsL1LfUC8C5UM4/qd1AeQBDezJxHm1binUeTwV3tWbJbrH4Uz3nBjNILZwiQ2cJMmyowJPFCnynvZfw==',key_name='tempest-keypair-1213048421',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2871e8755b32497d901be0f062fad858',ramdisk_id='',reservation_id='r-m01bxec1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-921350323',owner_user_name='tempest-ServerStableDeviceRescueTest-921350323-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T18:00:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ca4c02860b54cc68d0a7d1f6088cf8f',uuid=fcc2bfb6-fd6b-4229-9664-42f33b138444,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c7dcf78-fc4a-4fcb-905e-ce75143a9450", "address": "fa:16:3e:be:ec:38", "network": {"id": "20522623-c29d-44f8-9047-68dde7f763c1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1770250829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2871e8755b32497d901be0f062fad858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7dcf78-fc", "ovs_interfaceid": "8c7dcf78-fc4a-4fcb-905e-ce75143a9450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 18:00:27 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Converting VIF {"id": "8c7dcf78-fc4a-4fcb-905e-ce75143a9450", "address": "fa:16:3e:be:ec:38", "network": {"id": "20522623-c29d-44f8-9047-68dde7f763c1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1770250829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2871e8755b32497d901be0f062fad858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7dcf78-fc", "ovs_interfaceid": "8c7dcf78-fc4a-4fcb-905e-ce75143a9450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:00:27 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:ec:38,bridge_name='br-int',has_traffic_filtering=True,id=8c7dcf78-fc4a-4fcb-905e-ce75143a9450,network=Network(20522623-c29d-44f8-9047-68dde7f763c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c7dcf78-fc') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:00:27 user nova-compute[75100]: DEBUG os_vif [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:ec:38,bridge_name='br-int',has_traffic_filtering=True,id=8c7dcf78-fc4a-4fcb-905e-ce75143a9450,network=Network(20522623-c29d-44f8-9047-68dde7f763c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c7dcf78-fc') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 18:00:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:00:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:00:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 18:00:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:00:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a9a809a3-cbc8-5fa9-b70a-65223fef20b6', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:00:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:00:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:00:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:00:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8c7dcf78-fc, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:00:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8c7dcf78-fc, col_values=(('qos', UUID('e9a47dfc-a4de-4986-ab30-9945f51423de')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:00:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8c7dcf78-fc, col_values=(('external_ids', {'iface-id': '8c7dcf78-fc4a-4fcb-905e-ce75143a9450', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:ec:38', 'vm-uuid': 'fcc2bfb6-fd6b-4229-9664-42f33b138444'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:00:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:00:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:00:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:00:27 user nova-compute[75100]: INFO os_vif [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:ec:38,bridge_name='br-int',has_traffic_filtering=True,id=8c7dcf78-fc4a-4fcb-905e-ce75143a9450,network=Network(20522623-c29d-44f8-9047-68dde7f763c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c7dcf78-fc')
Nov 10 18:00:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json" returned: 0 in 0.289s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:00:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 18:00:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] No VIF found with MAC fa:16:3e:be:ec:38, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 18:00:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:00:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:00:28 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 18:00:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adf9e657-d366-4afd-a752-87e69b73eb81/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:00:28 user nova-compute[75100]: DEBUG nova.network.neutron [req-a56f0baa-8086-4aad-aa4e-7bc5d4ceb247 req-f28ba293-1c11-4c71-82f5-33a6f7880ffe service nova] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Updated VIF entry in instance network info cache for port 8c7dcf78-fc4a-4fcb-905e-ce75143a9450. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 18:00:28 user nova-compute[75100]: DEBUG nova.network.neutron [req-a56f0baa-8086-4aad-aa4e-7bc5d4ceb247 req-f28ba293-1c11-4c71-82f5-33a6f7880ffe service nova] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Updating instance_info_cache with network_info: [{"id": "8c7dcf78-fc4a-4fcb-905e-ce75143a9450", "address": "fa:16:3e:be:ec:38", "network": {"id": "20522623-c29d-44f8-9047-68dde7f763c1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1770250829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2871e8755b32497d901be0f062fad858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7dcf78-fc", "ovs_interfaceid": "8c7dcf78-fc4a-4fcb-905e-ce75143a9450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:00:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a56f0baa-8086-4aad-aa4e-7bc5d4ceb247 req-f28ba293-1c11-4c71-82f5-33a6f7880ffe service nova] Releasing lock "refresh_cache-fcc2bfb6-fd6b-4229-9664-42f33b138444" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:00:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adf9e657-d366-4afd-a752-87e69b73eb81/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:00:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adf9e657-d366-4afd-a752-87e69b73eb81/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:00:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adf9e657-d366-4afd-a752-87e69b73eb81/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:00:28 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 18:00:29 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:00:29 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:00:29 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Hypervisor/Node resource view: name=user free_ram=7600MB free_disk=24.510513305664062GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 18:00:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:00:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:00:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:00:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:00:29 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:00:29 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 3e14de19-540d-4dc2-a058-6874d8d14478 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:00:29 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:00:29 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 989f3ce5-067b-45e4-a2e5-445024e13202 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:00:29 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance c7fbe35b-4794-4eb9-8033-923247064458 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:00:29 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance adf9e657-d366-4afd-a752-87e69b73eb81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:00:29 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 6d227210-c4df-4aa7-9969-70fa137aeb63 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:00:29 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance ca2f4288-da43-4bf3-9ef4-fd53961fe74c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:00:29 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance ce634a11-5628-4f1c-8437-95f26519d8a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:00:29 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance fcc2bfb6-fd6b-4229-9664-42f33b138444 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:00:29 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 18:00:29 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 18:00:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:00:29 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:00:29 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:00:29 user nova-compute[75100]: DEBUG nova.compute.manager [req-92e57cc3-e4e1-4ca5-ae2e-89cfdcc91a63 req-808d98ca-80ba-4201-92c0-0e63528a1c8a service nova] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Received event network-vif-plugged-8c7dcf78-fc4a-4fcb-905e-ce75143a9450 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:00:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-92e57cc3-e4e1-4ca5-ae2e-89cfdcc91a63 req-808d98ca-80ba-4201-92c0-0e63528a1c8a service nova] Acquiring lock "fcc2bfb6-fd6b-4229-9664-42f33b138444-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:00:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-92e57cc3-e4e1-4ca5-ae2e-89cfdcc91a63 req-808d98ca-80ba-4201-92c0-0e63528a1c8a service nova] Lock "fcc2bfb6-fd6b-4229-9664-42f33b138444-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:00:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-92e57cc3-e4e1-4ca5-ae2e-89cfdcc91a63 req-808d98ca-80ba-4201-92c0-0e63528a1c8a service nova] Lock "fcc2bfb6-fd6b-4229-9664-42f33b138444-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:00:29 user nova-compute[75100]: DEBUG nova.compute.manager [req-92e57cc3-e4e1-4ca5-ae2e-89cfdcc91a63 req-808d98ca-80ba-4201-92c0-0e63528a1c8a service nova] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] No waiting events found dispatching network-vif-plugged-8c7dcf78-fc4a-4fcb-905e-ce75143a9450 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:00:29 user nova-compute[75100]: WARNING nova.compute.manager [req-92e57cc3-e4e1-4ca5-ae2e-89cfdcc91a63 req-808d98ca-80ba-4201-92c0-0e63528a1c8a service nova] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Received unexpected event network-vif-plugged-8c7dcf78-fc4a-4fcb-905e-ce75143a9450 for instance with vm_state building and task_state spawning.
Nov 10 18:00:29 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 18:00:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.736s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:00:29 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:00:29 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75100) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 18:00:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:00:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:00:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:00:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:00:30 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:00:30 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:00:30 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 18:00:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "refresh_cache-989f3ce5-067b-45e4-a2e5-445024e13202" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:00:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquired lock "refresh_cache-989f3ce5-067b-45e4-a2e5-445024e13202" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:00:31 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 18:00:31 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] Updating instance_info_cache with network_info: [{"id": "9dd712ca-c177-4a1b-8d45-78db1470b9c1", "address": "fa:16:3e:c5:ed:2a", "network": {"id": "879f9f54-7640-4384-b28f-7d8d38d7f74f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1830593335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc3d8aa64c704f45b08bdb0f1ecb2c90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dd712ca-c1", "ovs_interfaceid": "9dd712ca-c177-4a1b-8d45-78db1470b9c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:00:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Releasing lock "refresh_cache-989f3ce5-067b-45e4-a2e5-445024e13202" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:00:31 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 18:00:31 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:00:31 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:00:31 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:00:31 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Triggering sync for uuid b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b {{(pid=75100) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 18:00:31 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Triggering sync for uuid 3e14de19-540d-4dc2-a058-6874d8d14478 {{(pid=75100) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 18:00:31 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Triggering sync for uuid 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75 {{(pid=75100) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 18:00:31 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Triggering sync for uuid 989f3ce5-067b-45e4-a2e5-445024e13202 {{(pid=75100) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 18:00:31 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Triggering sync for uuid c7fbe35b-4794-4eb9-8033-923247064458 {{(pid=75100) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 18:00:31 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Triggering sync for uuid adf9e657-d366-4afd-a752-87e69b73eb81 {{(pid=75100) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 18:00:31 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Triggering sync for uuid 6d227210-c4df-4aa7-9969-70fa137aeb63 {{(pid=75100) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 18:00:31 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Triggering sync for uuid ca2f4288-da43-4bf3-9ef4-fd53961fe74c {{(pid=75100) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 18:00:31 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Triggering sync for uuid ce634a11-5628-4f1c-8437-95f26519d8a0 {{(pid=75100) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 18:00:31 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Triggering sync for uuid fcc2bfb6-fd6b-4229-9664-42f33b138444 {{(pid=75100) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 18:00:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:00:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:00:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "3e14de19-540d-4dc2-a058-6874d8d14478" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:00:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "3e14de19-540d-4dc2-a058-6874d8d14478" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:00:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "22c021d9-c8e4-455d-8e2a-a9cdfbb38f75" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:00:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "22c021d9-c8e4-455d-8e2a-a9cdfbb38f75" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:00:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "989f3ce5-067b-45e4-a2e5-445024e13202" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:00:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "989f3ce5-067b-45e4-a2e5-445024e13202" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:00:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "c7fbe35b-4794-4eb9-8033-923247064458" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:00:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "adf9e657-d366-4afd-a752-87e69b73eb81" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:00:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "adf9e657-d366-4afd-a752-87e69b73eb81" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:00:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "6d227210-c4df-4aa7-9969-70fa137aeb63" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:00:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "6d227210-c4df-4aa7-9969-70fa137aeb63" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:00:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "ca2f4288-da43-4bf3-9ef4-fd53961fe74c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:00:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "ca2f4288-da43-4bf3-9ef4-fd53961fe74c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:00:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "ce634a11-5628-4f1c-8437-95f26519d8a0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:00:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "ce634a11-5628-4f1c-8437-95f26519d8a0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:00:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "fcc2bfb6-fd6b-4229-9664-42f33b138444" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:00:31 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:00:31 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 18:00:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:00:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "3e14de19-540d-4dc2-a058-6874d8d14478" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:00:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "22c021d9-c8e4-455d-8e2a-a9cdfbb38f75" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.060s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:00:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "989f3ce5-067b-45e4-a2e5-445024e13202" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:00:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "adf9e657-d366-4afd-a752-87e69b73eb81" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.070s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:00:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "ca2f4288-da43-4bf3-9ef4-fd53961fe74c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.080s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:00:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "6d227210-c4df-4aa7-9969-70fa137aeb63" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:00:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "ce634a11-5628-4f1c-8437-95f26519d8a0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.083s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:00:31 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 18:00:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 18:00:31 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Instance spawned successfully.
Nov 10 18:00:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 18:00:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:00:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:00:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:00:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:00:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:00:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:00:31 user nova-compute[75100]: DEBUG nova.compute.manager [req-b8e31adc-b0b6-41c6-b2f8-0d9463fb37d5 req-8da92da2-1b7d-4061-80df-e7fa1040ec30 service nova] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Received event network-vif-plugged-8c7dcf78-fc4a-4fcb-905e-ce75143a9450 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:00:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b8e31adc-b0b6-41c6-b2f8-0d9463fb37d5 req-8da92da2-1b7d-4061-80df-e7fa1040ec30 service nova] Acquiring lock "fcc2bfb6-fd6b-4229-9664-42f33b138444-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:00:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b8e31adc-b0b6-41c6-b2f8-0d9463fb37d5 req-8da92da2-1b7d-4061-80df-e7fa1040ec30 service nova] Lock "fcc2bfb6-fd6b-4229-9664-42f33b138444-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:00:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b8e31adc-b0b6-41c6-b2f8-0d9463fb37d5 req-8da92da2-1b7d-4061-80df-e7fa1040ec30 service nova] Lock "fcc2bfb6-fd6b-4229-9664-42f33b138444-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:00:31 user nova-compute[75100]: DEBUG nova.compute.manager [req-b8e31adc-b0b6-41c6-b2f8-0d9463fb37d5 req-8da92da2-1b7d-4061-80df-e7fa1040ec30 service nova] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] No waiting events found dispatching network-vif-plugged-8c7dcf78-fc4a-4fcb-905e-ce75143a9450 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:00:31 user nova-compute[75100]: WARNING nova.compute.manager [req-b8e31adc-b0b6-41c6-b2f8-0d9463fb37d5 req-8da92da2-1b7d-4061-80df-e7fa1040ec30 service nova] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Received unexpected event network-vif-plugged-8c7dcf78-fc4a-4fcb-905e-ce75143a9450 for instance with vm_state building and task_state spawning.
Nov 10 18:00:31 user nova-compute[75100]: INFO nova.compute.manager [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Took 6.09 seconds to spawn the instance on the hypervisor.
Nov 10 18:00:31 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 18:00:32 user nova-compute[75100]: INFO nova.compute.manager [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Took 7.26 seconds to build instance.
Nov 10 18:00:32 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:00:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ad87cfc1-1d5d-4d1f-896b-d7d8406a59ff tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Lock "fcc2bfb6-fd6b-4229-9664-42f33b138444" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.399s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:00:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "fcc2bfb6-fd6b-4229-9664-42f33b138444" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.433s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:00:32 user nova-compute[75100]: INFO nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] During sync_power_state the instance has a pending task (spawning). Skip.
Nov 10 18:00:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "fcc2bfb6-fd6b-4229-9664-42f33b138444" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:00:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:00:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:00:36 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:00:36 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Cleaning up deleted instances {{(pid=75100) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 18:00:36 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] There are 0 instances to clean {{(pid=75100) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 18:00:36 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-a1784042-fd6a-4835-9634-9a0355a9374b tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c7fbe35b-4794-4eb9-8033-923247064458 is timed out.
Nov 10 18:00:36 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-a1784042-fd6a-4835-9634-9a0355a9374b tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Successfully detached device vdb from instance c7fbe35b-4794-4eb9-8033-923247064458 from the live domain config.
Nov 10 18:00:36 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1784042-fd6a-4835-9634-9a0355a9374b tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 18:00:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1784042-fd6a-4835-9634-9a0355a9374b tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, {'target_iqn': 'iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gzFeJSLW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:00:36 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-a1784042-fd6a-4835-9634-9a0355a9374b tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:00:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-a1784042-fd6a-4835-9634-9a0355a9374b tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:00:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-a1784042-fd6a-4835-9634-9a0355a9374b tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:00:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:00:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:00:36 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3889dc26-badb-42df-82c5-9d654035434a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:00:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1784042-fd6a-4835-9634-9a0355a9374b tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 18:00:36 user nova-compute[75100]: No targets found.
Nov 10 18:00:36 user nova-compute[75100]: iSNS:
Nov 10 18:00:36 user nova-compute[75100]: No targets found.
Nov 10 18:00:36 user nova-compute[75100]: STATIC:
Nov 10 18:00:36 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0
Nov 10 18:00:36 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:00:36 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:00:36 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308
Nov 10 18:00:36 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:00:36 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:00:36 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d
Nov 10 18:00:36 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:00:36 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:00:36 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00
Nov 10 18:00:36 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:00:36 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:00:36 user nova-compute[75100]: FIRMWARE:
Nov 10 18:00:36 user nova-compute[75100]: No targets found.
Nov 10 18:00:36 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:00:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1784042-fd6a-4835-9634-9a0355a9374b tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 18:00:36 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 18:00:36 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 18:00:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1784042-fd6a-4835-9634-9a0355a9374b tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 18:00:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:00:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:00:36 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b4f9e3-b143-4692-a8d3-475a545a42a2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:00:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:00:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:00:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[38705ed6-38cb-4bae-a9c4-439709d7abab]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:00:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1784042-fd6a-4835-9634-9a0355a9374b tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 (non-flash)
Nov 10 18:00:37 user nova-compute[75100]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 (non-flash)
Nov 10 18:00:37 user nova-compute[75100]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d (non-flash)
Nov 10 18:00:37 user nova-compute[75100]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 (non-flash)
Nov 10 18:00:37 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:00:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1784042-fd6a-4835-9634-9a0355a9374b tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 (non-flash)
Nov 10 18:00:37 user nova-compute[75100]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 (non-flash)
Nov 10 18:00:37 user nova-compute[75100]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d (non-flash)
Nov 10 18:00:37 user nova-compute[75100]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 (non-flash)
Nov 10 18:00:37 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:00:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1784042-fd6a-4835-9634-9a0355a9374b tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3d42c0550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308'): ({'sdg'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 18:00:37 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-a1784042-fd6a-4835-9634-9a0355a9374b tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Removing single pathed devices sdg {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 18:00:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:00:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:00:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[585e5e51-193b-48d3-9789-a2c775b179e3]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:00:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:00:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.030s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:00:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f9859d-e39b-4e96-a8a4-76d26716d599]: (4, ('ok\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:00:37 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-a1784042-fd6a-4835-9634-9a0355a9374b tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Flushing IO for device /dev/sdg {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 18:00:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:00:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:00:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1928663f-1461-49c0-aa66-d2a1205910c4]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:00:37 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-a1784042-fd6a-4835-9634-9a0355a9374b tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 18:00:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:00:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.042s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:00:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1165d444-8041-425c-a7a1-24da0aecd600]: (4, ('1', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:00:37 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-a1784042-fd6a-4835-9634-9a0355a9374b tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 18:00:37 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-a1784042-fd6a-4835-9634-9a0355a9374b tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] SCSI volumes sdg have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 18:00:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1784042-fd6a-4835-9634-9a0355a9374b tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 18:00:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:00:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:00:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b395b2-9b30-4468-b2dc-e7a52e90942c]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:00:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1784042-fd6a-4835-9634-9a0355a9374b tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:00:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 -p 172.16.0.220:3260 --logout {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:00:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:00:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba04bc5-67fc-4505-9bad-58b98c77b6ab]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:00:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1784042-fd6a-4835-9634-9a0355a9374b tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308, portal: 172.16.0.220,3260]
Nov 10 18:00:37 user nova-compute[75100]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308, portal: 172.16.0.220,3260] successful.
Nov 10 18:00:37 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:00:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 -p 172.16.0.220:3260 --op delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:00:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0280d371-2779-450b-9c9a-c5adde034308 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:00:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[584bd1ea-667c-4114-8349-761a2af2a74b]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:00:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1784042-fd6a-4835-9634-9a0355a9374b tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:00:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-a1784042-fd6a-4835-9634-9a0355a9374b tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:00:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1784042-fd6a-4835-9634-9a0355a9374b tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] <== disconnect_volume: return (374ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:00:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1784042-fd6a-4835-9634-9a0355a9374b tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 18:00:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:00:38 user nova-compute[75100]: DEBUG nova.objects.instance [None req-a1784042-fd6a-4835-9634-9a0355a9374b tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lazy-loading 'flavor' on Instance uuid c7fbe35b-4794-4eb9-8033-923247064458 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:00:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a1784042-fd6a-4835-9634-9a0355a9374b tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "c7fbe35b-4794-4eb9-8033-923247064458" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.471s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:00:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "c7fbe35b-4794-4eb9-8033-923247064458" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 7.150s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:00:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "c7fbe35b-4794-4eb9-8033-923247064458" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:00:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b224ef16-8c28-4e1f-abc4-16ae92d9c496 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Acquiring lock "adf9e657-d366-4afd-a752-87e69b73eb81" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:00:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b224ef16-8c28-4e1f-abc4-16ae92d9c496 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lock "adf9e657-d366-4afd-a752-87e69b73eb81" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:00:40 user nova-compute[75100]: INFO nova.compute.manager [None req-b224ef16-8c28-4e1f-abc4-16ae92d9c496 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Detaching volume 73be880b-b3af-4d74-831e-5d346119350d
Nov 10 18:00:40 user nova-compute[75100]: INFO nova.virt.block_device [None req-b224ef16-8c28-4e1f-abc4-16ae92d9c496 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Attempting to driver detach volume 73be880b-b3af-4d74-831e-5d346119350d from mountpoint /dev/vdb
Nov 10 18:00:40 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-b224ef16-8c28-4e1f-abc4-16ae92d9c496 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Attempting to detach device vdb from instance adf9e657-d366-4afd-a752-87e69b73eb81 from the persistent domain config. {{(pid=75100) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 18:00:40 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-b224ef16-8c28-4e1f-abc4-16ae92d9c496 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 18:00:40 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:00:40 user nova-compute[75100]:   <source dev="/dev/sdc"/>
Nov 10 18:00:40 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 18:00:40 user nova-compute[75100]:   <serial>73be880b-b3af-4d74-831e-5d346119350d</serial>
Nov 10 18:00:40 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 18:00:40 user nova-compute[75100]: </disk>
Nov 10 18:00:40 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 18:00:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-678a40f6-0527-4735-b256-aca9a9ea01ca tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Acquiring lock "adf9e657-d366-4afd-a752-87e69b73eb81" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:00:40 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-b224ef16-8c28-4e1f-abc4-16ae92d9c496 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Successfully detached device vdb from instance adf9e657-d366-4afd-a752-87e69b73eb81 from the persistent domain config.
Nov 10 18:00:40 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-b224ef16-8c28-4e1f-abc4-16ae92d9c496 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance adf9e657-d366-4afd-a752-87e69b73eb81 from the live domain config. {{(pid=75100) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 18:00:40 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-b224ef16-8c28-4e1f-abc4-16ae92d9c496 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 18:00:40 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:00:40 user nova-compute[75100]:   <source dev="/dev/sdc"/>
Nov 10 18:00:40 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 18:00:40 user nova-compute[75100]:   <serial>73be880b-b3af-4d74-831e-5d346119350d</serial>
Nov 10 18:00:40 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 18:00:40 user nova-compute[75100]: </disk>
Nov 10 18:00:40 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 18:00:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-b224ef16-8c28-4e1f-abc4-16ae92d9c496 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance adf9e657-d366-4afd-a752-87e69b73eb81 {{(pid=75100) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 18:00:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:00:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:00:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:00:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:00:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:00:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:00:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:00:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:00:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:00:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:00:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:00:54 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:00:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:00:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:01:01 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-b224ef16-8c28-4e1f-abc4-16ae92d9c496 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance adf9e657-d366-4afd-a752-87e69b73eb81 is timed out.
Nov 10 18:01:01 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-b224ef16-8c28-4e1f-abc4-16ae92d9c496 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Successfully detached device vdb from instance adf9e657-d366-4afd-a752-87e69b73eb81 from the live domain config.
Nov 10 18:01:01 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b224ef16-8c28-4e1f-abc4-16ae92d9c496 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 18:01:01 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b224ef16-8c28-4e1f-abc4-16ae92d9c496 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, {'target_iqn': 'iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pOYGWyaQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:01:01 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-b224ef16-8c28-4e1f-abc4-16ae92d9c496 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:01:01 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-b224ef16-8c28-4e1f-abc4-16ae92d9c496 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:01:01 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-b224ef16-8c28-4e1f-abc4-16ae92d9c496 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:01:01 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:01:01 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:01:01 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc1b841-2ac5-4bf5-9936-a9f4506a8e2a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:01:01 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b224ef16-8c28-4e1f-abc4-16ae92d9c496 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 18:01:01 user nova-compute[75100]: No targets found.
Nov 10 18:01:01 user nova-compute[75100]: iSNS:
Nov 10 18:01:01 user nova-compute[75100]: No targets found.
Nov 10 18:01:01 user nova-compute[75100]: STATIC:
Nov 10 18:01:01 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0
Nov 10 18:01:01 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:01:01 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:01:01 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d
Nov 10 18:01:01 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:01:01 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:01:01 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00
Nov 10 18:01:01 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:01:01 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:01:01 user nova-compute[75100]: FIRMWARE:
Nov 10 18:01:01 user nova-compute[75100]: No targets found.
Nov 10 18:01:01 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:01:01 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b224ef16-8c28-4e1f-abc4-16ae92d9c496 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 18:01:01 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 18:01:01 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 18:01:01 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b224ef16-8c28-4e1f-abc4-16ae92d9c496 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 18:01:01 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:01:01 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:01:01 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0cf3d4-7336-46ee-b4e1-b974eeefae99]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:01:01 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:01:01 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:01:01 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[304abaa3-06bc-4aad-9353-9e6a57374e18]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:01:01 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b224ef16-8c28-4e1f-abc4-16ae92d9c496 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 (non-flash)
Nov 10 18:01:01 user nova-compute[75100]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d (non-flash)
Nov 10 18:01:01 user nova-compute[75100]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 (non-flash)
Nov 10 18:01:01 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:01:01 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b224ef16-8c28-4e1f-abc4-16ae92d9c496 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 (non-flash)
Nov 10 18:01:01 user nova-compute[75100]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d (non-flash)
Nov 10 18:01:01 user nova-compute[75100]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 (non-flash)
Nov 10 18:01:01 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:01:01 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b224ef16-8c28-4e1f-abc4-16ae92d9c496 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3bc5b55a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d'): ({'sdc'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 18:01:01 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-b224ef16-8c28-4e1f-abc4-16ae92d9c496 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Removing single pathed devices sdc {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 18:01:01 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:01:01 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:01:01 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2a7048-391e-454c-8aa3-236ae41be67f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:01:01 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:01:01 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:01:01 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e3b1d0-a4fd-4872-94d6-aa9da530314d]: (4, ('ok\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:01:01 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-b224ef16-8c28-4e1f-abc4-16ae92d9c496 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Flushing IO for device /dev/sdc {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 18:01:01 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:01:01 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.023s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:01:01 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c08336-bf53-4df0-91a1-fe7544554fe3]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:01:01 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-b224ef16-8c28-4e1f-abc4-16ae92d9c496 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 18:01:01 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:01:01 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:01:01 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9ff735-fb55-4c1d-89ce-13c271aade3a]: (4, ('1', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:01:01 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-b224ef16-8c28-4e1f-abc4-16ae92d9c496 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 18:01:01 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-b224ef16-8c28-4e1f-abc4-16ae92d9c496 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] SCSI volumes sdc have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 18:01:01 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b224ef16-8c28-4e1f-abc4-16ae92d9c496 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 18:01:01 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:01:01 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:01:01 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e44303d-1486-41d8-9639-6060cddf8e08]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:01:01 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b224ef16-8c28-4e1f-abc4-16ae92d9c496 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:01:01 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d -p 172.16.0.220:3260 --logout {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:01:01 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:01:01 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[218f36a1-e132-4233-ae89-de1cef1e463c]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:01:01 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b224ef16-8c28-4e1f-abc4-16ae92d9c496 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d, portal: 172.16.0.220,3260]
Nov 10 18:01:01 user nova-compute[75100]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d, portal: 172.16.0.220,3260] successful.
Nov 10 18:01:01 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:01:01 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d -p 172.16.0.220:3260 --op delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:01:01 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:01:01 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[031b56d3-fcc0-45d9-a681-3cd58f154c73]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:01:01 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b224ef16-8c28-4e1f-abc4-16ae92d9c496 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:01:01 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-b224ef16-8c28-4e1f-abc4-16ae92d9c496 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:01:01 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b224ef16-8c28-4e1f-abc4-16ae92d9c496 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] <== disconnect_volume: return (347ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:01:01 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b224ef16-8c28-4e1f-abc4-16ae92d9c496 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 18:01:02 user nova-compute[75100]: DEBUG nova.objects.instance [None req-b224ef16-8c28-4e1f-abc4-16ae92d9c496 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lazy-loading 'flavor' on Instance uuid adf9e657-d366-4afd-a752-87e69b73eb81 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:01:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b224ef16-8c28-4e1f-abc4-16ae92d9c496 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lock "adf9e657-d366-4afd-a752-87e69b73eb81" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.038s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:01:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-678a40f6-0527-4735-b256-aca9a9ea01ca tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lock "adf9e657-d366-4afd-a752-87e69b73eb81" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.924s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:01:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-678a40f6-0527-4735-b256-aca9a9ea01ca tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Acquiring lock "adf9e657-d366-4afd-a752-87e69b73eb81-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:01:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-678a40f6-0527-4735-b256-aca9a9ea01ca tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lock "adf9e657-d366-4afd-a752-87e69b73eb81-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:01:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-678a40f6-0527-4735-b256-aca9a9ea01ca tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lock "adf9e657-d366-4afd-a752-87e69b73eb81-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:01:02 user nova-compute[75100]: INFO nova.compute.manager [None req-678a40f6-0527-4735-b256-aca9a9ea01ca tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Terminating instance
Nov 10 18:01:02 user nova-compute[75100]: DEBUG nova.compute.manager [None req-678a40f6-0527-4735-b256-aca9a9ea01ca tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 18:01:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:01:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:01:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:01:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:01:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:01:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:01:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-5551ee85-7883-4b93-96e3-e54028b66549 req-11d23e45-47ab-447e-af94-90fdf1a0fcdb service nova] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Received event network-vif-unplugged-aaf05601-502a-464f-b119-d4fcc50001ab {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:01:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5551ee85-7883-4b93-96e3-e54028b66549 req-11d23e45-47ab-447e-af94-90fdf1a0fcdb service nova] Acquiring lock "adf9e657-d366-4afd-a752-87e69b73eb81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:01:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5551ee85-7883-4b93-96e3-e54028b66549 req-11d23e45-47ab-447e-af94-90fdf1a0fcdb service nova] Lock "adf9e657-d366-4afd-a752-87e69b73eb81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:01:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5551ee85-7883-4b93-96e3-e54028b66549 req-11d23e45-47ab-447e-af94-90fdf1a0fcdb service nova] Lock "adf9e657-d366-4afd-a752-87e69b73eb81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:01:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-5551ee85-7883-4b93-96e3-e54028b66549 req-11d23e45-47ab-447e-af94-90fdf1a0fcdb service nova] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] No waiting events found dispatching network-vif-unplugged-aaf05601-502a-464f-b119-d4fcc50001ab {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:01:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-5551ee85-7883-4b93-96e3-e54028b66549 req-11d23e45-47ab-447e-af94-90fdf1a0fcdb service nova] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Received event network-vif-unplugged-aaf05601-502a-464f-b119-d4fcc50001ab for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 18:01:03 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Instance destroyed successfully.
Nov 10 18:01:03 user nova-compute[75100]: DEBUG nova.objects.instance [None req-678a40f6-0527-4735-b256-aca9a9ea01ca tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lazy-loading 'resources' on Instance uuid adf9e657-d366-4afd-a752-87e69b73eb81 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:01:03 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-678a40f6-0527-4735-b256-aca9a9ea01ca tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:55:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-767812613',display_name='tempest-VolumesSnapshotTestJSON-instance-767812613',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-767812613',id=26,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJktL9PPom+6SpnCH7GZeZrfHv8U/OnCAaR5TBVvosTDmmCSY2dR/eQ8fHnYglw8HArx9/9KkGgig6TS7Xfht9K64LstpKiYENOoiggQdlrijsIsbgODO/4VWW4nO5dJmQ==',key_name='tempest-keypair-1888131039',keypairs=<?>,launch_index=0,launched_at=2023-11-10T17:56:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='27994d50bda0480f8964e687ed76805c',ramdisk_id='',reservation_id='r-rjj4okoh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1608810188',owner_user_name='tempest-VolumesSnapshotTestJSON-1608810188-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T17:56:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='695874f914a149a6a432598bee57a80e',uuid=adf9e657-d366-4afd-a752-87e69b73eb81,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aaf05601-502a-464f-b119-d4fcc50001ab", "address": "fa:16:3e:12:d5:10", "network": {"id": "fa38ae2b-75a1-4312-9b92-462a4240d792", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-822691382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27994d50bda0480f8964e687ed76805c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaf05601-50", "ovs_interfaceid": "aaf05601-502a-464f-b119-d4fcc50001ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 18:01:03 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-678a40f6-0527-4735-b256-aca9a9ea01ca tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Converting VIF {"id": "aaf05601-502a-464f-b119-d4fcc50001ab", "address": "fa:16:3e:12:d5:10", "network": {"id": "fa38ae2b-75a1-4312-9b92-462a4240d792", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-822691382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27994d50bda0480f8964e687ed76805c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaf05601-50", "ovs_interfaceid": "aaf05601-502a-464f-b119-d4fcc50001ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:01:03 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-678a40f6-0527-4735-b256-aca9a9ea01ca tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:d5:10,bridge_name='br-int',has_traffic_filtering=True,id=aaf05601-502a-464f-b119-d4fcc50001ab,network=Network(fa38ae2b-75a1-4312-9b92-462a4240d792),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaaf05601-50') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:01:03 user nova-compute[75100]: DEBUG os_vif [None req-678a40f6-0527-4735-b256-aca9a9ea01ca tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:d5:10,bridge_name='br-int',has_traffic_filtering=True,id=aaf05601-502a-464f-b119-d4fcc50001ab,network=Network(fa38ae2b-75a1-4312-9b92-462a4240d792),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaaf05601-50') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 18:01:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:01:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaaf05601-50, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:01:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:01:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:01:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:01:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0fe6d9ee-eb5b-4bef-8e23-d549b64d3c7e) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:01:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:01:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:01:03 user nova-compute[75100]: INFO os_vif [None req-678a40f6-0527-4735-b256-aca9a9ea01ca tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:d5:10,bridge_name='br-int',has_traffic_filtering=True,id=aaf05601-502a-464f-b119-d4fcc50001ab,network=Network(fa38ae2b-75a1-4312-9b92-462a4240d792),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaaf05601-50')
Nov 10 18:01:03 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-678a40f6-0527-4735-b256-aca9a9ea01ca tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 18:01:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-678a40f6-0527-4735-b256-aca9a9ea01ca tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, {'target_iqn': 'iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pOYGWyaQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:01:03 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-678a40f6-0527-4735-b256-aca9a9ea01ca tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:01:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-678a40f6-0527-4735-b256-aca9a9ea01ca tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:01:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-678a40f6-0527-4735-b256-aca9a9ea01ca tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:01:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:01:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:01:03 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8566c3c1-3941-4f48-9c5f-5ee29da37053]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:01:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-678a40f6-0527-4735-b256-aca9a9ea01ca tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 18:01:03 user nova-compute[75100]: No targets found.
Nov 10 18:01:03 user nova-compute[75100]: iSNS:
Nov 10 18:01:03 user nova-compute[75100]: No targets found.
Nov 10 18:01:03 user nova-compute[75100]: STATIC:
Nov 10 18:01:03 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0
Nov 10 18:01:03 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:01:03 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:01:03 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00
Nov 10 18:01:03 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:01:03 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:01:03 user nova-compute[75100]: FIRMWARE:
Nov 10 18:01:03 user nova-compute[75100]: No targets found.
Nov 10 18:01:03 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:01:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-678a40f6-0527-4735-b256-aca9a9ea01ca tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 18:01:03 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 18:01:03 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 18:01:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-678a40f6-0527-4735-b256-aca9a9ea01ca tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73be880b-b3af-4d74-831e-5d346119350d', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 18:01:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:01:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:01:03 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc531f7b-ffea-4f94-8e34-07d04199a4c2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:01:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:01:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:01:03 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[08305696-dec3-450a-8a6c-5f53597855ab]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:01:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-678a40f6-0527-4735-b256-aca9a9ea01ca tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 (non-flash)
Nov 10 18:01:03 user nova-compute[75100]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 (non-flash)
Nov 10 18:01:03 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:01:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-678a40f6-0527-4735-b256-aca9a9ea01ca tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 (non-flash)
Nov 10 18:01:03 user nova-compute[75100]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 (non-flash)
Nov 10 18:01:03 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:01:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-678a40f6-0527-4735-b256-aca9a9ea01ca tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa398653760>, {}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 18:01:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-678a40f6-0527-4735-b256-aca9a9ea01ca tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Disconnecting from: [] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 18:01:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-678a40f6-0527-4735-b256-aca9a9ea01ca tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.076s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:01:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-678a40f6-0527-4735-b256-aca9a9ea01ca tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] <== disconnect_volume: return (77ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:01:03 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-678a40f6-0527-4735-b256-aca9a9ea01ca tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 18:01:03 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-678a40f6-0527-4735-b256-aca9a9ea01ca tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Deleting instance files /opt/stack/data/nova/instances/adf9e657-d366-4afd-a752-87e69b73eb81_del
Nov 10 18:01:03 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-678a40f6-0527-4735-b256-aca9a9ea01ca tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Deletion of /opt/stack/data/nova/instances/adf9e657-d366-4afd-a752-87e69b73eb81_del complete
Nov 10 18:01:03 user nova-compute[75100]: INFO nova.compute.manager [None req-678a40f6-0527-4735-b256-aca9a9ea01ca tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Took 1.04 seconds to destroy the instance on the hypervisor.
Nov 10 18:01:03 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-678a40f6-0527-4735-b256-aca9a9ea01ca tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 18:01:03 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 18:01:03 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 18:01:05 user nova-compute[75100]: DEBUG nova.compute.manager [req-072da99c-1c20-4251-a19f-5fb37035f2b4 req-3b55cc49-7a2d-49f6-b58e-459c0ba5164f service nova] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Received event network-vif-plugged-aaf05601-502a-464f-b119-d4fcc50001ab {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:01:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-072da99c-1c20-4251-a19f-5fb37035f2b4 req-3b55cc49-7a2d-49f6-b58e-459c0ba5164f service nova] Acquiring lock "adf9e657-d366-4afd-a752-87e69b73eb81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:01:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-072da99c-1c20-4251-a19f-5fb37035f2b4 req-3b55cc49-7a2d-49f6-b58e-459c0ba5164f service nova] Lock "adf9e657-d366-4afd-a752-87e69b73eb81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:01:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-072da99c-1c20-4251-a19f-5fb37035f2b4 req-3b55cc49-7a2d-49f6-b58e-459c0ba5164f service nova] Lock "adf9e657-d366-4afd-a752-87e69b73eb81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:01:05 user nova-compute[75100]: DEBUG nova.compute.manager [req-072da99c-1c20-4251-a19f-5fb37035f2b4 req-3b55cc49-7a2d-49f6-b58e-459c0ba5164f service nova] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] No waiting events found dispatching network-vif-plugged-aaf05601-502a-464f-b119-d4fcc50001ab {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:01:05 user nova-compute[75100]: WARNING nova.compute.manager [req-072da99c-1c20-4251-a19f-5fb37035f2b4 req-3b55cc49-7a2d-49f6-b58e-459c0ba5164f service nova] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Received unexpected event network-vif-plugged-aaf05601-502a-464f-b119-d4fcc50001ab for instance with vm_state active and task_state deleting.
Nov 10 18:01:05 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:01:05 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Took 1.92 seconds to deallocate network for instance.
Nov 10 18:01:05 user nova-compute[75100]: DEBUG nova.compute.manager [req-0fa10c35-61a3-4b34-a0a9-badc1ab04278 req-a08f0aef-e2a4-4622-b2cf-07d4f279f353 service nova] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Received event network-vif-deleted-aaf05601-502a-464f-b119-d4fcc50001ab {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:01:05 user nova-compute[75100]: WARNING nova.volume.cinder [None req-678a40f6-0527-4735-b256-aca9a9ea01ca tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Attachment 6c2fd361-567c-4923-aa26-f0c0808c23b8 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 6c2fd361-567c-4923-aa26-f0c0808c23b8. (HTTP 404) (Request-ID: req-f3adb6d0-73d9-4707-9a90-65082bd7b03d)
Nov 10 18:01:05 user nova-compute[75100]: INFO nova.compute.manager [None req-678a40f6-0527-4735-b256-aca9a9ea01ca tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: adf9e657-d366-4afd-a752-87e69b73eb81] Took 0.04 seconds to detach 1 volumes for instance.
Nov 10 18:01:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-678a40f6-0527-4735-b256-aca9a9ea01ca tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:01:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-678a40f6-0527-4735-b256-aca9a9ea01ca tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:01:05 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-678a40f6-0527-4735-b256-aca9a9ea01ca tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Refreshing inventories for resource provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 18:01:05 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-678a40f6-0527-4735-b256-aca9a9ea01ca tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Updating ProviderTree inventory for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 18:01:05 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-678a40f6-0527-4735-b256-aca9a9ea01ca tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Updating inventory in ProviderTree for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 18:01:05 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-678a40f6-0527-4735-b256-aca9a9ea01ca tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Refreshing aggregate associations for resource provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64, aggregates: None {{(pid=75100) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 18:01:05 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-678a40f6-0527-4735-b256-aca9a9ea01ca tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Refreshing trait associations for resource provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2 {{(pid=75100) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 18:01:06 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-678a40f6-0527-4735-b256-aca9a9ea01ca tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:01:06 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-678a40f6-0527-4735-b256-aca9a9ea01ca tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:01:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-678a40f6-0527-4735-b256-aca9a9ea01ca tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.585s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:01:06 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-678a40f6-0527-4735-b256-aca9a9ea01ca tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Deleted allocations for instance adf9e657-d366-4afd-a752-87e69b73eb81
Nov 10 18:01:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-678a40f6-0527-4735-b256-aca9a9ea01ca tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lock "adf9e657-d366-4afd-a752-87e69b73eb81" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.833s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:01:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ef9c1eaa-52ce-4e7a-a5af-c236a2021f2f tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Acquiring lock "c7fbe35b-4794-4eb9-8033-923247064458" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:01:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ef9c1eaa-52ce-4e7a-a5af-c236a2021f2f tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "c7fbe35b-4794-4eb9-8033-923247064458" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:01:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ef9c1eaa-52ce-4e7a-a5af-c236a2021f2f tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Acquiring lock "c7fbe35b-4794-4eb9-8033-923247064458-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:01:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ef9c1eaa-52ce-4e7a-a5af-c236a2021f2f tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "c7fbe35b-4794-4eb9-8033-923247064458-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:01:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ef9c1eaa-52ce-4e7a-a5af-c236a2021f2f tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "c7fbe35b-4794-4eb9-8033-923247064458-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:01:06 user nova-compute[75100]: INFO nova.compute.manager [None req-ef9c1eaa-52ce-4e7a-a5af-c236a2021f2f tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Terminating instance
Nov 10 18:01:06 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ef9c1eaa-52ce-4e7a-a5af-c236a2021f2f tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 18:01:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:01:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:01:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:01:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:01:07 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Instance destroyed successfully.
Nov 10 18:01:07 user nova-compute[75100]: DEBUG nova.objects.instance [None req-ef9c1eaa-52ce-4e7a-a5af-c236a2021f2f tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lazy-loading 'resources' on Instance uuid c7fbe35b-4794-4eb9-8033-923247064458 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:01:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-ef9c1eaa-52ce-4e7a-a5af-c236a2021f2f tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T17:53:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-843010782',display_name='tempest-ServerActionsTestOtherA-server-523741731',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-843010782',id=24,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiOZtaw5osdCG7Z7OltXtNzbXyV1FVC6Yjpxvw/cDI+myaYVJpvsg9jfQJ1xjf+l5X7jK/9ICsmh5wP1Dm3CArptdAr7p9gmRDbitYb+wjwjgZ+DGtTIty8caL67y+u8g==',key_name='tempest-keypair-1694465190',keypairs=<?>,launch_index=0,launched_at=2023-11-10T17:57:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ce7bb141ef59487dbb2ce6243c5002af',ramdisk_id='',reservation_id='r-pq63h9x0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1364670684',owner_user_name='tempest-ServerActionsTestOtherA-1364670684-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T17:57:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f4df424af2343a2a27e869502651216',uuid=c7fbe35b-4794-4eb9-8033-923247064458,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "54a1b80b-3910-4ab8-a694-88989c4b6f4e", "address": "fa:16:3e:d3:5e:89", "network": {"id": "bf1edb58-ef26-40ca-8ec9-853fa05de13d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1416469583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7bb141ef59487dbb2ce6243c5002af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54a1b80b-39", "ovs_interfaceid": "54a1b80b-3910-4ab8-a694-88989c4b6f4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 18:01:07 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-ef9c1eaa-52ce-4e7a-a5af-c236a2021f2f tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Converting VIF {"id": "54a1b80b-3910-4ab8-a694-88989c4b6f4e", "address": "fa:16:3e:d3:5e:89", "network": {"id": "bf1edb58-ef26-40ca-8ec9-853fa05de13d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1416469583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7bb141ef59487dbb2ce6243c5002af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54a1b80b-39", "ovs_interfaceid": "54a1b80b-3910-4ab8-a694-88989c4b6f4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:01:07 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-ef9c1eaa-52ce-4e7a-a5af-c236a2021f2f tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:5e:89,bridge_name='br-int',has_traffic_filtering=True,id=54a1b80b-3910-4ab8-a694-88989c4b6f4e,network=Network(bf1edb58-ef26-40ca-8ec9-853fa05de13d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54a1b80b-39') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:01:07 user nova-compute[75100]: DEBUG os_vif [None req-ef9c1eaa-52ce-4e7a-a5af-c236a2021f2f tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:5e:89,bridge_name='br-int',has_traffic_filtering=True,id=54a1b80b-3910-4ab8-a694-88989c4b6f4e,network=Network(bf1edb58-ef26-40ca-8ec9-853fa05de13d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54a1b80b-39') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 18:01:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:01:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap54a1b80b-39, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:01:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:01:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:01:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ca969030-c0d7-4e9e-b182-b15156481de5) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:01:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:01:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:01:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:01:07 user nova-compute[75100]: INFO os_vif [None req-ef9c1eaa-52ce-4e7a-a5af-c236a2021f2f tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:5e:89,bridge_name='br-int',has_traffic_filtering=True,id=54a1b80b-3910-4ab8-a694-88989c4b6f4e,network=Network(bf1edb58-ef26-40ca-8ec9-853fa05de13d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54a1b80b-39')
Nov 10 18:01:07 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-ef9c1eaa-52ce-4e7a-a5af-c236a2021f2f tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Deleting instance files /opt/stack/data/nova/instances/c7fbe35b-4794-4eb9-8033-923247064458_del
Nov 10 18:01:07 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-ef9c1eaa-52ce-4e7a-a5af-c236a2021f2f tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Deletion of /opt/stack/data/nova/instances/c7fbe35b-4794-4eb9-8033-923247064458_del complete
Nov 10 18:01:07 user nova-compute[75100]: INFO nova.compute.manager [None req-ef9c1eaa-52ce-4e7a-a5af-c236a2021f2f tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Took 0.76 seconds to destroy the instance on the hypervisor.
Nov 10 18:01:07 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-ef9c1eaa-52ce-4e7a-a5af-c236a2021f2f tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 18:01:07 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 18:01:07 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: c7fbe35b-4794-4eb9-8033-923247064458] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 18:01:07 user nova-compute[75100]: DEBUG nova.compute.manager [req-6cfb40ba-a860-48e3-bfbf-7ce324ebc25c req-302f2c2a-a259-4768-92f3-836253ef3432 service nova] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Received event network-vif-unplugged-54a1b80b-3910-4ab8-a694-88989c4b6f4e {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:01:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6cfb40ba-a860-48e3-bfbf-7ce324ebc25c req-302f2c2a-a259-4768-92f3-836253ef3432 service nova] Acquiring lock "c7fbe35b-4794-4eb9-8033-923247064458-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:01:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6cfb40ba-a860-48e3-bfbf-7ce324ebc25c req-302f2c2a-a259-4768-92f3-836253ef3432 service nova] Lock "c7fbe35b-4794-4eb9-8033-923247064458-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:01:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6cfb40ba-a860-48e3-bfbf-7ce324ebc25c req-302f2c2a-a259-4768-92f3-836253ef3432 service nova] Lock "c7fbe35b-4794-4eb9-8033-923247064458-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:01:07 user nova-compute[75100]: DEBUG nova.compute.manager [req-6cfb40ba-a860-48e3-bfbf-7ce324ebc25c req-302f2c2a-a259-4768-92f3-836253ef3432 service nova] [instance: c7fbe35b-4794-4eb9-8033-923247064458] No waiting events found dispatching network-vif-unplugged-54a1b80b-3910-4ab8-a694-88989c4b6f4e {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:01:07 user nova-compute[75100]: DEBUG nova.compute.manager [req-6cfb40ba-a860-48e3-bfbf-7ce324ebc25c req-302f2c2a-a259-4768-92f3-836253ef3432 service nova] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Received event network-vif-unplugged-54a1b80b-3910-4ab8-a694-88989c4b6f4e for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 18:01:07 user nova-compute[75100]: DEBUG nova.compute.manager [req-6cfb40ba-a860-48e3-bfbf-7ce324ebc25c req-302f2c2a-a259-4768-92f3-836253ef3432 service nova] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Received event network-vif-plugged-54a1b80b-3910-4ab8-a694-88989c4b6f4e {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:01:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6cfb40ba-a860-48e3-bfbf-7ce324ebc25c req-302f2c2a-a259-4768-92f3-836253ef3432 service nova] Acquiring lock "c7fbe35b-4794-4eb9-8033-923247064458-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:01:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6cfb40ba-a860-48e3-bfbf-7ce324ebc25c req-302f2c2a-a259-4768-92f3-836253ef3432 service nova] Lock "c7fbe35b-4794-4eb9-8033-923247064458-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:01:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6cfb40ba-a860-48e3-bfbf-7ce324ebc25c req-302f2c2a-a259-4768-92f3-836253ef3432 service nova] Lock "c7fbe35b-4794-4eb9-8033-923247064458-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:01:07 user nova-compute[75100]: DEBUG nova.compute.manager [req-6cfb40ba-a860-48e3-bfbf-7ce324ebc25c req-302f2c2a-a259-4768-92f3-836253ef3432 service nova] [instance: c7fbe35b-4794-4eb9-8033-923247064458] No waiting events found dispatching network-vif-plugged-54a1b80b-3910-4ab8-a694-88989c4b6f4e {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:01:07 user nova-compute[75100]: WARNING nova.compute.manager [req-6cfb40ba-a860-48e3-bfbf-7ce324ebc25c req-302f2c2a-a259-4768-92f3-836253ef3432 service nova] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Received unexpected event network-vif-plugged-54a1b80b-3910-4ab8-a694-88989c4b6f4e for instance with vm_state active and task_state deleting.
Nov 10 18:01:08 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:01:08 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Took 0.89 seconds to deallocate network for instance.
Nov 10 18:01:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ef9c1eaa-52ce-4e7a-a5af-c236a2021f2f tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:01:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ef9c1eaa-52ce-4e7a-a5af-c236a2021f2f tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:01:08 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ef9c1eaa-52ce-4e7a-a5af-c236a2021f2f tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:01:08 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ef9c1eaa-52ce-4e7a-a5af-c236a2021f2f tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:01:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ef9c1eaa-52ce-4e7a-a5af-c236a2021f2f tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.382s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:01:08 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-ef9c1eaa-52ce-4e7a-a5af-c236a2021f2f tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Deleted allocations for instance c7fbe35b-4794-4eb9-8033-923247064458
Nov 10 18:01:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ef9c1eaa-52ce-4e7a-a5af-c236a2021f2f tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "c7fbe35b-4794-4eb9-8033-923247064458" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.299s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:01:09 user nova-compute[75100]: DEBUG nova.compute.manager [req-0d9394b9-1e04-4c33-856a-b6379c28601d req-d51a9bc7-dfdf-494e-ac04-c4be7518dcff service nova] [instance: c7fbe35b-4794-4eb9-8033-923247064458] Received event network-vif-deleted-54a1b80b-3910-4ab8-a694-88989c4b6f4e {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:01:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fbfe46db-094f-41c1-bcc6-f11332839387 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Acquiring lock "6d227210-c4df-4aa7-9969-70fa137aeb63" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:01:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fbfe46db-094f-41c1-bcc6-f11332839387 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "6d227210-c4df-4aa7-9969-70fa137aeb63" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:01:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fbfe46db-094f-41c1-bcc6-f11332839387 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Acquiring lock "6d227210-c4df-4aa7-9969-70fa137aeb63-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:01:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fbfe46db-094f-41c1-bcc6-f11332839387 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "6d227210-c4df-4aa7-9969-70fa137aeb63-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:01:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fbfe46db-094f-41c1-bcc6-f11332839387 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "6d227210-c4df-4aa7-9969-70fa137aeb63-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:01:10 user nova-compute[75100]: INFO nova.compute.manager [None req-fbfe46db-094f-41c1-bcc6-f11332839387 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Terminating instance
Nov 10 18:01:10 user nova-compute[75100]: DEBUG nova.compute.manager [None req-fbfe46db-094f-41c1-bcc6-f11332839387 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 18:01:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:01:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:01:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:01:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:01:10 user nova-compute[75100]: DEBUG nova.compute.manager [req-7129a6fb-e020-4f99-865c-28e7bbeee722 req-32b755be-dce9-420b-9459-0853576b939f service nova] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Received event network-vif-unplugged-230f2661-361c-4699-8dbc-fac4fbc6b612 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:01:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7129a6fb-e020-4f99-865c-28e7bbeee722 req-32b755be-dce9-420b-9459-0853576b939f service nova] Acquiring lock "6d227210-c4df-4aa7-9969-70fa137aeb63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:01:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7129a6fb-e020-4f99-865c-28e7bbeee722 req-32b755be-dce9-420b-9459-0853576b939f service nova] Lock "6d227210-c4df-4aa7-9969-70fa137aeb63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:01:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7129a6fb-e020-4f99-865c-28e7bbeee722 req-32b755be-dce9-420b-9459-0853576b939f service nova] Lock "6d227210-c4df-4aa7-9969-70fa137aeb63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:01:10 user nova-compute[75100]: DEBUG nova.compute.manager [req-7129a6fb-e020-4f99-865c-28e7bbeee722 req-32b755be-dce9-420b-9459-0853576b939f service nova] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] No waiting events found dispatching network-vif-unplugged-230f2661-361c-4699-8dbc-fac4fbc6b612 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:01:10 user nova-compute[75100]: DEBUG nova.compute.manager [req-7129a6fb-e020-4f99-865c-28e7bbeee722 req-32b755be-dce9-420b-9459-0853576b939f service nova] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Received event network-vif-unplugged-230f2661-361c-4699-8dbc-fac4fbc6b612 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 18:01:10 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Instance destroyed successfully.
Nov 10 18:01:10 user nova-compute[75100]: DEBUG nova.objects.instance [None req-fbfe46db-094f-41c1-bcc6-f11332839387 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lazy-loading 'resources' on Instance uuid 6d227210-c4df-4aa7-9969-70fa137aeb63 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:01:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-fbfe46db-094f-41c1-bcc6-f11332839387 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:56:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-473634604',display_name='tempest-TestVolumeBootPattern-volume-backed-server-473634604',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-473634604',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNEPnfsKEClTnO54Fzmppfii5WSNUfYlhFhSjY5PIcufKxG5x9205njSFdJlW/YYw8zCojWPvd/7gs5JdwnurdLPyd6c3p4UiBE02/b4badlIlzVaaBXQyK8bjAAt0vl+w==',key_name='tempest-keypair-790104153',keypairs=<?>,launch_index=0,launched_at=2023-11-10T17:56:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b9cd441a46aa4a579feff608d6ff9bb4',ramdisk_id='',reservation_id='r-petbrs0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-706331648',owner_user_name='tempest-TestVolumeBootPattern-706331648-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T17:56:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='323c5738ca424a379f666b4ca60825ac',uuid=6d227210-c4df-4aa7-9969-70fa137aeb63,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "230f2661-361c-4699-8dbc-fac4fbc6b612", "address": "fa:16:3e:9d:d1:eb", "network": {"id": "2a85480b-f67d-4ef1-b967-3e93af57d7c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1717495768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9cd441a46aa4a579feff608d6ff9bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap230f2661-36", "ovs_interfaceid": "230f2661-361c-4699-8dbc-fac4fbc6b612", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 18:01:10 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-fbfe46db-094f-41c1-bcc6-f11332839387 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Converting VIF {"id": "230f2661-361c-4699-8dbc-fac4fbc6b612", "address": "fa:16:3e:9d:d1:eb", "network": {"id": "2a85480b-f67d-4ef1-b967-3e93af57d7c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1717495768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9cd441a46aa4a579feff608d6ff9bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap230f2661-36", "ovs_interfaceid": "230f2661-361c-4699-8dbc-fac4fbc6b612", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:01:10 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-fbfe46db-094f-41c1-bcc6-f11332839387 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9d:d1:eb,bridge_name='br-int',has_traffic_filtering=True,id=230f2661-361c-4699-8dbc-fac4fbc6b612,network=Network(2a85480b-f67d-4ef1-b967-3e93af57d7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap230f2661-36') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:01:10 user nova-compute[75100]: DEBUG os_vif [None req-fbfe46db-094f-41c1-bcc6-f11332839387 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:d1:eb,bridge_name='br-int',has_traffic_filtering=True,id=230f2661-361c-4699-8dbc-fac4fbc6b612,network=Network(2a85480b-f67d-4ef1-b967-3e93af57d7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap230f2661-36') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 18:01:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:01:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap230f2661-36, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:01:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:01:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:01:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b4de74dc-4dc4-4536-8543-3502e5a32908) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:01:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:01:10 user nova-compute[75100]: INFO os_vif [None req-fbfe46db-094f-41c1-bcc6-f11332839387 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:d1:eb,bridge_name='br-int',has_traffic_filtering=True,id=230f2661-361c-4699-8dbc-fac4fbc6b612,network=Network(2a85480b-f67d-4ef1-b967-3e93af57d7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap230f2661-36')
Nov 10 18:01:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbfe46db-094f-41c1-bcc6-f11332839387 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 18:01:10 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbfe46db-094f-41c1-bcc6-f11332839387 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, {'target_iqn': 'iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IcpQGmha', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:01:10 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-fbfe46db-094f-41c1-bcc6-f11332839387 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:01:10 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-fbfe46db-094f-41c1-bcc6-f11332839387 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:01:10 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-fbfe46db-094f-41c1-bcc6-f11332839387 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:01:10 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:01:10 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:01:10 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ceeb54-4729-4fae-9b44-41ffb35b46f0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:01:10 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbfe46db-094f-41c1-bcc6-f11332839387 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 18:01:10 user nova-compute[75100]: No targets found.
Nov 10 18:01:10 user nova-compute[75100]: iSNS:
Nov 10 18:01:10 user nova-compute[75100]: No targets found.
Nov 10 18:01:10 user nova-compute[75100]: STATIC:
Nov 10 18:01:10 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0
Nov 10 18:01:10 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:01:10 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:01:10 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00
Nov 10 18:01:10 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:01:10 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:01:10 user nova-compute[75100]: FIRMWARE:
Nov 10 18:01:10 user nova-compute[75100]: No targets found.
Nov 10 18:01:10 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:01:10 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbfe46db-094f-41c1-bcc6-f11332839387 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 18:01:10 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 18:01:10 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 18:01:10 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbfe46db-094f-41c1-bcc6-f11332839387 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 18:01:10 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:01:10 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:01:10 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2394ab-6676-4aee-aef3-185b021e924c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:01:10 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:01:10 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:01:10 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ce07fe-9928-471f-90a6-802a201e7c84]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:01:10 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbfe46db-094f-41c1-bcc6-f11332839387 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 (non-flash)
Nov 10 18:01:10 user nova-compute[75100]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 (non-flash)
Nov 10 18:01:10 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:01:10 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbfe46db-094f-41c1-bcc6-f11332839387 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 (non-flash)
Nov 10 18:01:10 user nova-compute[75100]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 (non-flash)
Nov 10 18:01:10 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:01:10 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbfe46db-094f-41c1-bcc6-f11332839387 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa398651360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00'): ({'sdf'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 18:01:10 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-fbfe46db-094f-41c1-bcc6-f11332839387 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Removing single pathed devices sdf {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 18:01:10 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:01:10 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:01:10 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4a41b9-5381-422c-b5b1-1c2d8cd503fc]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:01:10 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:01:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:01:11 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4584d2-c51a-4b78-9726-c3be072ee815]: (4, ('ok\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:01:11 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-fbfe46db-094f-41c1-bcc6-f11332839387 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Flushing IO for device /dev/sdf {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 18:01:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:01:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:01:11 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d1d38b-d440-450c-943c-9fe366ac565d]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:01:11 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-fbfe46db-094f-41c1-bcc6-f11332839387 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 18:01:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:01:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.051s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:01:11 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccbd84d7-86d4-4bcc-9523-ea609d702f3a]: (4, ('1', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:01:11 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-fbfe46db-094f-41c1-bcc6-f11332839387 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 18:01:11 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-fbfe46db-094f-41c1-bcc6-f11332839387 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] SCSI volumes sdf have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 18:01:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbfe46db-094f-41c1-bcc6-f11332839387 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 18:01:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:01:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:01:11 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaad2548-6914-467f-b821-f81d4e24625f]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:01:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbfe46db-094f-41c1-bcc6-f11332839387 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:01:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 -p 172.16.0.220:3260 --logout {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:01:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:01:11 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a7bc548-2e09-46e4-9a4b-b06cc962668c]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:01:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbfe46db-094f-41c1-bcc6-f11332839387 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00, portal: 172.16.0.220,3260]
Nov 10 18:01:11 user nova-compute[75100]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00, portal: 172.16.0.220,3260] successful.
Nov 10 18:01:11 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:01:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 -p 172.16.0.220:3260 --op delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:01:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6c2e35c-41f9-4c5b-92da-f29547ae8b00 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:01:11 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d267efe9-06f7-4cd4-8ad5-0dfac7d6188a]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:01:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbfe46db-094f-41c1-bcc6-f11332839387 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:01:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-fbfe46db-094f-41c1-bcc6-f11332839387 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:01:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbfe46db-094f-41c1-bcc6-f11332839387 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] <== disconnect_volume: return (315ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:01:11 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbfe46db-094f-41c1-bcc6-f11332839387 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 18:01:11 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-fbfe46db-094f-41c1-bcc6-f11332839387 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Deleting instance files /opt/stack/data/nova/instances/6d227210-c4df-4aa7-9969-70fa137aeb63_del
Nov 10 18:01:11 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-fbfe46db-094f-41c1-bcc6-f11332839387 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Deletion of /opt/stack/data/nova/instances/6d227210-c4df-4aa7-9969-70fa137aeb63_del complete
Nov 10 18:01:11 user nova-compute[75100]: INFO nova.compute.manager [None req-fbfe46db-094f-41c1-bcc6-f11332839387 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Took 1.21 seconds to destroy the instance on the hypervisor.
Nov 10 18:01:11 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-fbfe46db-094f-41c1-bcc6-f11332839387 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 18:01:11 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 18:01:11 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 18:01:12 user nova-compute[75100]: DEBUG nova.compute.manager [req-04d63b60-a231-4d05-b42c-5fbc4ea30633 req-129a42c0-862c-407b-a732-c1a45156ac17 service nova] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Received event network-vif-deleted-230f2661-361c-4699-8dbc-fac4fbc6b612 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:01:12 user nova-compute[75100]: INFO nova.compute.manager [req-04d63b60-a231-4d05-b42c-5fbc4ea30633 req-129a42c0-862c-407b-a732-c1a45156ac17 service nova] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Neutron deleted interface 230f2661-361c-4699-8dbc-fac4fbc6b612; detaching it from the instance and deleting it from the info cache
Nov 10 18:01:12 user nova-compute[75100]: DEBUG nova.network.neutron [req-04d63b60-a231-4d05-b42c-5fbc4ea30633 req-129a42c0-862c-407b-a732-c1a45156ac17 service nova] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:01:12 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:01:12 user nova-compute[75100]: DEBUG nova.compute.manager [req-04d63b60-a231-4d05-b42c-5fbc4ea30633 req-129a42c0-862c-407b-a732-c1a45156ac17 service nova] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Detach interface failed, port_id=230f2661-361c-4699-8dbc-fac4fbc6b612, reason: Instance 6d227210-c4df-4aa7-9969-70fa137aeb63 could not be found. {{(pid=75100) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 18:01:12 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Took 0.90 seconds to deallocate network for instance.
Nov 10 18:01:12 user nova-compute[75100]: DEBUG nova.compute.manager [req-47a1f948-19df-4482-bc16-16360ae729ba req-4290ee3e-d079-444f-83ec-7f066eca1b83 service nova] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Received event network-vif-plugged-230f2661-361c-4699-8dbc-fac4fbc6b612 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:01:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-47a1f948-19df-4482-bc16-16360ae729ba req-4290ee3e-d079-444f-83ec-7f066eca1b83 service nova] Acquiring lock "6d227210-c4df-4aa7-9969-70fa137aeb63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:01:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-47a1f948-19df-4482-bc16-16360ae729ba req-4290ee3e-d079-444f-83ec-7f066eca1b83 service nova] Lock "6d227210-c4df-4aa7-9969-70fa137aeb63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:01:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-47a1f948-19df-4482-bc16-16360ae729ba req-4290ee3e-d079-444f-83ec-7f066eca1b83 service nova] Lock "6d227210-c4df-4aa7-9969-70fa137aeb63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:01:12 user nova-compute[75100]: DEBUG nova.compute.manager [req-47a1f948-19df-4482-bc16-16360ae729ba req-4290ee3e-d079-444f-83ec-7f066eca1b83 service nova] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] No waiting events found dispatching network-vif-plugged-230f2661-361c-4699-8dbc-fac4fbc6b612 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:01:12 user nova-compute[75100]: WARNING nova.compute.manager [req-47a1f948-19df-4482-bc16-16360ae729ba req-4290ee3e-d079-444f-83ec-7f066eca1b83 service nova] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Received unexpected event network-vif-plugged-230f2661-361c-4699-8dbc-fac4fbc6b612 for instance with vm_state active and task_state deleting.
Nov 10 18:01:13 user nova-compute[75100]: INFO nova.compute.manager [None req-fbfe46db-094f-41c1-bcc6-f11332839387 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Took 1.02 seconds to detach 1 volumes for instance.
Nov 10 18:01:13 user nova-compute[75100]: DEBUG nova.compute.manager [None req-fbfe46db-094f-41c1-bcc6-f11332839387 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 6d227210-c4df-4aa7-9969-70fa137aeb63] Deleting volume: e6c2e35c-41f9-4c5b-92da-f29547ae8b00 {{(pid=75100) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 10 18:01:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fbfe46db-094f-41c1-bcc6-f11332839387 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:01:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fbfe46db-094f-41c1-bcc6-f11332839387 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:01:13 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-fbfe46db-094f-41c1-bcc6-f11332839387 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:01:13 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-fbfe46db-094f-41c1-bcc6-f11332839387 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:01:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fbfe46db-094f-41c1-bcc6-f11332839387 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.347s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:01:13 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-fbfe46db-094f-41c1-bcc6-f11332839387 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Deleted allocations for instance 6d227210-c4df-4aa7-9969-70fa137aeb63
Nov 10 18:01:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fbfe46db-094f-41c1-bcc6-f11332839387 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "6d227210-c4df-4aa7-9969-70fa137aeb63" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.795s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:01:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:01:20 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:01:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9a0c2842-cc67-446b-8d73-60474adfe9b9 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Acquiring lock "3e14de19-540d-4dc2-a058-6874d8d14478" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:01:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9a0c2842-cc67-446b-8d73-60474adfe9b9 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "3e14de19-540d-4dc2-a058-6874d8d14478" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:01:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9a0c2842-cc67-446b-8d73-60474adfe9b9 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Acquiring lock "3e14de19-540d-4dc2-a058-6874d8d14478-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:01:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9a0c2842-cc67-446b-8d73-60474adfe9b9 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "3e14de19-540d-4dc2-a058-6874d8d14478-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:01:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9a0c2842-cc67-446b-8d73-60474adfe9b9 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "3e14de19-540d-4dc2-a058-6874d8d14478-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:01:20 user nova-compute[75100]: INFO nova.compute.manager [None req-9a0c2842-cc67-446b-8d73-60474adfe9b9 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Terminating instance
Nov 10 18:01:20 user nova-compute[75100]: DEBUG nova.compute.manager [None req-9a0c2842-cc67-446b-8d73-60474adfe9b9 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 18:01:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:01:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:01:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:01:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:01:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:01:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:01:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:01:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:01:21 user nova-compute[75100]: DEBUG nova.compute.manager [req-3c11e3ee-95dd-4241-b7d2-360229870281 req-174baba4-ce1c-4ad7-baf2-5f43c53d5ab7 service nova] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Received event network-vif-unplugged-d3f47ac6-ad90-4589-b41e-798c6fe6d5cf {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:01:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3c11e3ee-95dd-4241-b7d2-360229870281 req-174baba4-ce1c-4ad7-baf2-5f43c53d5ab7 service nova] Acquiring lock "3e14de19-540d-4dc2-a058-6874d8d14478-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:01:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3c11e3ee-95dd-4241-b7d2-360229870281 req-174baba4-ce1c-4ad7-baf2-5f43c53d5ab7 service nova] Lock "3e14de19-540d-4dc2-a058-6874d8d14478-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:01:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3c11e3ee-95dd-4241-b7d2-360229870281 req-174baba4-ce1c-4ad7-baf2-5f43c53d5ab7 service nova] Lock "3e14de19-540d-4dc2-a058-6874d8d14478-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:01:21 user nova-compute[75100]: DEBUG nova.compute.manager [req-3c11e3ee-95dd-4241-b7d2-360229870281 req-174baba4-ce1c-4ad7-baf2-5f43c53d5ab7 service nova] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] No waiting events found dispatching network-vif-unplugged-d3f47ac6-ad90-4589-b41e-798c6fe6d5cf {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:01:21 user nova-compute[75100]: DEBUG nova.compute.manager [req-3c11e3ee-95dd-4241-b7d2-360229870281 req-174baba4-ce1c-4ad7-baf2-5f43c53d5ab7 service nova] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Received event network-vif-unplugged-d3f47ac6-ad90-4589-b41e-798c6fe6d5cf for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 18:01:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:01:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:01:21 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:01:21 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Instance destroyed successfully.
Nov 10 18:01:21 user nova-compute[75100]: DEBUG nova.objects.instance [None req-9a0c2842-cc67-446b-8d73-60474adfe9b9 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lazy-loading 'resources' on Instance uuid 3e14de19-540d-4dc2-a058-6874d8d14478 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:01:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-9a0c2842-cc67-446b-8d73-60474adfe9b9 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:44:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1959011287',display_name='tempest-ServerRescueNegativeTestJSON-server-1959011287',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1959011287',id=3,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T17:46:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6b19755f3e634fdfbd562c33fbfa2a88',ramdisk_id='',reservation_id='r-6vqr8vu5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-783763036',owner_user_name='tempest-ServerRescueNegativeTestJSON-783763036-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T17:46:20Z,user_data=None,user_id='8cdb9250e6c7459587e429a0aea577c6',uuid=3e14de19-540d-4dc2-a058-6874d8d14478,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "d3f47ac6-ad90-4589-b41e-798c6fe6d5cf", "address": "fa:16:3e:b3:84:ec", "network": {"id": "26a554fe-9a5e-40c0-9981-5ac084c9ea73", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-269663495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19755f3e634fdfbd562c33fbfa2a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3f47ac6-ad", "ovs_interfaceid": "d3f47ac6-ad90-4589-b41e-798c6fe6d5cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 18:01:21 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-9a0c2842-cc67-446b-8d73-60474adfe9b9 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Converting VIF {"id": "d3f47ac6-ad90-4589-b41e-798c6fe6d5cf", "address": "fa:16:3e:b3:84:ec", "network": {"id": "26a554fe-9a5e-40c0-9981-5ac084c9ea73", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-269663495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19755f3e634fdfbd562c33fbfa2a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3f47ac6-ad", "ovs_interfaceid": "d3f47ac6-ad90-4589-b41e-798c6fe6d5cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:01:21 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-9a0c2842-cc67-446b-8d73-60474adfe9b9 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:84:ec,bridge_name='br-int',has_traffic_filtering=True,id=d3f47ac6-ad90-4589-b41e-798c6fe6d5cf,network=Network(26a554fe-9a5e-40c0-9981-5ac084c9ea73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3f47ac6-ad') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:01:21 user nova-compute[75100]: DEBUG os_vif [None req-9a0c2842-cc67-446b-8d73-60474adfe9b9 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:84:ec,bridge_name='br-int',has_traffic_filtering=True,id=d3f47ac6-ad90-4589-b41e-798c6fe6d5cf,network=Network(26a554fe-9a5e-40c0-9981-5ac084c9ea73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3f47ac6-ad') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 18:01:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:01:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd3f47ac6-ad, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:01:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:01:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:01:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:01:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=336ea0fd-506d-422e-94a4-b5f84e4b9da6) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:01:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:01:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:01:21 user nova-compute[75100]: INFO os_vif [None req-9a0c2842-cc67-446b-8d73-60474adfe9b9 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:84:ec,bridge_name='br-int',has_traffic_filtering=True,id=d3f47ac6-ad90-4589-b41e-798c6fe6d5cf,network=Network(26a554fe-9a5e-40c0-9981-5ac084c9ea73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3f47ac6-ad')
Nov 10 18:01:21 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-9a0c2842-cc67-446b-8d73-60474adfe9b9 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Deleting instance files /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478_del
Nov 10 18:01:21 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-9a0c2842-cc67-446b-8d73-60474adfe9b9 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Deletion of /opt/stack/data/nova/instances/3e14de19-540d-4dc2-a058-6874d8d14478_del complete
Nov 10 18:01:21 user nova-compute[75100]: INFO nova.compute.manager [None req-9a0c2842-cc67-446b-8d73-60474adfe9b9 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Took 0.74 seconds to destroy the instance on the hypervisor.
Nov 10 18:01:21 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-9a0c2842-cc67-446b-8d73-60474adfe9b9 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 18:01:21 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 18:01:21 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 18:01:22 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:01:22 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Took 0.52 seconds to deallocate network for instance.
Nov 10 18:01:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9a0c2842-cc67-446b-8d73-60474adfe9b9 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:01:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9a0c2842-cc67-446b-8d73-60474adfe9b9 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:01:22 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-9a0c2842-cc67-446b-8d73-60474adfe9b9 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:01:22 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-9a0c2842-cc67-446b-8d73-60474adfe9b9 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:01:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9a0c2842-cc67-446b-8d73-60474adfe9b9 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.249s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:01:22 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-9a0c2842-cc67-446b-8d73-60474adfe9b9 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Deleted allocations for instance 3e14de19-540d-4dc2-a058-6874d8d14478
Nov 10 18:01:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9a0c2842-cc67-446b-8d73-60474adfe9b9 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "3e14de19-540d-4dc2-a058-6874d8d14478" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.707s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:01:23 user nova-compute[75100]: DEBUG nova.compute.manager [req-20506486-b41a-4eeb-8976-352c8d72a73e req-e512dd7c-0caf-4d81-ab31-9d7952b97104 service nova] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Received event network-vif-plugged-d3f47ac6-ad90-4589-b41e-798c6fe6d5cf {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:01:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-20506486-b41a-4eeb-8976-352c8d72a73e req-e512dd7c-0caf-4d81-ab31-9d7952b97104 service nova] Acquiring lock "3e14de19-540d-4dc2-a058-6874d8d14478-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:01:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-20506486-b41a-4eeb-8976-352c8d72a73e req-e512dd7c-0caf-4d81-ab31-9d7952b97104 service nova] Lock "3e14de19-540d-4dc2-a058-6874d8d14478-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:01:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-20506486-b41a-4eeb-8976-352c8d72a73e req-e512dd7c-0caf-4d81-ab31-9d7952b97104 service nova] Lock "3e14de19-540d-4dc2-a058-6874d8d14478-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:01:23 user nova-compute[75100]: DEBUG nova.compute.manager [req-20506486-b41a-4eeb-8976-352c8d72a73e req-e512dd7c-0caf-4d81-ab31-9d7952b97104 service nova] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] No waiting events found dispatching network-vif-plugged-d3f47ac6-ad90-4589-b41e-798c6fe6d5cf {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:01:23 user nova-compute[75100]: WARNING nova.compute.manager [req-20506486-b41a-4eeb-8976-352c8d72a73e req-e512dd7c-0caf-4d81-ab31-9d7952b97104 service nova] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Received unexpected event network-vif-plugged-d3f47ac6-ad90-4589-b41e-798c6fe6d5cf for instance with vm_state deleted and task_state None.
Nov 10 18:01:23 user nova-compute[75100]: DEBUG nova.compute.manager [req-20506486-b41a-4eeb-8976-352c8d72a73e req-e512dd7c-0caf-4d81-ab31-9d7952b97104 service nova] [instance: 3e14de19-540d-4dc2-a058-6874d8d14478] Received event network-vif-deleted-d3f47ac6-ad90-4589-b41e-798c6fe6d5cf {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:01:24 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:01:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:01:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:01:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:01:24 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 18:01:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:01:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:01:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:01:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:01:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce634a11-5628-4f1c-8437-95f26519d8a0/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:01:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce634a11-5628-4f1c-8437-95f26519d8a0/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:01:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce634a11-5628-4f1c-8437-95f26519d8a0/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:01:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce634a11-5628-4f1c-8437-95f26519d8a0/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:01:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/989f3ce5-067b-45e4-a2e5-445024e13202/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:01:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/989f3ce5-067b-45e4-a2e5-445024e13202/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:01:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/989f3ce5-067b-45e4-a2e5-445024e13202/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:01:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/989f3ce5-067b-45e4-a2e5-445024e13202/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:01:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:01:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:01:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:01:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:01:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2f4288-da43-4bf3-9ef4-fd53961fe74c/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:01:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2f4288-da43-4bf3-9ef4-fd53961fe74c/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:01:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2f4288-da43-4bf3-9ef4-fd53961fe74c/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:01:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2f4288-da43-4bf3-9ef4-fd53961fe74c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:01:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 18:01:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc2bfb6-fd6b-4229-9664-42f33b138444/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:01:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:01:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc2bfb6-fd6b-4229-9664-42f33b138444/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:01:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc2bfb6-fd6b-4229-9664-42f33b138444/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:01:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc2bfb6-fd6b-4229-9664-42f33b138444/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:01:27 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:01:27 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:01:27 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Hypervisor/Node resource view: name=user free_ram=7890MB free_disk=24.554046630859375GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 18:01:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:01:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:01:27 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:01:27 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:01:27 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 989f3ce5-067b-45e4-a2e5-445024e13202 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:01:27 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance ca2f4288-da43-4bf3-9ef4-fd53961fe74c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:01:27 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance ce634a11-5628-4f1c-8437-95f26519d8a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:01:27 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance fcc2bfb6-fd6b-4229-9664-42f33b138444 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:01:27 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 18:01:27 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 18:01:27 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:01:27 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:01:27 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 18:01:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.380s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:01:28 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:01:28 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:01:28 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:01:29 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:01:29 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 18:01:30 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:01:30 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 18:01:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "refresh_cache-ca2f4288-da43-4bf3-9ef4-fd53961fe74c" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:01:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquired lock "refresh_cache-ca2f4288-da43-4bf3-9ef4-fd53961fe74c" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:01:30 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 18:01:30 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Updating instance_info_cache with network_info: [{"id": "f33ff122-270e-4129-be5b-e67c0bc0708c", "address": "fa:16:3e:e0:bd:a4", "network": {"id": "78d86418-c0e0-4cc2-8f4f-262f600f7d66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2054827063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19cfb454e59745bf9c77d7a7ede2bc0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33ff122-27", "ovs_interfaceid": "f33ff122-270e-4129-be5b-e67c0bc0708c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:01:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Releasing lock "refresh_cache-ca2f4288-da43-4bf3-9ef4-fd53961fe74c" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:01:30 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 18:01:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:01:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:01:31 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:01:32 user nova-compute[75100]: DEBUG nova.compute.manager [req-2af7ce10-ff96-49ff-b18c-c585cd1912b6 req-b0088541-9cfb-4e0f-8f59-227f0dab9221 service nova] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Received event network-changed-f33ff122-270e-4129-be5b-e67c0bc0708c {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:01:32 user nova-compute[75100]: DEBUG nova.compute.manager [req-2af7ce10-ff96-49ff-b18c-c585cd1912b6 req-b0088541-9cfb-4e0f-8f59-227f0dab9221 service nova] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Refreshing instance network info cache due to event network-changed-f33ff122-270e-4129-be5b-e67c0bc0708c. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 18:01:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2af7ce10-ff96-49ff-b18c-c585cd1912b6 req-b0088541-9cfb-4e0f-8f59-227f0dab9221 service nova] Acquiring lock "refresh_cache-ca2f4288-da43-4bf3-9ef4-fd53961fe74c" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:01:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2af7ce10-ff96-49ff-b18c-c585cd1912b6 req-b0088541-9cfb-4e0f-8f59-227f0dab9221 service nova] Acquired lock "refresh_cache-ca2f4288-da43-4bf3-9ef4-fd53961fe74c" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:01:32 user nova-compute[75100]: DEBUG nova.network.neutron [req-2af7ce10-ff96-49ff-b18c-c585cd1912b6 req-b0088541-9cfb-4e0f-8f59-227f0dab9221 service nova] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Refreshing network info cache for port f33ff122-270e-4129-be5b-e67c0bc0708c {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 18:01:33 user nova-compute[75100]: DEBUG nova.network.neutron [req-2af7ce10-ff96-49ff-b18c-c585cd1912b6 req-b0088541-9cfb-4e0f-8f59-227f0dab9221 service nova] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Updated VIF entry in instance network info cache for port f33ff122-270e-4129-be5b-e67c0bc0708c. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 18:01:33 user nova-compute[75100]: DEBUG nova.network.neutron [req-2af7ce10-ff96-49ff-b18c-c585cd1912b6 req-b0088541-9cfb-4e0f-8f59-227f0dab9221 service nova] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Updating instance_info_cache with network_info: [{"id": "f33ff122-270e-4129-be5b-e67c0bc0708c", "address": "fa:16:3e:e0:bd:a4", "network": {"id": "78d86418-c0e0-4cc2-8f4f-262f600f7d66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2054827063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19cfb454e59745bf9c77d7a7ede2bc0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33ff122-27", "ovs_interfaceid": "f33ff122-270e-4129-be5b-e67c0bc0708c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:01:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2af7ce10-ff96-49ff-b18c-c585cd1912b6 req-b0088541-9cfb-4e0f-8f59-227f0dab9221 service nova] Releasing lock "refresh_cache-ca2f4288-da43-4bf3-9ef4-fd53961fe74c" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:01:33 user nova-compute[75100]: DEBUG nova.compute.manager [req-92c15219-4e38-40af-8955-69bc1ca92a21 req-00d5a916-198b-49ea-83e0-f5c658d8a061 service nova] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Received event network-changed-f33ff122-270e-4129-be5b-e67c0bc0708c {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:01:33 user nova-compute[75100]: DEBUG nova.compute.manager [req-92c15219-4e38-40af-8955-69bc1ca92a21 req-00d5a916-198b-49ea-83e0-f5c658d8a061 service nova] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Refreshing instance network info cache due to event network-changed-f33ff122-270e-4129-be5b-e67c0bc0708c. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 18:01:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-92c15219-4e38-40af-8955-69bc1ca92a21 req-00d5a916-198b-49ea-83e0-f5c658d8a061 service nova] Acquiring lock "refresh_cache-ca2f4288-da43-4bf3-9ef4-fd53961fe74c" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:01:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-92c15219-4e38-40af-8955-69bc1ca92a21 req-00d5a916-198b-49ea-83e0-f5c658d8a061 service nova] Acquired lock "refresh_cache-ca2f4288-da43-4bf3-9ef4-fd53961fe74c" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:01:33 user nova-compute[75100]: DEBUG nova.network.neutron [req-92c15219-4e38-40af-8955-69bc1ca92a21 req-00d5a916-198b-49ea-83e0-f5c658d8a061 service nova] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Refreshing network info cache for port f33ff122-270e-4129-be5b-e67c0bc0708c {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 18:01:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-082611d6-cfe5-4532-b9b4-a38720ac2a45 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Acquiring lock "ca2f4288-da43-4bf3-9ef4-fd53961fe74c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:01:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-082611d6-cfe5-4532-b9b4-a38720ac2a45 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "ca2f4288-da43-4bf3-9ef4-fd53961fe74c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:01:33 user nova-compute[75100]: INFO nova.compute.manager [None req-082611d6-cfe5-4532-b9b4-a38720ac2a45 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Detaching volume eb371cd8-f98e-4eb4-8047-76cc41e0d6d0
Nov 10 18:01:33 user nova-compute[75100]: INFO nova.virt.block_device [None req-082611d6-cfe5-4532-b9b4-a38720ac2a45 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Attempting to driver detach volume eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 from mountpoint /dev/vdb
Nov 10 18:01:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-082611d6-cfe5-4532-b9b4-a38720ac2a45 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Attempting to detach device vdb from instance ca2f4288-da43-4bf3-9ef4-fd53961fe74c from the persistent domain config. {{(pid=75100) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 18:01:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-082611d6-cfe5-4532-b9b4-a38720ac2a45 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 18:01:33 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:01:33 user nova-compute[75100]:   <source dev="/dev/sdd"/>
Nov 10 18:01:33 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 18:01:33 user nova-compute[75100]:   <serial>eb371cd8-f98e-4eb4-8047-76cc41e0d6d0</serial>
Nov 10 18:01:33 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 10 18:01:33 user nova-compute[75100]: </disk>
Nov 10 18:01:33 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 18:01:33 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-082611d6-cfe5-4532-b9b4-a38720ac2a45 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Successfully detached device vdb from instance ca2f4288-da43-4bf3-9ef4-fd53961fe74c from the persistent domain config.
Nov 10 18:01:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-082611d6-cfe5-4532-b9b4-a38720ac2a45 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ca2f4288-da43-4bf3-9ef4-fd53961fe74c from the live domain config. {{(pid=75100) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 18:01:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-082611d6-cfe5-4532-b9b4-a38720ac2a45 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 18:01:33 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:01:33 user nova-compute[75100]:   <source dev="/dev/sdd"/>
Nov 10 18:01:33 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 18:01:33 user nova-compute[75100]:   <serial>eb371cd8-f98e-4eb4-8047-76cc41e0d6d0</serial>
Nov 10 18:01:33 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 10 18:01:33 user nova-compute[75100]: </disk>
Nov 10 18:01:33 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 18:01:33 user nova-compute[75100]: DEBUG nova.network.neutron [req-92c15219-4e38-40af-8955-69bc1ca92a21 req-00d5a916-198b-49ea-83e0-f5c658d8a061 service nova] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Updated VIF entry in instance network info cache for port f33ff122-270e-4129-be5b-e67c0bc0708c. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 18:01:33 user nova-compute[75100]: DEBUG nova.network.neutron [req-92c15219-4e38-40af-8955-69bc1ca92a21 req-00d5a916-198b-49ea-83e0-f5c658d8a061 service nova] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Updating instance_info_cache with network_info: [{"id": "f33ff122-270e-4129-be5b-e67c0bc0708c", "address": "fa:16:3e:e0:bd:a4", "network": {"id": "78d86418-c0e0-4cc2-8f4f-262f600f7d66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2054827063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19cfb454e59745bf9c77d7a7ede2bc0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33ff122-27", "ovs_interfaceid": "f33ff122-270e-4129-be5b-e67c0bc0708c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:01:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-92c15219-4e38-40af-8955-69bc1ca92a21 req-00d5a916-198b-49ea-83e0-f5c658d8a061 service nova] Releasing lock "refresh_cache-ca2f4288-da43-4bf3-9ef4-fd53961fe74c" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:01:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-082611d6-cfe5-4532-b9b4-a38720ac2a45 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ca2f4288-da43-4bf3-9ef4-fd53961fe74c {{(pid=75100) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 18:01:34 user nova-compute[75100]: DEBUG nova.compute.manager [req-61117008-721f-4f27-97d7-22b7a45b29ab req-02a901d9-fdae-45f0-acec-a0f8b107e780 service nova] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Received event network-changed-4c3793c8-de6c-4246-9a29-46ac085f065e {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:01:34 user nova-compute[75100]: DEBUG nova.compute.manager [req-61117008-721f-4f27-97d7-22b7a45b29ab req-02a901d9-fdae-45f0-acec-a0f8b107e780 service nova] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Refreshing instance network info cache due to event network-changed-4c3793c8-de6c-4246-9a29-46ac085f065e. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 18:01:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-61117008-721f-4f27-97d7-22b7a45b29ab req-02a901d9-fdae-45f0-acec-a0f8b107e780 service nova] Acquiring lock "refresh_cache-ce634a11-5628-4f1c-8437-95f26519d8a0" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:01:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-61117008-721f-4f27-97d7-22b7a45b29ab req-02a901d9-fdae-45f0-acec-a0f8b107e780 service nova] Acquired lock "refresh_cache-ce634a11-5628-4f1c-8437-95f26519d8a0" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:01:34 user nova-compute[75100]: DEBUG nova.network.neutron [req-61117008-721f-4f27-97d7-22b7a45b29ab req-02a901d9-fdae-45f0-acec-a0f8b107e780 service nova] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Refreshing network info cache for port 4c3793c8-de6c-4246-9a29-46ac085f065e {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 18:01:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:01:34 user nova-compute[75100]: DEBUG nova.network.neutron [req-61117008-721f-4f27-97d7-22b7a45b29ab req-02a901d9-fdae-45f0-acec-a0f8b107e780 service nova] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Updated VIF entry in instance network info cache for port 4c3793c8-de6c-4246-9a29-46ac085f065e. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 18:01:34 user nova-compute[75100]: DEBUG nova.network.neutron [req-61117008-721f-4f27-97d7-22b7a45b29ab req-02a901d9-fdae-45f0-acec-a0f8b107e780 service nova] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Updating instance_info_cache with network_info: [{"id": "4c3793c8-de6c-4246-9a29-46ac085f065e", "address": "fa:16:3e:a0:b0:b8", "network": {"id": "7a78ac5d-8f24-436d-9cb9-05f4efecb101", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-476509015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae38bb92c5474a578f3827bdae12cd74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c3793c8-de", "ovs_interfaceid": "4c3793c8-de6c-4246-9a29-46ac085f065e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:01:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-61117008-721f-4f27-97d7-22b7a45b29ab req-02a901d9-fdae-45f0-acec-a0f8b107e780 service nova] Releasing lock "refresh_cache-ce634a11-5628-4f1c-8437-95f26519d8a0" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:01:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:01:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:01:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0522e885-da73-43e8-923d-5b545d8b7d7f tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Acquiring lock "ce634a11-5628-4f1c-8437-95f26519d8a0" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:01:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0522e885-da73-43e8-923d-5b545d8b7d7f tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "ce634a11-5628-4f1c-8437-95f26519d8a0" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:01:40 user nova-compute[75100]: INFO nova.compute.manager [None req-0522e885-da73-43e8-923d-5b545d8b7d7f tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Shelving
Nov 10 18:01:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:01:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:01:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:01:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:01:40 user nova-compute[75100]: DEBUG nova.compute.manager [req-39b9468b-0da0-4731-9357-6e996a810b33 req-ae025fa3-3d09-44df-8857-33afa78975f7 service nova] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Received event network-vif-unplugged-4c3793c8-de6c-4246-9a29-46ac085f065e {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:01:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-39b9468b-0da0-4731-9357-6e996a810b33 req-ae025fa3-3d09-44df-8857-33afa78975f7 service nova] Acquiring lock "ce634a11-5628-4f1c-8437-95f26519d8a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:01:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-39b9468b-0da0-4731-9357-6e996a810b33 req-ae025fa3-3d09-44df-8857-33afa78975f7 service nova] Lock "ce634a11-5628-4f1c-8437-95f26519d8a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:01:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-39b9468b-0da0-4731-9357-6e996a810b33 req-ae025fa3-3d09-44df-8857-33afa78975f7 service nova] Lock "ce634a11-5628-4f1c-8437-95f26519d8a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:01:40 user nova-compute[75100]: DEBUG nova.compute.manager [req-39b9468b-0da0-4731-9357-6e996a810b33 req-ae025fa3-3d09-44df-8857-33afa78975f7 service nova] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] No waiting events found dispatching network-vif-unplugged-4c3793c8-de6c-4246-9a29-46ac085f065e {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:01:40 user nova-compute[75100]: WARNING nova.compute.manager [req-39b9468b-0da0-4731-9357-6e996a810b33 req-ae025fa3-3d09-44df-8857-33afa78975f7 service nova] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Received unexpected event network-vif-unplugged-4c3793c8-de6c-4246-9a29-46ac085f065e for instance with vm_state active and task_state shelving.
Nov 10 18:01:40 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Instance destroyed successfully.
Nov 10 18:01:40 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-0522e885-da73-43e8-923d-5b545d8b7d7f tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Beginning cold snapshot process
Nov 10 18:01:40 user nova-compute[75100]: DEBUG nova.privsep.utils [None req-0522e885-da73-43e8-923d-5b545d8b7d7f tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75100) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 18:01:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-0522e885-da73-43e8-923d-5b545d8b7d7f tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/ce634a11-5628-4f1c-8437-95f26519d8a0/disk /opt/stack/data/nova/instances/snapshots/tmpuufitgwb/c5e1bf99f6ce4dcf9d31ba6818a4e538 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:01:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:01:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-0522e885-da73-43e8-923d-5b545d8b7d7f tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/ce634a11-5628-4f1c-8437-95f26519d8a0/disk /opt/stack/data/nova/instances/snapshots/tmpuufitgwb/c5e1bf99f6ce4dcf9d31ba6818a4e538" returned: 0 in 0.713s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:01:41 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-0522e885-da73-43e8-923d-5b545d8b7d7f tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Snapshot extracted, beginning image upload
Nov 10 18:01:42 user nova-compute[75100]: DEBUG nova.compute.manager [req-7433eeb4-e902-42e4-9b1d-d215aaeeb4bc req-33480845-b224-4804-ab08-cafa8650b46f service nova] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Received event network-vif-plugged-4c3793c8-de6c-4246-9a29-46ac085f065e {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:01:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7433eeb4-e902-42e4-9b1d-d215aaeeb4bc req-33480845-b224-4804-ab08-cafa8650b46f service nova] Acquiring lock "ce634a11-5628-4f1c-8437-95f26519d8a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:01:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7433eeb4-e902-42e4-9b1d-d215aaeeb4bc req-33480845-b224-4804-ab08-cafa8650b46f service nova] Lock "ce634a11-5628-4f1c-8437-95f26519d8a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:01:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7433eeb4-e902-42e4-9b1d-d215aaeeb4bc req-33480845-b224-4804-ab08-cafa8650b46f service nova] Lock "ce634a11-5628-4f1c-8437-95f26519d8a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:01:42 user nova-compute[75100]: DEBUG nova.compute.manager [req-7433eeb4-e902-42e4-9b1d-d215aaeeb4bc req-33480845-b224-4804-ab08-cafa8650b46f service nova] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] No waiting events found dispatching network-vif-plugged-4c3793c8-de6c-4246-9a29-46ac085f065e {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:01:42 user nova-compute[75100]: WARNING nova.compute.manager [req-7433eeb4-e902-42e4-9b1d-d215aaeeb4bc req-33480845-b224-4804-ab08-cafa8650b46f service nova] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Received unexpected event network-vif-plugged-4c3793c8-de6c-4246-9a29-46ac085f065e for instance with vm_state active and task_state shelving_image_uploading.
Nov 10 18:01:44 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-0522e885-da73-43e8-923d-5b545d8b7d7f tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Snapshot image upload complete
Nov 10 18:01:44 user nova-compute[75100]: DEBUG nova.compute.manager [None req-0522e885-da73-43e8-923d-5b545d8b7d7f tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 18:01:44 user nova-compute[75100]: INFO nova.compute.manager [None req-0522e885-da73-43e8-923d-5b545d8b7d7f tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Shelve offloading
Nov 10 18:01:44 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Instance destroyed successfully.
Nov 10 18:01:44 user nova-compute[75100]: DEBUG nova.compute.manager [None req-0522e885-da73-43e8-923d-5b545d8b7d7f tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 18:01:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0522e885-da73-43e8-923d-5b545d8b7d7f tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Acquiring lock "refresh_cache-ce634a11-5628-4f1c-8437-95f26519d8a0" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:01:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0522e885-da73-43e8-923d-5b545d8b7d7f tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Acquired lock "refresh_cache-ce634a11-5628-4f1c-8437-95f26519d8a0" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:01:44 user nova-compute[75100]: DEBUG nova.network.neutron [None req-0522e885-da73-43e8-923d-5b545d8b7d7f tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 18:01:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:01:44 user nova-compute[75100]: DEBUG nova.network.neutron [None req-0522e885-da73-43e8-923d-5b545d8b7d7f tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Updating instance_info_cache with network_info: [{"id": "4c3793c8-de6c-4246-9a29-46ac085f065e", "address": "fa:16:3e:a0:b0:b8", "network": {"id": "7a78ac5d-8f24-436d-9cb9-05f4efecb101", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-476509015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae38bb92c5474a578f3827bdae12cd74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c3793c8-de", "ovs_interfaceid": "4c3793c8-de6c-4246-9a29-46ac085f065e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:01:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0522e885-da73-43e8-923d-5b545d8b7d7f tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Releasing lock "refresh_cache-ce634a11-5628-4f1c-8437-95f26519d8a0" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:01:45 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Instance destroyed successfully.
Nov 10 18:01:45 user nova-compute[75100]: DEBUG nova.objects.instance [None req-0522e885-da73-43e8-923d-5b545d8b7d7f tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lazy-loading 'resources' on Instance uuid ce634a11-5628-4f1c-8437-95f26519d8a0 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:01:45 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-0522e885-da73-43e8-923d-5b545d8b7d7f tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:59:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-727841680',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-727841680',id=31,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNXJUSH8ImyQEQfIfFe1NG91+SubEBrWrTHrr4HPhH4qdxn71cE+Nbpwrengk/NgRguInZ4Ho95ee7g3Uxxbl34+PMj5HYderPpgNTv1f1rj1py60lD1qnogBB8DmNmDCg==',key_name='tempest-keypair-461573842',keypairs=<?>,launch_index=0,launched_at=2023-11-10T17:59:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ae38bb92c5474a578f3827bdae12cd74',ramdisk_id='',reservation_id='r-i78hj9rl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2073508773',owner_user_name='tempest-AttachVolumeShelveTestJSON-2073508773-project-member',shelved_at='2023-11-10T18:01:44.334000',shelved_host='user',shelved_image_id='c01adca2-dcb6-4e30-b51d-19f3266fbe2f'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T18:01:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='805917c846f34264b51388bfd9a8413f',uuid=ce634a11-5628-4f1c-8437-95f26519d8a0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "4c3793c8-de6c-4246-9a29-46ac085f065e", "address": "fa:16:3e:a0:b0:b8", "network": {"id": "7a78ac5d-8f24-436d-9cb9-05f4efecb101", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-476509015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae38bb92c5474a578f3827bdae12cd74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c3793c8-de", "ovs_interfaceid": "4c3793c8-de6c-4246-9a29-46ac085f065e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 18:01:45 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-0522e885-da73-43e8-923d-5b545d8b7d7f tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Converting VIF {"id": "4c3793c8-de6c-4246-9a29-46ac085f065e", "address": "fa:16:3e:a0:b0:b8", "network": {"id": "7a78ac5d-8f24-436d-9cb9-05f4efecb101", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-476509015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae38bb92c5474a578f3827bdae12cd74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c3793c8-de", "ovs_interfaceid": "4c3793c8-de6c-4246-9a29-46ac085f065e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:01:45 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-0522e885-da73-43e8-923d-5b545d8b7d7f tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:b0:b8,bridge_name='br-int',has_traffic_filtering=True,id=4c3793c8-de6c-4246-9a29-46ac085f065e,network=Network(7a78ac5d-8f24-436d-9cb9-05f4efecb101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c3793c8-de') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:01:45 user nova-compute[75100]: DEBUG os_vif [None req-0522e885-da73-43e8-923d-5b545d8b7d7f tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:b0:b8,bridge_name='br-int',has_traffic_filtering=True,id=4c3793c8-de6c-4246-9a29-46ac085f065e,network=Network(7a78ac5d-8f24-436d-9cb9-05f4efecb101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c3793c8-de') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 18:01:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:01:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c3793c8-de, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:01:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:01:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:01:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:01:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fae1148e-54ba-4f7d-99b9-d4ab8eadf4b2) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:01:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:01:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:01:45 user nova-compute[75100]: INFO os_vif [None req-0522e885-da73-43e8-923d-5b545d8b7d7f tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:b0:b8,bridge_name='br-int',has_traffic_filtering=True,id=4c3793c8-de6c-4246-9a29-46ac085f065e,network=Network(7a78ac5d-8f24-436d-9cb9-05f4efecb101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c3793c8-de')
Nov 10 18:01:45 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-0522e885-da73-43e8-923d-5b545d8b7d7f tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Deleting instance files /opt/stack/data/nova/instances/ce634a11-5628-4f1c-8437-95f26519d8a0_del
Nov 10 18:01:45 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-0522e885-da73-43e8-923d-5b545d8b7d7f tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Deletion of /opt/stack/data/nova/instances/ce634a11-5628-4f1c-8437-95f26519d8a0_del complete
Nov 10 18:01:45 user nova-compute[75100]: DEBUG nova.compute.manager [req-763330da-c4b8-43e3-bcfb-08255fa8a6a4 req-11bb9c13-746a-4626-bc7a-7d3009b6de8c service nova] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Received event network-changed-4c3793c8-de6c-4246-9a29-46ac085f065e {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:01:45 user nova-compute[75100]: DEBUG nova.compute.manager [req-763330da-c4b8-43e3-bcfb-08255fa8a6a4 req-11bb9c13-746a-4626-bc7a-7d3009b6de8c service nova] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Refreshing instance network info cache due to event network-changed-4c3793c8-de6c-4246-9a29-46ac085f065e. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 18:01:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-763330da-c4b8-43e3-bcfb-08255fa8a6a4 req-11bb9c13-746a-4626-bc7a-7d3009b6de8c service nova] Acquiring lock "refresh_cache-ce634a11-5628-4f1c-8437-95f26519d8a0" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:01:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-763330da-c4b8-43e3-bcfb-08255fa8a6a4 req-11bb9c13-746a-4626-bc7a-7d3009b6de8c service nova] Acquired lock "refresh_cache-ce634a11-5628-4f1c-8437-95f26519d8a0" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:01:45 user nova-compute[75100]: DEBUG nova.network.neutron [req-763330da-c4b8-43e3-bcfb-08255fa8a6a4 req-11bb9c13-746a-4626-bc7a-7d3009b6de8c service nova] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Refreshing network info cache for port 4c3793c8-de6c-4246-9a29-46ac085f065e {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 18:01:46 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-0522e885-da73-43e8-923d-5b545d8b7d7f tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Deleted allocations for instance ce634a11-5628-4f1c-8437-95f26519d8a0
Nov 10 18:01:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0522e885-da73-43e8-923d-5b545d8b7d7f tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:01:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0522e885-da73-43e8-923d-5b545d8b7d7f tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:01:46 user nova-compute[75100]: DEBUG nova.objects.instance [None req-0522e885-da73-43e8-923d-5b545d8b7d7f tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lazy-loading 'numa_topology' on Instance uuid ce634a11-5628-4f1c-8437-95f26519d8a0 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:01:46 user nova-compute[75100]: DEBUG nova.objects.base [None req-0522e885-da73-43e8-923d-5b545d8b7d7f tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Object Instance<ce634a11-5628-4f1c-8437-95f26519d8a0> lazy-loaded attributes: resources,numa_topology {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 18:01:46 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-0522e885-da73-43e8-923d-5b545d8b7d7f tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:01:46 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-0522e885-da73-43e8-923d-5b545d8b7d7f tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:01:46 user nova-compute[75100]: DEBUG nova.network.neutron [req-763330da-c4b8-43e3-bcfb-08255fa8a6a4 req-11bb9c13-746a-4626-bc7a-7d3009b6de8c service nova] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Updated VIF entry in instance network info cache for port 4c3793c8-de6c-4246-9a29-46ac085f065e. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 18:01:46 user nova-compute[75100]: DEBUG nova.network.neutron [req-763330da-c4b8-43e3-bcfb-08255fa8a6a4 req-11bb9c13-746a-4626-bc7a-7d3009b6de8c service nova] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Updating instance_info_cache with network_info: [{"id": "4c3793c8-de6c-4246-9a29-46ac085f065e", "address": "fa:16:3e:a0:b0:b8", "network": {"id": "7a78ac5d-8f24-436d-9cb9-05f4efecb101", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-476509015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae38bb92c5474a578f3827bdae12cd74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap4c3793c8-de", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:01:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0522e885-da73-43e8-923d-5b545d8b7d7f tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.239s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:01:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-763330da-c4b8-43e3-bcfb-08255fa8a6a4 req-11bb9c13-746a-4626-bc7a-7d3009b6de8c service nova] Releasing lock "refresh_cache-ce634a11-5628-4f1c-8437-95f26519d8a0" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:01:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0522e885-da73-43e8-923d-5b545d8b7d7f tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "ce634a11-5628-4f1c-8437-95f26519d8a0" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.208s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:01:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:01:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:01:54 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-082611d6-cfe5-4532-b9b4-a38720ac2a45 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ca2f4288-da43-4bf3-9ef4-fd53961fe74c is timed out.
Nov 10 18:01:54 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-082611d6-cfe5-4532-b9b4-a38720ac2a45 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Successfully detached device vdb from instance ca2f4288-da43-4bf3-9ef4-fd53961fe74c from the live domain config.
Nov 10 18:01:54 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-082611d6-cfe5-4532-b9b4-a38720ac2a45 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 18:01:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-082611d6-cfe5-4532-b9b4-a38720ac2a45 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, {'target_iqn': 'iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zlHmpLBc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:01:54 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-082611d6-cfe5-4532-b9b4-a38720ac2a45 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:01:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-082611d6-cfe5-4532-b9b4-a38720ac2a45 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:01:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-082611d6-cfe5-4532-b9b4-a38720ac2a45 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:01:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:01:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:01:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[645f13a7-a39d-47c2-8e57-b4087cbd5970]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:01:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-082611d6-cfe5-4532-b9b4-a38720ac2a45 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 18:01:54 user nova-compute[75100]: No targets found.
Nov 10 18:01:54 user nova-compute[75100]: iSNS:
Nov 10 18:01:54 user nova-compute[75100]: No targets found.
Nov 10 18:01:54 user nova-compute[75100]: STATIC:
Nov 10 18:01:54 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0
Nov 10 18:01:54 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:01:54 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:01:54 user nova-compute[75100]: FIRMWARE:
Nov 10 18:01:54 user nova-compute[75100]: No targets found.
Nov 10 18:01:54 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:01:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-082611d6-cfe5-4532-b9b4-a38720ac2a45 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 18:01:54 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 18:01:54 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 18:01:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-082611d6-cfe5-4532-b9b4-a38720ac2a45 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 18:01:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:01:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:01:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6df8f39-651e-42c4-a5d7-417247a25f97]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:01:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:01:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:01:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e56c66f9-269f-4078-88a2-7fdeae52a4bb]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:01:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-082611d6-cfe5-4532-b9b4-a38720ac2a45 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 (non-flash)
Nov 10 18:01:54 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:01:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-082611d6-cfe5-4532-b9b4-a38720ac2a45 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 (non-flash)
Nov 10 18:01:54 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:01:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-082611d6-cfe5-4532-b9b4-a38720ac2a45 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3bc3c1b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0'): ({'sdd'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 18:01:54 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-082611d6-cfe5-4532-b9b4-a38720ac2a45 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Removing single pathed devices sdd {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 18:01:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:01:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:01:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5cc99eb-4283-4f94-a905-b21228e4fb5b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:01:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:01:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:01:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cda4cb9-b7d2-4d8f-92f7-dd0dd422f03e]: (4, ('ok\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:01:54 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-082611d6-cfe5-4532-b9b4-a38720ac2a45 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Flushing IO for device /dev/sdd {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 18:01:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:01:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:01:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d972e93-22f0-4ef6-ae32-84026c58aa32]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:01:54 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-082611d6-cfe5-4532-b9b4-a38720ac2a45 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 18:01:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:01:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.055s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:01:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3eeb1c-8c92-457d-b4e8-8ba92c514b12]: (4, ('1', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:01:54 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-082611d6-cfe5-4532-b9b4-a38720ac2a45 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 18:01:54 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-082611d6-cfe5-4532-b9b4-a38720ac2a45 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] SCSI volumes sdd have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 18:01:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-082611d6-cfe5-4532-b9b4-a38720ac2a45 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 18:01:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:01:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:01:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[896482e1-dec6-4c03-8897-ed81eb8c8622]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:01:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-082611d6-cfe5-4532-b9b4-a38720ac2a45 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:01:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 -p 172.16.0.220:3260 --logout {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:01:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:01:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[69fce3fa-9f01-46da-b237-acf1c1123601]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:01:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-082611d6-cfe5-4532-b9b4-a38720ac2a45 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0, portal: 172.16.0.220,3260]
Nov 10 18:01:54 user nova-compute[75100]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0, portal: 172.16.0.220,3260] successful.
Nov 10 18:01:54 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:01:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 -p 172.16.0.220:3260 --op delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:01:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb371cd8-f98e-4eb4-8047-76cc41e0d6d0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:01:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[442c4f35-6bda-4c1a-9d09-452870c81ff8]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:01:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-082611d6-cfe5-4532-b9b4-a38720ac2a45 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:01:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-082611d6-cfe5-4532-b9b4-a38720ac2a45 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:01:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-082611d6-cfe5-4532-b9b4-a38720ac2a45 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] <== disconnect_volume: return (308ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:01:54 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-082611d6-cfe5-4532-b9b4-a38720ac2a45 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 18:01:55 user nova-compute[75100]: DEBUG nova.objects.instance [None req-082611d6-cfe5-4532-b9b4-a38720ac2a45 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lazy-loading 'flavor' on Instance uuid ca2f4288-da43-4bf3-9ef4-fd53961fe74c {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:01:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-082611d6-cfe5-4532-b9b4-a38720ac2a45 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "ca2f4288-da43-4bf3-9ef4-fd53961fe74c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.910s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:01:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-877b4abc-8433-4ce7-b389-0ee7178fd3c9 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Acquiring lock "b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:02:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-877b4abc-8433-4ce7-b389-0ee7178fd3c9 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:02:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-877b4abc-8433-4ce7-b389-0ee7178fd3c9 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Acquiring lock "b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:02:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-877b4abc-8433-4ce7-b389-0ee7178fd3c9 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:02:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-877b4abc-8433-4ce7-b389-0ee7178fd3c9 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:02:11 user nova-compute[75100]: INFO nova.compute.manager [None req-877b4abc-8433-4ce7-b389-0ee7178fd3c9 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Terminating instance
Nov 10 18:02:11 user nova-compute[75100]: DEBUG nova.compute.manager [None req-877b4abc-8433-4ce7-b389-0ee7178fd3c9 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 18:02:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:11 user nova-compute[75100]: DEBUG nova.compute.manager [req-0286c907-abe0-4852-b270-764ce8c019bd req-a6b6b998-8f6d-4f44-b05f-f4277c0f1614 service nova] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Received event network-vif-unplugged-be620d2e-a2ea-49fe-9205-68101009027b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:02:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0286c907-abe0-4852-b270-764ce8c019bd req-a6b6b998-8f6d-4f44-b05f-f4277c0f1614 service nova] Acquiring lock "b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:02:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0286c907-abe0-4852-b270-764ce8c019bd req-a6b6b998-8f6d-4f44-b05f-f4277c0f1614 service nova] Lock "b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:02:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0286c907-abe0-4852-b270-764ce8c019bd req-a6b6b998-8f6d-4f44-b05f-f4277c0f1614 service nova] Lock "b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:02:11 user nova-compute[75100]: DEBUG nova.compute.manager [req-0286c907-abe0-4852-b270-764ce8c019bd req-a6b6b998-8f6d-4f44-b05f-f4277c0f1614 service nova] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] No waiting events found dispatching network-vif-unplugged-be620d2e-a2ea-49fe-9205-68101009027b {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:02:11 user nova-compute[75100]: DEBUG nova.compute.manager [req-0286c907-abe0-4852-b270-764ce8c019bd req-a6b6b998-8f6d-4f44-b05f-f4277c0f1614 service nova] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Received event network-vif-unplugged-be620d2e-a2ea-49fe-9205-68101009027b for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 18:02:11 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Instance destroyed successfully.
Nov 10 18:02:11 user nova-compute[75100]: DEBUG nova.objects.instance [None req-877b4abc-8433-4ce7-b389-0ee7178fd3c9 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lazy-loading 'resources' on Instance uuid b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:02:11 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-877b4abc-8433-4ce7-b389-0ee7178fd3c9 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:44:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-81379937',display_name='tempest-ServerRescueNegativeTestJSON-server-81379937',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-81379937',id=2,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T17:49:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6b19755f3e634fdfbd562c33fbfa2a88',ramdisk_id='',reservation_id='r-sqwzcrjg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-783763036',owner_user_name='tempest-ServerRescueNegativeTestJSON-783763036-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T17:51:10Z,user_data=None,user_id='8cdb9250e6c7459587e429a0aea577c6',uuid=b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "be620d2e-a2ea-49fe-9205-68101009027b", "address": "fa:16:3e:2d:37:4e", "network": {"id": "26a554fe-9a5e-40c0-9981-5ac084c9ea73", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-269663495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19755f3e634fdfbd562c33fbfa2a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe620d2e-a2", "ovs_interfaceid": "be620d2e-a2ea-49fe-9205-68101009027b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 18:02:11 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-877b4abc-8433-4ce7-b389-0ee7178fd3c9 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Converting VIF {"id": "be620d2e-a2ea-49fe-9205-68101009027b", "address": "fa:16:3e:2d:37:4e", "network": {"id": "26a554fe-9a5e-40c0-9981-5ac084c9ea73", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-269663495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b19755f3e634fdfbd562c33fbfa2a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe620d2e-a2", "ovs_interfaceid": "be620d2e-a2ea-49fe-9205-68101009027b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:02:11 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-877b4abc-8433-4ce7-b389-0ee7178fd3c9 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2d:37:4e,bridge_name='br-int',has_traffic_filtering=True,id=be620d2e-a2ea-49fe-9205-68101009027b,network=Network(26a554fe-9a5e-40c0-9981-5ac084c9ea73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe620d2e-a2') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:02:11 user nova-compute[75100]: DEBUG os_vif [None req-877b4abc-8433-4ce7-b389-0ee7178fd3c9 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:37:4e,bridge_name='br-int',has_traffic_filtering=True,id=be620d2e-a2ea-49fe-9205-68101009027b,network=Network(26a554fe-9a5e-40c0-9981-5ac084c9ea73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe620d2e-a2') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 18:02:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbe620d2e-a2, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:02:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:02:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7209b566-ca69-4d11-bb5c-61289f25e45e) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:02:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:11 user nova-compute[75100]: INFO os_vif [None req-877b4abc-8433-4ce7-b389-0ee7178fd3c9 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:37:4e,bridge_name='br-int',has_traffic_filtering=True,id=be620d2e-a2ea-49fe-9205-68101009027b,network=Network(26a554fe-9a5e-40c0-9981-5ac084c9ea73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe620d2e-a2')
Nov 10 18:02:11 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-877b4abc-8433-4ce7-b389-0ee7178fd3c9 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Deleting instance files /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b_del
Nov 10 18:02:11 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-877b4abc-8433-4ce7-b389-0ee7178fd3c9 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Deletion of /opt/stack/data/nova/instances/b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b_del complete
Nov 10 18:02:12 user nova-compute[75100]: INFO nova.compute.manager [None req-877b4abc-8433-4ce7-b389-0ee7178fd3c9 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Took 0.71 seconds to destroy the instance on the hypervisor.
Nov 10 18:02:12 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-877b4abc-8433-4ce7-b389-0ee7178fd3c9 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 18:02:12 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 18:02:12 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 18:02:12 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:02:12 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Took 0.47 seconds to deallocate network for instance.
Nov 10 18:02:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-877b4abc-8433-4ce7-b389-0ee7178fd3c9 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:02:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-877b4abc-8433-4ce7-b389-0ee7178fd3c9 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:02:12 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-877b4abc-8433-4ce7-b389-0ee7178fd3c9 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:02:12 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-877b4abc-8433-4ce7-b389-0ee7178fd3c9 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:02:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-877b4abc-8433-4ce7-b389-0ee7178fd3c9 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.252s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:02:12 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-877b4abc-8433-4ce7-b389-0ee7178fd3c9 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Deleted allocations for instance b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b
Nov 10 18:02:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-877b4abc-8433-4ce7-b389-0ee7178fd3c9 tempest-ServerRescueNegativeTestJSON-783763036 tempest-ServerRescueNegativeTestJSON-783763036-project-member] Lock "b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.629s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:02:13 user nova-compute[75100]: DEBUG nova.compute.manager [req-5339523e-79a0-4de3-99aa-9375e589d9c0 req-32d23942-1b53-48fb-8940-3e864fbaaf54 service nova] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Received event network-vif-plugged-be620d2e-a2ea-49fe-9205-68101009027b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:02:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5339523e-79a0-4de3-99aa-9375e589d9c0 req-32d23942-1b53-48fb-8940-3e864fbaaf54 service nova] Acquiring lock "b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:02:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5339523e-79a0-4de3-99aa-9375e589d9c0 req-32d23942-1b53-48fb-8940-3e864fbaaf54 service nova] Lock "b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:02:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5339523e-79a0-4de3-99aa-9375e589d9c0 req-32d23942-1b53-48fb-8940-3e864fbaaf54 service nova] Lock "b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:02:13 user nova-compute[75100]: DEBUG nova.compute.manager [req-5339523e-79a0-4de3-99aa-9375e589d9c0 req-32d23942-1b53-48fb-8940-3e864fbaaf54 service nova] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] No waiting events found dispatching network-vif-plugged-be620d2e-a2ea-49fe-9205-68101009027b {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:02:13 user nova-compute[75100]: WARNING nova.compute.manager [req-5339523e-79a0-4de3-99aa-9375e589d9c0 req-32d23942-1b53-48fb-8940-3e864fbaaf54 service nova] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Received unexpected event network-vif-plugged-be620d2e-a2ea-49fe-9205-68101009027b for instance with vm_state deleted and task_state None.
Nov 10 18:02:13 user nova-compute[75100]: DEBUG nova.compute.manager [req-5339523e-79a0-4de3-99aa-9375e589d9c0 req-32d23942-1b53-48fb-8940-3e864fbaaf54 service nova] [instance: b9cf5ad6-3f89-4e80-b73f-f9ca53df8b1b] Received event network-vif-deleted-be620d2e-a2ea-49fe-9205-68101009027b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:02:15 user nova-compute[75100]: DEBUG nova.compute.manager [req-3ac96756-ff30-4890-9fa3-5ae746c8b309 req-1e3ca848-18a5-4dd2-ba85-c055de7b403e service nova] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Received event network-changed-8c7dcf78-fc4a-4fcb-905e-ce75143a9450 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:02:15 user nova-compute[75100]: DEBUG nova.compute.manager [req-3ac96756-ff30-4890-9fa3-5ae746c8b309 req-1e3ca848-18a5-4dd2-ba85-c055de7b403e service nova] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Refreshing instance network info cache due to event network-changed-8c7dcf78-fc4a-4fcb-905e-ce75143a9450. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 18:02:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3ac96756-ff30-4890-9fa3-5ae746c8b309 req-1e3ca848-18a5-4dd2-ba85-c055de7b403e service nova] Acquiring lock "refresh_cache-fcc2bfb6-fd6b-4229-9664-42f33b138444" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:02:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3ac96756-ff30-4890-9fa3-5ae746c8b309 req-1e3ca848-18a5-4dd2-ba85-c055de7b403e service nova] Acquired lock "refresh_cache-fcc2bfb6-fd6b-4229-9664-42f33b138444" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:02:15 user nova-compute[75100]: DEBUG nova.network.neutron [req-3ac96756-ff30-4890-9fa3-5ae746c8b309 req-1e3ca848-18a5-4dd2-ba85-c055de7b403e service nova] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Refreshing network info cache for port 8c7dcf78-fc4a-4fcb-905e-ce75143a9450 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 18:02:15 user nova-compute[75100]: DEBUG nova.network.neutron [req-3ac96756-ff30-4890-9fa3-5ae746c8b309 req-1e3ca848-18a5-4dd2-ba85-c055de7b403e service nova] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Updated VIF entry in instance network info cache for port 8c7dcf78-fc4a-4fcb-905e-ce75143a9450. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 18:02:15 user nova-compute[75100]: DEBUG nova.network.neutron [req-3ac96756-ff30-4890-9fa3-5ae746c8b309 req-1e3ca848-18a5-4dd2-ba85-c055de7b403e service nova] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Updating instance_info_cache with network_info: [{"id": "8c7dcf78-fc4a-4fcb-905e-ce75143a9450", "address": "fa:16:3e:be:ec:38", "network": {"id": "20522623-c29d-44f8-9047-68dde7f763c1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1770250829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2871e8755b32497d901be0f062fad858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7dcf78-fc", "ovs_interfaceid": "8c7dcf78-fc4a-4fcb-905e-ce75143a9450", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:02:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3ac96756-ff30-4890-9fa3-5ae746c8b309 req-1e3ca848-18a5-4dd2-ba85-c055de7b403e service nova] Releasing lock "refresh_cache-fcc2bfb6-fd6b-4229-9664-42f33b138444" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:02:16 user nova-compute[75100]: DEBUG nova.compute.manager [None req-b5701d42-3f4f-4c7c-b76f-e903a59a73a3 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 18:02:16 user nova-compute[75100]: INFO nova.compute.manager [None req-b5701d42-3f4f-4c7c-b76f-e903a59a73a3 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] instance snapshotting
Nov 10 18:02:16 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-b5701d42-3f4f-4c7c-b76f-e903a59a73a3 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Beginning live snapshot process
Nov 10 18:02:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-b5701d42-3f4f-4c7c-b76f-e903a59a73a3 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc2bfb6-fd6b-4229-9664-42f33b138444/disk --force-share --output=json -f qcow2 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:02:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-b5701d42-3f4f-4c7c-b76f-e903a59a73a3 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc2bfb6-fd6b-4229-9664-42f33b138444/disk --force-share --output=json -f qcow2" returned: 0 in 0.192s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:02:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-b5701d42-3f4f-4c7c-b76f-e903a59a73a3 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc2bfb6-fd6b-4229-9664-42f33b138444/disk --force-share --output=json -f qcow2 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:02:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-b5701d42-3f4f-4c7c-b76f-e903a59a73a3 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc2bfb6-fd6b-4229-9664-42f33b138444/disk --force-share --output=json -f qcow2" returned: 0 in 0.252s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:02:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-b5701d42-3f4f-4c7c-b76f-e903a59a73a3 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:02:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-b5701d42-3f4f-4c7c-b76f-e903a59a73a3 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.182s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:02:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-b5701d42-3f4f-4c7c-b76f-e903a59a73a3 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpq3aluq8i/457ec28d5035420fbe697c387b5a8a9d.delta 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:02:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-b5701d42-3f4f-4c7c-b76f-e903a59a73a3 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpq3aluq8i/457ec28d5035420fbe697c387b5a8a9d.delta 1073741824" returned: 0 in 0.053s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:02:17 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-b5701d42-3f4f-4c7c-b76f-e903a59a73a3 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 10 18:02:18 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-b5701d42-3f4f-4c7c-b76f-e903a59a73a3 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75100) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 18:02:18 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-b5701d42-3f4f-4c7c-b76f-e903a59a73a3 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75100) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 18:02:18 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-b5701d42-3f4f-4c7c-b76f-e903a59a73a3 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 10 18:02:18 user nova-compute[75100]: DEBUG nova.privsep.utils [None req-b5701d42-3f4f-4c7c-b76f-e903a59a73a3 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75100) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 18:02:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-b5701d42-3f4f-4c7c-b76f-e903a59a73a3 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpq3aluq8i/457ec28d5035420fbe697c387b5a8a9d.delta /opt/stack/data/nova/instances/snapshots/tmpq3aluq8i/457ec28d5035420fbe697c387b5a8a9d {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:02:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-b5701d42-3f4f-4c7c-b76f-e903a59a73a3 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpq3aluq8i/457ec28d5035420fbe697c387b5a8a9d.delta /opt/stack/data/nova/instances/snapshots/tmpq3aluq8i/457ec28d5035420fbe697c387b5a8a9d" returned: 0 in 0.496s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:02:19 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-b5701d42-3f4f-4c7c-b76f-e903a59a73a3 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Snapshot extracted, beginning image upload
Nov 10 18:02:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:20 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:02:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:22 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-b5701d42-3f4f-4c7c-b76f-e903a59a73a3 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Snapshot image upload complete
Nov 10 18:02:22 user nova-compute[75100]: INFO nova.compute.manager [None req-b5701d42-3f4f-4c7c-b76f-e903a59a73a3 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Took 5.64 seconds to snapshot the instance on the hypervisor.
Nov 10 18:02:22 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:02:24 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:02:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:02:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:02:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:02:24 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 18:02:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:02:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Acquiring lock "9f115887-d874-4499-b20a-05d4f0623866" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:02:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "9f115887-d874-4499-b20a-05d4f0623866" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:02:24 user nova-compute[75100]: DEBUG nova.compute.manager [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 9f115887-d874-4499-b20a-05d4f0623866] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 18:02:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:02:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:02:24 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 18:02:24 user nova-compute[75100]: INFO nova.compute.claims [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 9f115887-d874-4499-b20a-05d4f0623866] Claim successful on node user
Nov 10 18:02:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:02:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:02:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:02:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/989f3ce5-067b-45e4-a2e5-445024e13202/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:02:24 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:02:24 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:02:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.374s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:02:25 user nova-compute[75100]: DEBUG nova.compute.manager [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 9f115887-d874-4499-b20a-05d4f0623866] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 18:02:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/989f3ce5-067b-45e4-a2e5-445024e13202/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:02:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/989f3ce5-067b-45e4-a2e5-445024e13202/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:02:25 user nova-compute[75100]: DEBUG nova.compute.manager [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 9f115887-d874-4499-b20a-05d4f0623866] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 18:02:25 user nova-compute[75100]: DEBUG nova.network.neutron [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 9f115887-d874-4499-b20a-05d4f0623866] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 18:02:25 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 9f115887-d874-4499-b20a-05d4f0623866] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 18:02:25 user nova-compute[75100]: DEBUG nova.compute.manager [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 9f115887-d874-4499-b20a-05d4f0623866] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 18:02:25 user nova-compute[75100]: DEBUG nova.policy [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '323c5738ca424a379f666b4ca60825ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd441a46aa4a579feff608d6ff9bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 18:02:25 user nova-compute[75100]: INFO nova.virt.block_device [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 9f115887-d874-4499-b20a-05d4f0623866] Booting with volume a54f8ddb-2769-4cf8-9e3e-e199b57b3005 at /dev/vda
Nov 10 18:02:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/989f3ce5-067b-45e4-a2e5-445024e13202/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:02:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2f4288-da43-4bf3-9ef4-fd53961fe74c/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:02:25 user nova-compute[75100]: DEBUG os_brick.utils [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:02:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:02:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:02:25 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2bdb66-6905-4863-a049-bd7ad698a238]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90b1a229568f\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:02:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:02:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:02:25 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d927a80-a15d-4634-baaa-fd1394482108]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:02:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:02:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:02:25 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8dd8bee-3d4b-4332-afd2-304ef4b8cfdf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:02:25 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f52de8-e576-4449-a1d5-3492d74a8db4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:02:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:02:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 18:02:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 18:02:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:02:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 18:02:25 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 18:02:25 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[92813951-6a89-4c79-8359-d8ce0d26deae]: (4, '') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:02:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 18:02:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 18:02:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 18:02:25 user nova-compute[75100]: DEBUG os_brick.utils [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90b1a229568f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:02:25 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 9f115887-d874-4499-b20a-05d4f0623866] Updating existing volume attachment record: 4e760198-43fd-4608-b4cd-45c98cc95276 {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 18:02:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2f4288-da43-4bf3-9ef4-fd53961fe74c/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:02:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2f4288-da43-4bf3-9ef4-fd53961fe74c/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:02:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2f4288-da43-4bf3-9ef4-fd53961fe74c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:02:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc2bfb6-fd6b-4229-9664-42f33b138444/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:02:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc2bfb6-fd6b-4229-9664-42f33b138444/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:02:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc2bfb6-fd6b-4229-9664-42f33b138444/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:02:26 user nova-compute[75100]: DEBUG nova.network.neutron [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 9f115887-d874-4499-b20a-05d4f0623866] Successfully created port: 246d725a-3837-4114-8a55-77503840db0e {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 18:02:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc2bfb6-fd6b-4229-9664-42f33b138444/disk --force-share --output=json" returned: 0 in 0.393s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:02:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:27 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:02:27 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:02:27 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Hypervisor/Node resource view: name=user free_ram=8245MB free_disk=24.507797241210938GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 18:02:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:02:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:02:27 user nova-compute[75100]: DEBUG nova.network.neutron [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 9f115887-d874-4499-b20a-05d4f0623866] Successfully updated port: 246d725a-3837-4114-8a55-77503840db0e {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 18:02:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Acquiring lock "refresh_cache-9f115887-d874-4499-b20a-05d4f0623866" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:02:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Acquired lock "refresh_cache-9f115887-d874-4499-b20a-05d4f0623866" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:02:27 user nova-compute[75100]: DEBUG nova.network.neutron [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 9f115887-d874-4499-b20a-05d4f0623866] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 18:02:27 user nova-compute[75100]: DEBUG nova.compute.manager [req-b0bd85fb-ee12-41a2-974e-4370afdd6d5f req-a861ea3f-f4eb-43ee-ab37-b0bf27a050db service nova] [instance: 9f115887-d874-4499-b20a-05d4f0623866] Received event network-changed-246d725a-3837-4114-8a55-77503840db0e {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:02:27 user nova-compute[75100]: DEBUG nova.compute.manager [req-b0bd85fb-ee12-41a2-974e-4370afdd6d5f req-a861ea3f-f4eb-43ee-ab37-b0bf27a050db service nova] [instance: 9f115887-d874-4499-b20a-05d4f0623866] Refreshing instance network info cache due to event network-changed-246d725a-3837-4114-8a55-77503840db0e. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 18:02:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b0bd85fb-ee12-41a2-974e-4370afdd6d5f req-a861ea3f-f4eb-43ee-ab37-b0bf27a050db service nova] Acquiring lock "refresh_cache-9f115887-d874-4499-b20a-05d4f0623866" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:02:27 user nova-compute[75100]: DEBUG nova.network.neutron [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 9f115887-d874-4499-b20a-05d4f0623866] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 18:02:27 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:02:27 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 989f3ce5-067b-45e4-a2e5-445024e13202 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:02:27 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance ca2f4288-da43-4bf3-9ef4-fd53961fe74c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:02:27 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance fcc2bfb6-fd6b-4229-9664-42f33b138444 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:02:27 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 9f115887-d874-4499-b20a-05d4f0623866 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:02:27 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 18:02:27 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 18:02:27 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:02:27 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:02:27 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 18:02:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.422s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:02:27 user nova-compute[75100]: DEBUG nova.network.neutron [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 9f115887-d874-4499-b20a-05d4f0623866] Updating instance_info_cache with network_info: [{"id": "246d725a-3837-4114-8a55-77503840db0e", "address": "fa:16:3e:1d:ae:19", "network": {"id": "2a85480b-f67d-4ef1-b967-3e93af57d7c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1717495768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9cd441a46aa4a579feff608d6ff9bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap246d725a-38", "ovs_interfaceid": "246d725a-3837-4114-8a55-77503840db0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:02:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Releasing lock "refresh_cache-9f115887-d874-4499-b20a-05d4f0623866" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:02:27 user nova-compute[75100]: DEBUG nova.compute.manager [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 9f115887-d874-4499-b20a-05d4f0623866] Instance network_info: |[{"id": "246d725a-3837-4114-8a55-77503840db0e", "address": "fa:16:3e:1d:ae:19", "network": {"id": "2a85480b-f67d-4ef1-b967-3e93af57d7c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1717495768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9cd441a46aa4a579feff608d6ff9bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap246d725a-38", "ovs_interfaceid": "246d725a-3837-4114-8a55-77503840db0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 18:02:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b0bd85fb-ee12-41a2-974e-4370afdd6d5f req-a861ea3f-f4eb-43ee-ab37-b0bf27a050db service nova] Acquired lock "refresh_cache-9f115887-d874-4499-b20a-05d4f0623866" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:02:27 user nova-compute[75100]: DEBUG nova.network.neutron [req-b0bd85fb-ee12-41a2-974e-4370afdd6d5f req-a861ea3f-f4eb-43ee-ab37-b0bf27a050db service nova] [instance: 9f115887-d874-4499-b20a-05d4f0623866] Refreshing network info cache for port 246d725a-3837-4114-8a55-77503840db0e {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 18:02:28 user nova-compute[75100]: DEBUG nova.network.neutron [req-b0bd85fb-ee12-41a2-974e-4370afdd6d5f req-a861ea3f-f4eb-43ee-ab37-b0bf27a050db service nova] [instance: 9f115887-d874-4499-b20a-05d4f0623866] Updated VIF entry in instance network info cache for port 246d725a-3837-4114-8a55-77503840db0e. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 18:02:28 user nova-compute[75100]: DEBUG nova.network.neutron [req-b0bd85fb-ee12-41a2-974e-4370afdd6d5f req-a861ea3f-f4eb-43ee-ab37-b0bf27a050db service nova] [instance: 9f115887-d874-4499-b20a-05d4f0623866] Updating instance_info_cache with network_info: [{"id": "246d725a-3837-4114-8a55-77503840db0e", "address": "fa:16:3e:1d:ae:19", "network": {"id": "2a85480b-f67d-4ef1-b967-3e93af57d7c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1717495768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9cd441a46aa4a579feff608d6ff9bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap246d725a-38", "ovs_interfaceid": "246d725a-3837-4114-8a55-77503840db0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:02:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b0bd85fb-ee12-41a2-974e-4370afdd6d5f req-a861ea3f-f4eb-43ee-ab37-b0bf27a050db service nova] Releasing lock "refresh_cache-9f115887-d874-4499-b20a-05d4f0623866" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:02:30 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:02:30 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:02:30 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:02:31 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:02:31 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 18:02:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:32 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:02:32 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:02:32 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 18:02:32 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Rebuilding the list of instances to heal {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 18:02:32 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 9f115887-d874-4499-b20a-05d4f0623866] Skipping network cache update for instance because it is Building. {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 10 18:02:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "refresh_cache-22c021d9-c8e4-455d-8e2a-a9cdfbb38f75" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:02:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquired lock "refresh_cache-22c021d9-c8e4-455d-8e2a-a9cdfbb38f75" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:02:32 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 18:02:32 user nova-compute[75100]: DEBUG nova.objects.instance [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lazy-loading 'info_cache' on Instance uuid 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:02:32 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Updating instance_info_cache with network_info: [{"id": "9855a14c-55c7-4a35-a4cc-7085dfbda684", "address": "fa:16:3e:02:b1:a1", "network": {"id": "bf1edb58-ef26-40ca-8ec9-853fa05de13d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1416469583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7bb141ef59487dbb2ce6243c5002af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9855a14c-55", "ovs_interfaceid": "9855a14c-55c7-4a35-a4cc-7085dfbda684", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:02:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Releasing lock "refresh_cache-22c021d9-c8e4-455d-8e2a-a9cdfbb38f75" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:02:32 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 18:02:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:34 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:02:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-94edb68e-f9e1-41f5-915f-c9b56d612272 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Acquiring lock "ca2f4288-da43-4bf3-9ef4-fd53961fe74c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:02:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-94edb68e-f9e1-41f5-915f-c9b56d612272 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "ca2f4288-da43-4bf3-9ef4-fd53961fe74c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:02:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-94edb68e-f9e1-41f5-915f-c9b56d612272 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Acquiring lock "ca2f4288-da43-4bf3-9ef4-fd53961fe74c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:02:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-94edb68e-f9e1-41f5-915f-c9b56d612272 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "ca2f4288-da43-4bf3-9ef4-fd53961fe74c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:02:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-94edb68e-f9e1-41f5-915f-c9b56d612272 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "ca2f4288-da43-4bf3-9ef4-fd53961fe74c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:02:37 user nova-compute[75100]: INFO nova.compute.manager [None req-94edb68e-f9e1-41f5-915f-c9b56d612272 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Terminating instance
Nov 10 18:02:37 user nova-compute[75100]: DEBUG nova.compute.manager [None req-94edb68e-f9e1-41f5-915f-c9b56d612272 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 18:02:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e2161549-d93d-44ad-824f-c6ce978c2eac tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Acquiring lock "989f3ce5-067b-45e4-a2e5-445024e13202" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:02:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e2161549-d93d-44ad-824f-c6ce978c2eac tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Lock "989f3ce5-067b-45e4-a2e5-445024e13202" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:02:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e2161549-d93d-44ad-824f-c6ce978c2eac tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Acquiring lock "989f3ce5-067b-45e4-a2e5-445024e13202-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:02:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e2161549-d93d-44ad-824f-c6ce978c2eac tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Lock "989f3ce5-067b-45e4-a2e5-445024e13202-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:02:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e2161549-d93d-44ad-824f-c6ce978c2eac tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Lock "989f3ce5-067b-45e4-a2e5-445024e13202-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:02:37 user nova-compute[75100]: INFO nova.compute.manager [None req-e2161549-d93d-44ad-824f-c6ce978c2eac tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] Terminating instance
Nov 10 18:02:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:37 user nova-compute[75100]: DEBUG nova.compute.manager [None req-e2161549-d93d-44ad-824f-c6ce978c2eac tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 18:02:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:37 user nova-compute[75100]: DEBUG nova.compute.manager [req-28096c3b-9eb5-40b5-a3fe-9e3c65e3fb95 req-26b5f047-ef39-422e-94ea-7800aec50ce3 service nova] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Received event network-vif-unplugged-f33ff122-270e-4129-be5b-e67c0bc0708c {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:02:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-28096c3b-9eb5-40b5-a3fe-9e3c65e3fb95 req-26b5f047-ef39-422e-94ea-7800aec50ce3 service nova] Acquiring lock "ca2f4288-da43-4bf3-9ef4-fd53961fe74c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:02:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-28096c3b-9eb5-40b5-a3fe-9e3c65e3fb95 req-26b5f047-ef39-422e-94ea-7800aec50ce3 service nova] Lock "ca2f4288-da43-4bf3-9ef4-fd53961fe74c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:02:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-28096c3b-9eb5-40b5-a3fe-9e3c65e3fb95 req-26b5f047-ef39-422e-94ea-7800aec50ce3 service nova] Lock "ca2f4288-da43-4bf3-9ef4-fd53961fe74c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:02:37 user nova-compute[75100]: DEBUG nova.compute.manager [req-28096c3b-9eb5-40b5-a3fe-9e3c65e3fb95 req-26b5f047-ef39-422e-94ea-7800aec50ce3 service nova] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] No waiting events found dispatching network-vif-unplugged-f33ff122-270e-4129-be5b-e67c0bc0708c {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:02:37 user nova-compute[75100]: DEBUG nova.compute.manager [req-28096c3b-9eb5-40b5-a3fe-9e3c65e3fb95 req-26b5f047-ef39-422e-94ea-7800aec50ce3 service nova] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Received event network-vif-unplugged-f33ff122-270e-4129-be5b-e67c0bc0708c for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 18:02:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:38 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] Instance destroyed successfully.
Nov 10 18:02:38 user nova-compute[75100]: DEBUG nova.objects.instance [None req-e2161549-d93d-44ad-824f-c6ce978c2eac tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Lazy-loading 'resources' on Instance uuid 989f3ce5-067b-45e4-a2e5-445024e13202 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:02:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-e2161549-d93d-44ad-824f-c6ce978c2eac tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:53:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-714070398',display_name='tempest-ServersNegativeTestJSON-server-714070398',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-714070398',id=23,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T17:53:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fc3d8aa64c704f45b08bdb0f1ecb2c90',ramdisk_id='',reservation_id='r-z3wvbf41',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1166274989',owner_user_name='tempest-ServersNegativeTestJSON-1166274989-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T17:53:31Z,user_data=None,user_id='624efcea1cd1402d93c86d77c1424307',uuid=989f3ce5-067b-45e4-a2e5-445024e13202,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9dd712ca-c177-4a1b-8d45-78db1470b9c1", "address": "fa:16:3e:c5:ed:2a", "network": {"id": "879f9f54-7640-4384-b28f-7d8d38d7f74f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1830593335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc3d8aa64c704f45b08bdb0f1ecb2c90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dd712ca-c1", "ovs_interfaceid": "9dd712ca-c177-4a1b-8d45-78db1470b9c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 18:02:38 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-e2161549-d93d-44ad-824f-c6ce978c2eac tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Converting VIF {"id": "9dd712ca-c177-4a1b-8d45-78db1470b9c1", "address": "fa:16:3e:c5:ed:2a", "network": {"id": "879f9f54-7640-4384-b28f-7d8d38d7f74f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1830593335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc3d8aa64c704f45b08bdb0f1ecb2c90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dd712ca-c1", "ovs_interfaceid": "9dd712ca-c177-4a1b-8d45-78db1470b9c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:02:38 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-e2161549-d93d-44ad-824f-c6ce978c2eac tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:ed:2a,bridge_name='br-int',has_traffic_filtering=True,id=9dd712ca-c177-4a1b-8d45-78db1470b9c1,network=Network(879f9f54-7640-4384-b28f-7d8d38d7f74f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dd712ca-c1') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:02:38 user nova-compute[75100]: DEBUG os_vif [None req-e2161549-d93d-44ad-824f-c6ce978c2eac tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:ed:2a,bridge_name='br-int',has_traffic_filtering=True,id=9dd712ca-c177-4a1b-8d45-78db1470b9c1,network=Network(879f9f54-7640-4384-b28f-7d8d38d7f74f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dd712ca-c1') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 18:02:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9dd712ca-c1, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:02:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:02:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aa1cc046-a01d-4cf2-a659-9bede715c6d7) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:02:38 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Instance destroyed successfully.
Nov 10 18:02:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:38 user nova-compute[75100]: DEBUG nova.objects.instance [None req-94edb68e-f9e1-41f5-915f-c9b56d612272 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lazy-loading 'resources' on Instance uuid ca2f4288-da43-4bf3-9ef4-fd53961fe74c {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:02:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:02:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:38 user nova-compute[75100]: INFO os_vif [None req-e2161549-d93d-44ad-824f-c6ce978c2eac tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:ed:2a,bridge_name='br-int',has_traffic_filtering=True,id=9dd712ca-c177-4a1b-8d45-78db1470b9c1,network=Network(879f9f54-7640-4384-b28f-7d8d38d7f74f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dd712ca-c1')
Nov 10 18:02:38 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-e2161549-d93d-44ad-824f-c6ce978c2eac tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] Deleting instance files /opt/stack/data/nova/instances/989f3ce5-067b-45e4-a2e5-445024e13202_del
Nov 10 18:02:38 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-e2161549-d93d-44ad-824f-c6ce978c2eac tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] Deletion of /opt/stack/data/nova/instances/989f3ce5-067b-45e4-a2e5-445024e13202_del complete
Nov 10 18:02:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-94edb68e-f9e1-41f5-915f-c9b56d612272 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:56:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2141027010',display_name='tempest-TestMinimumBasicScenario-server-2141027010',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2141027010',id=28,image_ref='9aca461c-4c8d-4e01-96d9-5330997a3b2b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+9Ljzn6uNPZfvsGzjgf1rzPigyBeIjo1hMLKvKaNMvgjphzLJkq/N+5Rj1I8Bo9ee1XzM24XDugNOdWVPL1ENg5TesGhg9QW7vu/ykAEwYg59w+wwxgQEjuXd/8c6JAA==',key_name='tempest-TestMinimumBasicScenario-2102848825',keypairs=<?>,launch_index=0,launched_at=2023-11-10T17:56:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='19cfb454e59745bf9c77d7a7ede2bc0e',ramdisk_id='',reservation_id='r-nrbksuex',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9aca461c-4c8d-4e01-96d9-5330997a3b2b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-281006384',owner_user_name='tempest-TestMinimumBasicScenario-281006384-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T17:59:49Z,user_data=None,user_id='4d873ec5a11a4ccdb868fef673ffc568',uuid=ca2f4288-da43-4bf3-9ef4-fd53961fe74c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f33ff122-270e-4129-be5b-e67c0bc0708c", "address": "fa:16:3e:e0:bd:a4", "network": {"id": "78d86418-c0e0-4cc2-8f4f-262f600f7d66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2054827063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19cfb454e59745bf9c77d7a7ede2bc0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33ff122-27", "ovs_interfaceid": "f33ff122-270e-4129-be5b-e67c0bc0708c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 18:02:38 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-94edb68e-f9e1-41f5-915f-c9b56d612272 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Converting VIF {"id": "f33ff122-270e-4129-be5b-e67c0bc0708c", "address": "fa:16:3e:e0:bd:a4", "network": {"id": "78d86418-c0e0-4cc2-8f4f-262f600f7d66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2054827063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19cfb454e59745bf9c77d7a7ede2bc0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33ff122-27", "ovs_interfaceid": "f33ff122-270e-4129-be5b-e67c0bc0708c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:02:38 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-94edb68e-f9e1-41f5-915f-c9b56d612272 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:bd:a4,bridge_name='br-int',has_traffic_filtering=True,id=f33ff122-270e-4129-be5b-e67c0bc0708c,network=Network(78d86418-c0e0-4cc2-8f4f-262f600f7d66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf33ff122-27') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:02:38 user nova-compute[75100]: DEBUG os_vif [None req-94edb68e-f9e1-41f5-915f-c9b56d612272 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:bd:a4,bridge_name='br-int',has_traffic_filtering=True,id=f33ff122-270e-4129-be5b-e67c0bc0708c,network=Network(78d86418-c0e0-4cc2-8f4f-262f600f7d66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf33ff122-27') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 18:02:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf33ff122-27, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:02:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a22051fe-ef10-4c0f-85f0-bde4ed4a4732) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:02:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:38 user nova-compute[75100]: INFO os_vif [None req-94edb68e-f9e1-41f5-915f-c9b56d612272 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:bd:a4,bridge_name='br-int',has_traffic_filtering=True,id=f33ff122-270e-4129-be5b-e67c0bc0708c,network=Network(78d86418-c0e0-4cc2-8f4f-262f600f7d66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf33ff122-27')
Nov 10 18:02:38 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-94edb68e-f9e1-41f5-915f-c9b56d612272 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Deleting instance files /opt/stack/data/nova/instances/ca2f4288-da43-4bf3-9ef4-fd53961fe74c_del
Nov 10 18:02:38 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-94edb68e-f9e1-41f5-915f-c9b56d612272 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Deletion of /opt/stack/data/nova/instances/ca2f4288-da43-4bf3-9ef4-fd53961fe74c_del complete
Nov 10 18:02:38 user nova-compute[75100]: INFO nova.compute.manager [None req-e2161549-d93d-44ad-824f-c6ce978c2eac tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] Took 1.23 seconds to destroy the instance on the hypervisor.
Nov 10 18:02:38 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-e2161549-d93d-44ad-824f-c6ce978c2eac tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 18:02:38 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 18:02:38 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 18:02:38 user nova-compute[75100]: INFO nova.compute.manager [None req-94edb68e-f9e1-41f5-915f-c9b56d612272 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Took 1.38 seconds to destroy the instance on the hypervisor.
Nov 10 18:02:38 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-94edb68e-f9e1-41f5-915f-c9b56d612272 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 18:02:38 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 18:02:38 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 18:02:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:39 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:02:39 user nova-compute[75100]: DEBUG nova.compute.manager [req-9fdb0494-58b2-4801-b69d-bbd36d490797 req-5f428e67-7180-4b5a-a7a4-baef3e3383d5 service nova] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] Received event network-vif-deleted-9dd712ca-c177-4a1b-8d45-78db1470b9c1 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:02:39 user nova-compute[75100]: INFO nova.compute.manager [req-9fdb0494-58b2-4801-b69d-bbd36d490797 req-5f428e67-7180-4b5a-a7a4-baef3e3383d5 service nova] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] Neutron deleted interface 9dd712ca-c177-4a1b-8d45-78db1470b9c1; detaching it from the instance and deleting it from the info cache
Nov 10 18:02:39 user nova-compute[75100]: DEBUG nova.network.neutron [req-9fdb0494-58b2-4801-b69d-bbd36d490797 req-5f428e67-7180-4b5a-a7a4-baef3e3383d5 service nova] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:02:39 user nova-compute[75100]: DEBUG nova.compute.manager [req-9fdb0494-58b2-4801-b69d-bbd36d490797 req-5f428e67-7180-4b5a-a7a4-baef3e3383d5 service nova] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] Detach interface failed, port_id=9dd712ca-c177-4a1b-8d45-78db1470b9c1, reason: Instance 989f3ce5-067b-45e4-a2e5-445024e13202 could not be found. {{(pid=75100) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 18:02:39 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] Took 0.66 seconds to deallocate network for instance.
Nov 10 18:02:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e2161549-d93d-44ad-824f-c6ce978c2eac tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:02:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e2161549-d93d-44ad-824f-c6ce978c2eac tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:02:39 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:02:39 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-e2161549-d93d-44ad-824f-c6ce978c2eac tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:02:39 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Took 0.94 seconds to deallocate network for instance.
Nov 10 18:02:39 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-e2161549-d93d-44ad-824f-c6ce978c2eac tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:02:39 user nova-compute[75100]: DEBUG nova.compute.manager [req-4dba6c53-8dff-4cad-8be2-e7d300e422a7 req-54e16d30-b8bb-414e-84fa-acf04c8057a0 service nova] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Received event network-vif-deleted-f33ff122-270e-4129-be5b-e67c0bc0708c {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:02:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e2161549-d93d-44ad-824f-c6ce978c2eac tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.308s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:02:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-94edb68e-f9e1-41f5-915f-c9b56d612272 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:02:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-94edb68e-f9e1-41f5-915f-c9b56d612272 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:02:39 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-e2161549-d93d-44ad-824f-c6ce978c2eac tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Deleted allocations for instance 989f3ce5-067b-45e4-a2e5-445024e13202
Nov 10 18:02:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e2161549-d93d-44ad-824f-c6ce978c2eac tempest-ServersNegativeTestJSON-1166274989 tempest-ServersNegativeTestJSON-1166274989-project-member] Lock "989f3ce5-067b-45e4-a2e5-445024e13202" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.414s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:02:39 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-94edb68e-f9e1-41f5-915f-c9b56d612272 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:02:39 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-94edb68e-f9e1-41f5-915f-c9b56d612272 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:02:39 user nova-compute[75100]: DEBUG nova.compute.manager [req-d4296dd0-dfce-415d-afd4-f0421ce4941a req-3e9a7589-aec3-4025-a4f4-2e359c42129b service nova] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Received event network-vif-plugged-f33ff122-270e-4129-be5b-e67c0bc0708c {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:02:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d4296dd0-dfce-415d-afd4-f0421ce4941a req-3e9a7589-aec3-4025-a4f4-2e359c42129b service nova] Acquiring lock "ca2f4288-da43-4bf3-9ef4-fd53961fe74c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:02:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d4296dd0-dfce-415d-afd4-f0421ce4941a req-3e9a7589-aec3-4025-a4f4-2e359c42129b service nova] Lock "ca2f4288-da43-4bf3-9ef4-fd53961fe74c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:02:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d4296dd0-dfce-415d-afd4-f0421ce4941a req-3e9a7589-aec3-4025-a4f4-2e359c42129b service nova] Lock "ca2f4288-da43-4bf3-9ef4-fd53961fe74c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:02:39 user nova-compute[75100]: DEBUG nova.compute.manager [req-d4296dd0-dfce-415d-afd4-f0421ce4941a req-3e9a7589-aec3-4025-a4f4-2e359c42129b service nova] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] No waiting events found dispatching network-vif-plugged-f33ff122-270e-4129-be5b-e67c0bc0708c {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:02:39 user nova-compute[75100]: WARNING nova.compute.manager [req-d4296dd0-dfce-415d-afd4-f0421ce4941a req-3e9a7589-aec3-4025-a4f4-2e359c42129b service nova] [instance: ca2f4288-da43-4bf3-9ef4-fd53961fe74c] Received unexpected event network-vif-plugged-f33ff122-270e-4129-be5b-e67c0bc0708c for instance with vm_state deleted and task_state None.
Nov 10 18:02:39 user nova-compute[75100]: DEBUG nova.compute.manager [req-d4296dd0-dfce-415d-afd4-f0421ce4941a req-3e9a7589-aec3-4025-a4f4-2e359c42129b service nova] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] Received event network-vif-unplugged-9dd712ca-c177-4a1b-8d45-78db1470b9c1 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:02:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d4296dd0-dfce-415d-afd4-f0421ce4941a req-3e9a7589-aec3-4025-a4f4-2e359c42129b service nova] Acquiring lock "989f3ce5-067b-45e4-a2e5-445024e13202-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:02:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d4296dd0-dfce-415d-afd4-f0421ce4941a req-3e9a7589-aec3-4025-a4f4-2e359c42129b service nova] Lock "989f3ce5-067b-45e4-a2e5-445024e13202-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:02:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d4296dd0-dfce-415d-afd4-f0421ce4941a req-3e9a7589-aec3-4025-a4f4-2e359c42129b service nova] Lock "989f3ce5-067b-45e4-a2e5-445024e13202-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:02:39 user nova-compute[75100]: DEBUG nova.compute.manager [req-d4296dd0-dfce-415d-afd4-f0421ce4941a req-3e9a7589-aec3-4025-a4f4-2e359c42129b service nova] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] No waiting events found dispatching network-vif-unplugged-9dd712ca-c177-4a1b-8d45-78db1470b9c1 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:02:39 user nova-compute[75100]: WARNING nova.compute.manager [req-d4296dd0-dfce-415d-afd4-f0421ce4941a req-3e9a7589-aec3-4025-a4f4-2e359c42129b service nova] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] Received unexpected event network-vif-unplugged-9dd712ca-c177-4a1b-8d45-78db1470b9c1 for instance with vm_state deleted and task_state None.
Nov 10 18:02:39 user nova-compute[75100]: DEBUG nova.compute.manager [req-d4296dd0-dfce-415d-afd4-f0421ce4941a req-3e9a7589-aec3-4025-a4f4-2e359c42129b service nova] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] Received event network-vif-plugged-9dd712ca-c177-4a1b-8d45-78db1470b9c1 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:02:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d4296dd0-dfce-415d-afd4-f0421ce4941a req-3e9a7589-aec3-4025-a4f4-2e359c42129b service nova] Acquiring lock "989f3ce5-067b-45e4-a2e5-445024e13202-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:02:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d4296dd0-dfce-415d-afd4-f0421ce4941a req-3e9a7589-aec3-4025-a4f4-2e359c42129b service nova] Lock "989f3ce5-067b-45e4-a2e5-445024e13202-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:02:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d4296dd0-dfce-415d-afd4-f0421ce4941a req-3e9a7589-aec3-4025-a4f4-2e359c42129b service nova] Lock "989f3ce5-067b-45e4-a2e5-445024e13202-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:02:39 user nova-compute[75100]: DEBUG nova.compute.manager [req-d4296dd0-dfce-415d-afd4-f0421ce4941a req-3e9a7589-aec3-4025-a4f4-2e359c42129b service nova] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] No waiting events found dispatching network-vif-plugged-9dd712ca-c177-4a1b-8d45-78db1470b9c1 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:02:39 user nova-compute[75100]: WARNING nova.compute.manager [req-d4296dd0-dfce-415d-afd4-f0421ce4941a req-3e9a7589-aec3-4025-a4f4-2e359c42129b service nova] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] Received unexpected event network-vif-plugged-9dd712ca-c177-4a1b-8d45-78db1470b9c1 for instance with vm_state deleted and task_state None.
Nov 10 18:02:39 user nova-compute[75100]: DEBUG nova.compute.manager [req-d4296dd0-dfce-415d-afd4-f0421ce4941a req-3e9a7589-aec3-4025-a4f4-2e359c42129b service nova] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] Received event network-vif-plugged-9dd712ca-c177-4a1b-8d45-78db1470b9c1 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:02:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d4296dd0-dfce-415d-afd4-f0421ce4941a req-3e9a7589-aec3-4025-a4f4-2e359c42129b service nova] Acquiring lock "989f3ce5-067b-45e4-a2e5-445024e13202-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:02:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d4296dd0-dfce-415d-afd4-f0421ce4941a req-3e9a7589-aec3-4025-a4f4-2e359c42129b service nova] Lock "989f3ce5-067b-45e4-a2e5-445024e13202-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:02:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d4296dd0-dfce-415d-afd4-f0421ce4941a req-3e9a7589-aec3-4025-a4f4-2e359c42129b service nova] Lock "989f3ce5-067b-45e4-a2e5-445024e13202-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:02:39 user nova-compute[75100]: DEBUG nova.compute.manager [req-d4296dd0-dfce-415d-afd4-f0421ce4941a req-3e9a7589-aec3-4025-a4f4-2e359c42129b service nova] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] No waiting events found dispatching network-vif-plugged-9dd712ca-c177-4a1b-8d45-78db1470b9c1 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:02:39 user nova-compute[75100]: WARNING nova.compute.manager [req-d4296dd0-dfce-415d-afd4-f0421ce4941a req-3e9a7589-aec3-4025-a4f4-2e359c42129b service nova] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] Received unexpected event network-vif-plugged-9dd712ca-c177-4a1b-8d45-78db1470b9c1 for instance with vm_state deleted and task_state None.
Nov 10 18:02:39 user nova-compute[75100]: DEBUG nova.compute.manager [req-d4296dd0-dfce-415d-afd4-f0421ce4941a req-3e9a7589-aec3-4025-a4f4-2e359c42129b service nova] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] Received event network-vif-plugged-9dd712ca-c177-4a1b-8d45-78db1470b9c1 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:02:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d4296dd0-dfce-415d-afd4-f0421ce4941a req-3e9a7589-aec3-4025-a4f4-2e359c42129b service nova] Acquiring lock "989f3ce5-067b-45e4-a2e5-445024e13202-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:02:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d4296dd0-dfce-415d-afd4-f0421ce4941a req-3e9a7589-aec3-4025-a4f4-2e359c42129b service nova] Lock "989f3ce5-067b-45e4-a2e5-445024e13202-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:02:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d4296dd0-dfce-415d-afd4-f0421ce4941a req-3e9a7589-aec3-4025-a4f4-2e359c42129b service nova] Lock "989f3ce5-067b-45e4-a2e5-445024e13202-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:02:39 user nova-compute[75100]: DEBUG nova.compute.manager [req-d4296dd0-dfce-415d-afd4-f0421ce4941a req-3e9a7589-aec3-4025-a4f4-2e359c42129b service nova] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] No waiting events found dispatching network-vif-plugged-9dd712ca-c177-4a1b-8d45-78db1470b9c1 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:02:39 user nova-compute[75100]: WARNING nova.compute.manager [req-d4296dd0-dfce-415d-afd4-f0421ce4941a req-3e9a7589-aec3-4025-a4f4-2e359c42129b service nova] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] Received unexpected event network-vif-plugged-9dd712ca-c177-4a1b-8d45-78db1470b9c1 for instance with vm_state deleted and task_state None.
Nov 10 18:02:39 user nova-compute[75100]: DEBUG nova.compute.manager [req-d4296dd0-dfce-415d-afd4-f0421ce4941a req-3e9a7589-aec3-4025-a4f4-2e359c42129b service nova] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] Received event network-vif-unplugged-9dd712ca-c177-4a1b-8d45-78db1470b9c1 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:02:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d4296dd0-dfce-415d-afd4-f0421ce4941a req-3e9a7589-aec3-4025-a4f4-2e359c42129b service nova] Acquiring lock "989f3ce5-067b-45e4-a2e5-445024e13202-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:02:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d4296dd0-dfce-415d-afd4-f0421ce4941a req-3e9a7589-aec3-4025-a4f4-2e359c42129b service nova] Lock "989f3ce5-067b-45e4-a2e5-445024e13202-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:02:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d4296dd0-dfce-415d-afd4-f0421ce4941a req-3e9a7589-aec3-4025-a4f4-2e359c42129b service nova] Lock "989f3ce5-067b-45e4-a2e5-445024e13202-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:02:39 user nova-compute[75100]: DEBUG nova.compute.manager [req-d4296dd0-dfce-415d-afd4-f0421ce4941a req-3e9a7589-aec3-4025-a4f4-2e359c42129b service nova] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] No waiting events found dispatching network-vif-unplugged-9dd712ca-c177-4a1b-8d45-78db1470b9c1 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:02:39 user nova-compute[75100]: WARNING nova.compute.manager [req-d4296dd0-dfce-415d-afd4-f0421ce4941a req-3e9a7589-aec3-4025-a4f4-2e359c42129b service nova] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] Received unexpected event network-vif-unplugged-9dd712ca-c177-4a1b-8d45-78db1470b9c1 for instance with vm_state deleted and task_state None.
Nov 10 18:02:39 user nova-compute[75100]: DEBUG nova.compute.manager [req-d4296dd0-dfce-415d-afd4-f0421ce4941a req-3e9a7589-aec3-4025-a4f4-2e359c42129b service nova] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] Received event network-vif-plugged-9dd712ca-c177-4a1b-8d45-78db1470b9c1 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:02:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d4296dd0-dfce-415d-afd4-f0421ce4941a req-3e9a7589-aec3-4025-a4f4-2e359c42129b service nova] Acquiring lock "989f3ce5-067b-45e4-a2e5-445024e13202-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:02:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d4296dd0-dfce-415d-afd4-f0421ce4941a req-3e9a7589-aec3-4025-a4f4-2e359c42129b service nova] Lock "989f3ce5-067b-45e4-a2e5-445024e13202-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:02:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d4296dd0-dfce-415d-afd4-f0421ce4941a req-3e9a7589-aec3-4025-a4f4-2e359c42129b service nova] Lock "989f3ce5-067b-45e4-a2e5-445024e13202-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:02:39 user nova-compute[75100]: DEBUG nova.compute.manager [req-d4296dd0-dfce-415d-afd4-f0421ce4941a req-3e9a7589-aec3-4025-a4f4-2e359c42129b service nova] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] No waiting events found dispatching network-vif-plugged-9dd712ca-c177-4a1b-8d45-78db1470b9c1 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:02:39 user nova-compute[75100]: WARNING nova.compute.manager [req-d4296dd0-dfce-415d-afd4-f0421ce4941a req-3e9a7589-aec3-4025-a4f4-2e359c42129b service nova] [instance: 989f3ce5-067b-45e4-a2e5-445024e13202] Received unexpected event network-vif-plugged-9dd712ca-c177-4a1b-8d45-78db1470b9c1 for instance with vm_state deleted and task_state None.
Nov 10 18:02:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-94edb68e-f9e1-41f5-915f-c9b56d612272 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.237s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:02:39 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-94edb68e-f9e1-41f5-915f-c9b56d612272 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Deleted allocations for instance ca2f4288-da43-4bf3-9ef4-fd53961fe74c
Nov 10 18:02:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-94edb68e-f9e1-41f5-915f-c9b56d612272 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "ca2f4288-da43-4bf3-9ef4-fd53961fe74c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.764s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:02:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG nova.compute.manager [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 9f115887-d874-4499-b20a-05d4f0623866] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 9f115887-d874-4499-b20a-05d4f0623866] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 18:02:51 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 9f115887-d874-4499-b20a-05d4f0623866] Creating image(s)
Nov 10 18:02:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 9f115887-d874-4499-b20a-05d4f0623866] Did not create local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 9f115887-d874-4499-b20a-05d4f0623866] Ensure instance console log exists: /opt/stack/data/nova/instances/9f115887-d874-4499-b20a-05d4f0623866/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 9f115887-d874-4499-b20a-05d4f0623866] Start _get_guest_xml network_info=[{"id": "246d725a-3837-4114-8a55-77503840db0e", "address": "fa:16:3e:1d:ae:19", "network": {"id": "2a85480b-f67d-4ef1-b967-3e93af57d7c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1717495768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9cd441a46aa4a579feff608d6ff9bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap246d725a-38", "ovs_interfaceid": "246d725a-3837-4114-8a55-77503840db0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JEPndhyG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9f115887-d874-4499-b20a-05d4f0623866', 'attached_at': '', 'detached_at': '', 'volume_id': 'a54f8ddb-2769-4cf8-9e3e-e199b57b3005', 'serial': 'a54f8ddb-2769-4cf8-9e3e-e199b57b3005'}, 'mount_device': '/dev/vda', 'attachment_id': '4e760198-43fd-4608-b4cd-45c98cc95276', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 18:02:51 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:02:51 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:02:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T17:40:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 9f115887-d874-4499-b20a-05d4f0623866] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JEPndhyG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:02:51 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:02:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:02:51 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:02:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:02:51 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 18:02:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 -p 172.16.0.220:3260 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde3c245-7ff2-4a3d-9666-ac2f1b4af40e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 18:02:51 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 -p 172.16.0.220:3260 --interface default --op new {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b504eef-c12e-46fa-971f-8ca194680030]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005] added\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005] added
Nov 10 18:02:51 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2bf9962-50b2-4a23-8d77-8ae187d3dad7]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.051s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c845d4bf-1633-494d-afcc-9672e1147890]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JEPndhyG {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JEPndhyG" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ae8615-e1b3-4d77-bd4d-343edbdc51d5]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JEPndhyG'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[61149588-ab5c-46c1-8fb3-cbb91909f017]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2a0b87-47df-4ec2-955d-27668646ab55]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 10 18:02:51 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 10 18:02:51 user nova-compute[75100]:  {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:02:51 user nova-compute[75100]: WARNING os_brick.initiator.connectors.iscsi [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 10 18:02:51 user nova-compute[75100]: 
Nov 10 18:02:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 -p 172.16.0.220:3260 --login {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b64391f-cc69-47f1-9428-690376487dd7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005, portal: 172.16.0.220,3260]
Nov 10 18:02:51 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005, portal: 172.16.0.220,3260] successful.
Nov 10 18:02:51 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[abcbf8fc-8c9d-4d3b-a8e1-0dd4c749ad7d]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf8adbb-3ba8-4e33-ba00-49f5ee17595d]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 (non-flash)
Nov 10 18:02:51 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 (non-flash)
Nov 10 18:02:51 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] HCTL ('33', '-', '-', 0) found on session 24 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6ba8dd-98ef-4354-a041-6d307fa65bbc]: (4, ('- - 0', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:02:51 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: None {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 18:02:52 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 18:02:52 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JEPndhyG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 18:02:52 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:02:52 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '23637303233313361', 'path': '/dev/sdb'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:02:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 9f115887-d874-4499-b20a-05d4f0623866] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637303233313361', 'path': '/dev/sdb'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 18:02:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:02:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-237251791',display_name='tempest-TestVolumeBootPattern-server-237251791',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-237251791',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILrjRswgoJPqA+suzoqc8EEXkFg1B3St2cTU0CL5tiD3TI/qO87+FOfxjV/dwwN6UPPBmEGN67tPxZrctQdNsOvA6IRt0kMT8eF3nDG1qAx3cky0fCNWo1RZsce/R29pA==',key_name='tempest-TestVolumeBootPattern-1607857152',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9cd441a46aa4a579feff608d6ff9bb4',ramdisk_id='',reservation_id='r-8tt0t9mz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-706331648',owner_user_name='tempest-TestVolumeBootPattern-706331648-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T18:02:25Z,user_data=None,user_id='323c5738ca424a379f666b4ca60825ac',uuid=9f115887-d874-4499-b20a-05d4f0623866,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "246d725a-3837-4114-8a55-77503840db0e", "address": "fa:16:3e:1d:ae:19", "network": {"id": "2a85480b-f67d-4ef1-b967-3e93af57d7c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1717495768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9cd441a46aa4a579feff608d6ff9bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap246d725a-38", "ovs_interfaceid": "246d725a-3837-4114-8a55-77503840db0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 18:02:52 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Converting VIF {"id": "246d725a-3837-4114-8a55-77503840db0e", "address": "fa:16:3e:1d:ae:19", "network": {"id": "2a85480b-f67d-4ef1-b967-3e93af57d7c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1717495768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9cd441a46aa4a579feff608d6ff9bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap246d725a-38", "ovs_interfaceid": "246d725a-3837-4114-8a55-77503840db0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:02:52 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:ae:19,bridge_name='br-int',has_traffic_filtering=True,id=246d725a-3837-4114-8a55-77503840db0e,network=Network(2a85480b-f67d-4ef1-b967-3e93af57d7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap246d725a-38') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:02:52 user nova-compute[75100]: DEBUG nova.objects.instance [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lazy-loading 'pci_devices' on Instance uuid 9f115887-d874-4499-b20a-05d4f0623866 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:02:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 9f115887-d874-4499-b20a-05d4f0623866] End _get_guest_xml xml=<domain type="kvm">
Nov 10 18:02:52 user nova-compute[75100]:   <uuid>9f115887-d874-4499-b20a-05d4f0623866</uuid>
Nov 10 18:02:52 user nova-compute[75100]:   <name>instance-00000021</name>
Nov 10 18:02:52 user nova-compute[75100]:   <memory>524288</memory>
Nov 10 18:02:52 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 10 18:02:52 user nova-compute[75100]:   <metadata>
Nov 10 18:02:52 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 18:02:52 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 10 18:02:52 user nova-compute[75100]:       <nova:name>tempest-TestVolumeBootPattern-server-237251791</nova:name>
Nov 10 18:02:52 user nova-compute[75100]:       <nova:creationTime>2023-11-10 18:02:51</nova:creationTime>
Nov 10 18:02:52 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 10 18:02:52 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 10 18:02:52 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 10 18:02:52 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 10 18:02:52 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 18:02:52 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 10 18:02:52 user nova-compute[75100]:       </nova:flavor>
Nov 10 18:02:52 user nova-compute[75100]:       <nova:owner>
Nov 10 18:02:52 user nova-compute[75100]:         <nova:user uuid="323c5738ca424a379f666b4ca60825ac">tempest-TestVolumeBootPattern-706331648-project-member</nova:user>
Nov 10 18:02:52 user nova-compute[75100]:         <nova:project uuid="b9cd441a46aa4a579feff608d6ff9bb4">tempest-TestVolumeBootPattern-706331648</nova:project>
Nov 10 18:02:52 user nova-compute[75100]:       </nova:owner>
Nov 10 18:02:52 user nova-compute[75100]:       <nova:ports>
Nov 10 18:02:52 user nova-compute[75100]:         <nova:port uuid="246d725a-3837-4114-8a55-77503840db0e">
Nov 10 18:02:52 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 10 18:02:52 user nova-compute[75100]:         </nova:port>
Nov 10 18:02:52 user nova-compute[75100]:       </nova:ports>
Nov 10 18:02:52 user nova-compute[75100]:     </nova:instance>
Nov 10 18:02:52 user nova-compute[75100]:   </metadata>
Nov 10 18:02:52 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 10 18:02:52 user nova-compute[75100]:     <system>
Nov 10 18:02:52 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 18:02:52 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 10 18:02:52 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 10 18:02:52 user nova-compute[75100]:       <entry name="serial">9f115887-d874-4499-b20a-05d4f0623866</entry>
Nov 10 18:02:52 user nova-compute[75100]:       <entry name="uuid">9f115887-d874-4499-b20a-05d4f0623866</entry>
Nov 10 18:02:52 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 10 18:02:52 user nova-compute[75100]:     </system>
Nov 10 18:02:52 user nova-compute[75100]:   </sysinfo>
Nov 10 18:02:52 user nova-compute[75100]:   <os>
Nov 10 18:02:52 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 18:02:52 user nova-compute[75100]:     <boot dev="hd"/>
Nov 10 18:02:52 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 10 18:02:52 user nova-compute[75100]:   </os>
Nov 10 18:02:52 user nova-compute[75100]:   <features>
Nov 10 18:02:52 user nova-compute[75100]:     <acpi/>
Nov 10 18:02:52 user nova-compute[75100]:     <apic/>
Nov 10 18:02:52 user nova-compute[75100]:     <vmcoreinfo/>
Nov 10 18:02:52 user nova-compute[75100]:   </features>
Nov 10 18:02:52 user nova-compute[75100]:   <clock offset="utc">
Nov 10 18:02:52 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 18:02:52 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 18:02:52 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 10 18:02:52 user nova-compute[75100]:   </clock>
Nov 10 18:02:52 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 10 18:02:52 user nova-compute[75100]:     <model>Nehalem</model>
Nov 10 18:02:52 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 18:02:52 user nova-compute[75100]:   </cpu>
Nov 10 18:02:52 user nova-compute[75100]:   <devices>
Nov 10 18:02:52 user nova-compute[75100]:     <disk type="block" device="disk">
Nov 10 18:02:52 user nova-compute[75100]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:02:52 user nova-compute[75100]:       <source dev="/dev/sdb"/>
Nov 10 18:02:52 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 10 18:02:52 user nova-compute[75100]:       <serial>a54f8ddb-2769-4cf8-9e3e-e199b57b3005</serial>
Nov 10 18:02:52 user nova-compute[75100]:     </disk>
Nov 10 18:02:52 user nova-compute[75100]:     <interface type="ethernet">
Nov 10 18:02:52 user nova-compute[75100]:       <mac address="fa:16:3e:1d:ae:19"/>
Nov 10 18:02:52 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 18:02:52 user nova-compute[75100]:       <mtu size="1442"/>
Nov 10 18:02:52 user nova-compute[75100]:       <target dev="tap246d725a-38"/>
Nov 10 18:02:52 user nova-compute[75100]:     </interface>
Nov 10 18:02:52 user nova-compute[75100]:     <serial type="pty">
Nov 10 18:02:52 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/9f115887-d874-4499-b20a-05d4f0623866/console.log" append="off"/>
Nov 10 18:02:52 user nova-compute[75100]:     </serial>
Nov 10 18:02:52 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 18:02:52 user nova-compute[75100]:     <video>
Nov 10 18:02:52 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 18:02:52 user nova-compute[75100]:     </video>
Nov 10 18:02:52 user nova-compute[75100]:     <rng model="virtio">
Nov 10 18:02:52 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 10 18:02:52 user nova-compute[75100]:     </rng>
Nov 10 18:02:52 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 10 18:02:52 user nova-compute[75100]:     <memballoon model="virtio">
Nov 10 18:02:52 user nova-compute[75100]:       <stats period="10"/>
Nov 10 18:02:52 user nova-compute[75100]:     </memballoon>
Nov 10 18:02:52 user nova-compute[75100]:   </devices>
Nov 10 18:02:52 user nova-compute[75100]: </domain>
Nov 10 18:02:52 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 18:02:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:02:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-237251791',display_name='tempest-TestVolumeBootPattern-server-237251791',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-237251791',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILrjRswgoJPqA+suzoqc8EEXkFg1B3St2cTU0CL5tiD3TI/qO87+FOfxjV/dwwN6UPPBmEGN67tPxZrctQdNsOvA6IRt0kMT8eF3nDG1qAx3cky0fCNWo1RZsce/R29pA==',key_name='tempest-TestVolumeBootPattern-1607857152',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9cd441a46aa4a579feff608d6ff9bb4',ramdisk_id='',reservation_id='r-8tt0t9mz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-706331648',owner_user_name='tempest-TestVolumeBootPattern-706331648-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T18:02:25Z,user_data=None,user_id='323c5738ca424a379f666b4ca60825ac',uuid=9f115887-d874-4499-b20a-05d4f0623866,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "246d725a-3837-4114-8a55-77503840db0e", "address": "fa:16:3e:1d:ae:19", "network": {"id": "2a85480b-f67d-4ef1-b967-3e93af57d7c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1717495768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9cd441a46aa4a579feff608d6ff9bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap246d725a-38", "ovs_interfaceid": "246d725a-3837-4114-8a55-77503840db0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 18:02:52 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Converting VIF {"id": "246d725a-3837-4114-8a55-77503840db0e", "address": "fa:16:3e:1d:ae:19", "network": {"id": "2a85480b-f67d-4ef1-b967-3e93af57d7c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1717495768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9cd441a46aa4a579feff608d6ff9bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap246d725a-38", "ovs_interfaceid": "246d725a-3837-4114-8a55-77503840db0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:02:52 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:ae:19,bridge_name='br-int',has_traffic_filtering=True,id=246d725a-3837-4114-8a55-77503840db0e,network=Network(2a85480b-f67d-4ef1-b967-3e93af57d7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap246d725a-38') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:02:52 user nova-compute[75100]: DEBUG os_vif [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:ae:19,bridge_name='br-int',has_traffic_filtering=True,id=246d725a-3837-4114-8a55-77503840db0e,network=Network(2a85480b-f67d-4ef1-b967-3e93af57d7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap246d725a-38') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 18:02:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:02:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 18:02:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4b51e947-93fa-548a-8139-82f3c6807830', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:02:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:02:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap246d725a-38, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:02:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap246d725a-38, col_values=(('qos', UUID('6ee73392-3292-4361-bdf1-88abc3fae8e5')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:02:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap246d725a-38, col_values=(('external_ids', {'iface-id': '246d725a-3837-4114-8a55-77503840db0e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:ae:19', 'vm-uuid': '9f115887-d874-4499-b20a-05d4f0623866'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:02:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:02:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:52 user nova-compute[75100]: INFO os_vif [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:ae:19,bridge_name='br-int',has_traffic_filtering=True,id=246d725a-3837-4114-8a55-77503840db0e,network=Network(2a85480b-f67d-4ef1-b967-3e93af57d7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap246d725a-38')
Nov 10 18:02:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 18:02:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] No VIF found with MAC fa:16:3e:1d:ae:19, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 18:02:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:54 user nova-compute[75100]: DEBUG nova.compute.manager [req-6984e67b-b14f-4718-9290-28d694e475b6 req-d8e6edd4-64e7-4846-be64-fd71ac6bd38f service nova] [instance: 9f115887-d874-4499-b20a-05d4f0623866] Received event network-vif-plugged-246d725a-3837-4114-8a55-77503840db0e {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:02:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6984e67b-b14f-4718-9290-28d694e475b6 req-d8e6edd4-64e7-4846-be64-fd71ac6bd38f service nova] Acquiring lock "9f115887-d874-4499-b20a-05d4f0623866-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:02:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6984e67b-b14f-4718-9290-28d694e475b6 req-d8e6edd4-64e7-4846-be64-fd71ac6bd38f service nova] Lock "9f115887-d874-4499-b20a-05d4f0623866-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:02:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6984e67b-b14f-4718-9290-28d694e475b6 req-d8e6edd4-64e7-4846-be64-fd71ac6bd38f service nova] Lock "9f115887-d874-4499-b20a-05d4f0623866-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:02:54 user nova-compute[75100]: DEBUG nova.compute.manager [req-6984e67b-b14f-4718-9290-28d694e475b6 req-d8e6edd4-64e7-4846-be64-fd71ac6bd38f service nova] [instance: 9f115887-d874-4499-b20a-05d4f0623866] No waiting events found dispatching network-vif-plugged-246d725a-3837-4114-8a55-77503840db0e {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:02:54 user nova-compute[75100]: WARNING nova.compute.manager [req-6984e67b-b14f-4718-9290-28d694e475b6 req-d8e6edd4-64e7-4846-be64-fd71ac6bd38f service nova] [instance: 9f115887-d874-4499-b20a-05d4f0623866] Received unexpected event network-vif-plugged-246d725a-3837-4114-8a55-77503840db0e for instance with vm_state building and task_state spawning.
Nov 10 18:02:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Acquiring lock "9dabb40d-299b-4c8a-bc92-63e5c0932047" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:02:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Lock "9dabb40d-299b-4c8a-bc92-63e5c0932047" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:02:54 user nova-compute[75100]: DEBUG nova.compute.manager [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 18:02:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:02:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:02:54 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 18:02:54 user nova-compute[75100]: INFO nova.compute.claims [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] Claim successful on node user
Nov 10 18:02:54 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:54 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:54 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:54 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:02:54 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:02:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.308s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:02:54 user nova-compute[75100]: DEBUG nova.compute.manager [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 18:02:54 user nova-compute[75100]: DEBUG nova.compute.manager [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 18:02:54 user nova-compute[75100]: DEBUG nova.network.neutron [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 18:02:54 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 18:02:54 user nova-compute[75100]: DEBUG nova.compute.manager [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 18:02:54 user nova-compute[75100]: DEBUG nova.policy [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '51318008e5db48f6ad9973d8bc3f3123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b43954bd11143f2a7df5b5a81d47291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 18:02:54 user nova-compute[75100]: DEBUG nova.compute.manager [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 18:02:54 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 18:02:54 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] Creating image(s)
Nov 10 18:02:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Acquiring lock "/opt/stack/data/nova/instances/9dabb40d-299b-4c8a-bc92-63e5c0932047/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:02:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Lock "/opt/stack/data/nova/instances/9dabb40d-299b-4c8a-bc92-63e5c0932047/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:02:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Lock "/opt/stack/data/nova/instances/9dabb40d-299b-4c8a-bc92-63e5c0932047/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:02:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:02:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.187s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:02:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Acquiring lock "818b9e28e061d41a38d903968b229be2ed9ba520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:02:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:02:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:02:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.176s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:02:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/9dabb40d-299b-4c8a-bc92-63e5c0932047/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:02:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/9dabb40d-299b-4c8a-bc92-63e5c0932047/disk 1073741824" returned: 0 in 0.049s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:02:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:02:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:02:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.222s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:02:55 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9dabb40d-299b-4c8a-bc92-63e5c0932047/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 18:02:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dabb40d-299b-4c8a-bc92-63e5c0932047/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:02:55 user nova-compute[75100]: DEBUG nova.network.neutron [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] Successfully created port: 75bd6d86-2609-4694-969e-edd1cc65c12b {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 18:02:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dabb40d-299b-4c8a-bc92-63e5c0932047/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:02:55 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Cannot resize image /opt/stack/data/nova/instances/9dabb40d-299b-4c8a-bc92-63e5c0932047/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 18:02:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 18:02:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] Ensure instance console log exists: /opt/stack/data/nova/instances/9dabb40d-299b-4c8a-bc92-63e5c0932047/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 18:02:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:02:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:02:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:02:56 user nova-compute[75100]: DEBUG nova.compute.manager [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 9f115887-d874-4499-b20a-05d4f0623866] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 18:02:56 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 9f115887-d874-4499-b20a-05d4f0623866] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 18:02:56 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 9f115887-d874-4499-b20a-05d4f0623866] Instance spawned successfully.
Nov 10 18:02:56 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 9f115887-d874-4499-b20a-05d4f0623866] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 18:02:56 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 9f115887-d874-4499-b20a-05d4f0623866] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:02:56 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 9f115887-d874-4499-b20a-05d4f0623866] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:02:56 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 9f115887-d874-4499-b20a-05d4f0623866] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:02:56 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 9f115887-d874-4499-b20a-05d4f0623866] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:02:56 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 9f115887-d874-4499-b20a-05d4f0623866] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:02:56 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 9f115887-d874-4499-b20a-05d4f0623866] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:02:56 user nova-compute[75100]: DEBUG nova.compute.manager [req-8ce8b789-70a0-4c82-afb2-56e7a029875c req-df460804-f636-4105-80d9-36a94af29914 service nova] [instance: 9f115887-d874-4499-b20a-05d4f0623866] Received event network-vif-plugged-246d725a-3837-4114-8a55-77503840db0e {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:02:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8ce8b789-70a0-4c82-afb2-56e7a029875c req-df460804-f636-4105-80d9-36a94af29914 service nova] Acquiring lock "9f115887-d874-4499-b20a-05d4f0623866-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:02:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8ce8b789-70a0-4c82-afb2-56e7a029875c req-df460804-f636-4105-80d9-36a94af29914 service nova] Lock "9f115887-d874-4499-b20a-05d4f0623866-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:02:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8ce8b789-70a0-4c82-afb2-56e7a029875c req-df460804-f636-4105-80d9-36a94af29914 service nova] Lock "9f115887-d874-4499-b20a-05d4f0623866-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:02:56 user nova-compute[75100]: DEBUG nova.compute.manager [req-8ce8b789-70a0-4c82-afb2-56e7a029875c req-df460804-f636-4105-80d9-36a94af29914 service nova] [instance: 9f115887-d874-4499-b20a-05d4f0623866] No waiting events found dispatching network-vif-plugged-246d725a-3837-4114-8a55-77503840db0e {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:02:56 user nova-compute[75100]: WARNING nova.compute.manager [req-8ce8b789-70a0-4c82-afb2-56e7a029875c req-df460804-f636-4105-80d9-36a94af29914 service nova] [instance: 9f115887-d874-4499-b20a-05d4f0623866] Received unexpected event network-vif-plugged-246d725a-3837-4114-8a55-77503840db0e for instance with vm_state building and task_state spawning.
Nov 10 18:02:56 user nova-compute[75100]: INFO nova.compute.manager [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 9f115887-d874-4499-b20a-05d4f0623866] Took 5.16 seconds to spawn the instance on the hypervisor.
Nov 10 18:02:56 user nova-compute[75100]: DEBUG nova.compute.manager [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 9f115887-d874-4499-b20a-05d4f0623866] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 18:02:56 user nova-compute[75100]: DEBUG nova.network.neutron [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] Successfully updated port: 75bd6d86-2609-4694-969e-edd1cc65c12b {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 18:02:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Acquiring lock "refresh_cache-9dabb40d-299b-4c8a-bc92-63e5c0932047" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:02:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Acquired lock "refresh_cache-9dabb40d-299b-4c8a-bc92-63e5c0932047" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:02:56 user nova-compute[75100]: DEBUG nova.network.neutron [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 18:02:56 user nova-compute[75100]: INFO nova.compute.manager [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 9f115887-d874-4499-b20a-05d4f0623866] Took 31.68 seconds to build instance.
Nov 10 18:02:56 user nova-compute[75100]: DEBUG nova.compute.manager [req-d1fb4647-0d1c-41be-a154-13cdb9acf7c4 req-8d30cb05-5074-43c4-a1fd-d2a40c4de9ca service nova] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] Received event network-changed-75bd6d86-2609-4694-969e-edd1cc65c12b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:02:56 user nova-compute[75100]: DEBUG nova.compute.manager [req-d1fb4647-0d1c-41be-a154-13cdb9acf7c4 req-8d30cb05-5074-43c4-a1fd-d2a40c4de9ca service nova] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] Refreshing instance network info cache due to event network-changed-75bd6d86-2609-4694-969e-edd1cc65c12b. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 18:02:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d1fb4647-0d1c-41be-a154-13cdb9acf7c4 req-8d30cb05-5074-43c4-a1fd-d2a40c4de9ca service nova] Acquiring lock "refresh_cache-9dabb40d-299b-4c8a-bc92-63e5c0932047" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:02:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d807153f-433c-44f0-bf85-6e169ed0566d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "9f115887-d874-4499-b20a-05d4f0623866" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 31.792s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:02:56 user nova-compute[75100]: DEBUG nova.network.neutron [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 18:02:56 user nova-compute[75100]: DEBUG nova.network.neutron [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] Updating instance_info_cache with network_info: [{"id": "75bd6d86-2609-4694-969e-edd1cc65c12b", "address": "fa:16:3e:64:1d:f2", "network": {"id": "4dda5b3e-106d-4eb9-b939-ac553b155aad", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1558952398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b43954bd11143f2a7df5b5a81d47291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75bd6d86-26", "ovs_interfaceid": "75bd6d86-2609-4694-969e-edd1cc65c12b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:02:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Releasing lock "refresh_cache-9dabb40d-299b-4c8a-bc92-63e5c0932047" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:02:56 user nova-compute[75100]: DEBUG nova.compute.manager [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] Instance network_info: |[{"id": "75bd6d86-2609-4694-969e-edd1cc65c12b", "address": "fa:16:3e:64:1d:f2", "network": {"id": "4dda5b3e-106d-4eb9-b939-ac553b155aad", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1558952398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b43954bd11143f2a7df5b5a81d47291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75bd6d86-26", "ovs_interfaceid": "75bd6d86-2609-4694-969e-edd1cc65c12b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 18:02:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d1fb4647-0d1c-41be-a154-13cdb9acf7c4 req-8d30cb05-5074-43c4-a1fd-d2a40c4de9ca service nova] Acquired lock "refresh_cache-9dabb40d-299b-4c8a-bc92-63e5c0932047" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:02:56 user nova-compute[75100]: DEBUG nova.network.neutron [req-d1fb4647-0d1c-41be-a154-13cdb9acf7c4 req-8d30cb05-5074-43c4-a1fd-d2a40c4de9ca service nova] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] Refreshing network info cache for port 75bd6d86-2609-4694-969e-edd1cc65c12b {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 18:02:56 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] Start _get_guest_xml network_info=[{"id": "75bd6d86-2609-4694-969e-edd1cc65c12b", "address": "fa:16:3e:64:1d:f2", "network": {"id": "4dda5b3e-106d-4eb9-b939-ac553b155aad", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1558952398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b43954bd11143f2a7df5b5a81d47291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75bd6d86-26", "ovs_interfaceid": "75bd6d86-2609-4694-969e-edd1cc65c12b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'e3cc5321-4d40-49ee-885c-700e14741732'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 18:02:56 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:02:56 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:02:56 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 18:02:56 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 18:02:56 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 18:02:56 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 18:02:56 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 18:02:56 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T17:40:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 18:02:56 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 18:02:56 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 18:02:56 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 18:02:56 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 18:02:56 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 18:02:56 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 18:02:56 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 18:02:56 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 18:02:56 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 18:02:56 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 18:02:56 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:02:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-326371896',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-326371896',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-3263718',id=34,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0ob87C9vzLmMTEmRODF1om+p59G6Xa01yLKDlAKbRJ90oEkO+WUw7uc0wiIsmxnhd81lJ9UziVzXOCO/FWXxGrpTxOVvlgA9RP7cRHhX9s6TNwws/HHIFmRAbmoPo6cw==',key_name='tempest-keypair-1088211268',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b43954bd11143f2a7df5b5a81d47291',ramdisk_id='',reservation_id='r-rqq09rcs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-151723916',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T18:02:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51318008e5db48f6ad9973d8bc3f3123',uuid=9dabb40d-299b-4c8a-bc92-63e5c0932047,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75bd6d86-2609-4694-969e-edd1cc65c12b", "address": "fa:16:3e:64:1d:f2", "network": {"id": "4dda5b3e-106d-4eb9-b939-ac553b155aad", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1558952398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b43954bd11143f2a7df5b5a81d47291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75bd6d86-26", "ovs_interfaceid": "75bd6d86-2609-4694-969e-edd1cc65c12b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 18:02:56 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Converting VIF {"id": "75bd6d86-2609-4694-969e-edd1cc65c12b", "address": "fa:16:3e:64:1d:f2", "network": {"id": "4dda5b3e-106d-4eb9-b939-ac553b155aad", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1558952398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b43954bd11143f2a7df5b5a81d47291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75bd6d86-26", "ovs_interfaceid": "75bd6d86-2609-4694-969e-edd1cc65c12b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:02:56 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:1d:f2,bridge_name='br-int',has_traffic_filtering=True,id=75bd6d86-2609-4694-969e-edd1cc65c12b,network=Network(4dda5b3e-106d-4eb9-b939-ac553b155aad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75bd6d86-26') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:02:56 user nova-compute[75100]: DEBUG nova.objects.instance [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Lazy-loading 'pci_devices' on Instance uuid 9dabb40d-299b-4c8a-bc92-63e5c0932047 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:02:56 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] End _get_guest_xml xml=<domain type="kvm">
Nov 10 18:02:56 user nova-compute[75100]:   <uuid>9dabb40d-299b-4c8a-bc92-63e5c0932047</uuid>
Nov 10 18:02:56 user nova-compute[75100]:   <name>instance-00000022</name>
Nov 10 18:02:56 user nova-compute[75100]:   <memory>524288</memory>
Nov 10 18:02:56 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 10 18:02:56 user nova-compute[75100]:   <metadata>
Nov 10 18:02:56 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 18:02:56 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 10 18:02:56 user nova-compute[75100]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-326371896</nova:name>
Nov 10 18:02:56 user nova-compute[75100]:       <nova:creationTime>2023-11-10 18:02:56</nova:creationTime>
Nov 10 18:02:56 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 10 18:02:56 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 10 18:02:56 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 10 18:02:56 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 10 18:02:56 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 18:02:56 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 10 18:02:56 user nova-compute[75100]:       </nova:flavor>
Nov 10 18:02:56 user nova-compute[75100]:       <nova:owner>
Nov 10 18:02:56 user nova-compute[75100]:         <nova:user uuid="51318008e5db48f6ad9973d8bc3f3123">tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member</nova:user>
Nov 10 18:02:56 user nova-compute[75100]:         <nova:project uuid="0b43954bd11143f2a7df5b5a81d47291">tempest-TestServerVolumeAttachScenarioOldVersion-151723916</nova:project>
Nov 10 18:02:56 user nova-compute[75100]:       </nova:owner>
Nov 10 18:02:56 user nova-compute[75100]:       <nova:root type="image" uuid="e3cc5321-4d40-49ee-885c-700e14741732"/>
Nov 10 18:02:56 user nova-compute[75100]:       <nova:ports>
Nov 10 18:02:56 user nova-compute[75100]:         <nova:port uuid="75bd6d86-2609-4694-969e-edd1cc65c12b">
Nov 10 18:02:56 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 10 18:02:56 user nova-compute[75100]:         </nova:port>
Nov 10 18:02:56 user nova-compute[75100]:       </nova:ports>
Nov 10 18:02:56 user nova-compute[75100]:     </nova:instance>
Nov 10 18:02:56 user nova-compute[75100]:   </metadata>
Nov 10 18:02:56 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 10 18:02:56 user nova-compute[75100]:     <system>
Nov 10 18:02:56 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 18:02:56 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 10 18:02:56 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 10 18:02:56 user nova-compute[75100]:       <entry name="serial">9dabb40d-299b-4c8a-bc92-63e5c0932047</entry>
Nov 10 18:02:56 user nova-compute[75100]:       <entry name="uuid">9dabb40d-299b-4c8a-bc92-63e5c0932047</entry>
Nov 10 18:02:56 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 10 18:02:56 user nova-compute[75100]:     </system>
Nov 10 18:02:56 user nova-compute[75100]:   </sysinfo>
Nov 10 18:02:56 user nova-compute[75100]:   <os>
Nov 10 18:02:56 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 18:02:56 user nova-compute[75100]:     <boot dev="hd"/>
Nov 10 18:02:56 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 10 18:02:56 user nova-compute[75100]:   </os>
Nov 10 18:02:56 user nova-compute[75100]:   <features>
Nov 10 18:02:56 user nova-compute[75100]:     <acpi/>
Nov 10 18:02:56 user nova-compute[75100]:     <apic/>
Nov 10 18:02:56 user nova-compute[75100]:     <vmcoreinfo/>
Nov 10 18:02:56 user nova-compute[75100]:   </features>
Nov 10 18:02:56 user nova-compute[75100]:   <clock offset="utc">
Nov 10 18:02:56 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 18:02:56 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 18:02:56 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 10 18:02:56 user nova-compute[75100]:   </clock>
Nov 10 18:02:56 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 10 18:02:56 user nova-compute[75100]:     <model>Nehalem</model>
Nov 10 18:02:56 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 18:02:56 user nova-compute[75100]:   </cpu>
Nov 10 18:02:56 user nova-compute[75100]:   <devices>
Nov 10 18:02:56 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 10 18:02:56 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 18:02:56 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/9dabb40d-299b-4c8a-bc92-63e5c0932047/disk"/>
Nov 10 18:02:56 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 10 18:02:56 user nova-compute[75100]:     </disk>
Nov 10 18:02:56 user nova-compute[75100]:     <interface type="ethernet">
Nov 10 18:02:56 user nova-compute[75100]:       <mac address="fa:16:3e:64:1d:f2"/>
Nov 10 18:02:56 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 18:02:56 user nova-compute[75100]:       <mtu size="1442"/>
Nov 10 18:02:56 user nova-compute[75100]:       <target dev="tap75bd6d86-26"/>
Nov 10 18:02:56 user nova-compute[75100]:     </interface>
Nov 10 18:02:56 user nova-compute[75100]:     <serial type="pty">
Nov 10 18:02:56 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/9dabb40d-299b-4c8a-bc92-63e5c0932047/console.log" append="off"/>
Nov 10 18:02:56 user nova-compute[75100]:     </serial>
Nov 10 18:02:56 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 18:02:56 user nova-compute[75100]:     <video>
Nov 10 18:02:56 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 18:02:56 user nova-compute[75100]:     </video>
Nov 10 18:02:56 user nova-compute[75100]:     <rng model="virtio">
Nov 10 18:02:56 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 10 18:02:56 user nova-compute[75100]:     </rng>
Nov 10 18:02:56 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 10 18:02:56 user nova-compute[75100]:     <memballoon model="virtio">
Nov 10 18:02:56 user nova-compute[75100]:       <stats period="10"/>
Nov 10 18:02:56 user nova-compute[75100]:     </memballoon>
Nov 10 18:02:56 user nova-compute[75100]:   </devices>
Nov 10 18:02:56 user nova-compute[75100]: </domain>
Nov 10 18:02:56 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 18:02:56 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:02:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-326371896',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-326371896',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-3263718',id=34,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0ob87C9vzLmMTEmRODF1om+p59G6Xa01yLKDlAKbRJ90oEkO+WUw7uc0wiIsmxnhd81lJ9UziVzXOCO/FWXxGrpTxOVvlgA9RP7cRHhX9s6TNwws/HHIFmRAbmoPo6cw==',key_name='tempest-keypair-1088211268',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b43954bd11143f2a7df5b5a81d47291',ramdisk_id='',reservation_id='r-rqq09rcs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-151723916',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T18:02:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51318008e5db48f6ad9973d8bc3f3123',uuid=9dabb40d-299b-4c8a-bc92-63e5c0932047,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75bd6d86-2609-4694-969e-edd1cc65c12b", "address": "fa:16:3e:64:1d:f2", "network": {"id": "4dda5b3e-106d-4eb9-b939-ac553b155aad", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1558952398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b43954bd11143f2a7df5b5a81d47291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75bd6d86-26", "ovs_interfaceid": "75bd6d86-2609-4694-969e-edd1cc65c12b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 18:02:56 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Converting VIF {"id": "75bd6d86-2609-4694-969e-edd1cc65c12b", "address": "fa:16:3e:64:1d:f2", "network": {"id": "4dda5b3e-106d-4eb9-b939-ac553b155aad", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1558952398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b43954bd11143f2a7df5b5a81d47291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75bd6d86-26", "ovs_interfaceid": "75bd6d86-2609-4694-969e-edd1cc65c12b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:02:56 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:1d:f2,bridge_name='br-int',has_traffic_filtering=True,id=75bd6d86-2609-4694-969e-edd1cc65c12b,network=Network(4dda5b3e-106d-4eb9-b939-ac553b155aad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75bd6d86-26') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:02:56 user nova-compute[75100]: DEBUG os_vif [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:1d:f2,bridge_name='br-int',has_traffic_filtering=True,id=75bd6d86-2609-4694-969e-edd1cc65c12b,network=Network(4dda5b3e-106d-4eb9-b939-ac553b155aad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75bd6d86-26') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 18:02:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:02:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 18:02:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd0324fc2-c5ec-5cee-a25a-d1036b4c696f', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:02:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap75bd6d86-26, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:02:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap75bd6d86-26, col_values=(('qos', UUID('cac2302c-8779-4566-977d-ca5f605b3232')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:02:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap75bd6d86-26, col_values=(('external_ids', {'iface-id': '75bd6d86-2609-4694-969e-edd1cc65c12b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:1d:f2', 'vm-uuid': '9dabb40d-299b-4c8a-bc92-63e5c0932047'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:02:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:02:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:56 user nova-compute[75100]: INFO os_vif [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:1d:f2,bridge_name='br-int',has_traffic_filtering=True,id=75bd6d86-2609-4694-969e-edd1cc65c12b,network=Network(4dda5b3e-106d-4eb9-b939-ac553b155aad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75bd6d86-26')
Nov 10 18:02:56 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 18:02:56 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] No VIF found with MAC fa:16:3e:64:1d:f2, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 18:02:57 user nova-compute[75100]: DEBUG nova.network.neutron [req-d1fb4647-0d1c-41be-a154-13cdb9acf7c4 req-8d30cb05-5074-43c4-a1fd-d2a40c4de9ca service nova] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] Updated VIF entry in instance network info cache for port 75bd6d86-2609-4694-969e-edd1cc65c12b. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 18:02:57 user nova-compute[75100]: DEBUG nova.network.neutron [req-d1fb4647-0d1c-41be-a154-13cdb9acf7c4 req-8d30cb05-5074-43c4-a1fd-d2a40c4de9ca service nova] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] Updating instance_info_cache with network_info: [{"id": "75bd6d86-2609-4694-969e-edd1cc65c12b", "address": "fa:16:3e:64:1d:f2", "network": {"id": "4dda5b3e-106d-4eb9-b939-ac553b155aad", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1558952398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b43954bd11143f2a7df5b5a81d47291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75bd6d86-26", "ovs_interfaceid": "75bd6d86-2609-4694-969e-edd1cc65c12b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:02:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d1fb4647-0d1c-41be-a154-13cdb9acf7c4 req-8d30cb05-5074-43c4-a1fd-d2a40c4de9ca service nova] Releasing lock "refresh_cache-9dabb40d-299b-4c8a-bc92-63e5c0932047" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:02:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Acquiring lock "5194f111-ba1a-43bc-9564-b744d1960307" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:02:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lock "5194f111-ba1a-43bc-9564-b744d1960307" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:02:58 user nova-compute[75100]: DEBUG nova.compute.manager [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 18:02:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:02:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:02:58 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 18:02:58 user nova-compute[75100]: INFO nova.compute.claims [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Claim successful on node user
Nov 10 18:02:58 user nova-compute[75100]: DEBUG nova.compute.manager [req-c6fa74d4-3c8f-4697-a646-9caa9e128ae9 req-c697560d-37f8-4e6e-a43c-662c6d126dad service nova] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] Received event network-vif-plugged-75bd6d86-2609-4694-969e-edd1cc65c12b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:02:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c6fa74d4-3c8f-4697-a646-9caa9e128ae9 req-c697560d-37f8-4e6e-a43c-662c6d126dad service nova] Acquiring lock "9dabb40d-299b-4c8a-bc92-63e5c0932047-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:02:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c6fa74d4-3c8f-4697-a646-9caa9e128ae9 req-c697560d-37f8-4e6e-a43c-662c6d126dad service nova] Lock "9dabb40d-299b-4c8a-bc92-63e5c0932047-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:02:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c6fa74d4-3c8f-4697-a646-9caa9e128ae9 req-c697560d-37f8-4e6e-a43c-662c6d126dad service nova] Lock "9dabb40d-299b-4c8a-bc92-63e5c0932047-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:02:58 user nova-compute[75100]: DEBUG nova.compute.manager [req-c6fa74d4-3c8f-4697-a646-9caa9e128ae9 req-c697560d-37f8-4e6e-a43c-662c6d126dad service nova] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] No waiting events found dispatching network-vif-plugged-75bd6d86-2609-4694-969e-edd1cc65c12b {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:02:58 user nova-compute[75100]: WARNING nova.compute.manager [req-c6fa74d4-3c8f-4697-a646-9caa9e128ae9 req-c697560d-37f8-4e6e-a43c-662c6d126dad service nova] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] Received unexpected event network-vif-plugged-75bd6d86-2609-4694-969e-edd1cc65c12b for instance with vm_state building and task_state spawning.
Nov 10 18:02:58 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:02:58 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:02:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.443s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:02:58 user nova-compute[75100]: DEBUG nova.compute.manager [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 18:02:58 user nova-compute[75100]: DEBUG nova.compute.manager [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 18:02:58 user nova-compute[75100]: DEBUG nova.network.neutron [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 18:02:58 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 18:02:58 user nova-compute[75100]: DEBUG nova.compute.manager [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 18:02:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:59 user nova-compute[75100]: DEBUG nova.policy [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '695874f914a149a6a432598bee57a80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27994d50bda0480f8964e687ed76805c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 18:02:59 user nova-compute[75100]: DEBUG nova.compute.manager [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 18:02:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 18:02:59 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Creating image(s)
Nov 10 18:02:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Acquiring lock "/opt/stack/data/nova/instances/5194f111-ba1a-43bc-9564-b744d1960307/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:02:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lock "/opt/stack/data/nova/instances/5194f111-ba1a-43bc-9564-b744d1960307/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:02:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lock "/opt/stack/data/nova/instances/5194f111-ba1a-43bc-9564-b744d1960307/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:02:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:02:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.194s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:02:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Acquiring lock "818b9e28e061d41a38d903968b229be2ed9ba520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:02:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:02:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:02:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.196s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:02:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/5194f111-ba1a-43bc-9564-b744d1960307/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:02:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:02:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/5194f111-ba1a-43bc-9564-b744d1960307/disk 1073741824" returned: 0 in 0.198s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:02:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.403s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:02:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:02:59 user nova-compute[75100]: DEBUG nova.network.neutron [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Successfully created port: 9829f1f6-ef24-440f-964b-1ae5326963dd {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 18:02:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.208s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:02:59 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5194f111-ba1a-43bc-9564-b744d1960307/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 18:02:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5194f111-ba1a-43bc-9564-b744d1960307/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:03:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5194f111-ba1a-43bc-9564-b744d1960307/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:03:00 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Cannot resize image /opt/stack/data/nova/instances/5194f111-ba1a-43bc-9564-b744d1960307/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 18:03:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 18:03:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Ensure instance console log exists: /opt/stack/data/nova/instances/5194f111-ba1a-43bc-9564-b744d1960307/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 18:03:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:03:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:03:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:03:00 user nova-compute[75100]: DEBUG nova.network.neutron [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Successfully updated port: 9829f1f6-ef24-440f-964b-1ae5326963dd {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 18:03:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Acquiring lock "refresh_cache-5194f111-ba1a-43bc-9564-b744d1960307" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:03:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Acquired lock "refresh_cache-5194f111-ba1a-43bc-9564-b744d1960307" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:03:00 user nova-compute[75100]: DEBUG nova.network.neutron [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 18:03:00 user nova-compute[75100]: DEBUG nova.network.neutron [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 18:03:00 user nova-compute[75100]: DEBUG nova.compute.manager [req-6dc8f263-1338-4558-9a37-6e138a2d9d2c req-3426225c-8ef1-4feb-917c-e5c7393abf1d service nova] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] Received event network-vif-plugged-75bd6d86-2609-4694-969e-edd1cc65c12b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:03:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6dc8f263-1338-4558-9a37-6e138a2d9d2c req-3426225c-8ef1-4feb-917c-e5c7393abf1d service nova] Acquiring lock "9dabb40d-299b-4c8a-bc92-63e5c0932047-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:03:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6dc8f263-1338-4558-9a37-6e138a2d9d2c req-3426225c-8ef1-4feb-917c-e5c7393abf1d service nova] Lock "9dabb40d-299b-4c8a-bc92-63e5c0932047-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:03:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6dc8f263-1338-4558-9a37-6e138a2d9d2c req-3426225c-8ef1-4feb-917c-e5c7393abf1d service nova] Lock "9dabb40d-299b-4c8a-bc92-63e5c0932047-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:03:00 user nova-compute[75100]: DEBUG nova.compute.manager [req-6dc8f263-1338-4558-9a37-6e138a2d9d2c req-3426225c-8ef1-4feb-917c-e5c7393abf1d service nova] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] No waiting events found dispatching network-vif-plugged-75bd6d86-2609-4694-969e-edd1cc65c12b {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:03:00 user nova-compute[75100]: WARNING nova.compute.manager [req-6dc8f263-1338-4558-9a37-6e138a2d9d2c req-3426225c-8ef1-4feb-917c-e5c7393abf1d service nova] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] Received unexpected event network-vif-plugged-75bd6d86-2609-4694-969e-edd1cc65c12b for instance with vm_state building and task_state spawning.
Nov 10 18:03:00 user nova-compute[75100]: DEBUG nova.compute.manager [req-6dc8f263-1338-4558-9a37-6e138a2d9d2c req-3426225c-8ef1-4feb-917c-e5c7393abf1d service nova] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Received event network-changed-9829f1f6-ef24-440f-964b-1ae5326963dd {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:03:00 user nova-compute[75100]: DEBUG nova.compute.manager [req-6dc8f263-1338-4558-9a37-6e138a2d9d2c req-3426225c-8ef1-4feb-917c-e5c7393abf1d service nova] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Refreshing instance network info cache due to event network-changed-9829f1f6-ef24-440f-964b-1ae5326963dd. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 18:03:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6dc8f263-1338-4558-9a37-6e138a2d9d2c req-3426225c-8ef1-4feb-917c-e5c7393abf1d service nova] Acquiring lock "refresh_cache-5194f111-ba1a-43bc-9564-b744d1960307" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:03:00 user nova-compute[75100]: DEBUG nova.compute.manager [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 18:03:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 18:03:00 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] Instance spawned successfully.
Nov 10 18:03:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 18:03:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:03:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:03:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:03:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:03:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:03:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:03:00 user nova-compute[75100]: DEBUG nova.network.neutron [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Updating instance_info_cache with network_info: [{"id": "9829f1f6-ef24-440f-964b-1ae5326963dd", "address": "fa:16:3e:49:3b:cc", "network": {"id": "fa38ae2b-75a1-4312-9b92-462a4240d792", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-822691382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27994d50bda0480f8964e687ed76805c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9829f1f6-ef", "ovs_interfaceid": "9829f1f6-ef24-440f-964b-1ae5326963dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:03:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Releasing lock "refresh_cache-5194f111-ba1a-43bc-9564-b744d1960307" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:03:00 user nova-compute[75100]: DEBUG nova.compute.manager [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Instance network_info: |[{"id": "9829f1f6-ef24-440f-964b-1ae5326963dd", "address": "fa:16:3e:49:3b:cc", "network": {"id": "fa38ae2b-75a1-4312-9b92-462a4240d792", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-822691382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27994d50bda0480f8964e687ed76805c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9829f1f6-ef", "ovs_interfaceid": "9829f1f6-ef24-440f-964b-1ae5326963dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 18:03:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6dc8f263-1338-4558-9a37-6e138a2d9d2c req-3426225c-8ef1-4feb-917c-e5c7393abf1d service nova] Acquired lock "refresh_cache-5194f111-ba1a-43bc-9564-b744d1960307" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:03:00 user nova-compute[75100]: DEBUG nova.network.neutron [req-6dc8f263-1338-4558-9a37-6e138a2d9d2c req-3426225c-8ef1-4feb-917c-e5c7393abf1d service nova] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Refreshing network info cache for port 9829f1f6-ef24-440f-964b-1ae5326963dd {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 18:03:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Start _get_guest_xml network_info=[{"id": "9829f1f6-ef24-440f-964b-1ae5326963dd", "address": "fa:16:3e:49:3b:cc", "network": {"id": "fa38ae2b-75a1-4312-9b92-462a4240d792", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-822691382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27994d50bda0480f8964e687ed76805c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9829f1f6-ef", "ovs_interfaceid": "9829f1f6-ef24-440f-964b-1ae5326963dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'e3cc5321-4d40-49ee-885c-700e14741732'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 18:03:00 user nova-compute[75100]: INFO nova.compute.manager [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] Took 5.92 seconds to spawn the instance on the hypervisor.
Nov 10 18:03:00 user nova-compute[75100]: DEBUG nova.compute.manager [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 18:03:00 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:03:00 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:03:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 18:03:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 18:03:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 18:03:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 18:03:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 18:03:00 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T17:40:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 18:03:00 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 18:03:00 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 18:03:00 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 18:03:00 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 18:03:00 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 18:03:00 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 18:03:00 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 18:03:00 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 18:03:00 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 18:03:00 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 18:03:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:02:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1780838620',display_name='tempest-VolumesSnapshotTestJSON-instance-1780838620',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1780838620',id=35,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWXxJUqFl/Mx/bXB9u1e6+JWdt7NoHJnU736ah9MdZCpHCcsT75QVAvwHNJhx4DTay9iFVzuWJu1rTlzXdX4J4xdmyCleO56jJkXd79j2xM6USvsKJMZlS2wP7+mUv2dQ==',key_name='tempest-keypair-684408520',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27994d50bda0480f8964e687ed76805c',ramdisk_id='',reservation_id='r-29m7w8lo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1608810188',owner_user_name='tempest-VolumesSnapshotTestJSON-1608810188-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T18:02:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='695874f914a149a6a432598bee57a80e',uuid=5194f111-ba1a-43bc-9564-b744d1960307,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9829f1f6-ef24-440f-964b-1ae5326963dd", "address": "fa:16:3e:49:3b:cc", "network": {"id": "fa38ae2b-75a1-4312-9b92-462a4240d792", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-822691382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27994d50bda0480f8964e687ed76805c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9829f1f6-ef", "ovs_interfaceid": "9829f1f6-ef24-440f-964b-1ae5326963dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 18:03:00 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Converting VIF {"id": "9829f1f6-ef24-440f-964b-1ae5326963dd", "address": "fa:16:3e:49:3b:cc", "network": {"id": "fa38ae2b-75a1-4312-9b92-462a4240d792", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-822691382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27994d50bda0480f8964e687ed76805c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9829f1f6-ef", "ovs_interfaceid": "9829f1f6-ef24-440f-964b-1ae5326963dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:03:00 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:3b:cc,bridge_name='br-int',has_traffic_filtering=True,id=9829f1f6-ef24-440f-964b-1ae5326963dd,network=Network(fa38ae2b-75a1-4312-9b92-462a4240d792),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9829f1f6-ef') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:03:00 user nova-compute[75100]: DEBUG nova.objects.instance [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lazy-loading 'pci_devices' on Instance uuid 5194f111-ba1a-43bc-9564-b744d1960307 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:03:00 user nova-compute[75100]: INFO nova.compute.manager [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] Took 6.62 seconds to build instance.
Nov 10 18:03:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] End _get_guest_xml xml=<domain type="kvm">
Nov 10 18:03:00 user nova-compute[75100]:   <uuid>5194f111-ba1a-43bc-9564-b744d1960307</uuid>
Nov 10 18:03:00 user nova-compute[75100]:   <name>instance-00000023</name>
Nov 10 18:03:00 user nova-compute[75100]:   <memory>524288</memory>
Nov 10 18:03:00 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 10 18:03:00 user nova-compute[75100]:   <metadata>
Nov 10 18:03:00 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 18:03:00 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 10 18:03:00 user nova-compute[75100]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1780838620</nova:name>
Nov 10 18:03:00 user nova-compute[75100]:       <nova:creationTime>2023-11-10 18:03:00</nova:creationTime>
Nov 10 18:03:00 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 10 18:03:00 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 10 18:03:00 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 10 18:03:00 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 10 18:03:00 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 18:03:00 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 10 18:03:00 user nova-compute[75100]:       </nova:flavor>
Nov 10 18:03:00 user nova-compute[75100]:       <nova:owner>
Nov 10 18:03:00 user nova-compute[75100]:         <nova:user uuid="695874f914a149a6a432598bee57a80e">tempest-VolumesSnapshotTestJSON-1608810188-project-member</nova:user>
Nov 10 18:03:00 user nova-compute[75100]:         <nova:project uuid="27994d50bda0480f8964e687ed76805c">tempest-VolumesSnapshotTestJSON-1608810188</nova:project>
Nov 10 18:03:00 user nova-compute[75100]:       </nova:owner>
Nov 10 18:03:00 user nova-compute[75100]:       <nova:root type="image" uuid="e3cc5321-4d40-49ee-885c-700e14741732"/>
Nov 10 18:03:00 user nova-compute[75100]:       <nova:ports>
Nov 10 18:03:00 user nova-compute[75100]:         <nova:port uuid="9829f1f6-ef24-440f-964b-1ae5326963dd">
Nov 10 18:03:00 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 10 18:03:00 user nova-compute[75100]:         </nova:port>
Nov 10 18:03:00 user nova-compute[75100]:       </nova:ports>
Nov 10 18:03:00 user nova-compute[75100]:     </nova:instance>
Nov 10 18:03:00 user nova-compute[75100]:   </metadata>
Nov 10 18:03:00 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 10 18:03:00 user nova-compute[75100]:     <system>
Nov 10 18:03:00 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 18:03:00 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 10 18:03:00 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 10 18:03:00 user nova-compute[75100]:       <entry name="serial">5194f111-ba1a-43bc-9564-b744d1960307</entry>
Nov 10 18:03:00 user nova-compute[75100]:       <entry name="uuid">5194f111-ba1a-43bc-9564-b744d1960307</entry>
Nov 10 18:03:00 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 10 18:03:00 user nova-compute[75100]:     </system>
Nov 10 18:03:00 user nova-compute[75100]:   </sysinfo>
Nov 10 18:03:00 user nova-compute[75100]:   <os>
Nov 10 18:03:00 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 18:03:00 user nova-compute[75100]:     <boot dev="hd"/>
Nov 10 18:03:00 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 10 18:03:00 user nova-compute[75100]:   </os>
Nov 10 18:03:00 user nova-compute[75100]:   <features>
Nov 10 18:03:00 user nova-compute[75100]:     <acpi/>
Nov 10 18:03:00 user nova-compute[75100]:     <apic/>
Nov 10 18:03:00 user nova-compute[75100]:     <vmcoreinfo/>
Nov 10 18:03:00 user nova-compute[75100]:   </features>
Nov 10 18:03:00 user nova-compute[75100]:   <clock offset="utc">
Nov 10 18:03:00 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 18:03:00 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 18:03:00 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 10 18:03:00 user nova-compute[75100]:   </clock>
Nov 10 18:03:00 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 10 18:03:00 user nova-compute[75100]:     <model>Nehalem</model>
Nov 10 18:03:00 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 18:03:00 user nova-compute[75100]:   </cpu>
Nov 10 18:03:00 user nova-compute[75100]:   <devices>
Nov 10 18:03:00 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 10 18:03:00 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 18:03:00 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/5194f111-ba1a-43bc-9564-b744d1960307/disk"/>
Nov 10 18:03:00 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 10 18:03:00 user nova-compute[75100]:     </disk>
Nov 10 18:03:00 user nova-compute[75100]:     <interface type="ethernet">
Nov 10 18:03:00 user nova-compute[75100]:       <mac address="fa:16:3e:49:3b:cc"/>
Nov 10 18:03:00 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 18:03:00 user nova-compute[75100]:       <mtu size="1442"/>
Nov 10 18:03:00 user nova-compute[75100]:       <target dev="tap9829f1f6-ef"/>
Nov 10 18:03:00 user nova-compute[75100]:     </interface>
Nov 10 18:03:00 user nova-compute[75100]:     <serial type="pty">
Nov 10 18:03:00 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/5194f111-ba1a-43bc-9564-b744d1960307/console.log" append="off"/>
Nov 10 18:03:00 user nova-compute[75100]:     </serial>
Nov 10 18:03:00 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 18:03:00 user nova-compute[75100]:     <video>
Nov 10 18:03:00 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 18:03:00 user nova-compute[75100]:     </video>
Nov 10 18:03:00 user nova-compute[75100]:     <rng model="virtio">
Nov 10 18:03:00 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 10 18:03:00 user nova-compute[75100]:     </rng>
Nov 10 18:03:00 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 10 18:03:00 user nova-compute[75100]:     <memballoon model="virtio">
Nov 10 18:03:00 user nova-compute[75100]:       <stats period="10"/>
Nov 10 18:03:00 user nova-compute[75100]:     </memballoon>
Nov 10 18:03:00 user nova-compute[75100]:   </devices>
Nov 10 18:03:00 user nova-compute[75100]: </domain>
Nov 10 18:03:00 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 18:03:01 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:02:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1780838620',display_name='tempest-VolumesSnapshotTestJSON-instance-1780838620',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1780838620',id=35,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWXxJUqFl/Mx/bXB9u1e6+JWdt7NoHJnU736ah9MdZCpHCcsT75QVAvwHNJhx4DTay9iFVzuWJu1rTlzXdX4J4xdmyCleO56jJkXd79j2xM6USvsKJMZlS2wP7+mUv2dQ==',key_name='tempest-keypair-684408520',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27994d50bda0480f8964e687ed76805c',ramdisk_id='',reservation_id='r-29m7w8lo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1608810188',owner_user_name='tempest-VolumesSnapshotTestJSON-1608810188-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T18:02:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='695874f914a149a6a432598bee57a80e',uuid=5194f111-ba1a-43bc-9564-b744d1960307,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9829f1f6-ef24-440f-964b-1ae5326963dd", "address": "fa:16:3e:49:3b:cc", "network": {"id": "fa38ae2b-75a1-4312-9b92-462a4240d792", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-822691382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27994d50bda0480f8964e687ed76805c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9829f1f6-ef", "ovs_interfaceid": "9829f1f6-ef24-440f-964b-1ae5326963dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 18:03:01 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Converting VIF {"id": "9829f1f6-ef24-440f-964b-1ae5326963dd", "address": "fa:16:3e:49:3b:cc", "network": {"id": "fa38ae2b-75a1-4312-9b92-462a4240d792", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-822691382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27994d50bda0480f8964e687ed76805c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9829f1f6-ef", "ovs_interfaceid": "9829f1f6-ef24-440f-964b-1ae5326963dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:03:01 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:3b:cc,bridge_name='br-int',has_traffic_filtering=True,id=9829f1f6-ef24-440f-964b-1ae5326963dd,network=Network(fa38ae2b-75a1-4312-9b92-462a4240d792),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9829f1f6-ef') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:03:01 user nova-compute[75100]: DEBUG os_vif [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:3b:cc,bridge_name='br-int',has_traffic_filtering=True,id=9829f1f6-ef24-440f-964b-1ae5326963dd,network=Network(fa38ae2b-75a1-4312-9b92-462a4240d792),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9829f1f6-ef') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 18:03:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:03:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 18:03:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd533dbc1-9d70-5194-81ec-3b14d25ba1f2', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:03:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:03:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6685cd67-fc5b-430b-a0ed-32a46230f65b tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Lock "9dabb40d-299b-4c8a-bc92-63e5c0932047" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.722s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:03:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9829f1f6-ef, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:03:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9829f1f6-ef, col_values=(('qos', UUID('e3f1b510-0de2-4b4e-87f9-0a5d51c3f51f')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:03:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9829f1f6-ef, col_values=(('external_ids', {'iface-id': '9829f1f6-ef24-440f-964b-1ae5326963dd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:3b:cc', 'vm-uuid': '5194f111-ba1a-43bc-9564-b744d1960307'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:03:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:03:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:01 user nova-compute[75100]: INFO os_vif [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:3b:cc,bridge_name='br-int',has_traffic_filtering=True,id=9829f1f6-ef24-440f-964b-1ae5326963dd,network=Network(fa38ae2b-75a1-4312-9b92-462a4240d792),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9829f1f6-ef')
Nov 10 18:03:01 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 18:03:01 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] No VIF found with MAC fa:16:3e:49:3b:cc, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 18:03:01 user nova-compute[75100]: DEBUG nova.network.neutron [req-6dc8f263-1338-4558-9a37-6e138a2d9d2c req-3426225c-8ef1-4feb-917c-e5c7393abf1d service nova] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Updated VIF entry in instance network info cache for port 9829f1f6-ef24-440f-964b-1ae5326963dd. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 18:03:01 user nova-compute[75100]: DEBUG nova.network.neutron [req-6dc8f263-1338-4558-9a37-6e138a2d9d2c req-3426225c-8ef1-4feb-917c-e5c7393abf1d service nova] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Updating instance_info_cache with network_info: [{"id": "9829f1f6-ef24-440f-964b-1ae5326963dd", "address": "fa:16:3e:49:3b:cc", "network": {"id": "fa38ae2b-75a1-4312-9b92-462a4240d792", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-822691382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27994d50bda0480f8964e687ed76805c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9829f1f6-ef", "ovs_interfaceid": "9829f1f6-ef24-440f-964b-1ae5326963dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:03:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6dc8f263-1338-4558-9a37-6e138a2d9d2c req-3426225c-8ef1-4feb-917c-e5c7393abf1d service nova] Releasing lock "refresh_cache-5194f111-ba1a-43bc-9564-b744d1960307" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:03:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:02 user nova-compute[75100]: DEBUG nova.compute.manager [req-9fd98e46-2e59-4a59-88e9-00b2894928ba req-344a5b41-a852-4c79-8aba-a36e1f2140e4 service nova] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Received event network-vif-plugged-9829f1f6-ef24-440f-964b-1ae5326963dd {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:03:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9fd98e46-2e59-4a59-88e9-00b2894928ba req-344a5b41-a852-4c79-8aba-a36e1f2140e4 service nova] Acquiring lock "5194f111-ba1a-43bc-9564-b744d1960307-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:03:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9fd98e46-2e59-4a59-88e9-00b2894928ba req-344a5b41-a852-4c79-8aba-a36e1f2140e4 service nova] Lock "5194f111-ba1a-43bc-9564-b744d1960307-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:03:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9fd98e46-2e59-4a59-88e9-00b2894928ba req-344a5b41-a852-4c79-8aba-a36e1f2140e4 service nova] Lock "5194f111-ba1a-43bc-9564-b744d1960307-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:03:02 user nova-compute[75100]: DEBUG nova.compute.manager [req-9fd98e46-2e59-4a59-88e9-00b2894928ba req-344a5b41-a852-4c79-8aba-a36e1f2140e4 service nova] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] No waiting events found dispatching network-vif-plugged-9829f1f6-ef24-440f-964b-1ae5326963dd {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:03:02 user nova-compute[75100]: WARNING nova.compute.manager [req-9fd98e46-2e59-4a59-88e9-00b2894928ba req-344a5b41-a852-4c79-8aba-a36e1f2140e4 service nova] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Received unexpected event network-vif-plugged-9829f1f6-ef24-440f-964b-1ae5326963dd for instance with vm_state building and task_state spawning.
Nov 10 18:03:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:04 user nova-compute[75100]: DEBUG nova.compute.manager [req-6c83c231-8a21-4cd0-9c08-a92962a9068b req-2613e564-4ffe-4751-bef5-d7ef23f69059 service nova] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Received event network-vif-plugged-9829f1f6-ef24-440f-964b-1ae5326963dd {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:03:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6c83c231-8a21-4cd0-9c08-a92962a9068b req-2613e564-4ffe-4751-bef5-d7ef23f69059 service nova] Acquiring lock "5194f111-ba1a-43bc-9564-b744d1960307-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:03:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6c83c231-8a21-4cd0-9c08-a92962a9068b req-2613e564-4ffe-4751-bef5-d7ef23f69059 service nova] Lock "5194f111-ba1a-43bc-9564-b744d1960307-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:03:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6c83c231-8a21-4cd0-9c08-a92962a9068b req-2613e564-4ffe-4751-bef5-d7ef23f69059 service nova] Lock "5194f111-ba1a-43bc-9564-b744d1960307-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:03:04 user nova-compute[75100]: DEBUG nova.compute.manager [req-6c83c231-8a21-4cd0-9c08-a92962a9068b req-2613e564-4ffe-4751-bef5-d7ef23f69059 service nova] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] No waiting events found dispatching network-vif-plugged-9829f1f6-ef24-440f-964b-1ae5326963dd {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:03:04 user nova-compute[75100]: WARNING nova.compute.manager [req-6c83c231-8a21-4cd0-9c08-a92962a9068b req-2613e564-4ffe-4751-bef5-d7ef23f69059 service nova] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Received unexpected event network-vif-plugged-9829f1f6-ef24-440f-964b-1ae5326963dd for instance with vm_state building and task_state spawning.
Nov 10 18:03:05 user nova-compute[75100]: DEBUG nova.compute.manager [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 18:03:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 18:03:05 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Instance spawned successfully.
Nov 10 18:03:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 18:03:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:03:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:03:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:03:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:03:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:03:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:03:05 user nova-compute[75100]: INFO nova.compute.manager [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Took 6.24 seconds to spawn the instance on the hypervisor.
Nov 10 18:03:05 user nova-compute[75100]: DEBUG nova.compute.manager [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 18:03:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:05 user nova-compute[75100]: INFO nova.compute.manager [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Took 7.09 seconds to build instance.
Nov 10 18:03:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a5f68b9f-e321-4caa-9cd2-b5010937aa20 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lock "5194f111-ba1a-43bc-9564-b744d1960307" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.225s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:03:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Acquiring lock "b0bae328-2528-4562-850b-14fa108923c6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:03:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "b0bae328-2528-4562-850b-14fa108923c6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:03:16 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: b0bae328-2528-4562-850b-14fa108923c6] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 18:03:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:03:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:03:17 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 18:03:17 user nova-compute[75100]: INFO nova.compute.claims [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: b0bae328-2528-4562-850b-14fa108923c6] Claim successful on node user
Nov 10 18:03:17 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:03:17 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:03:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.310s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:03:17 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: b0bae328-2528-4562-850b-14fa108923c6] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 18:03:17 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: b0bae328-2528-4562-850b-14fa108923c6] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 18:03:17 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: b0bae328-2528-4562-850b-14fa108923c6] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 18:03:17 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: b0bae328-2528-4562-850b-14fa108923c6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 18:03:17 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: b0bae328-2528-4562-850b-14fa108923c6] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 18:03:17 user nova-compute[75100]: DEBUG nova.policy [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'efe92a172011414e8507cb6ddbfab0bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4e5cb8bdc24a009dcb3dbee36a6bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 18:03:17 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: b0bae328-2528-4562-850b-14fa108923c6] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 18:03:17 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: b0bae328-2528-4562-850b-14fa108923c6] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 18:03:17 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: b0bae328-2528-4562-850b-14fa108923c6] Creating image(s)
Nov 10 18:03:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Acquiring lock "/opt/stack/data/nova/instances/b0bae328-2528-4562-850b-14fa108923c6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:03:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "/opt/stack/data/nova/instances/b0bae328-2528-4562-850b-14fa108923c6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:03:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "/opt/stack/data/nova/instances/b0bae328-2528-4562-850b-14fa108923c6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:03:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:03:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.181s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:03:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Acquiring lock "818b9e28e061d41a38d903968b229be2ed9ba520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:03:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:03:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:03:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.175s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:03:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/b0bae328-2528-4562-850b-14fa108923c6/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:03:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/b0bae328-2528-4562-850b-14fa108923c6/disk 1073741824" returned: 0 in 0.054s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:03:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:03:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:03:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.197s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:03:18 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b0bae328-2528-4562-850b-14fa108923c6/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 18:03:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0bae328-2528-4562-850b-14fa108923c6/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:03:18 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: b0bae328-2528-4562-850b-14fa108923c6] Successfully created port: 6f68d50b-62e9-4068-98e8-131d624dd612 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 18:03:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0bae328-2528-4562-850b-14fa108923c6/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:03:18 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Cannot resize image /opt/stack/data/nova/instances/b0bae328-2528-4562-850b-14fa108923c6/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 18:03:18 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: b0bae328-2528-4562-850b-14fa108923c6] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 18:03:18 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: b0bae328-2528-4562-850b-14fa108923c6] Ensure instance console log exists: /opt/stack/data/nova/instances/b0bae328-2528-4562-850b-14fa108923c6/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 18:03:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:03:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:03:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:03:19 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: b0bae328-2528-4562-850b-14fa108923c6] Successfully updated port: 6f68d50b-62e9-4068-98e8-131d624dd612 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 18:03:19 user nova-compute[75100]: DEBUG nova.compute.manager [req-ecb3bfb1-8b99-4a50-b098-391200ee087b req-fcaf325a-8158-4079-a247-a69b4859c941 service nova] [instance: b0bae328-2528-4562-850b-14fa108923c6] Received event network-changed-6f68d50b-62e9-4068-98e8-131d624dd612 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:03:19 user nova-compute[75100]: DEBUG nova.compute.manager [req-ecb3bfb1-8b99-4a50-b098-391200ee087b req-fcaf325a-8158-4079-a247-a69b4859c941 service nova] [instance: b0bae328-2528-4562-850b-14fa108923c6] Refreshing instance network info cache due to event network-changed-6f68d50b-62e9-4068-98e8-131d624dd612. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 18:03:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ecb3bfb1-8b99-4a50-b098-391200ee087b req-fcaf325a-8158-4079-a247-a69b4859c941 service nova] Acquiring lock "refresh_cache-b0bae328-2528-4562-850b-14fa108923c6" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:03:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ecb3bfb1-8b99-4a50-b098-391200ee087b req-fcaf325a-8158-4079-a247-a69b4859c941 service nova] Acquired lock "refresh_cache-b0bae328-2528-4562-850b-14fa108923c6" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:03:19 user nova-compute[75100]: DEBUG nova.network.neutron [req-ecb3bfb1-8b99-4a50-b098-391200ee087b req-fcaf325a-8158-4079-a247-a69b4859c941 service nova] [instance: b0bae328-2528-4562-850b-14fa108923c6] Refreshing network info cache for port 6f68d50b-62e9-4068-98e8-131d624dd612 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 18:03:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Acquiring lock "refresh_cache-b0bae328-2528-4562-850b-14fa108923c6" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:03:19 user nova-compute[75100]: DEBUG nova.network.neutron [req-ecb3bfb1-8b99-4a50-b098-391200ee087b req-fcaf325a-8158-4079-a247-a69b4859c941 service nova] [instance: b0bae328-2528-4562-850b-14fa108923c6] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 18:03:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:19 user nova-compute[75100]: DEBUG nova.network.neutron [req-ecb3bfb1-8b99-4a50-b098-391200ee087b req-fcaf325a-8158-4079-a247-a69b4859c941 service nova] [instance: b0bae328-2528-4562-850b-14fa108923c6] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:03:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ecb3bfb1-8b99-4a50-b098-391200ee087b req-fcaf325a-8158-4079-a247-a69b4859c941 service nova] Releasing lock "refresh_cache-b0bae328-2528-4562-850b-14fa108923c6" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:03:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Acquired lock "refresh_cache-b0bae328-2528-4562-850b-14fa108923c6" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:03:19 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: b0bae328-2528-4562-850b-14fa108923c6] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 18:03:19 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: b0bae328-2528-4562-850b-14fa108923c6] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 18:03:19 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: b0bae328-2528-4562-850b-14fa108923c6] Updating instance_info_cache with network_info: [{"id": "6f68d50b-62e9-4068-98e8-131d624dd612", "address": "fa:16:3e:ae:03:fd", "network": {"id": "e906a397-504d-48d8-8726-187cfbb1f270", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2095832274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4e5cb8bdc24a009dcb3dbee36a6bce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f68d50b-62", "ovs_interfaceid": "6f68d50b-62e9-4068-98e8-131d624dd612", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:03:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Releasing lock "refresh_cache-b0bae328-2528-4562-850b-14fa108923c6" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:03:19 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: b0bae328-2528-4562-850b-14fa108923c6] Instance network_info: |[{"id": "6f68d50b-62e9-4068-98e8-131d624dd612", "address": "fa:16:3e:ae:03:fd", "network": {"id": "e906a397-504d-48d8-8726-187cfbb1f270", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2095832274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4e5cb8bdc24a009dcb3dbee36a6bce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f68d50b-62", "ovs_interfaceid": "6f68d50b-62e9-4068-98e8-131d624dd612", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 18:03:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: b0bae328-2528-4562-850b-14fa108923c6] Start _get_guest_xml network_info=[{"id": "6f68d50b-62e9-4068-98e8-131d624dd612", "address": "fa:16:3e:ae:03:fd", "network": {"id": "e906a397-504d-48d8-8726-187cfbb1f270", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2095832274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4e5cb8bdc24a009dcb3dbee36a6bce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f68d50b-62", "ovs_interfaceid": "6f68d50b-62e9-4068-98e8-131d624dd612", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'e3cc5321-4d40-49ee-885c-700e14741732'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 18:03:19 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:03:19 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:03:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 18:03:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 18:03:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 18:03:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 18:03:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 18:03:19 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T17:40:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 18:03:19 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 18:03:19 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 18:03:19 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 18:03:19 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 18:03:19 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 18:03:19 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 18:03:19 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 18:03:19 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 18:03:19 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 18:03:19 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 18:03:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:03:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1468565613',display_name='tempest-AttachVolumeNegativeTest-server-1468565613',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1468565613',id=36,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGfbhvGDgoDP2dxNtmL9BJEbA7dohTeOBW8+eBHKAHMLlRXpo/2O6+Hm0SDaDg7UVuVYlsPFN/ntEb+SzjlbLRihNQyRABlP0FGFjDIW9cGNyzktF0VWw6A4GOeN0sYKqw==',key_name='tempest-keypair-2070911957',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d4e5cb8bdc24a009dcb3dbee36a6bce',ramdisk_id='',reservation_id='r-hupb1hkw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1395057280',owner_user_name='tempest-AttachVolumeNegativeTest-1395057280-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T18:03:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efe92a172011414e8507cb6ddbfab0bb',uuid=b0bae328-2528-4562-850b-14fa108923c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f68d50b-62e9-4068-98e8-131d624dd612", "address": "fa:16:3e:ae:03:fd", "network": {"id": "e906a397-504d-48d8-8726-187cfbb1f270", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2095832274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4e5cb8bdc24a009dcb3dbee36a6bce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f68d50b-62", "ovs_interfaceid": "6f68d50b-62e9-4068-98e8-131d624dd612", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 18:03:20 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Converting VIF {"id": "6f68d50b-62e9-4068-98e8-131d624dd612", "address": "fa:16:3e:ae:03:fd", "network": {"id": "e906a397-504d-48d8-8726-187cfbb1f270", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2095832274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4e5cb8bdc24a009dcb3dbee36a6bce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f68d50b-62", "ovs_interfaceid": "6f68d50b-62e9-4068-98e8-131d624dd612", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:03:20 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:03:fd,bridge_name='br-int',has_traffic_filtering=True,id=6f68d50b-62e9-4068-98e8-131d624dd612,network=Network(e906a397-504d-48d8-8726-187cfbb1f270),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f68d50b-62') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:03:20 user nova-compute[75100]: DEBUG nova.objects.instance [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lazy-loading 'pci_devices' on Instance uuid b0bae328-2528-4562-850b-14fa108923c6 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:03:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: b0bae328-2528-4562-850b-14fa108923c6] End _get_guest_xml xml=<domain type="kvm">
Nov 10 18:03:20 user nova-compute[75100]:   <uuid>b0bae328-2528-4562-850b-14fa108923c6</uuid>
Nov 10 18:03:20 user nova-compute[75100]:   <name>instance-00000024</name>
Nov 10 18:03:20 user nova-compute[75100]:   <memory>524288</memory>
Nov 10 18:03:20 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 10 18:03:20 user nova-compute[75100]:   <metadata>
Nov 10 18:03:20 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 18:03:20 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 10 18:03:20 user nova-compute[75100]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1468565613</nova:name>
Nov 10 18:03:20 user nova-compute[75100]:       <nova:creationTime>2023-11-10 18:03:19</nova:creationTime>
Nov 10 18:03:20 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 10 18:03:20 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 10 18:03:20 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 10 18:03:20 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 10 18:03:20 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 18:03:20 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 10 18:03:20 user nova-compute[75100]:       </nova:flavor>
Nov 10 18:03:20 user nova-compute[75100]:       <nova:owner>
Nov 10 18:03:20 user nova-compute[75100]:         <nova:user uuid="efe92a172011414e8507cb6ddbfab0bb">tempest-AttachVolumeNegativeTest-1395057280-project-member</nova:user>
Nov 10 18:03:20 user nova-compute[75100]:         <nova:project uuid="9d4e5cb8bdc24a009dcb3dbee36a6bce">tempest-AttachVolumeNegativeTest-1395057280</nova:project>
Nov 10 18:03:20 user nova-compute[75100]:       </nova:owner>
Nov 10 18:03:20 user nova-compute[75100]:       <nova:root type="image" uuid="e3cc5321-4d40-49ee-885c-700e14741732"/>
Nov 10 18:03:20 user nova-compute[75100]:       <nova:ports>
Nov 10 18:03:20 user nova-compute[75100]:         <nova:port uuid="6f68d50b-62e9-4068-98e8-131d624dd612">
Nov 10 18:03:20 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 10 18:03:20 user nova-compute[75100]:         </nova:port>
Nov 10 18:03:20 user nova-compute[75100]:       </nova:ports>
Nov 10 18:03:20 user nova-compute[75100]:     </nova:instance>
Nov 10 18:03:20 user nova-compute[75100]:   </metadata>
Nov 10 18:03:20 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 10 18:03:20 user nova-compute[75100]:     <system>
Nov 10 18:03:20 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 18:03:20 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 10 18:03:20 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 10 18:03:20 user nova-compute[75100]:       <entry name="serial">b0bae328-2528-4562-850b-14fa108923c6</entry>
Nov 10 18:03:20 user nova-compute[75100]:       <entry name="uuid">b0bae328-2528-4562-850b-14fa108923c6</entry>
Nov 10 18:03:20 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 10 18:03:20 user nova-compute[75100]:     </system>
Nov 10 18:03:20 user nova-compute[75100]:   </sysinfo>
Nov 10 18:03:20 user nova-compute[75100]:   <os>
Nov 10 18:03:20 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 18:03:20 user nova-compute[75100]:     <boot dev="hd"/>
Nov 10 18:03:20 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 10 18:03:20 user nova-compute[75100]:   </os>
Nov 10 18:03:20 user nova-compute[75100]:   <features>
Nov 10 18:03:20 user nova-compute[75100]:     <acpi/>
Nov 10 18:03:20 user nova-compute[75100]:     <apic/>
Nov 10 18:03:20 user nova-compute[75100]:     <vmcoreinfo/>
Nov 10 18:03:20 user nova-compute[75100]:   </features>
Nov 10 18:03:20 user nova-compute[75100]:   <clock offset="utc">
Nov 10 18:03:20 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 18:03:20 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 18:03:20 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 10 18:03:20 user nova-compute[75100]:   </clock>
Nov 10 18:03:20 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 10 18:03:20 user nova-compute[75100]:     <model>Nehalem</model>
Nov 10 18:03:20 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 18:03:20 user nova-compute[75100]:   </cpu>
Nov 10 18:03:20 user nova-compute[75100]:   <devices>
Nov 10 18:03:20 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 10 18:03:20 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 18:03:20 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/b0bae328-2528-4562-850b-14fa108923c6/disk"/>
Nov 10 18:03:20 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 10 18:03:20 user nova-compute[75100]:     </disk>
Nov 10 18:03:20 user nova-compute[75100]:     <interface type="ethernet">
Nov 10 18:03:20 user nova-compute[75100]:       <mac address="fa:16:3e:ae:03:fd"/>
Nov 10 18:03:20 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 18:03:20 user nova-compute[75100]:       <mtu size="1442"/>
Nov 10 18:03:20 user nova-compute[75100]:       <target dev="tap6f68d50b-62"/>
Nov 10 18:03:20 user nova-compute[75100]:     </interface>
Nov 10 18:03:20 user nova-compute[75100]:     <serial type="pty">
Nov 10 18:03:20 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/b0bae328-2528-4562-850b-14fa108923c6/console.log" append="off"/>
Nov 10 18:03:20 user nova-compute[75100]:     </serial>
Nov 10 18:03:20 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 18:03:20 user nova-compute[75100]:     <video>
Nov 10 18:03:20 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 18:03:20 user nova-compute[75100]:     </video>
Nov 10 18:03:20 user nova-compute[75100]:     <rng model="virtio">
Nov 10 18:03:20 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 10 18:03:20 user nova-compute[75100]:     </rng>
Nov 10 18:03:20 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 10 18:03:20 user nova-compute[75100]:     <memballoon model="virtio">
Nov 10 18:03:20 user nova-compute[75100]:       <stats period="10"/>
Nov 10 18:03:20 user nova-compute[75100]:     </memballoon>
Nov 10 18:03:20 user nova-compute[75100]:   </devices>
Nov 10 18:03:20 user nova-compute[75100]: </domain>
Nov 10 18:03:20 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 18:03:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:03:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1468565613',display_name='tempest-AttachVolumeNegativeTest-server-1468565613',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1468565613',id=36,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGfbhvGDgoDP2dxNtmL9BJEbA7dohTeOBW8+eBHKAHMLlRXpo/2O6+Hm0SDaDg7UVuVYlsPFN/ntEb+SzjlbLRihNQyRABlP0FGFjDIW9cGNyzktF0VWw6A4GOeN0sYKqw==',key_name='tempest-keypair-2070911957',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d4e5cb8bdc24a009dcb3dbee36a6bce',ramdisk_id='',reservation_id='r-hupb1hkw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1395057280',owner_user_name='tempest-AttachVolumeNegativeTest-1395057280-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T18:03:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efe92a172011414e8507cb6ddbfab0bb',uuid=b0bae328-2528-4562-850b-14fa108923c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f68d50b-62e9-4068-98e8-131d624dd612", "address": "fa:16:3e:ae:03:fd", "network": {"id": "e906a397-504d-48d8-8726-187cfbb1f270", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2095832274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4e5cb8bdc24a009dcb3dbee36a6bce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f68d50b-62", "ovs_interfaceid": "6f68d50b-62e9-4068-98e8-131d624dd612", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 18:03:20 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Converting VIF {"id": "6f68d50b-62e9-4068-98e8-131d624dd612", "address": "fa:16:3e:ae:03:fd", "network": {"id": "e906a397-504d-48d8-8726-187cfbb1f270", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2095832274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4e5cb8bdc24a009dcb3dbee36a6bce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f68d50b-62", "ovs_interfaceid": "6f68d50b-62e9-4068-98e8-131d624dd612", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:03:20 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:03:fd,bridge_name='br-int',has_traffic_filtering=True,id=6f68d50b-62e9-4068-98e8-131d624dd612,network=Network(e906a397-504d-48d8-8726-187cfbb1f270),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f68d50b-62') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:03:20 user nova-compute[75100]: DEBUG os_vif [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:03:fd,bridge_name='br-int',has_traffic_filtering=True,id=6f68d50b-62e9-4068-98e8-131d624dd612,network=Network(e906a397-504d-48d8-8726-187cfbb1f270),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f68d50b-62') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 18:03:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:03:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 18:03:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '06b9aae8-e4d4-5701-957f-ad63b3092e8c', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:03:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:03:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6f68d50b-62, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:03:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6f68d50b-62, col_values=(('qos', UUID('09478e93-d99a-4fe3-aa8a-800c0e2aca6e')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:03:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6f68d50b-62, col_values=(('external_ids', {'iface-id': '6f68d50b-62e9-4068-98e8-131d624dd612', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:03:fd', 'vm-uuid': 'b0bae328-2528-4562-850b-14fa108923c6'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:03:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:03:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:20 user nova-compute[75100]: INFO os_vif [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:03:fd,bridge_name='br-int',has_traffic_filtering=True,id=6f68d50b-62e9-4068-98e8-131d624dd612,network=Network(e906a397-504d-48d8-8726-187cfbb1f270),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f68d50b-62')
Nov 10 18:03:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 18:03:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] No VIF found with MAC fa:16:3e:ae:03:fd, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 18:03:21 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:03:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:21 user nova-compute[75100]: DEBUG nova.compute.manager [req-ffad194e-20af-4d94-a71f-1c423eb55991 req-486e3c00-e31e-46c9-8ce5-14501888d002 service nova] [instance: b0bae328-2528-4562-850b-14fa108923c6] Received event network-vif-plugged-6f68d50b-62e9-4068-98e8-131d624dd612 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:03:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ffad194e-20af-4d94-a71f-1c423eb55991 req-486e3c00-e31e-46c9-8ce5-14501888d002 service nova] Acquiring lock "b0bae328-2528-4562-850b-14fa108923c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:03:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ffad194e-20af-4d94-a71f-1c423eb55991 req-486e3c00-e31e-46c9-8ce5-14501888d002 service nova] Lock "b0bae328-2528-4562-850b-14fa108923c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:03:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ffad194e-20af-4d94-a71f-1c423eb55991 req-486e3c00-e31e-46c9-8ce5-14501888d002 service nova] Lock "b0bae328-2528-4562-850b-14fa108923c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:03:21 user nova-compute[75100]: DEBUG nova.compute.manager [req-ffad194e-20af-4d94-a71f-1c423eb55991 req-486e3c00-e31e-46c9-8ce5-14501888d002 service nova] [instance: b0bae328-2528-4562-850b-14fa108923c6] No waiting events found dispatching network-vif-plugged-6f68d50b-62e9-4068-98e8-131d624dd612 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:03:21 user nova-compute[75100]: WARNING nova.compute.manager [req-ffad194e-20af-4d94-a71f-1c423eb55991 req-486e3c00-e31e-46c9-8ce5-14501888d002 service nova] [instance: b0bae328-2528-4562-850b-14fa108923c6] Received unexpected event network-vif-plugged-6f68d50b-62e9-4068-98e8-131d624dd612 for instance with vm_state building and task_state spawning.
Nov 10 18:03:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:23 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:03:23 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: b0bae328-2528-4562-850b-14fa108923c6] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 18:03:23 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: b0bae328-2528-4562-850b-14fa108923c6] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 18:03:23 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: b0bae328-2528-4562-850b-14fa108923c6] Instance spawned successfully.
Nov 10 18:03:23 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: b0bae328-2528-4562-850b-14fa108923c6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 18:03:23 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: b0bae328-2528-4562-850b-14fa108923c6] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:03:23 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: b0bae328-2528-4562-850b-14fa108923c6] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:03:23 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: b0bae328-2528-4562-850b-14fa108923c6] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:03:23 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: b0bae328-2528-4562-850b-14fa108923c6] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:03:23 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: b0bae328-2528-4562-850b-14fa108923c6] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:03:23 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: b0bae328-2528-4562-850b-14fa108923c6] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:03:23 user nova-compute[75100]: DEBUG nova.compute.manager [req-ed1c5c00-1edd-470f-8c40-6edaae7dfac0 req-fc46df2a-51de-4a0c-8d3a-979961e5b181 service nova] [instance: b0bae328-2528-4562-850b-14fa108923c6] Received event network-vif-plugged-6f68d50b-62e9-4068-98e8-131d624dd612 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:03:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ed1c5c00-1edd-470f-8c40-6edaae7dfac0 req-fc46df2a-51de-4a0c-8d3a-979961e5b181 service nova] Acquiring lock "b0bae328-2528-4562-850b-14fa108923c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:03:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ed1c5c00-1edd-470f-8c40-6edaae7dfac0 req-fc46df2a-51de-4a0c-8d3a-979961e5b181 service nova] Lock "b0bae328-2528-4562-850b-14fa108923c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:03:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ed1c5c00-1edd-470f-8c40-6edaae7dfac0 req-fc46df2a-51de-4a0c-8d3a-979961e5b181 service nova] Lock "b0bae328-2528-4562-850b-14fa108923c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:03:23 user nova-compute[75100]: DEBUG nova.compute.manager [req-ed1c5c00-1edd-470f-8c40-6edaae7dfac0 req-fc46df2a-51de-4a0c-8d3a-979961e5b181 service nova] [instance: b0bae328-2528-4562-850b-14fa108923c6] No waiting events found dispatching network-vif-plugged-6f68d50b-62e9-4068-98e8-131d624dd612 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:03:23 user nova-compute[75100]: WARNING nova.compute.manager [req-ed1c5c00-1edd-470f-8c40-6edaae7dfac0 req-fc46df2a-51de-4a0c-8d3a-979961e5b181 service nova] [instance: b0bae328-2528-4562-850b-14fa108923c6] Received unexpected event network-vif-plugged-6f68d50b-62e9-4068-98e8-131d624dd612 for instance with vm_state building and task_state spawning.
Nov 10 18:03:23 user nova-compute[75100]: INFO nova.compute.manager [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: b0bae328-2528-4562-850b-14fa108923c6] Took 6.07 seconds to spawn the instance on the hypervisor.
Nov 10 18:03:23 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: b0bae328-2528-4562-850b-14fa108923c6] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 18:03:23 user nova-compute[75100]: INFO nova.compute.manager [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: b0bae328-2528-4562-850b-14fa108923c6] Took 6.76 seconds to build instance.
Nov 10 18:03:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ba292fd4-e63a-46f9-ab3c-1278a8b07e5a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "b0bae328-2528-4562-850b-14fa108923c6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.851s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:03:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:25 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:03:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:03:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:03:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:03:25 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 18:03:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc2bfb6-fd6b-4229-9664-42f33b138444/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:03:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc2bfb6-fd6b-4229-9664-42f33b138444/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:03:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc2bfb6-fd6b-4229-9664-42f33b138444/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:03:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc2bfb6-fd6b-4229-9664-42f33b138444/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:03:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5194f111-ba1a-43bc-9564-b744d1960307/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:03:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5194f111-ba1a-43bc-9564-b744d1960307/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:03:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5194f111-ba1a-43bc-9564-b744d1960307/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:03:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5194f111-ba1a-43bc-9564-b744d1960307/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:03:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 18:03:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dabb40d-299b-4c8a-bc92-63e5c0932047/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:03:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dabb40d-299b-4c8a-bc92-63e5c0932047/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:03:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dabb40d-299b-4c8a-bc92-63e5c0932047/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:03:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dabb40d-299b-4c8a-bc92-63e5c0932047/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:03:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:03:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:03:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:03:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:03:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0bae328-2528-4562-850b-14fa108923c6/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:03:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0bae328-2528-4562-850b-14fa108923c6/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:03:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0bae328-2528-4562-850b-14fa108923c6/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:03:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0bae328-2528-4562-850b-14fa108923c6/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:03:27 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:03:27 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:03:27 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Hypervisor/Node resource view: name=user free_ram=7836MB free_disk=24.477706909179688GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 18:03:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:03:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:03:27 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:03:27 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance fcc2bfb6-fd6b-4229-9664-42f33b138444 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:03:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 9f115887-d874-4499-b20a-05d4f0623866 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:03:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 9dabb40d-299b-4c8a-bc92-63e5c0932047 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:03:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 5194f111-ba1a-43bc-9564-b744d1960307 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:03:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance b0bae328-2528-4562-850b-14fa108923c6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:03:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 18:03:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 18:03:28 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:03:28 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:03:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 18:03:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.423s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:03:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:30 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:03:30 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:03:30 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:03:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Acquiring lock "1937fab6-d892-406e-b8ff-52194021eea4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:03:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "1937fab6-d892-406e-b8ff-52194021eea4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:03:31 user nova-compute[75100]: DEBUG nova.compute.manager [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 18:03:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:03:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:03:31 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 18:03:31 user nova-compute[75100]: INFO nova.compute.claims [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Claim successful on node user
Nov 10 18:03:32 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:03:32 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:03:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.395s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:03:32 user nova-compute[75100]: DEBUG nova.compute.manager [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 18:03:32 user nova-compute[75100]: DEBUG nova.compute.manager [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 18:03:32 user nova-compute[75100]: DEBUG nova.network.neutron [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 18:03:32 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 18:03:32 user nova-compute[75100]: DEBUG nova.compute.manager [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 18:03:32 user nova-compute[75100]: DEBUG nova.policy [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4d873ec5a11a4ccdb868fef673ffc568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19cfb454e59745bf9c77d7a7ede2bc0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 18:03:32 user nova-compute[75100]: DEBUG nova.compute.manager [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 18:03:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 18:03:32 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Creating image(s)
Nov 10 18:03:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Acquiring lock "/opt/stack/data/nova/instances/1937fab6-d892-406e-b8ff-52194021eea4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:03:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "/opt/stack/data/nova/instances/1937fab6-d892-406e-b8ff-52194021eea4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:03:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "/opt/stack/data/nova/instances/1937fab6-d892-406e-b8ff-52194021eea4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:03:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Acquiring lock "73fed14145cf922fc471d7b2cf11b042ef0978a4" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:03:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "73fed14145cf922fc471d7b2cf11b042ef0978a4" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:03:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73fed14145cf922fc471d7b2cf11b042ef0978a4.part --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:03:33 user nova-compute[75100]: DEBUG nova.network.neutron [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Successfully created port: c19c4cab-962c-4915-806a-9dbffdf4bfa4 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 18:03:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73fed14145cf922fc471d7b2cf11b042ef0978a4.part --force-share --output=json" returned: 0 in 0.188s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:03:33 user nova-compute[75100]: DEBUG nova.virt.images [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] 58ffe2f6-bf44-41f2-8818-788e8006c7a3 was qcow2, converting to raw {{(pid=75100) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 10 18:03:33 user nova-compute[75100]: DEBUG nova.privsep.utils [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75100) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 18:03:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/73fed14145cf922fc471d7b2cf11b042ef0978a4.part /opt/stack/data/nova/instances/_base/73fed14145cf922fc471d7b2cf11b042ef0978a4.converted {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:03:33 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:03:33 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:03:33 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 18:03:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/73fed14145cf922fc471d7b2cf11b042ef0978a4.part /opt/stack/data/nova/instances/_base/73fed14145cf922fc471d7b2cf11b042ef0978a4.converted" returned: 0 in 0.378s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:03:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73fed14145cf922fc471d7b2cf11b042ef0978a4.converted --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:03:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73fed14145cf922fc471d7b2cf11b042ef0978a4.converted --force-share --output=json" returned: 0 in 0.203s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:03:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "73fed14145cf922fc471d7b2cf11b042ef0978a4" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.462s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:03:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73fed14145cf922fc471d7b2cf11b042ef0978a4 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:03:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73fed14145cf922fc471d7b2cf11b042ef0978a4 --force-share --output=json" returned: 0 in 0.231s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:03:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Acquiring lock "73fed14145cf922fc471d7b2cf11b042ef0978a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:03:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "73fed14145cf922fc471d7b2cf11b042ef0978a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:03:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73fed14145cf922fc471d7b2cf11b042ef0978a4 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:03:34 user nova-compute[75100]: DEBUG nova.network.neutron [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Successfully updated port: c19c4cab-962c-4915-806a-9dbffdf4bfa4 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 18:03:34 user nova-compute[75100]: DEBUG nova.compute.manager [req-a9d402dd-8848-452b-9f8f-dd674cd21209 req-a329f0e0-072a-4b9a-972b-3e46f40bb4ed service nova] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Received event network-changed-c19c4cab-962c-4915-806a-9dbffdf4bfa4 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:03:34 user nova-compute[75100]: DEBUG nova.compute.manager [req-a9d402dd-8848-452b-9f8f-dd674cd21209 req-a329f0e0-072a-4b9a-972b-3e46f40bb4ed service nova] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Refreshing instance network info cache due to event network-changed-c19c4cab-962c-4915-806a-9dbffdf4bfa4. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 18:03:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a9d402dd-8848-452b-9f8f-dd674cd21209 req-a329f0e0-072a-4b9a-972b-3e46f40bb4ed service nova] Acquiring lock "refresh_cache-1937fab6-d892-406e-b8ff-52194021eea4" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:03:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a9d402dd-8848-452b-9f8f-dd674cd21209 req-a329f0e0-072a-4b9a-972b-3e46f40bb4ed service nova] Acquired lock "refresh_cache-1937fab6-d892-406e-b8ff-52194021eea4" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:03:34 user nova-compute[75100]: DEBUG nova.network.neutron [req-a9d402dd-8848-452b-9f8f-dd674cd21209 req-a329f0e0-072a-4b9a-972b-3e46f40bb4ed service nova] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Refreshing network info cache for port c19c4cab-962c-4915-806a-9dbffdf4bfa4 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 18:03:34 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:03:34 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 18:03:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Acquiring lock "refresh_cache-1937fab6-d892-406e-b8ff-52194021eea4" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:03:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73fed14145cf922fc471d7b2cf11b042ef0978a4 --force-share --output=json" returned: 0 in 0.263s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:03:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73fed14145cf922fc471d7b2cf11b042ef0978a4,backing_fmt=raw /opt/stack/data/nova/instances/1937fab6-d892-406e-b8ff-52194021eea4/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:03:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Acquiring lock "ce634a11-5628-4f1c-8437-95f26519d8a0" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:03:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "ce634a11-5628-4f1c-8437-95f26519d8a0" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:03:34 user nova-compute[75100]: INFO nova.compute.manager [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Unshelving
Nov 10 18:03:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73fed14145cf922fc471d7b2cf11b042ef0978a4,backing_fmt=raw /opt/stack/data/nova/instances/1937fab6-d892-406e-b8ff-52194021eea4/disk 1073741824" returned: 0 in 0.098s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:03:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "73fed14145cf922fc471d7b2cf11b042ef0978a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.365s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:03:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73fed14145cf922fc471d7b2cf11b042ef0978a4 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:03:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "refresh_cache-fcc2bfb6-fd6b-4229-9664-42f33b138444" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:03:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquired lock "refresh_cache-fcc2bfb6-fd6b-4229-9664-42f33b138444" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:03:34 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 18:03:34 user nova-compute[75100]: DEBUG nova.network.neutron [req-a9d402dd-8848-452b-9f8f-dd674cd21209 req-a329f0e0-072a-4b9a-972b-3e46f40bb4ed service nova] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 18:03:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73fed14145cf922fc471d7b2cf11b042ef0978a4 --force-share --output=json" returned: 0 in 0.184s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:03:34 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1937fab6-d892-406e-b8ff-52194021eea4/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 18:03:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1937fab6-d892-406e-b8ff-52194021eea4/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:03:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:03:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:03:34 user nova-compute[75100]: DEBUG nova.objects.instance [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lazy-loading 'pci_requests' on Instance uuid ce634a11-5628-4f1c-8437-95f26519d8a0 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:03:34 user nova-compute[75100]: DEBUG nova.objects.instance [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lazy-loading 'numa_topology' on Instance uuid ce634a11-5628-4f1c-8437-95f26519d8a0 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:03:34 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 18:03:34 user nova-compute[75100]: INFO nova.compute.claims [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Claim successful on node user
Nov 10 18:03:34 user nova-compute[75100]: DEBUG nova.network.neutron [req-a9d402dd-8848-452b-9f8f-dd674cd21209 req-a329f0e0-072a-4b9a-972b-3e46f40bb4ed service nova] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:03:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1937fab6-d892-406e-b8ff-52194021eea4/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:03:34 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Cannot resize image /opt/stack/data/nova/instances/1937fab6-d892-406e-b8ff-52194021eea4/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 18:03:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 18:03:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Ensure instance console log exists: /opt/stack/data/nova/instances/1937fab6-d892-406e-b8ff-52194021eea4/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 18:03:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:03:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:03:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:03:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a9d402dd-8848-452b-9f8f-dd674cd21209 req-a329f0e0-072a-4b9a-972b-3e46f40bb4ed service nova] Releasing lock "refresh_cache-1937fab6-d892-406e-b8ff-52194021eea4" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:03:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Acquired lock "refresh_cache-1937fab6-d892-406e-b8ff-52194021eea4" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:03:34 user nova-compute[75100]: DEBUG nova.network.neutron [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 18:03:34 user nova-compute[75100]: DEBUG nova.network.neutron [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 18:03:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:35 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:03:35 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:03:35 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Updating instance_info_cache with network_info: [{"id": "8c7dcf78-fc4a-4fcb-905e-ce75143a9450", "address": "fa:16:3e:be:ec:38", "network": {"id": "20522623-c29d-44f8-9047-68dde7f763c1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1770250829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2871e8755b32497d901be0f062fad858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7dcf78-fc", "ovs_interfaceid": "8c7dcf78-fc4a-4fcb-905e-ce75143a9450", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:03:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Releasing lock "refresh_cache-fcc2bfb6-fd6b-4229-9664-42f33b138444" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:03:35 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 18:03:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.369s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:03:35 user nova-compute[75100]: DEBUG nova.network.neutron [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Updating instance_info_cache with network_info: [{"id": "c19c4cab-962c-4915-806a-9dbffdf4bfa4", "address": "fa:16:3e:ba:d7:b9", "network": {"id": "78d86418-c0e0-4cc2-8f4f-262f600f7d66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2054827063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19cfb454e59745bf9c77d7a7ede2bc0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc19c4cab-96", "ovs_interfaceid": "c19c4cab-962c-4915-806a-9dbffdf4bfa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:03:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Releasing lock "refresh_cache-1937fab6-d892-406e-b8ff-52194021eea4" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:03:35 user nova-compute[75100]: DEBUG nova.compute.manager [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Instance network_info: |[{"id": "c19c4cab-962c-4915-806a-9dbffdf4bfa4", "address": "fa:16:3e:ba:d7:b9", "network": {"id": "78d86418-c0e0-4cc2-8f4f-262f600f7d66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2054827063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19cfb454e59745bf9c77d7a7ede2bc0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc19c4cab-96", "ovs_interfaceid": "c19c4cab-962c-4915-806a-9dbffdf4bfa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 18:03:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Start _get_guest_xml network_info=[{"id": "c19c4cab-962c-4915-806a-9dbffdf4bfa4", "address": "fa:16:3e:ba:d7:b9", "network": {"id": "78d86418-c0e0-4cc2-8f4f-262f600f7d66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2054827063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19cfb454e59745bf9c77d7a7ede2bc0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc19c4cab-96", "ovs_interfaceid": "c19c4cab-962c-4915-806a-9dbffdf4bfa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T18:03:29Z,direct_url=<?>,disk_format='qcow2',id=58ffe2f6-bf44-41f2-8818-788e8006c7a3,min_disk=0,min_ram=0,name='tempest-scenario-img--827780966',owner='19cfb454e59745bf9c77d7a7ede2bc0e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T18:03:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '58ffe2f6-bf44-41f2-8818-788e8006c7a3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 18:03:35 user nova-compute[75100]: INFO nova.network.neutron [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Updating port 4c3793c8-de6c-4246-9a29-46ac085f065e with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 10 18:03:35 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:03:35 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:03:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 18:03:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 18:03:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 18:03:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 18:03:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 18:03:35 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T17:40:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T18:03:29Z,direct_url=<?>,disk_format='qcow2',id=58ffe2f6-bf44-41f2-8818-788e8006c7a3,min_disk=0,min_ram=0,name='tempest-scenario-img--827780966',owner='19cfb454e59745bf9c77d7a7ede2bc0e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T18:03:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 18:03:35 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 18:03:35 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 18:03:35 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 18:03:35 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 18:03:35 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 18:03:35 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 18:03:35 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 18:03:35 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 18:03:35 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 18:03:35 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 18:03:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:03:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-550712417',display_name='tempest-TestMinimumBasicScenario-server-550712417',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-550712417',id=37,image_ref='58ffe2f6-bf44-41f2-8818-788e8006c7a3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbHMZ/csSY9p+GduPtuiqFIhYNllnC3slobeatmB+uPE9c+Afr9UfpO7kdA+O9NN0RauKt1vhBXu2JQ7B4+8FD+GLdH4CQGjuZaKNVoAdd5YzFm4CKGoGlEpfA3dSUkrg==',key_name='tempest-TestMinimumBasicScenario-1493594938',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='19cfb454e59745bf9c77d7a7ede2bc0e',ramdisk_id='',reservation_id='r-8qlus30s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='58ffe2f6-bf44-41f2-8818-788e8006c7a3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-281006384',owner_user_name='tempest-TestMinimumBasicScenario-281006384-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T18:03:32Z,user_data=None,user_id='4d873ec5a11a4ccdb868fef673ffc568',uuid=1937fab6-d892-406e-b8ff-52194021eea4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c19c4cab-962c-4915-806a-9dbffdf4bfa4", "address": "fa:16:3e:ba:d7:b9", "network": {"id": "78d86418-c0e0-4cc2-8f4f-262f600f7d66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2054827063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19cfb454e59745bf9c77d7a7ede2bc0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc19c4cab-96", "ovs_interfaceid": "c19c4cab-962c-4915-806a-9dbffdf4bfa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 18:03:35 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Converting VIF {"id": "c19c4cab-962c-4915-806a-9dbffdf4bfa4", "address": "fa:16:3e:ba:d7:b9", "network": {"id": "78d86418-c0e0-4cc2-8f4f-262f600f7d66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2054827063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19cfb454e59745bf9c77d7a7ede2bc0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc19c4cab-96", "ovs_interfaceid": "c19c4cab-962c-4915-806a-9dbffdf4bfa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:03:35 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:d7:b9,bridge_name='br-int',has_traffic_filtering=True,id=c19c4cab-962c-4915-806a-9dbffdf4bfa4,network=Network(78d86418-c0e0-4cc2-8f4f-262f600f7d66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc19c4cab-96') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:03:35 user nova-compute[75100]: DEBUG nova.objects.instance [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lazy-loading 'pci_devices' on Instance uuid 1937fab6-d892-406e-b8ff-52194021eea4 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:03:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] End _get_guest_xml xml=<domain type="kvm">
Nov 10 18:03:35 user nova-compute[75100]:   <uuid>1937fab6-d892-406e-b8ff-52194021eea4</uuid>
Nov 10 18:03:35 user nova-compute[75100]:   <name>instance-00000025</name>
Nov 10 18:03:35 user nova-compute[75100]:   <memory>524288</memory>
Nov 10 18:03:35 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 10 18:03:35 user nova-compute[75100]:   <metadata>
Nov 10 18:03:35 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 18:03:35 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 10 18:03:35 user nova-compute[75100]:       <nova:name>tempest-TestMinimumBasicScenario-server-550712417</nova:name>
Nov 10 18:03:35 user nova-compute[75100]:       <nova:creationTime>2023-11-10 18:03:35</nova:creationTime>
Nov 10 18:03:35 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 10 18:03:35 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 10 18:03:35 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 10 18:03:35 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 10 18:03:35 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 18:03:35 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 10 18:03:35 user nova-compute[75100]:       </nova:flavor>
Nov 10 18:03:35 user nova-compute[75100]:       <nova:owner>
Nov 10 18:03:35 user nova-compute[75100]:         <nova:user uuid="4d873ec5a11a4ccdb868fef673ffc568">tempest-TestMinimumBasicScenario-281006384-project-member</nova:user>
Nov 10 18:03:35 user nova-compute[75100]:         <nova:project uuid="19cfb454e59745bf9c77d7a7ede2bc0e">tempest-TestMinimumBasicScenario-281006384</nova:project>
Nov 10 18:03:35 user nova-compute[75100]:       </nova:owner>
Nov 10 18:03:35 user nova-compute[75100]:       <nova:root type="image" uuid="58ffe2f6-bf44-41f2-8818-788e8006c7a3"/>
Nov 10 18:03:35 user nova-compute[75100]:       <nova:ports>
Nov 10 18:03:35 user nova-compute[75100]:         <nova:port uuid="c19c4cab-962c-4915-806a-9dbffdf4bfa4">
Nov 10 18:03:35 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 10 18:03:35 user nova-compute[75100]:         </nova:port>
Nov 10 18:03:35 user nova-compute[75100]:       </nova:ports>
Nov 10 18:03:35 user nova-compute[75100]:     </nova:instance>
Nov 10 18:03:35 user nova-compute[75100]:   </metadata>
Nov 10 18:03:35 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 10 18:03:35 user nova-compute[75100]:     <system>
Nov 10 18:03:35 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 18:03:35 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 10 18:03:35 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 10 18:03:35 user nova-compute[75100]:       <entry name="serial">1937fab6-d892-406e-b8ff-52194021eea4</entry>
Nov 10 18:03:35 user nova-compute[75100]:       <entry name="uuid">1937fab6-d892-406e-b8ff-52194021eea4</entry>
Nov 10 18:03:35 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 10 18:03:35 user nova-compute[75100]:     </system>
Nov 10 18:03:35 user nova-compute[75100]:   </sysinfo>
Nov 10 18:03:35 user nova-compute[75100]:   <os>
Nov 10 18:03:35 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 18:03:35 user nova-compute[75100]:     <boot dev="hd"/>
Nov 10 18:03:35 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 10 18:03:35 user nova-compute[75100]:   </os>
Nov 10 18:03:35 user nova-compute[75100]:   <features>
Nov 10 18:03:35 user nova-compute[75100]:     <acpi/>
Nov 10 18:03:35 user nova-compute[75100]:     <apic/>
Nov 10 18:03:35 user nova-compute[75100]:     <vmcoreinfo/>
Nov 10 18:03:35 user nova-compute[75100]:   </features>
Nov 10 18:03:35 user nova-compute[75100]:   <clock offset="utc">
Nov 10 18:03:35 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 18:03:35 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 18:03:35 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 10 18:03:35 user nova-compute[75100]:   </clock>
Nov 10 18:03:35 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 10 18:03:35 user nova-compute[75100]:     <model>Nehalem</model>
Nov 10 18:03:35 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 18:03:35 user nova-compute[75100]:   </cpu>
Nov 10 18:03:35 user nova-compute[75100]:   <devices>
Nov 10 18:03:35 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 10 18:03:35 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 18:03:35 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/1937fab6-d892-406e-b8ff-52194021eea4/disk"/>
Nov 10 18:03:35 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 10 18:03:35 user nova-compute[75100]:     </disk>
Nov 10 18:03:35 user nova-compute[75100]:     <interface type="ethernet">
Nov 10 18:03:35 user nova-compute[75100]:       <mac address="fa:16:3e:ba:d7:b9"/>
Nov 10 18:03:35 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 18:03:35 user nova-compute[75100]:       <mtu size="1442"/>
Nov 10 18:03:35 user nova-compute[75100]:       <target dev="tapc19c4cab-96"/>
Nov 10 18:03:35 user nova-compute[75100]:     </interface>
Nov 10 18:03:35 user nova-compute[75100]:     <serial type="pty">
Nov 10 18:03:35 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/1937fab6-d892-406e-b8ff-52194021eea4/console.log" append="off"/>
Nov 10 18:03:35 user nova-compute[75100]:     </serial>
Nov 10 18:03:35 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 18:03:35 user nova-compute[75100]:     <video>
Nov 10 18:03:35 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 18:03:35 user nova-compute[75100]:     </video>
Nov 10 18:03:35 user nova-compute[75100]:     <rng model="virtio">
Nov 10 18:03:35 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 10 18:03:35 user nova-compute[75100]:     </rng>
Nov 10 18:03:35 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 10 18:03:35 user nova-compute[75100]:     <memballoon model="virtio">
Nov 10 18:03:35 user nova-compute[75100]:       <stats period="10"/>
Nov 10 18:03:35 user nova-compute[75100]:     </memballoon>
Nov 10 18:03:35 user nova-compute[75100]:   </devices>
Nov 10 18:03:35 user nova-compute[75100]: </domain>
Nov 10 18:03:35 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 18:03:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:03:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-550712417',display_name='tempest-TestMinimumBasicScenario-server-550712417',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-550712417',id=37,image_ref='58ffe2f6-bf44-41f2-8818-788e8006c7a3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbHMZ/csSY9p+GduPtuiqFIhYNllnC3slobeatmB+uPE9c+Afr9UfpO7kdA+O9NN0RauKt1vhBXu2JQ7B4+8FD+GLdH4CQGjuZaKNVoAdd5YzFm4CKGoGlEpfA3dSUkrg==',key_name='tempest-TestMinimumBasicScenario-1493594938',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='19cfb454e59745bf9c77d7a7ede2bc0e',ramdisk_id='',reservation_id='r-8qlus30s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='58ffe2f6-bf44-41f2-8818-788e8006c7a3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-281006384',owner_user_name='tempest-TestMinimumBasicScenario-281006384-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T18:03:32Z,user_data=None,user_id='4d873ec5a11a4ccdb868fef673ffc568',uuid=1937fab6-d892-406e-b8ff-52194021eea4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c19c4cab-962c-4915-806a-9dbffdf4bfa4", "address": "fa:16:3e:ba:d7:b9", "network": {"id": "78d86418-c0e0-4cc2-8f4f-262f600f7d66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2054827063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19cfb454e59745bf9c77d7a7ede2bc0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc19c4cab-96", "ovs_interfaceid": "c19c4cab-962c-4915-806a-9dbffdf4bfa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 18:03:35 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Converting VIF {"id": "c19c4cab-962c-4915-806a-9dbffdf4bfa4", "address": "fa:16:3e:ba:d7:b9", "network": {"id": "78d86418-c0e0-4cc2-8f4f-262f600f7d66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2054827063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19cfb454e59745bf9c77d7a7ede2bc0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc19c4cab-96", "ovs_interfaceid": "c19c4cab-962c-4915-806a-9dbffdf4bfa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:03:35 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:d7:b9,bridge_name='br-int',has_traffic_filtering=True,id=c19c4cab-962c-4915-806a-9dbffdf4bfa4,network=Network(78d86418-c0e0-4cc2-8f4f-262f600f7d66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc19c4cab-96') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:03:35 user nova-compute[75100]: DEBUG os_vif [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:d7:b9,bridge_name='br-int',has_traffic_filtering=True,id=c19c4cab-962c-4915-806a-9dbffdf4bfa4,network=Network(78d86418-c0e0-4cc2-8f4f-262f600f7d66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc19c4cab-96') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 18:03:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:03:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 18:03:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c580c351-b961-5ab9-a758-c454965cf611', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:03:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:03:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc19c4cab-96, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:03:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc19c4cab-96, col_values=(('qos', UUID('a67125bc-8147-4548-b3b9-361d616f5246')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:03:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc19c4cab-96, col_values=(('external_ids', {'iface-id': 'c19c4cab-962c-4915-806a-9dbffdf4bfa4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:d7:b9', 'vm-uuid': '1937fab6-d892-406e-b8ff-52194021eea4'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:03:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:03:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:35 user nova-compute[75100]: INFO os_vif [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:d7:b9,bridge_name='br-int',has_traffic_filtering=True,id=c19c4cab-962c-4915-806a-9dbffdf4bfa4,network=Network(78d86418-c0e0-4cc2-8f4f-262f600f7d66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc19c4cab-96')
Nov 10 18:03:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 18:03:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] No VIF found with MAC fa:16:3e:ba:d7:b9, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 18:03:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Acquiring lock "refresh_cache-ce634a11-5628-4f1c-8437-95f26519d8a0" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:03:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Acquired lock "refresh_cache-ce634a11-5628-4f1c-8437-95f26519d8a0" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:03:36 user nova-compute[75100]: DEBUG nova.network.neutron [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 18:03:36 user nova-compute[75100]: DEBUG nova.compute.manager [req-c9eea587-3302-42c4-ae25-2fb69a464e8c req-1ea3daad-9e7c-44f2-ba5e-573293eb0e89 service nova] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Received event network-changed-4c3793c8-de6c-4246-9a29-46ac085f065e {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:03:36 user nova-compute[75100]: DEBUG nova.compute.manager [req-c9eea587-3302-42c4-ae25-2fb69a464e8c req-1ea3daad-9e7c-44f2-ba5e-573293eb0e89 service nova] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Refreshing instance network info cache due to event network-changed-4c3793c8-de6c-4246-9a29-46ac085f065e. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 18:03:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c9eea587-3302-42c4-ae25-2fb69a464e8c req-1ea3daad-9e7c-44f2-ba5e-573293eb0e89 service nova] Acquiring lock "refresh_cache-ce634a11-5628-4f1c-8437-95f26519d8a0" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:03:36 user nova-compute[75100]: DEBUG nova.network.neutron [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Updating instance_info_cache with network_info: [{"id": "4c3793c8-de6c-4246-9a29-46ac085f065e", "address": "fa:16:3e:a0:b0:b8", "network": {"id": "7a78ac5d-8f24-436d-9cb9-05f4efecb101", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-476509015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae38bb92c5474a578f3827bdae12cd74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c3793c8-de", "ovs_interfaceid": "4c3793c8-de6c-4246-9a29-46ac085f065e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:03:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Releasing lock "refresh_cache-ce634a11-5628-4f1c-8437-95f26519d8a0" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:03:36 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 18:03:36 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Creating image(s)
Nov 10 18:03:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Acquiring lock "/opt/stack/data/nova/instances/ce634a11-5628-4f1c-8437-95f26519d8a0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:03:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "/opt/stack/data/nova/instances/ce634a11-5628-4f1c-8437-95f26519d8a0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:03:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "/opt/stack/data/nova/instances/ce634a11-5628-4f1c-8437-95f26519d8a0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:03:36 user nova-compute[75100]: DEBUG nova.objects.instance [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lazy-loading 'trusted_certs' on Instance uuid ce634a11-5628-4f1c-8437-95f26519d8a0 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:03:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c9eea587-3302-42c4-ae25-2fb69a464e8c req-1ea3daad-9e7c-44f2-ba5e-573293eb0e89 service nova] Acquired lock "refresh_cache-ce634a11-5628-4f1c-8437-95f26519d8a0" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:03:36 user nova-compute[75100]: DEBUG nova.network.neutron [req-c9eea587-3302-42c4-ae25-2fb69a464e8c req-1ea3daad-9e7c-44f2-ba5e-573293eb0e89 service nova] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Refreshing network info cache for port 4c3793c8-de6c-4246-9a29-46ac085f065e {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 18:03:36 user nova-compute[75100]: DEBUG nova.objects.base [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Object Instance<ce634a11-5628-4f1c-8437-95f26519d8a0> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 18:03:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Acquiring lock "8eedf2b9c68a1e7afb9bdd92ae6b7b46130f810e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:03:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "8eedf2b9c68a1e7afb9bdd92ae6b7b46130f810e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:03:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eedf2b9c68a1e7afb9bdd92ae6b7b46130f810e.part --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:03:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eedf2b9c68a1e7afb9bdd92ae6b7b46130f810e.part --force-share --output=json" returned: 0 in 0.189s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:03:37 user nova-compute[75100]: DEBUG nova.virt.images [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] c01adca2-dcb6-4e30-b51d-19f3266fbe2f was qcow2, converting to raw {{(pid=75100) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 10 18:03:37 user nova-compute[75100]: DEBUG nova.privsep.utils [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75100) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 18:03:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8eedf2b9c68a1e7afb9bdd92ae6b7b46130f810e.part /opt/stack/data/nova/instances/_base/8eedf2b9c68a1e7afb9bdd92ae6b7b46130f810e.converted {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:03:37 user nova-compute[75100]: DEBUG nova.network.neutron [req-c9eea587-3302-42c4-ae25-2fb69a464e8c req-1ea3daad-9e7c-44f2-ba5e-573293eb0e89 service nova] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Updated VIF entry in instance network info cache for port 4c3793c8-de6c-4246-9a29-46ac085f065e. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 18:03:37 user nova-compute[75100]: DEBUG nova.network.neutron [req-c9eea587-3302-42c4-ae25-2fb69a464e8c req-1ea3daad-9e7c-44f2-ba5e-573293eb0e89 service nova] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Updating instance_info_cache with network_info: [{"id": "4c3793c8-de6c-4246-9a29-46ac085f065e", "address": "fa:16:3e:a0:b0:b8", "network": {"id": "7a78ac5d-8f24-436d-9cb9-05f4efecb101", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-476509015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae38bb92c5474a578f3827bdae12cd74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c3793c8-de", "ovs_interfaceid": "4c3793c8-de6c-4246-9a29-46ac085f065e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:03:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c9eea587-3302-42c4-ae25-2fb69a464e8c req-1ea3daad-9e7c-44f2-ba5e-573293eb0e89 service nova] Releasing lock "refresh_cache-ce634a11-5628-4f1c-8437-95f26519d8a0" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:03:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8eedf2b9c68a1e7afb9bdd92ae6b7b46130f810e.part /opt/stack/data/nova/instances/_base/8eedf2b9c68a1e7afb9bdd92ae6b7b46130f810e.converted" returned: 0 in 0.245s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:03:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eedf2b9c68a1e7afb9bdd92ae6b7b46130f810e.converted --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:03:38 user nova-compute[75100]: DEBUG nova.compute.manager [req-87730bf7-7bb5-4ca8-92e7-0896ea14facd req-cae7b9af-4dfa-47b8-af5b-57382687156f service nova] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Received event network-vif-plugged-c19c4cab-962c-4915-806a-9dbffdf4bfa4 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:03:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-87730bf7-7bb5-4ca8-92e7-0896ea14facd req-cae7b9af-4dfa-47b8-af5b-57382687156f service nova] Acquiring lock "1937fab6-d892-406e-b8ff-52194021eea4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:03:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-87730bf7-7bb5-4ca8-92e7-0896ea14facd req-cae7b9af-4dfa-47b8-af5b-57382687156f service nova] Lock "1937fab6-d892-406e-b8ff-52194021eea4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:03:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-87730bf7-7bb5-4ca8-92e7-0896ea14facd req-cae7b9af-4dfa-47b8-af5b-57382687156f service nova] Lock "1937fab6-d892-406e-b8ff-52194021eea4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:03:38 user nova-compute[75100]: DEBUG nova.compute.manager [req-87730bf7-7bb5-4ca8-92e7-0896ea14facd req-cae7b9af-4dfa-47b8-af5b-57382687156f service nova] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] No waiting events found dispatching network-vif-plugged-c19c4cab-962c-4915-806a-9dbffdf4bfa4 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:03:38 user nova-compute[75100]: WARNING nova.compute.manager [req-87730bf7-7bb5-4ca8-92e7-0896ea14facd req-cae7b9af-4dfa-47b8-af5b-57382687156f service nova] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Received unexpected event network-vif-plugged-c19c4cab-962c-4915-806a-9dbffdf4bfa4 for instance with vm_state building and task_state spawning.
Nov 10 18:03:38 user nova-compute[75100]: DEBUG nova.compute.manager [req-87730bf7-7bb5-4ca8-92e7-0896ea14facd req-cae7b9af-4dfa-47b8-af5b-57382687156f service nova] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Received event network-vif-plugged-c19c4cab-962c-4915-806a-9dbffdf4bfa4 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:03:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-87730bf7-7bb5-4ca8-92e7-0896ea14facd req-cae7b9af-4dfa-47b8-af5b-57382687156f service nova] Acquiring lock "1937fab6-d892-406e-b8ff-52194021eea4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:03:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-87730bf7-7bb5-4ca8-92e7-0896ea14facd req-cae7b9af-4dfa-47b8-af5b-57382687156f service nova] Lock "1937fab6-d892-406e-b8ff-52194021eea4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:03:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-87730bf7-7bb5-4ca8-92e7-0896ea14facd req-cae7b9af-4dfa-47b8-af5b-57382687156f service nova] Lock "1937fab6-d892-406e-b8ff-52194021eea4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:03:38 user nova-compute[75100]: DEBUG nova.compute.manager [req-87730bf7-7bb5-4ca8-92e7-0896ea14facd req-cae7b9af-4dfa-47b8-af5b-57382687156f service nova] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] No waiting events found dispatching network-vif-plugged-c19c4cab-962c-4915-806a-9dbffdf4bfa4 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:03:38 user nova-compute[75100]: WARNING nova.compute.manager [req-87730bf7-7bb5-4ca8-92e7-0896ea14facd req-cae7b9af-4dfa-47b8-af5b-57382687156f service nova] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Received unexpected event network-vif-plugged-c19c4cab-962c-4915-806a-9dbffdf4bfa4 for instance with vm_state building and task_state spawning.
Nov 10 18:03:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eedf2b9c68a1e7afb9bdd92ae6b7b46130f810e.converted --force-share --output=json" returned: 0 in 0.255s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:03:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "8eedf2b9c68a1e7afb9bdd92ae6b7b46130f810e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.698s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:03:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eedf2b9c68a1e7afb9bdd92ae6b7b46130f810e --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:03:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eedf2b9c68a1e7afb9bdd92ae6b7b46130f810e --force-share --output=json" returned: 0 in 0.191s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:03:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Acquiring lock "8eedf2b9c68a1e7afb9bdd92ae6b7b46130f810e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:03:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "8eedf2b9c68a1e7afb9bdd92ae6b7b46130f810e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:03:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eedf2b9c68a1e7afb9bdd92ae6b7b46130f810e --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:03:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eedf2b9c68a1e7afb9bdd92ae6b7b46130f810e --force-share --output=json" returned: 0 in 0.183s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:03:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eedf2b9c68a1e7afb9bdd92ae6b7b46130f810e,backing_fmt=raw /opt/stack/data/nova/instances/ce634a11-5628-4f1c-8437-95f26519d8a0/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:03:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eedf2b9c68a1e7afb9bdd92ae6b7b46130f810e,backing_fmt=raw /opt/stack/data/nova/instances/ce634a11-5628-4f1c-8437-95f26519d8a0/disk 1073741824" returned: 0 in 0.052s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:03:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "8eedf2b9c68a1e7afb9bdd92ae6b7b46130f810e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:03:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eedf2b9c68a1e7afb9bdd92ae6b7b46130f810e --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:03:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eedf2b9c68a1e7afb9bdd92ae6b7b46130f810e --force-share --output=json" returned: 0 in 0.205s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:03:38 user nova-compute[75100]: DEBUG nova.objects.instance [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lazy-loading 'migration_context' on Instance uuid ce634a11-5628-4f1c-8437-95f26519d8a0 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:03:38 user nova-compute[75100]: DEBUG nova.objects.base [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Object Instance<ce634a11-5628-4f1c-8437-95f26519d8a0> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 18:03:38 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Rebasing disk image.
Nov 10 18:03:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:03:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.174s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:03:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 -F raw /opt/stack/data/nova/instances/ce634a11-5628-4f1c-8437-95f26519d8a0/disk {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:03:39 user nova-compute[75100]: DEBUG nova.compute.manager [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 18:03:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 18:03:39 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Instance spawned successfully.
Nov 10 18:03:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 18:03:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Acquiring lock "4ebd9d80-365d-4334-8421-3b22a846321a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:03:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "4ebd9d80-365d-4334-8421-3b22a846321a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:03:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:03:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:03:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:03:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:03:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:03:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:03:39 user nova-compute[75100]: DEBUG nova.compute.manager [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 18:03:39 user nova-compute[75100]: INFO nova.compute.manager [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Took 7.00 seconds to spawn the instance on the hypervisor.
Nov 10 18:03:39 user nova-compute[75100]: DEBUG nova.compute.manager [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 18:03:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:03:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:03:39 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 18:03:39 user nova-compute[75100]: INFO nova.compute.claims [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Claim successful on node user
Nov 10 18:03:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:39 user nova-compute[75100]: INFO nova.compute.manager [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Took 8.03 seconds to build instance.
Nov 10 18:03:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-82f147ed-a908-4bf1-af5f-302e25f6f2b5 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "1937fab6-d892-406e-b8ff-52194021eea4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.299s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:03:40 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:03:40 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:03:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.669s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:03:40 user nova-compute[75100]: DEBUG nova.compute.manager [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 18:03:40 user nova-compute[75100]: DEBUG nova.compute.manager [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 18:03:40 user nova-compute[75100]: DEBUG nova.network.neutron [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 18:03:40 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 18:03:40 user nova-compute[75100]: DEBUG nova.compute.manager [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 18:03:40 user nova-compute[75100]: INFO nova.virt.block_device [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Booting with volume 9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 at /dev/vda
Nov 10 18:03:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:40 user nova-compute[75100]: DEBUG os_brick.utils [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:03:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:03:40 user nova-compute[75100]: DEBUG nova.policy [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9f4df424af2343a2a27e869502651216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7bb141ef59487dbb2ce6243c5002af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 18:03:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:03:40 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e41821-a8c5-4be3-98ce-a0d92601f0c6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90b1a229568f\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:03:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:03:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:03:40 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[85cb9ad2-6a0f-45ce-9368-dc03bb37971a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:03:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:03:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:03:40 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[279c2019-f745-41d8-a9db-1858fbd83280]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:03:40 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9517240a-80dc-40a0-8cd6-276eced7c488]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:03:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:03:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 18:03:40 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 18:03:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:03:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 18:03:40 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 18:03:40 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[129dc290-4a8a-45c1-848e-254571e58523]: (4, '') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:03:40 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 18:03:40 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 18:03:40 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 18:03:40 user nova-compute[75100]: DEBUG os_brick.utils [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] <== get_connector_properties: return (175ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90b1a229568f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:03:40 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Updating existing volume attachment record: 7e9255a7-ddda-4ec8-a985-eec2849d3ffd {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 18:03:41 user nova-compute[75100]: DEBUG nova.network.neutron [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Successfully created port: c9011ff5-53de-43f3-be8e-ba86274b2c99 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 18:03:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 -F raw /opt/stack/data/nova/instances/ce634a11-5628-4f1c-8437-95f26519d8a0/disk" returned: 0 in 2.856s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:03:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 18:03:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Ensure instance console log exists: /opt/stack/data/nova/instances/ce634a11-5628-4f1c-8437-95f26519d8a0/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 18:03:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:03:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:03:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:03:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Start _get_guest_xml network_info=[{"id": "4c3793c8-de6c-4246-9a29-46ac085f065e", "address": "fa:16:3e:a0:b0:b8", "network": {"id": "7a78ac5d-8f24-436d-9cb9-05f4efecb101", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-476509015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae38bb92c5474a578f3827bdae12cd74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c3793c8-de", "ovs_interfaceid": "4c3793c8-de6c-4246-9a29-46ac085f065e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='e424c7b90d8f105c5ef6bd6e70a5f25a',container_format='bare',created_at=2023-11-10T18:01:40Z,direct_url=<?>,disk_format='qcow2',id=c01adca2-dcb6-4e30-b51d-19f3266fbe2f,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-727841680-shelved',owner='ae38bb92c5474a578f3827bdae12cd74',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-10T18:01:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'e3cc5321-4d40-49ee-885c-700e14741732'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 18:03:41 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:03:41 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:03:42 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 18:03:42 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 18:03:42 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 18:03:42 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 18:03:42 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 18:03:42 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T17:40:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='e424c7b90d8f105c5ef6bd6e70a5f25a',container_format='bare',created_at=2023-11-10T18:01:40Z,direct_url=<?>,disk_format='qcow2',id=c01adca2-dcb6-4e30-b51d-19f3266fbe2f,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-727841680-shelved',owner='ae38bb92c5474a578f3827bdae12cd74',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-10T18:01:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 18:03:42 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 18:03:42 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 18:03:42 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 18:03:42 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 18:03:42 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 18:03:42 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 18:03:42 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 18:03:42 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 18:03:42 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 18:03:42 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 18:03:42 user nova-compute[75100]: DEBUG nova.objects.instance [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lazy-loading 'vcpu_model' on Instance uuid ce634a11-5628-4f1c-8437-95f26519d8a0 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:03:42 user nova-compute[75100]: DEBUG nova.objects.base [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Object Instance<ce634a11-5628-4f1c-8437-95f26519d8a0> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 18:03:42 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T17:59:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-727841680',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-727841680',id=31,image_ref='c01adca2-dcb6-4e30-b51d-19f3266fbe2f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-461573842',keypairs=<?>,launch_index=0,launched_at=2023-11-10T17:59:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ae38bb92c5474a578f3827bdae12cd74',ramdisk_id='',reservation_id='r-i78hj9rl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2073508773',owner_user_name='tempest-AttachVolumeShelveTestJSON-2073508773-project-member',shelved_at='2023-11-10T18:01:44.334000',shelved_host='user',shelved_image_id='c01adca2-dcb6-4e30-b51d-19f3266fbe2f'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T18:03:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='805917c846f34264b51388bfd9a8413f',uuid=ce634a11-5628-4f1c-8437-95f26519d8a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "4c3793c8-de6c-4246-9a29-46ac085f065e", "address": "fa:16:3e:a0:b0:b8", "network": {"id": "7a78ac5d-8f24-436d-9cb9-05f4efecb101", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-476509015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae38bb92c5474a578f3827bdae12cd74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c3793c8-de", "ovs_interfaceid": "4c3793c8-de6c-4246-9a29-46ac085f065e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 18:03:42 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Converting VIF {"id": "4c3793c8-de6c-4246-9a29-46ac085f065e", "address": "fa:16:3e:a0:b0:b8", "network": {"id": "7a78ac5d-8f24-436d-9cb9-05f4efecb101", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-476509015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae38bb92c5474a578f3827bdae12cd74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c3793c8-de", "ovs_interfaceid": "4c3793c8-de6c-4246-9a29-46ac085f065e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:03:42 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:b0:b8,bridge_name='br-int',has_traffic_filtering=True,id=4c3793c8-de6c-4246-9a29-46ac085f065e,network=Network(7a78ac5d-8f24-436d-9cb9-05f4efecb101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c3793c8-de') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:03:42 user nova-compute[75100]: DEBUG nova.objects.instance [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lazy-loading 'pci_devices' on Instance uuid ce634a11-5628-4f1c-8437-95f26519d8a0 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:03:42 user nova-compute[75100]: DEBUG nova.objects.base [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Object Instance<ce634a11-5628-4f1c-8437-95f26519d8a0> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 18:03:42 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] End _get_guest_xml xml=<domain type="kvm">
Nov 10 18:03:42 user nova-compute[75100]:   <uuid>ce634a11-5628-4f1c-8437-95f26519d8a0</uuid>
Nov 10 18:03:42 user nova-compute[75100]:   <name>instance-0000001f</name>
Nov 10 18:03:42 user nova-compute[75100]:   <memory>524288</memory>
Nov 10 18:03:42 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 10 18:03:42 user nova-compute[75100]:   <metadata>
Nov 10 18:03:42 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 18:03:42 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 10 18:03:42 user nova-compute[75100]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-727841680</nova:name>
Nov 10 18:03:42 user nova-compute[75100]:       <nova:creationTime>2023-11-10 18:03:41</nova:creationTime>
Nov 10 18:03:42 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 10 18:03:42 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 10 18:03:42 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 10 18:03:42 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 10 18:03:42 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 18:03:42 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 10 18:03:42 user nova-compute[75100]:       </nova:flavor>
Nov 10 18:03:42 user nova-compute[75100]:       <nova:owner>
Nov 10 18:03:42 user nova-compute[75100]:         <nova:user uuid="805917c846f34264b51388bfd9a8413f">tempest-AttachVolumeShelveTestJSON-2073508773-project-member</nova:user>
Nov 10 18:03:42 user nova-compute[75100]:         <nova:project uuid="ae38bb92c5474a578f3827bdae12cd74">tempest-AttachVolumeShelveTestJSON-2073508773</nova:project>
Nov 10 18:03:42 user nova-compute[75100]:       </nova:owner>
Nov 10 18:03:42 user nova-compute[75100]:       <nova:root type="image" uuid="c01adca2-dcb6-4e30-b51d-19f3266fbe2f"/>
Nov 10 18:03:42 user nova-compute[75100]:       <nova:ports>
Nov 10 18:03:42 user nova-compute[75100]:         <nova:port uuid="4c3793c8-de6c-4246-9a29-46ac085f065e">
Nov 10 18:03:42 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 10 18:03:42 user nova-compute[75100]:         </nova:port>
Nov 10 18:03:42 user nova-compute[75100]:       </nova:ports>
Nov 10 18:03:42 user nova-compute[75100]:     </nova:instance>
Nov 10 18:03:42 user nova-compute[75100]:   </metadata>
Nov 10 18:03:42 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 10 18:03:42 user nova-compute[75100]:     <system>
Nov 10 18:03:42 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 18:03:42 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 10 18:03:42 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 10 18:03:42 user nova-compute[75100]:       <entry name="serial">ce634a11-5628-4f1c-8437-95f26519d8a0</entry>
Nov 10 18:03:42 user nova-compute[75100]:       <entry name="uuid">ce634a11-5628-4f1c-8437-95f26519d8a0</entry>
Nov 10 18:03:42 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 10 18:03:42 user nova-compute[75100]:     </system>
Nov 10 18:03:42 user nova-compute[75100]:   </sysinfo>
Nov 10 18:03:42 user nova-compute[75100]:   <os>
Nov 10 18:03:42 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 18:03:42 user nova-compute[75100]:     <boot dev="hd"/>
Nov 10 18:03:42 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 10 18:03:42 user nova-compute[75100]:   </os>
Nov 10 18:03:42 user nova-compute[75100]:   <features>
Nov 10 18:03:42 user nova-compute[75100]:     <acpi/>
Nov 10 18:03:42 user nova-compute[75100]:     <apic/>
Nov 10 18:03:42 user nova-compute[75100]:     <vmcoreinfo/>
Nov 10 18:03:42 user nova-compute[75100]:   </features>
Nov 10 18:03:42 user nova-compute[75100]:   <clock offset="utc">
Nov 10 18:03:42 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 18:03:42 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 18:03:42 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 10 18:03:42 user nova-compute[75100]:   </clock>
Nov 10 18:03:42 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 10 18:03:42 user nova-compute[75100]:     <model>Nehalem</model>
Nov 10 18:03:42 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 18:03:42 user nova-compute[75100]:   </cpu>
Nov 10 18:03:42 user nova-compute[75100]:   <devices>
Nov 10 18:03:42 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 10 18:03:42 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 18:03:42 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/ce634a11-5628-4f1c-8437-95f26519d8a0/disk"/>
Nov 10 18:03:42 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 10 18:03:42 user nova-compute[75100]:     </disk>
Nov 10 18:03:42 user nova-compute[75100]:     <interface type="ethernet">
Nov 10 18:03:42 user nova-compute[75100]:       <mac address="fa:16:3e:a0:b0:b8"/>
Nov 10 18:03:42 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 18:03:42 user nova-compute[75100]:       <mtu size="1442"/>
Nov 10 18:03:42 user nova-compute[75100]:       <target dev="tap4c3793c8-de"/>
Nov 10 18:03:42 user nova-compute[75100]:     </interface>
Nov 10 18:03:42 user nova-compute[75100]:     <serial type="pty">
Nov 10 18:03:42 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/ce634a11-5628-4f1c-8437-95f26519d8a0/console.log" append="off"/>
Nov 10 18:03:42 user nova-compute[75100]:     </serial>
Nov 10 18:03:42 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 18:03:42 user nova-compute[75100]:     <video>
Nov 10 18:03:42 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 18:03:42 user nova-compute[75100]:     </video>
Nov 10 18:03:42 user nova-compute[75100]:     <rng model="virtio">
Nov 10 18:03:42 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 10 18:03:42 user nova-compute[75100]:     </rng>
Nov 10 18:03:42 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 10 18:03:42 user nova-compute[75100]:     <memballoon model="virtio">
Nov 10 18:03:42 user nova-compute[75100]:       <stats period="10"/>
Nov 10 18:03:42 user nova-compute[75100]:     </memballoon>
Nov 10 18:03:42 user nova-compute[75100]:   </devices>
Nov 10 18:03:42 user nova-compute[75100]: </domain>
Nov 10 18:03:42 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 18:03:42 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T17:59:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-727841680',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-727841680',id=31,image_ref='c01adca2-dcb6-4e30-b51d-19f3266fbe2f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-461573842',keypairs=<?>,launch_index=0,launched_at=2023-11-10T17:59:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ae38bb92c5474a578f3827bdae12cd74',ramdisk_id='',reservation_id='r-i78hj9rl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2073508773',owner_user_name='tempest-AttachVolumeShelveTestJSON-2073508773-project-member',shelved_at='2023-11-10T18:01:44.334000',shelved_host='user',shelved_image_id='c01adca2-dcb6-4e30-b51d-19f3266fbe2f'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T18:03:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='805917c846f34264b51388bfd9a8413f',uuid=ce634a11-5628-4f1c-8437-95f26519d8a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "4c3793c8-de6c-4246-9a29-46ac085f065e", "address": "fa:16:3e:a0:b0:b8", "network": {"id": "7a78ac5d-8f24-436d-9cb9-05f4efecb101", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-476509015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae38bb92c5474a578f3827bdae12cd74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c3793c8-de", "ovs_interfaceid": "4c3793c8-de6c-4246-9a29-46ac085f065e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 18:03:42 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Converting VIF {"id": "4c3793c8-de6c-4246-9a29-46ac085f065e", "address": "fa:16:3e:a0:b0:b8", "network": {"id": "7a78ac5d-8f24-436d-9cb9-05f4efecb101", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-476509015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae38bb92c5474a578f3827bdae12cd74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c3793c8-de", "ovs_interfaceid": "4c3793c8-de6c-4246-9a29-46ac085f065e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:03:42 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:b0:b8,bridge_name='br-int',has_traffic_filtering=True,id=4c3793c8-de6c-4246-9a29-46ac085f065e,network=Network(7a78ac5d-8f24-436d-9cb9-05f4efecb101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c3793c8-de') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:03:42 user nova-compute[75100]: DEBUG os_vif [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:b0:b8,bridge_name='br-int',has_traffic_filtering=True,id=4c3793c8-de6c-4246-9a29-46ac085f065e,network=Network(7a78ac5d-8f24-436d-9cb9-05f4efecb101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c3793c8-de') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 18:03:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:03:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 18:03:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b9e20245-150f-5392-8614-badcb9c1d508', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:03:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:03:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4c3793c8-de, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:03:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4c3793c8-de, col_values=(('qos', UUID('cc930951-214b-41b1-a9c1-9402c60cc91a')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:03:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4c3793c8-de, col_values=(('external_ids', {'iface-id': '4c3793c8-de6c-4246-9a29-46ac085f065e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:b0:b8', 'vm-uuid': 'ce634a11-5628-4f1c-8437-95f26519d8a0'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:03:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:03:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:42 user nova-compute[75100]: INFO os_vif [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:b0:b8,bridge_name='br-int',has_traffic_filtering=True,id=4c3793c8-de6c-4246-9a29-46ac085f065e,network=Network(7a78ac5d-8f24-436d-9cb9-05f4efecb101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c3793c8-de')
Nov 10 18:03:42 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 18:03:42 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] No VIF found with MAC fa:16:3e:a0:b0:b8, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 18:03:42 user nova-compute[75100]: DEBUG nova.network.neutron [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Successfully updated port: c9011ff5-53de-43f3-be8e-ba86274b2c99 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 18:03:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Acquiring lock "refresh_cache-4ebd9d80-365d-4334-8421-3b22a846321a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:03:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Acquired lock "refresh_cache-4ebd9d80-365d-4334-8421-3b22a846321a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:03:42 user nova-compute[75100]: DEBUG nova.network.neutron [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 18:03:42 user nova-compute[75100]: DEBUG nova.compute.manager [req-c184d137-4e85-431c-8f2c-0c81ed1a25c9 req-0626705d-54af-4f4d-9de2-9f4b021764aa service nova] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Received event network-changed-c9011ff5-53de-43f3-be8e-ba86274b2c99 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:03:42 user nova-compute[75100]: DEBUG nova.compute.manager [req-c184d137-4e85-431c-8f2c-0c81ed1a25c9 req-0626705d-54af-4f4d-9de2-9f4b021764aa service nova] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Refreshing instance network info cache due to event network-changed-c9011ff5-53de-43f3-be8e-ba86274b2c99. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 18:03:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c184d137-4e85-431c-8f2c-0c81ed1a25c9 req-0626705d-54af-4f4d-9de2-9f4b021764aa service nova] Acquiring lock "refresh_cache-4ebd9d80-365d-4334-8421-3b22a846321a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:03:42 user nova-compute[75100]: DEBUG nova.network.neutron [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 18:03:42 user nova-compute[75100]: DEBUG nova.network.neutron [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Updating instance_info_cache with network_info: [{"id": "c9011ff5-53de-43f3-be8e-ba86274b2c99", "address": "fa:16:3e:a7:f8:6b", "network": {"id": "bf1edb58-ef26-40ca-8ec9-853fa05de13d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1416469583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7bb141ef59487dbb2ce6243c5002af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9011ff5-53", "ovs_interfaceid": "c9011ff5-53de-43f3-be8e-ba86274b2c99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:03:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Releasing lock "refresh_cache-4ebd9d80-365d-4334-8421-3b22a846321a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:03:42 user nova-compute[75100]: DEBUG nova.compute.manager [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Instance network_info: |[{"id": "c9011ff5-53de-43f3-be8e-ba86274b2c99", "address": "fa:16:3e:a7:f8:6b", "network": {"id": "bf1edb58-ef26-40ca-8ec9-853fa05de13d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1416469583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7bb141ef59487dbb2ce6243c5002af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9011ff5-53", "ovs_interfaceid": "c9011ff5-53de-43f3-be8e-ba86274b2c99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 18:03:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c184d137-4e85-431c-8f2c-0c81ed1a25c9 req-0626705d-54af-4f4d-9de2-9f4b021764aa service nova] Acquired lock "refresh_cache-4ebd9d80-365d-4334-8421-3b22a846321a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:03:42 user nova-compute[75100]: DEBUG nova.network.neutron [req-c184d137-4e85-431c-8f2c-0c81ed1a25c9 req-0626705d-54af-4f4d-9de2-9f4b021764aa service nova] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Refreshing network info cache for port c9011ff5-53de-43f3-be8e-ba86274b2c99 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 18:03:43 user nova-compute[75100]: DEBUG nova.network.neutron [req-c184d137-4e85-431c-8f2c-0c81ed1a25c9 req-0626705d-54af-4f4d-9de2-9f4b021764aa service nova] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Updated VIF entry in instance network info cache for port c9011ff5-53de-43f3-be8e-ba86274b2c99. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 18:03:43 user nova-compute[75100]: DEBUG nova.network.neutron [req-c184d137-4e85-431c-8f2c-0c81ed1a25c9 req-0626705d-54af-4f4d-9de2-9f4b021764aa service nova] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Updating instance_info_cache with network_info: [{"id": "c9011ff5-53de-43f3-be8e-ba86274b2c99", "address": "fa:16:3e:a7:f8:6b", "network": {"id": "bf1edb58-ef26-40ca-8ec9-853fa05de13d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1416469583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7bb141ef59487dbb2ce6243c5002af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9011ff5-53", "ovs_interfaceid": "c9011ff5-53de-43f3-be8e-ba86274b2c99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:03:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c184d137-4e85-431c-8f2c-0c81ed1a25c9 req-0626705d-54af-4f4d-9de2-9f4b021764aa service nova] Releasing lock "refresh_cache-4ebd9d80-365d-4334-8421-3b22a846321a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:03:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:44 user nova-compute[75100]: DEBUG nova.compute.manager [req-6d1987a5-0311-4eb5-a325-a1a2592d4460 req-e169a086-a70f-49c4-bff3-6923450a5489 service nova] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Received event network-vif-plugged-4c3793c8-de6c-4246-9a29-46ac085f065e {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:03:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6d1987a5-0311-4eb5-a325-a1a2592d4460 req-e169a086-a70f-49c4-bff3-6923450a5489 service nova] Acquiring lock "ce634a11-5628-4f1c-8437-95f26519d8a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:03:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6d1987a5-0311-4eb5-a325-a1a2592d4460 req-e169a086-a70f-49c4-bff3-6923450a5489 service nova] Lock "ce634a11-5628-4f1c-8437-95f26519d8a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:03:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6d1987a5-0311-4eb5-a325-a1a2592d4460 req-e169a086-a70f-49c4-bff3-6923450a5489 service nova] Lock "ce634a11-5628-4f1c-8437-95f26519d8a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:03:44 user nova-compute[75100]: DEBUG nova.compute.manager [req-6d1987a5-0311-4eb5-a325-a1a2592d4460 req-e169a086-a70f-49c4-bff3-6923450a5489 service nova] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] No waiting events found dispatching network-vif-plugged-4c3793c8-de6c-4246-9a29-46ac085f065e {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:03:44 user nova-compute[75100]: WARNING nova.compute.manager [req-6d1987a5-0311-4eb5-a325-a1a2592d4460 req-e169a086-a70f-49c4-bff3-6923450a5489 service nova] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Received unexpected event network-vif-plugged-4c3793c8-de6c-4246-9a29-46ac085f065e for instance with vm_state shelved_offloaded and task_state spawning.
Nov 10 18:03:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:46 user nova-compute[75100]: DEBUG nova.compute.manager [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 18:03:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 18:03:46 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Instance spawned successfully.
Nov 10 18:03:46 user nova-compute[75100]: DEBUG nova.compute.manager [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 18:03:46 user nova-compute[75100]: DEBUG nova.compute.manager [req-9451b7fa-664d-4a40-bcee-2d3022aab654 req-a555f856-a7dc-4481-8120-9a890a8174ae service nova] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Received event network-vif-plugged-4c3793c8-de6c-4246-9a29-46ac085f065e {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:03:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9451b7fa-664d-4a40-bcee-2d3022aab654 req-a555f856-a7dc-4481-8120-9a890a8174ae service nova] Acquiring lock "ce634a11-5628-4f1c-8437-95f26519d8a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:03:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9451b7fa-664d-4a40-bcee-2d3022aab654 req-a555f856-a7dc-4481-8120-9a890a8174ae service nova] Lock "ce634a11-5628-4f1c-8437-95f26519d8a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:03:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9451b7fa-664d-4a40-bcee-2d3022aab654 req-a555f856-a7dc-4481-8120-9a890a8174ae service nova] Lock "ce634a11-5628-4f1c-8437-95f26519d8a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:03:46 user nova-compute[75100]: DEBUG nova.compute.manager [req-9451b7fa-664d-4a40-bcee-2d3022aab654 req-a555f856-a7dc-4481-8120-9a890a8174ae service nova] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] No waiting events found dispatching network-vif-plugged-4c3793c8-de6c-4246-9a29-46ac085f065e {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:03:46 user nova-compute[75100]: WARNING nova.compute.manager [req-9451b7fa-664d-4a40-bcee-2d3022aab654 req-a555f856-a7dc-4481-8120-9a890a8174ae service nova] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Received unexpected event network-vif-plugged-4c3793c8-de6c-4246-9a29-46ac085f065e for instance with vm_state shelved_offloaded and task_state spawning.
Nov 10 18:03:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-62a1fa96-3f55-4dfe-86e4-63ec1dd98a9e tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "ce634a11-5628-4f1c-8437-95f26519d8a0" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.115s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:03:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:54 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:03:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:04:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:04:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:04:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:04:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-db1f1952-f9c2-46f2-b7fa-dbc3a6357a27 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Acquiring lock "fcc2bfb6-fd6b-4229-9664-42f33b138444" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:04:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-db1f1952-f9c2-46f2-b7fa-dbc3a6357a27 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Lock "fcc2bfb6-fd6b-4229-9664-42f33b138444" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:04:07 user nova-compute[75100]: DEBUG nova.objects.instance [None req-db1f1952-f9c2-46f2-b7fa-dbc3a6357a27 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Lazy-loading 'flavor' on Instance uuid fcc2bfb6-fd6b-4229-9664-42f33b138444 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:04:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-db1f1952-f9c2-46f2-b7fa-dbc3a6357a27 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Lock "fcc2bfb6-fd6b-4229-9664-42f33b138444" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:04:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-db1f1952-f9c2-46f2-b7fa-dbc3a6357a27 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Acquiring lock "fcc2bfb6-fd6b-4229-9664-42f33b138444" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:04:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-db1f1952-f9c2-46f2-b7fa-dbc3a6357a27 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Lock "fcc2bfb6-fd6b-4229-9664-42f33b138444" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:04:08 user nova-compute[75100]: INFO nova.compute.manager [None req-db1f1952-f9c2-46f2-b7fa-dbc3a6357a27 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Attaching volume d4dc8883-7b87-4d41-85cd-d810824c1281 to /dev/vdb
Nov 10 18:04:08 user nova-compute[75100]: DEBUG os_brick.utils [None req-db1f1952-f9c2-46f2-b7fa-dbc3a6357a27 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:04:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:04:08 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c54ad93-5942-4aaa-858f-38adcce5d1fd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90b1a229568f\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:04:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:04:08 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8287deb0-7ec2-4f15-bd9f-f9d8ebe2bb85]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:04:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:04:08 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d852a822-c732-41ec-b5dc-982ee854e325]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:04:08 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[af4017dd-dfa9-4376-a0e2-461918a34e72]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:04:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-db1f1952-f9c2-46f2-b7fa-dbc3a6357a27 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-db1f1952-f9c2-46f2-b7fa-dbc3a6357a27 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 18:04:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-db1f1952-f9c2-46f2-b7fa-dbc3a6357a27 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 18:04:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 18:04:08 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 18:04:08 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f117be6e-e04e-4c5d-8fef-1a2626fa5cb9]: (4, '') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:04:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-db1f1952-f9c2-46f2-b7fa-dbc3a6357a27 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 18:04:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-db1f1952-f9c2-46f2-b7fa-dbc3a6357a27 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 18:04:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-db1f1952-f9c2-46f2-b7fa-dbc3a6357a27 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 18:04:08 user nova-compute[75100]: DEBUG os_brick.utils [None req-db1f1952-f9c2-46f2-b7fa-dbc3a6357a27 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90b1a229568f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:04:08 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-db1f1952-f9c2-46f2-b7fa-dbc3a6357a27 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Updating existing volume attachment record: f02f6c39-f4ca-459a-b0f0-39ef06af38d1 {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 18:04:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:04:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:04:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:04:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:04:16 user nova-compute[75100]: DEBUG nova.compute.manager [req-97c5067d-dcf2-4195-9865-1876a105c4fd req-ae6d7278-4fe5-40d3-93a2-813b611b18af service nova] [instance: 9f115887-d874-4499-b20a-05d4f0623866] Received event network-changed-246d725a-3837-4114-8a55-77503840db0e {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:04:16 user nova-compute[75100]: DEBUG nova.compute.manager [req-97c5067d-dcf2-4195-9865-1876a105c4fd req-ae6d7278-4fe5-40d3-93a2-813b611b18af service nova] [instance: 9f115887-d874-4499-b20a-05d4f0623866] Refreshing instance network info cache due to event network-changed-246d725a-3837-4114-8a55-77503840db0e. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 18:04:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-97c5067d-dcf2-4195-9865-1876a105c4fd req-ae6d7278-4fe5-40d3-93a2-813b611b18af service nova] Acquiring lock "refresh_cache-9f115887-d874-4499-b20a-05d4f0623866" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:04:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-97c5067d-dcf2-4195-9865-1876a105c4fd req-ae6d7278-4fe5-40d3-93a2-813b611b18af service nova] Acquired lock "refresh_cache-9f115887-d874-4499-b20a-05d4f0623866" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:04:16 user nova-compute[75100]: DEBUG nova.network.neutron [req-97c5067d-dcf2-4195-9865-1876a105c4fd req-ae6d7278-4fe5-40d3-93a2-813b611b18af service nova] [instance: 9f115887-d874-4499-b20a-05d4f0623866] Refreshing network info cache for port 246d725a-3837-4114-8a55-77503840db0e {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 18:04:17 user nova-compute[75100]: DEBUG nova.network.neutron [req-97c5067d-dcf2-4195-9865-1876a105c4fd req-ae6d7278-4fe5-40d3-93a2-813b611b18af service nova] [instance: 9f115887-d874-4499-b20a-05d4f0623866] Updated VIF entry in instance network info cache for port 246d725a-3837-4114-8a55-77503840db0e. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 18:04:17 user nova-compute[75100]: DEBUG nova.network.neutron [req-97c5067d-dcf2-4195-9865-1876a105c4fd req-ae6d7278-4fe5-40d3-93a2-813b611b18af service nova] [instance: 9f115887-d874-4499-b20a-05d4f0623866] Updating instance_info_cache with network_info: [{"id": "246d725a-3837-4114-8a55-77503840db0e", "address": "fa:16:3e:1d:ae:19", "network": {"id": "2a85480b-f67d-4ef1-b967-3e93af57d7c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1717495768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9cd441a46aa4a579feff608d6ff9bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap246d725a-38", "ovs_interfaceid": "246d725a-3837-4114-8a55-77503840db0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:04:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-97c5067d-dcf2-4195-9865-1876a105c4fd req-ae6d7278-4fe5-40d3-93a2-813b611b18af service nova] Releasing lock "refresh_cache-9f115887-d874-4499-b20a-05d4f0623866" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:04:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:04:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-776accd2-365a-4669-92b4-db98b26d23a2 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Acquiring lock "9f115887-d874-4499-b20a-05d4f0623866" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:04:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-776accd2-365a-4669-92b4-db98b26d23a2 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "9f115887-d874-4499-b20a-05d4f0623866" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:04:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-776accd2-365a-4669-92b4-db98b26d23a2 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Acquiring lock "9f115887-d874-4499-b20a-05d4f0623866-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:04:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-776accd2-365a-4669-92b4-db98b26d23a2 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "9f115887-d874-4499-b20a-05d4f0623866-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:04:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-776accd2-365a-4669-92b4-db98b26d23a2 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "9f115887-d874-4499-b20a-05d4f0623866-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:04:17 user nova-compute[75100]: INFO nova.compute.manager [None req-776accd2-365a-4669-92b4-db98b26d23a2 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 9f115887-d874-4499-b20a-05d4f0623866] Terminating instance
Nov 10 18:04:17 user nova-compute[75100]: DEBUG nova.compute.manager [None req-776accd2-365a-4669-92b4-db98b26d23a2 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 9f115887-d874-4499-b20a-05d4f0623866] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 18:04:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:04:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:04:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:04:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:04:18 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 9f115887-d874-4499-b20a-05d4f0623866] Instance destroyed successfully.
Nov 10 18:04:18 user nova-compute[75100]: DEBUG nova.objects.instance [None req-776accd2-365a-4669-92b4-db98b26d23a2 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lazy-loading 'resources' on Instance uuid 9f115887-d874-4499-b20a-05d4f0623866 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:04:18 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-776accd2-365a-4669-92b4-db98b26d23a2 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:02:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-237251791',display_name='tempest-TestVolumeBootPattern-server-237251791',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-237251791',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILrjRswgoJPqA+suzoqc8EEXkFg1B3St2cTU0CL5tiD3TI/qO87+FOfxjV/dwwN6UPPBmEGN67tPxZrctQdNsOvA6IRt0kMT8eF3nDG1qAx3cky0fCNWo1RZsce/R29pA==',key_name='tempest-TestVolumeBootPattern-1607857152',keypairs=<?>,launch_index=0,launched_at=2023-11-10T18:02:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b9cd441a46aa4a579feff608d6ff9bb4',ramdisk_id='',reservation_id='r-8tt0t9mz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-706331648',owner_user_name='tempest-TestVolumeBootPattern-706331648-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T18:02:56Z,user_data=None,user_id='323c5738ca424a379f666b4ca60825ac',uuid=9f115887-d874-4499-b20a-05d4f0623866,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "246d725a-3837-4114-8a55-77503840db0e", "address": "fa:16:3e:1d:ae:19", "network": {"id": "2a85480b-f67d-4ef1-b967-3e93af57d7c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1717495768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9cd441a46aa4a579feff608d6ff9bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap246d725a-38", "ovs_interfaceid": "246d725a-3837-4114-8a55-77503840db0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 18:04:18 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-776accd2-365a-4669-92b4-db98b26d23a2 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Converting VIF {"id": "246d725a-3837-4114-8a55-77503840db0e", "address": "fa:16:3e:1d:ae:19", "network": {"id": "2a85480b-f67d-4ef1-b967-3e93af57d7c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1717495768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9cd441a46aa4a579feff608d6ff9bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap246d725a-38", "ovs_interfaceid": "246d725a-3837-4114-8a55-77503840db0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:04:18 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-776accd2-365a-4669-92b4-db98b26d23a2 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1d:ae:19,bridge_name='br-int',has_traffic_filtering=True,id=246d725a-3837-4114-8a55-77503840db0e,network=Network(2a85480b-f67d-4ef1-b967-3e93af57d7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap246d725a-38') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:04:18 user nova-compute[75100]: DEBUG os_vif [None req-776accd2-365a-4669-92b4-db98b26d23a2 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:ae:19,bridge_name='br-int',has_traffic_filtering=True,id=246d725a-3837-4114-8a55-77503840db0e,network=Network(2a85480b-f67d-4ef1-b967-3e93af57d7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap246d725a-38') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 18:04:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:04:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap246d725a-38, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:04:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:04:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:04:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6ee73392-3292-4361-bdf1-88abc3fae8e5) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:04:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:04:18 user nova-compute[75100]: INFO os_vif [None req-776accd2-365a-4669-92b4-db98b26d23a2 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:ae:19,bridge_name='br-int',has_traffic_filtering=True,id=246d725a-3837-4114-8a55-77503840db0e,network=Network(2a85480b-f67d-4ef1-b967-3e93af57d7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap246d725a-38')
Nov 10 18:04:18 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-776accd2-365a-4669-92b4-db98b26d23a2 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 9f115887-d874-4499-b20a-05d4f0623866] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 18:04:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-776accd2-365a-4669-92b4-db98b26d23a2 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, {'target_iqn': 'iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JEPndhyG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:04:18 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-776accd2-365a-4669-92b4-db98b26d23a2 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:04:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-776accd2-365a-4669-92b4-db98b26d23a2 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:04:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-776accd2-365a-4669-92b4-db98b26d23a2 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:04:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:04:18 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9be9f7-430f-466f-b465-31338b4ab329]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:04:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-776accd2-365a-4669-92b4-db98b26d23a2 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 18:04:18 user nova-compute[75100]: No targets found.
Nov 10 18:04:18 user nova-compute[75100]: iSNS:
Nov 10 18:04:18 user nova-compute[75100]: No targets found.
Nov 10 18:04:18 user nova-compute[75100]: STATIC:
Nov 10 18:04:18 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005
Nov 10 18:04:18 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:04:18 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:04:18 user nova-compute[75100]: FIRMWARE:
Nov 10 18:04:18 user nova-compute[75100]: No targets found.
Nov 10 18:04:18 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:04:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-776accd2-365a-4669-92b4-db98b26d23a2 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 18:04:18 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 18:04:18 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 18:04:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-776accd2-365a-4669-92b4-db98b26d23a2 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 18:04:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:04:18 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b38d671-53aa-434d-b9be-00074b19b549]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:04:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:04:18 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c0c292-d549-44b2-9336-48a35bc5b97d]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:04:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-776accd2-365a-4669-92b4-db98b26d23a2 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 (non-flash)
Nov 10 18:04:18 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:04:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-776accd2-365a-4669-92b4-db98b26d23a2 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 (non-flash)
Nov 10 18:04:18 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:04:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-776accd2-365a-4669-92b4-db98b26d23a2 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3d42549d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005'): ({'sdb'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 18:04:18 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-776accd2-365a-4669-92b4-db98b26d23a2 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Removing single pathed devices sdb {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 18:04:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:04:18 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c56fe5-17d5-4e27-9796-d5f9c2c88e6c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:04:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:04:18 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b62228-35c4-4a17-b27d-065fd416838d]: (4, ('ok\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:04:18 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-776accd2-365a-4669-92b4-db98b26d23a2 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Flushing IO for device /dev/sdb {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 18:04:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:04:18 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f53e311-5c27-4b5d-8887-f4511d6811f6]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:04:18 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-776accd2-365a-4669-92b4-db98b26d23a2 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 18:04:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:04:18 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9584d7d-5be2-42e9-9645-dd46bf621d00]: (4, ('1', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:04:18 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-776accd2-365a-4669-92b4-db98b26d23a2 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 18:04:18 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-776accd2-365a-4669-92b4-db98b26d23a2 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 18:04:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-776accd2-365a-4669-92b4-db98b26d23a2 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 18:04:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:04:18 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8b03a8-7fe9-4e69-8656-5e88981d3d85]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:04:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-776accd2-365a-4669-92b4-db98b26d23a2 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:04:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 -p 172.16.0.220:3260 --logout {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:04:18 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb3080b-fc60-484f-b3f7-66d60992b5b8]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:04:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-776accd2-365a-4669-92b4-db98b26d23a2 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005, portal: 172.16.0.220,3260]
Nov 10 18:04:18 user nova-compute[75100]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005, portal: 172.16.0.220,3260] successful.
Nov 10 18:04:18 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:04:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 -p 172.16.0.220:3260 --op delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:04:18 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a85ddc-144a-4b05-b41b-b0c07d4e0a1c]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:04:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-776accd2-365a-4669-92b4-db98b26d23a2 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:04:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-776accd2-365a-4669-92b4-db98b26d23a2 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:04:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-776accd2-365a-4669-92b4-db98b26d23a2 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] <== disconnect_volume: return (323ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:04:18 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-776accd2-365a-4669-92b4-db98b26d23a2 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 9f115887-d874-4499-b20a-05d4f0623866] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 18:04:18 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-776accd2-365a-4669-92b4-db98b26d23a2 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 9f115887-d874-4499-b20a-05d4f0623866] Deleting instance files /opt/stack/data/nova/instances/9f115887-d874-4499-b20a-05d4f0623866_del
Nov 10 18:04:18 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-776accd2-365a-4669-92b4-db98b26d23a2 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 9f115887-d874-4499-b20a-05d4f0623866] Deletion of /opt/stack/data/nova/instances/9f115887-d874-4499-b20a-05d4f0623866_del complete
Nov 10 18:04:18 user nova-compute[75100]: INFO nova.compute.manager [None req-776accd2-365a-4669-92b4-db98b26d23a2 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 9f115887-d874-4499-b20a-05d4f0623866] Took 1.28 seconds to destroy the instance on the hypervisor.
Nov 10 18:04:18 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-776accd2-365a-4669-92b4-db98b26d23a2 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 18:04:18 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: 9f115887-d874-4499-b20a-05d4f0623866] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 18:04:18 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 9f115887-d874-4499-b20a-05d4f0623866] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 18:04:19 user nova-compute[75100]: DEBUG nova.compute.manager [req-a250a23f-5724-4642-8232-86f2830d7e6d req-98cbe863-1aa8-4b72-a2c4-c286e0eeaa5d service nova] [instance: 9f115887-d874-4499-b20a-05d4f0623866] Received event network-vif-unplugged-246d725a-3837-4114-8a55-77503840db0e {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:04:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a250a23f-5724-4642-8232-86f2830d7e6d req-98cbe863-1aa8-4b72-a2c4-c286e0eeaa5d service nova] Acquiring lock "9f115887-d874-4499-b20a-05d4f0623866-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:04:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a250a23f-5724-4642-8232-86f2830d7e6d req-98cbe863-1aa8-4b72-a2c4-c286e0eeaa5d service nova] Lock "9f115887-d874-4499-b20a-05d4f0623866-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:04:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a250a23f-5724-4642-8232-86f2830d7e6d req-98cbe863-1aa8-4b72-a2c4-c286e0eeaa5d service nova] Lock "9f115887-d874-4499-b20a-05d4f0623866-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:04:19 user nova-compute[75100]: DEBUG nova.compute.manager [req-a250a23f-5724-4642-8232-86f2830d7e6d req-98cbe863-1aa8-4b72-a2c4-c286e0eeaa5d service nova] [instance: 9f115887-d874-4499-b20a-05d4f0623866] No waiting events found dispatching network-vif-unplugged-246d725a-3837-4114-8a55-77503840db0e {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:04:19 user nova-compute[75100]: DEBUG nova.compute.manager [req-a250a23f-5724-4642-8232-86f2830d7e6d req-98cbe863-1aa8-4b72-a2c4-c286e0eeaa5d service nova] [instance: 9f115887-d874-4499-b20a-05d4f0623866] Received event network-vif-unplugged-246d725a-3837-4114-8a55-77503840db0e for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 18:04:19 user nova-compute[75100]: DEBUG nova.compute.manager [req-a250a23f-5724-4642-8232-86f2830d7e6d req-98cbe863-1aa8-4b72-a2c4-c286e0eeaa5d service nova] [instance: 9f115887-d874-4499-b20a-05d4f0623866] Received event network-vif-plugged-246d725a-3837-4114-8a55-77503840db0e {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:04:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a250a23f-5724-4642-8232-86f2830d7e6d req-98cbe863-1aa8-4b72-a2c4-c286e0eeaa5d service nova] Acquiring lock "9f115887-d874-4499-b20a-05d4f0623866-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:04:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a250a23f-5724-4642-8232-86f2830d7e6d req-98cbe863-1aa8-4b72-a2c4-c286e0eeaa5d service nova] Lock "9f115887-d874-4499-b20a-05d4f0623866-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:04:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a250a23f-5724-4642-8232-86f2830d7e6d req-98cbe863-1aa8-4b72-a2c4-c286e0eeaa5d service nova] Lock "9f115887-d874-4499-b20a-05d4f0623866-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:04:19 user nova-compute[75100]: DEBUG nova.compute.manager [req-a250a23f-5724-4642-8232-86f2830d7e6d req-98cbe863-1aa8-4b72-a2c4-c286e0eeaa5d service nova] [instance: 9f115887-d874-4499-b20a-05d4f0623866] No waiting events found dispatching network-vif-plugged-246d725a-3837-4114-8a55-77503840db0e {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:04:19 user nova-compute[75100]: WARNING nova.compute.manager [req-a250a23f-5724-4642-8232-86f2830d7e6d req-98cbe863-1aa8-4b72-a2c4-c286e0eeaa5d service nova] [instance: 9f115887-d874-4499-b20a-05d4f0623866] Received unexpected event network-vif-plugged-246d725a-3837-4114-8a55-77503840db0e for instance with vm_state active and task_state deleting.
Nov 10 18:04:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:04:19 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 9f115887-d874-4499-b20a-05d4f0623866] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:04:19 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: 9f115887-d874-4499-b20a-05d4f0623866] Took 1.17 seconds to deallocate network for instance.
Nov 10 18:04:21 user nova-compute[75100]: DEBUG nova.compute.manager [req-5996e822-adba-43d8-b701-40130f0124e7 req-f6fb361b-ef4a-405d-8d54-7ce1076b4f72 service nova] [instance: 9f115887-d874-4499-b20a-05d4f0623866] Received event network-vif-deleted-246d725a-3837-4114-8a55-77503840db0e {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:04:22 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:04:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:04:24 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:04:24 user nova-compute[75100]: DEBUG nova.compute.manager [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 18:04:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 18:04:24 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Creating image(s)
Nov 10 18:04:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Did not create local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 18:04:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Ensure instance console log exists: /opt/stack/data/nova/instances/4ebd9d80-365d-4334-8421-3b22a846321a/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 18:04:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:04:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:04:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:04:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Start _get_guest_xml network_info=[{"id": "c9011ff5-53de-43f3-be8e-ba86274b2c99", "address": "fa:16:3e:a7:f8:6b", "network": {"id": "bf1edb58-ef26-40ca-8ec9-853fa05de13d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1416469583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7bb141ef59487dbb2ce6243c5002af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9011ff5-53", "ovs_interfaceid": "c9011ff5-53de-43f3-be8e-ba86274b2c99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'esQJvHgS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4ebd9d80-365d-4334-8421-3b22a846321a', 'attached_at': '', 'detached_at': '', 'volume_id': '9942ef0e-de84-4e1e-b62b-34ab4d72d5d7', 'serial': '9942ef0e-de84-4e1e-b62b-34ab4d72d5d7'}, 'mount_device': '/dev/vda', 'attachment_id': '7e9255a7-ddda-4ec8-a985-eec2849d3ffd', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 18:04:24 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:04:24 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:04:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 18:04:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 18:04:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 18:04:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 18:04:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 18:04:24 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T17:40:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 18:04:24 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 18:04:24 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 18:04:24 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 18:04:24 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 18:04:24 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 18:04:24 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 18:04:24 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 18:04:24 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 18:04:24 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 18:04:24 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 18:04:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 18:04:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'esQJvHgS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:04:25 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:04:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:04:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:04:25 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:04:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:04:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:04:25 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 18:04:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 -p 172.16.0.220:3260 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:04:25 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6df66b-061d-46c8-adab-f00660a8784e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:04:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 18:04:25 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:04:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:04:25 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e265f0-e4be-4aaf-b277-6a5f59073d41]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7] added\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:04:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7] added
Nov 10 18:04:25 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:04:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:04:25 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af30810-1553-42ec-8a40-e27eb6e1c9a3]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:04:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:04:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:04:25 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[63333493-0079-4d84-a31c-75394fb3328e]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:04:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:04:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v esQJvHgS {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v esQJvHgS" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:04:25 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8d6428-ac04-4f3a-a343-aa6a1956d23b]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:04:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'esQJvHgS'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:04:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:04:25 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c55451-ffd9-4d4f-a2c3-343be4bcb8de]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:04:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:04:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:04:25 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5ea409-aabd-4fdb-8dac-afcc6a2bbc39]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:04:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 10 18:04:25 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:04:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 10 18:04:25 user nova-compute[75100]:  {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:04:25 user nova-compute[75100]: WARNING os_brick.initiator.connectors.iscsi [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 10 18:04:25 user nova-compute[75100]: 
Nov 10 18:04:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 -p 172.16.0.220:3260 --login {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:04:25 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ed69ff-a6fe-47f2-8e3b-f75251206064]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:04:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7, portal: 172.16.0.220,3260]
Nov 10 18:04:25 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7, portal: 172.16.0.220,3260] successful.
Nov 10 18:04:25 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:04:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:04:25 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a763d4bf-d227-498b-90b7-ed901119b1b3]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:04:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:04:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:04:25 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[592d7887-0c9a-48a5-a1eb-f01ae62a28ab]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:04:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)
Nov 10 18:04:25 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:04:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)
Nov 10 18:04:25 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:04:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:04:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 18:04:25 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] HCTL ('33', '-', '-', 0) found on session 25 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 18:04:25 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 18:04:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:04:25 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2998dbb-4cf2-4f38-bebe-7e66a2a653ce]: (4, ('- - 0', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:04:25 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 18:04:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'esQJvHgS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 18:04:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:04:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23261633231656262', 'path': '/dev/sdb'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:04:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23261633231656262', 'path': '/dev/sdb'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 18:04:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:03:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-541372061',display_name='tempest-ServerActionsTestOtherA-server-541372061',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-541372061',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJad9dm/VlgxkcoctzSOteh4UYTuKPNeJ9f0qso9IjuH6DpxTyWo1Jqw77DQ9s/VWyRmakd0roi/G14M/XBa/3VT72t8942zFgmm3ckvSnycGMTUzmFZ+zGnWexds7KMSQ==',key_name='tempest-keypair-1062541421',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce7bb141ef59487dbb2ce6243c5002af',ramdisk_id='',reservation_id='r-bes8zsqu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1364670684',owner_user_name='tempest-ServerActionsTestOtherA-1364670684-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T18:03:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f4df424af2343a2a27e869502651216',uuid=4ebd9d80-365d-4334-8421-3b22a846321a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9011ff5-53de-43f3-be8e-ba86274b2c99", "address": "fa:16:3e:a7:f8:6b", "network": {"id": "bf1edb58-ef26-40ca-8ec9-853fa05de13d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1416469583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7bb141ef59487dbb2ce6243c5002af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9011ff5-53", "ovs_interfaceid": "c9011ff5-53de-43f3-be8e-ba86274b2c99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 18:04:26 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Converting VIF {"id": "c9011ff5-53de-43f3-be8e-ba86274b2c99", "address": "fa:16:3e:a7:f8:6b", "network": {"id": "bf1edb58-ef26-40ca-8ec9-853fa05de13d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1416469583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7bb141ef59487dbb2ce6243c5002af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9011ff5-53", "ovs_interfaceid": "c9011ff5-53de-43f3-be8e-ba86274b2c99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:04:26 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:f8:6b,bridge_name='br-int',has_traffic_filtering=True,id=c9011ff5-53de-43f3-be8e-ba86274b2c99,network=Network(bf1edb58-ef26-40ca-8ec9-853fa05de13d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9011ff5-53') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:04:26 user nova-compute[75100]: DEBUG nova.objects.instance [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lazy-loading 'pci_devices' on Instance uuid 4ebd9d80-365d-4334-8421-3b22a846321a {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:04:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] End _get_guest_xml xml=<domain type="kvm">
Nov 10 18:04:26 user nova-compute[75100]:   <uuid>4ebd9d80-365d-4334-8421-3b22a846321a</uuid>
Nov 10 18:04:26 user nova-compute[75100]:   <name>instance-00000026</name>
Nov 10 18:04:26 user nova-compute[75100]:   <memory>524288</memory>
Nov 10 18:04:26 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 10 18:04:26 user nova-compute[75100]:   <metadata>
Nov 10 18:04:26 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 18:04:26 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 10 18:04:26 user nova-compute[75100]:       <nova:name>tempest-ServerActionsTestOtherA-server-541372061</nova:name>
Nov 10 18:04:26 user nova-compute[75100]:       <nova:creationTime>2023-11-10 18:04:24</nova:creationTime>
Nov 10 18:04:26 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 10 18:04:26 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 10 18:04:26 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 10 18:04:26 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 10 18:04:26 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 18:04:26 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 10 18:04:26 user nova-compute[75100]:       </nova:flavor>
Nov 10 18:04:26 user nova-compute[75100]:       <nova:owner>
Nov 10 18:04:26 user nova-compute[75100]:         <nova:user uuid="9f4df424af2343a2a27e869502651216">tempest-ServerActionsTestOtherA-1364670684-project-member</nova:user>
Nov 10 18:04:26 user nova-compute[75100]:         <nova:project uuid="ce7bb141ef59487dbb2ce6243c5002af">tempest-ServerActionsTestOtherA-1364670684</nova:project>
Nov 10 18:04:26 user nova-compute[75100]:       </nova:owner>
Nov 10 18:04:26 user nova-compute[75100]:       <nova:ports>
Nov 10 18:04:26 user nova-compute[75100]:         <nova:port uuid="c9011ff5-53de-43f3-be8e-ba86274b2c99">
Nov 10 18:04:26 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 10 18:04:26 user nova-compute[75100]:         </nova:port>
Nov 10 18:04:26 user nova-compute[75100]:       </nova:ports>
Nov 10 18:04:26 user nova-compute[75100]:     </nova:instance>
Nov 10 18:04:26 user nova-compute[75100]:   </metadata>
Nov 10 18:04:26 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 10 18:04:26 user nova-compute[75100]:     <system>
Nov 10 18:04:26 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 18:04:26 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 10 18:04:26 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 10 18:04:26 user nova-compute[75100]:       <entry name="serial">4ebd9d80-365d-4334-8421-3b22a846321a</entry>
Nov 10 18:04:26 user nova-compute[75100]:       <entry name="uuid">4ebd9d80-365d-4334-8421-3b22a846321a</entry>
Nov 10 18:04:26 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 10 18:04:26 user nova-compute[75100]:     </system>
Nov 10 18:04:26 user nova-compute[75100]:   </sysinfo>
Nov 10 18:04:26 user nova-compute[75100]:   <os>
Nov 10 18:04:26 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 18:04:26 user nova-compute[75100]:     <boot dev="hd"/>
Nov 10 18:04:26 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 10 18:04:26 user nova-compute[75100]:   </os>
Nov 10 18:04:26 user nova-compute[75100]:   <features>
Nov 10 18:04:26 user nova-compute[75100]:     <acpi/>
Nov 10 18:04:26 user nova-compute[75100]:     <apic/>
Nov 10 18:04:26 user nova-compute[75100]:     <vmcoreinfo/>
Nov 10 18:04:26 user nova-compute[75100]:   </features>
Nov 10 18:04:26 user nova-compute[75100]:   <clock offset="utc">
Nov 10 18:04:26 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 18:04:26 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 18:04:26 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 10 18:04:26 user nova-compute[75100]:   </clock>
Nov 10 18:04:26 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 10 18:04:26 user nova-compute[75100]:     <model>Nehalem</model>
Nov 10 18:04:26 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 18:04:26 user nova-compute[75100]:   </cpu>
Nov 10 18:04:26 user nova-compute[75100]:   <devices>
Nov 10 18:04:26 user nova-compute[75100]:     <disk type="block" device="disk">
Nov 10 18:04:26 user nova-compute[75100]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:04:26 user nova-compute[75100]:       <source dev="/dev/sdb"/>
Nov 10 18:04:26 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 10 18:04:26 user nova-compute[75100]:       <serial>9942ef0e-de84-4e1e-b62b-34ab4d72d5d7</serial>
Nov 10 18:04:26 user nova-compute[75100]:     </disk>
Nov 10 18:04:26 user nova-compute[75100]:     <interface type="ethernet">
Nov 10 18:04:26 user nova-compute[75100]:       <mac address="fa:16:3e:a7:f8:6b"/>
Nov 10 18:04:26 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 18:04:26 user nova-compute[75100]:       <mtu size="1442"/>
Nov 10 18:04:26 user nova-compute[75100]:       <target dev="tapc9011ff5-53"/>
Nov 10 18:04:26 user nova-compute[75100]:     </interface>
Nov 10 18:04:26 user nova-compute[75100]:     <serial type="pty">
Nov 10 18:04:26 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/4ebd9d80-365d-4334-8421-3b22a846321a/console.log" append="off"/>
Nov 10 18:04:26 user nova-compute[75100]:     </serial>
Nov 10 18:04:26 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 18:04:26 user nova-compute[75100]:     <video>
Nov 10 18:04:26 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 18:04:26 user nova-compute[75100]:     </video>
Nov 10 18:04:26 user nova-compute[75100]:     <rng model="virtio">
Nov 10 18:04:26 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 10 18:04:26 user nova-compute[75100]:     </rng>
Nov 10 18:04:26 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 10 18:04:26 user nova-compute[75100]:     <memballoon model="virtio">
Nov 10 18:04:26 user nova-compute[75100]:       <stats period="10"/>
Nov 10 18:04:26 user nova-compute[75100]:     </memballoon>
Nov 10 18:04:26 user nova-compute[75100]:   </devices>
Nov 10 18:04:26 user nova-compute[75100]: </domain>
Nov 10 18:04:26 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 18:04:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:03:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-541372061',display_name='tempest-ServerActionsTestOtherA-server-541372061',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-541372061',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJad9dm/VlgxkcoctzSOteh4UYTuKPNeJ9f0qso9IjuH6DpxTyWo1Jqw77DQ9s/VWyRmakd0roi/G14M/XBa/3VT72t8942zFgmm3ckvSnycGMTUzmFZ+zGnWexds7KMSQ==',key_name='tempest-keypair-1062541421',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce7bb141ef59487dbb2ce6243c5002af',ramdisk_id='',reservation_id='r-bes8zsqu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1364670684',owner_user_name='tempest-ServerActionsTestOtherA-1364670684-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T18:03:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f4df424af2343a2a27e869502651216',uuid=4ebd9d80-365d-4334-8421-3b22a846321a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9011ff5-53de-43f3-be8e-ba86274b2c99", "address": "fa:16:3e:a7:f8:6b", "network": {"id": "bf1edb58-ef26-40ca-8ec9-853fa05de13d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1416469583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7bb141ef59487dbb2ce6243c5002af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9011ff5-53", "ovs_interfaceid": "c9011ff5-53de-43f3-be8e-ba86274b2c99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 18:04:26 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Converting VIF {"id": "c9011ff5-53de-43f3-be8e-ba86274b2c99", "address": "fa:16:3e:a7:f8:6b", "network": {"id": "bf1edb58-ef26-40ca-8ec9-853fa05de13d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1416469583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7bb141ef59487dbb2ce6243c5002af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9011ff5-53", "ovs_interfaceid": "c9011ff5-53de-43f3-be8e-ba86274b2c99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:04:26 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:f8:6b,bridge_name='br-int',has_traffic_filtering=True,id=c9011ff5-53de-43f3-be8e-ba86274b2c99,network=Network(bf1edb58-ef26-40ca-8ec9-853fa05de13d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9011ff5-53') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:04:26 user nova-compute[75100]: DEBUG os_vif [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:f8:6b,bridge_name='br-int',has_traffic_filtering=True,id=c9011ff5-53de-43f3-be8e-ba86274b2c99,network=Network(bf1edb58-ef26-40ca-8ec9-853fa05de13d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9011ff5-53') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 18:04:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:04:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:04:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 18:04:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:04:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2bc1ea4a-9b5b-51df-b684-8e1aeb162e59', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:04:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:04:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:04:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:04:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc9011ff5-53, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:04:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc9011ff5-53, col_values=(('qos', UUID('555be521-61ef-4890-8ed6-20ffcaca4c39')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:04:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc9011ff5-53, col_values=(('external_ids', {'iface-id': 'c9011ff5-53de-43f3-be8e-ba86274b2c99', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:f8:6b', 'vm-uuid': '4ebd9d80-365d-4334-8421-3b22a846321a'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:04:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:04:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:04:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:04:26 user nova-compute[75100]: INFO os_vif [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:f8:6b,bridge_name='br-int',has_traffic_filtering=True,id=c9011ff5-53de-43f3-be8e-ba86274b2c99,network=Network(bf1edb58-ef26-40ca-8ec9-853fa05de13d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9011ff5-53')
Nov 10 18:04:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 18:04:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] No VIF found with MAC fa:16:3e:a7:f8:6b, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 18:04:26 user nova-compute[75100]: INFO nova.compute.manager [None req-776accd2-365a-4669-92b4-db98b26d23a2 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: 9f115887-d874-4499-b20a-05d4f0623866] Took 6.81 seconds to detach 1 volumes for instance.
Nov 10 18:04:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-776accd2-365a-4669-92b4-db98b26d23a2 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:04:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-776accd2-365a-4669-92b4-db98b26d23a2 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:04:26 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-776accd2-365a-4669-92b4-db98b26d23a2 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:04:26 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-776accd2-365a-4669-92b4-db98b26d23a2 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:04:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-776accd2-365a-4669-92b4-db98b26d23a2 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.300s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:04:26 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-776accd2-365a-4669-92b4-db98b26d23a2 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Deleted allocations for instance 9f115887-d874-4499-b20a-05d4f0623866
Nov 10 18:04:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-776accd2-365a-4669-92b4-db98b26d23a2 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "9f115887-d874-4499-b20a-05d4f0623866" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.742s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:04:27 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:04:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:04:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:04:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:04:27 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 18:04:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:04:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:04:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:04:28 user nova-compute[75100]: DEBUG nova.compute.manager [req-b0722641-1b5c-49b1-b547-dc0f122eecfc req-b96b905d-227e-4937-ba48-ec73842aa098 service nova] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Received event network-vif-plugged-c9011ff5-53de-43f3-be8e-ba86274b2c99 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:04:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b0722641-1b5c-49b1-b547-dc0f122eecfc req-b96b905d-227e-4937-ba48-ec73842aa098 service nova] Acquiring lock "4ebd9d80-365d-4334-8421-3b22a846321a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:04:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b0722641-1b5c-49b1-b547-dc0f122eecfc req-b96b905d-227e-4937-ba48-ec73842aa098 service nova] Lock "4ebd9d80-365d-4334-8421-3b22a846321a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:04:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b0722641-1b5c-49b1-b547-dc0f122eecfc req-b96b905d-227e-4937-ba48-ec73842aa098 service nova] Lock "4ebd9d80-365d-4334-8421-3b22a846321a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:04:28 user nova-compute[75100]: DEBUG nova.compute.manager [req-b0722641-1b5c-49b1-b547-dc0f122eecfc req-b96b905d-227e-4937-ba48-ec73842aa098 service nova] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] No waiting events found dispatching network-vif-plugged-c9011ff5-53de-43f3-be8e-ba86274b2c99 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:04:28 user nova-compute[75100]: WARNING nova.compute.manager [req-b0722641-1b5c-49b1-b547-dc0f122eecfc req-b96b905d-227e-4937-ba48-ec73842aa098 service nova] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Received unexpected event network-vif-plugged-c9011ff5-53de-43f3-be8e-ba86274b2c99 for instance with vm_state building and task_state spawning.
Nov 10 18:04:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:04:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:04:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5194f111-ba1a-43bc-9564-b744d1960307/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5194f111-ba1a-43bc-9564-b744d1960307/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:04:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5194f111-ba1a-43bc-9564-b744d1960307/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5194f111-ba1a-43bc-9564-b744d1960307/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:04:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0bae328-2528-4562-850b-14fa108923c6/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0bae328-2528-4562-850b-14fa108923c6/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:04:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0bae328-2528-4562-850b-14fa108923c6/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0bae328-2528-4562-850b-14fa108923c6/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:04:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:04:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:04:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:04:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce634a11-5628-4f1c-8437-95f26519d8a0/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce634a11-5628-4f1c-8437-95f26519d8a0/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:04:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce634a11-5628-4f1c-8437-95f26519d8a0/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce634a11-5628-4f1c-8437-95f26519d8a0/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:04:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1937fab6-d892-406e-b8ff-52194021eea4/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:30 user nova-compute[75100]: DEBUG nova.compute.manager [req-104f11f0-5e4e-4454-ad09-9e4744997641 req-96d285ed-d032-4559-b615-5abfb9146a6f service nova] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Received event network-vif-plugged-c9011ff5-53de-43f3-be8e-ba86274b2c99 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:04:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-104f11f0-5e4e-4454-ad09-9e4744997641 req-96d285ed-d032-4559-b615-5abfb9146a6f service nova] Acquiring lock "4ebd9d80-365d-4334-8421-3b22a846321a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:04:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-104f11f0-5e4e-4454-ad09-9e4744997641 req-96d285ed-d032-4559-b615-5abfb9146a6f service nova] Lock "4ebd9d80-365d-4334-8421-3b22a846321a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:04:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-104f11f0-5e4e-4454-ad09-9e4744997641 req-96d285ed-d032-4559-b615-5abfb9146a6f service nova] Lock "4ebd9d80-365d-4334-8421-3b22a846321a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:04:30 user nova-compute[75100]: DEBUG nova.compute.manager [req-104f11f0-5e4e-4454-ad09-9e4744997641 req-96d285ed-d032-4559-b615-5abfb9146a6f service nova] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] No waiting events found dispatching network-vif-plugged-c9011ff5-53de-43f3-be8e-ba86274b2c99 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:04:30 user nova-compute[75100]: WARNING nova.compute.manager [req-104f11f0-5e4e-4454-ad09-9e4744997641 req-96d285ed-d032-4559-b615-5abfb9146a6f service nova] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Received unexpected event network-vif-plugged-c9011ff5-53de-43f3-be8e-ba86274b2c99 for instance with vm_state building and task_state spawning.
Nov 10 18:04:30 user nova-compute[75100]: DEBUG nova.compute.manager [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 18:04:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 18:04:30 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Instance spawned successfully.
Nov 10 18:04:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 18:04:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:04:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:04:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:04:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:04:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:04:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:04:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1937fab6-d892-406e-b8ff-52194021eea4/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:04:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1937fab6-d892-406e-b8ff-52194021eea4/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:30 user nova-compute[75100]: INFO nova.compute.manager [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Took 5.30 seconds to spawn the instance on the hypervisor.
Nov 10 18:04:30 user nova-compute[75100]: DEBUG nova.compute.manager [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 18:04:30 user nova-compute[75100]: INFO nova.compute.manager [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Took 50.98 seconds to build instance.
Nov 10 18:04:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-cfc419ae-496a-4954-9852-d5fcb61b5b85 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "4ebd9d80-365d-4334-8421-3b22a846321a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 51.098s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:04:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1937fab6-d892-406e-b8ff-52194021eea4/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:04:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dabb40d-299b-4c8a-bc92-63e5c0932047/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dabb40d-299b-4c8a-bc92-63e5c0932047/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:04:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dabb40d-299b-4c8a-bc92-63e5c0932047/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dabb40d-299b-4c8a-bc92-63e5c0932047/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:04:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc2bfb6-fd6b-4229-9664-42f33b138444/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc2bfb6-fd6b-4229-9664-42f33b138444/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:04:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc2bfb6-fd6b-4229-9664-42f33b138444/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc2bfb6-fd6b-4229-9664-42f33b138444/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:04:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 18:04:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:04:31 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:04:31 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:04:31 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Hypervisor/Node resource view: name=user free_ram=7721MB free_disk=24.361743927001953GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 18:04:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:04:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:04:31 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:04:31 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance fcc2bfb6-fd6b-4229-9664-42f33b138444 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:04:31 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 9dabb40d-299b-4c8a-bc92-63e5c0932047 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:04:31 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 5194f111-ba1a-43bc-9564-b744d1960307 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:04:31 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance b0bae328-2528-4562-850b-14fa108923c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:04:31 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 1937fab6-d892-406e-b8ff-52194021eea4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:04:31 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance ce634a11-5628-4f1c-8437-95f26519d8a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:04:31 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 4ebd9d80-365d-4334-8421-3b22a846321a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:04:31 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 18:04:31 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 18:04:32 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:04:32 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:04:32 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 18:04:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.403s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:04:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db1f1952-f9c2-46f2-b7fa-dbc3a6357a27 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 18:04:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1f1952-f9c2-46f2-b7fa-dbc3a6357a27 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OEmBVZoT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:04:33 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-db1f1952-f9c2-46f2-b7fa-dbc3a6357a27 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:04:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-db1f1952-f9c2-46f2-b7fa-dbc3a6357a27 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:04:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-db1f1952-f9c2-46f2-b7fa-dbc3a6357a27 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:04:33 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-db1f1952-f9c2-46f2-b7fa-dbc3a6357a27 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:04:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-db1f1952-f9c2-46f2-b7fa-dbc3a6357a27 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:04:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-db1f1952-f9c2-46f2-b7fa-dbc3a6357a27 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:04:33 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-db1f1952-f9c2-46f2-b7fa-dbc3a6357a27 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 18:04:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 -p 172.16.0.220:3260 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:04:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0082da-7f2a-4d80-97f1-05f57ce8b1ce]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:04:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1f1952-f9c2-46f2-b7fa-dbc3a6357a27 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 18:04:33 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:04:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 -p 172.16.0.220:3260 --interface default --op new {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:04:34 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a71f609-eca1-49d8-ac89-73acac50470f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281] added\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:04:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1f1952-f9c2-46f2-b7fa-dbc3a6357a27 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281] added
Nov 10 18:04:34 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:04:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:04:34 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d78059-c44f-470e-b3fe-e8d00b97e666]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:04:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1f1952-f9c2-46f2-b7fa-dbc3a6357a27 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:04:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:04:34 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af09b4d-b30b-4f04-bfbb-f4a0b1c80e2c]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:04:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1f1952-f9c2-46f2-b7fa-dbc3a6357a27 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:04:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OEmBVZoT {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OEmBVZoT" returned: 0 in 0.027s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:04:34 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b49a435-a6fd-4013-8b82-4ab9366869c2]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:04:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1f1952-f9c2-46f2-b7fa-dbc3a6357a27 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OEmBVZoT'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:04:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:04:34 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5768a320-0f6d-48db-a803-bac51d25fb80]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:04:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1f1952-f9c2-46f2-b7fa-dbc3a6357a27 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:04:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:04:34 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f366ee34-12bf-41d1-a8c4-b691cfd3e0d2]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:04:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1f1952-f9c2-46f2-b7fa-dbc3a6357a27 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)
Nov 10 18:04:34 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:04:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1f1952-f9c2-46f2-b7fa-dbc3a6357a27 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)
Nov 10 18:04:34 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:04:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 -p 172.16.0.220:3260 --login {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:34 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:04:34 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:04:34 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:04:34 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:04:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:04:34 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f53a419-6a8a-4cfc-bb15-2cfea6a8c677]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:04:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1f1952-f9c2-46f2-b7fa-dbc3a6357a27 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281, portal: 172.16.0.220,3260]
Nov 10 18:04:34 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281, portal: 172.16.0.220,3260] successful.
Nov 10 18:04:34 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:04:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:04:34 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9508a74-91e1-4224-94a5-60a205d0bcc1]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:04:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1f1952-f9c2-46f2-b7fa-dbc3a6357a27 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:04:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:04:34 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4064637-be3b-4eed-ab4e-388e7379d548]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:04:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1f1952-f9c2-46f2-b7fa-dbc3a6357a27 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)
Nov 10 18:04:34 user nova-compute[75100]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 (non-flash)
Nov 10 18:04:34 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:04:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1f1952-f9c2-46f2-b7fa-dbc3a6357a27 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)
Nov 10 18:04:34 user nova-compute[75100]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 (non-flash)
Nov 10 18:04:34 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:04:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-db1f1952-f9c2-46f2-b7fa-dbc3a6357a27 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:04:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1f1952-f9c2-46f2-b7fa-dbc3a6357a27 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 18:04:34 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-db1f1952-f9c2-46f2-b7fa-dbc3a6357a27 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] HCTL ('34', '-', '-', 0) found on session 26 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 18:04:34 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-db1f1952-f9c2-46f2-b7fa-dbc3a6357a27 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 18:04:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:04:34 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5d1b91-3abc-447f-8fa5-47247d4b1735]: (4, ('- - 0', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:04:34 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-db1f1952-f9c2-46f2-b7fa-dbc3a6357a27 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Searching for a device in session 26 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 18:04:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1f1952-f9c2-46f2-b7fa-dbc3a6357a27 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OEmBVZoT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 18:04:35 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-db1f1952-f9c2-46f2-b7fa-dbc3a6357a27 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:04:35 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1f1952-f9c2-46f2-b7fa-dbc3a6357a27 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '26233636331383466', 'path': '/dev/sdc'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:04:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db1f1952-f9c2-46f2-b7fa-dbc3a6357a27 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233636331383466', 'path': '/dev/sdc'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 18:04:35 user nova-compute[75100]: DEBUG nova.objects.instance [None req-db1f1952-f9c2-46f2-b7fa-dbc3a6357a27 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Lazy-loading 'flavor' on Instance uuid fcc2bfb6-fd6b-4229-9664-42f33b138444 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:04:35 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:04:35 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 18:04:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-db1f1952-f9c2-46f2-b7fa-dbc3a6357a27 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 18:04:35 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:04:35 user nova-compute[75100]:   <source dev="/dev/sdc"/>
Nov 10 18:04:35 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 18:04:35 user nova-compute[75100]:   <serial>d4dc8883-7b87-4d41-85cd-d810824c1281</serial>
Nov 10 18:04:35 user nova-compute[75100]: </disk>
Nov 10 18:04:35 user nova-compute[75100]:  {{(pid=75100) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 18:04:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-db1f1952-f9c2-46f2-b7fa-dbc3a6357a27 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 18:04:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-db1f1952-f9c2-46f2-b7fa-dbc3a6357a27 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 18:04:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-db1f1952-f9c2-46f2-b7fa-dbc3a6357a27 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] No VIF found with MAC fa:16:3e:be:ec:38, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 18:04:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-db1f1952-f9c2-46f2-b7fa-dbc3a6357a27 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Lock "fcc2bfb6-fd6b-4229-9664-42f33b138444" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.024s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:04:36 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:04:36 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 18:04:36 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Rebuilding the list of instances to heal {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 18:04:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "refresh_cache-22c021d9-c8e4-455d-8e2a-a9cdfbb38f75" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:04:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquired lock "refresh_cache-22c021d9-c8e4-455d-8e2a-a9cdfbb38f75" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:04:36 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 18:04:36 user nova-compute[75100]: DEBUG nova.objects.instance [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lazy-loading 'info_cache' on Instance uuid 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:04:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:04:36 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Updating instance_info_cache with network_info: [{"id": "9855a14c-55c7-4a35-a4cc-7085dfbda684", "address": "fa:16:3e:02:b1:a1", "network": {"id": "bf1edb58-ef26-40ca-8ec9-853fa05de13d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1416469583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7bb141ef59487dbb2ce6243c5002af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9855a14c-55", "ovs_interfaceid": "9855a14c-55c7-4a35-a4cc-7085dfbda684", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:04:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Releasing lock "refresh_cache-22c021d9-c8e4-455d-8e2a-a9cdfbb38f75" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:04:36 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 18:04:36 user nova-compute[75100]: INFO nova.compute.manager [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Rescuing
Nov 10 18:04:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Acquiring lock "refresh_cache-fcc2bfb6-fd6b-4229-9664-42f33b138444" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:04:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Acquired lock "refresh_cache-fcc2bfb6-fd6b-4229-9664-42f33b138444" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:04:36 user nova-compute[75100]: DEBUG nova.network.neutron [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 18:04:37 user nova-compute[75100]: DEBUG nova.network.neutron [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Updating instance_info_cache with network_info: [{"id": "8c7dcf78-fc4a-4fcb-905e-ce75143a9450", "address": "fa:16:3e:be:ec:38", "network": {"id": "20522623-c29d-44f8-9047-68dde7f763c1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1770250829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2871e8755b32497d901be0f062fad858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7dcf78-fc", "ovs_interfaceid": "8c7dcf78-fc4a-4fcb-905e-ce75143a9450", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:04:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Releasing lock "refresh_cache-fcc2bfb6-fd6b-4229-9664-42f33b138444" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:04:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:04:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:04:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:04:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:04:37 user nova-compute[75100]: DEBUG nova.compute.manager [req-924f507a-37fc-4331-b324-a019ec703e92 req-fd7b5b33-dce1-41d0-a176-af368864bbd9 service nova] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Received event network-vif-unplugged-8c7dcf78-fc4a-4fcb-905e-ce75143a9450 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:04:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-924f507a-37fc-4331-b324-a019ec703e92 req-fd7b5b33-dce1-41d0-a176-af368864bbd9 service nova] Acquiring lock "fcc2bfb6-fd6b-4229-9664-42f33b138444-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:04:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-924f507a-37fc-4331-b324-a019ec703e92 req-fd7b5b33-dce1-41d0-a176-af368864bbd9 service nova] Lock "fcc2bfb6-fd6b-4229-9664-42f33b138444-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:04:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-924f507a-37fc-4331-b324-a019ec703e92 req-fd7b5b33-dce1-41d0-a176-af368864bbd9 service nova] Lock "fcc2bfb6-fd6b-4229-9664-42f33b138444-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:04:37 user nova-compute[75100]: DEBUG nova.compute.manager [req-924f507a-37fc-4331-b324-a019ec703e92 req-fd7b5b33-dce1-41d0-a176-af368864bbd9 service nova] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] No waiting events found dispatching network-vif-unplugged-8c7dcf78-fc4a-4fcb-905e-ce75143a9450 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:04:37 user nova-compute[75100]: WARNING nova.compute.manager [req-924f507a-37fc-4331-b324-a019ec703e92 req-fd7b5b33-dce1-41d0-a176-af368864bbd9 service nova] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Received unexpected event network-vif-unplugged-8c7dcf78-fc4a-4fcb-905e-ce75143a9450 for instance with vm_state active and task_state rescuing.
Nov 10 18:04:38 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Instance destroyed successfully.
Nov 10 18:04:38 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Attempting a stable device rescue
Nov 10 18:04:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75100) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 10 18:04:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Instance directory exists: not creating {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 10 18:04:38 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Creating image(s)
Nov 10 18:04:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Acquiring lock "/opt/stack/data/nova/instances/fcc2bfb6-fd6b-4229-9664-42f33b138444/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:04:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Lock "/opt/stack/data/nova/instances/fcc2bfb6-fd6b-4229-9664-42f33b138444/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:04:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Lock "/opt/stack/data/nova/instances/fcc2bfb6-fd6b-4229-9664-42f33b138444/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.024s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:04:38 user nova-compute[75100]: DEBUG nova.objects.instance [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Lazy-loading 'trusted_certs' on Instance uuid fcc2bfb6-fd6b-4229-9664-42f33b138444 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:04:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Acquiring lock "459501bcfccfaec0db1be9fbec75d5813f56216d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:04:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Lock "459501bcfccfaec0db1be9fbec75d5813f56216d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.004s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:04:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/459501bcfccfaec0db1be9fbec75d5813f56216d.part --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:39 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:04:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/459501bcfccfaec0db1be9fbec75d5813f56216d.part --force-share --output=json" returned: 0 in 0.185s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:04:39 user nova-compute[75100]: DEBUG nova.virt.images [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] 71837eac-5af6-43af-b782-0d078fd28244 was qcow2, converting to raw {{(pid=75100) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 10 18:04:39 user nova-compute[75100]: DEBUG nova.privsep.utils [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75100) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 18:04:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/459501bcfccfaec0db1be9fbec75d5813f56216d.part /opt/stack/data/nova/instances/_base/459501bcfccfaec0db1be9fbec75d5813f56216d.converted {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:39 user nova-compute[75100]: DEBUG nova.compute.manager [req-108cb41a-9b19-4c97-ba75-2e313c33fe0b req-c0264b95-864e-44e1-b19e-48fcb02e202d service nova] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Received event network-vif-plugged-8c7dcf78-fc4a-4fcb-905e-ce75143a9450 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:04:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-108cb41a-9b19-4c97-ba75-2e313c33fe0b req-c0264b95-864e-44e1-b19e-48fcb02e202d service nova] Acquiring lock "fcc2bfb6-fd6b-4229-9664-42f33b138444-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:04:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-108cb41a-9b19-4c97-ba75-2e313c33fe0b req-c0264b95-864e-44e1-b19e-48fcb02e202d service nova] Lock "fcc2bfb6-fd6b-4229-9664-42f33b138444-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:04:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-108cb41a-9b19-4c97-ba75-2e313c33fe0b req-c0264b95-864e-44e1-b19e-48fcb02e202d service nova] Lock "fcc2bfb6-fd6b-4229-9664-42f33b138444-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:04:39 user nova-compute[75100]: DEBUG nova.compute.manager [req-108cb41a-9b19-4c97-ba75-2e313c33fe0b req-c0264b95-864e-44e1-b19e-48fcb02e202d service nova] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] No waiting events found dispatching network-vif-plugged-8c7dcf78-fc4a-4fcb-905e-ce75143a9450 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:04:39 user nova-compute[75100]: WARNING nova.compute.manager [req-108cb41a-9b19-4c97-ba75-2e313c33fe0b req-c0264b95-864e-44e1-b19e-48fcb02e202d service nova] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Received unexpected event network-vif-plugged-8c7dcf78-fc4a-4fcb-905e-ce75143a9450 for instance with vm_state active and task_state rescuing.
Nov 10 18:04:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/459501bcfccfaec0db1be9fbec75d5813f56216d.part /opt/stack/data/nova/instances/_base/459501bcfccfaec0db1be9fbec75d5813f56216d.converted" returned: 0 in 0.481s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:04:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/459501bcfccfaec0db1be9fbec75d5813f56216d.converted --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/459501bcfccfaec0db1be9fbec75d5813f56216d.converted --force-share --output=json" returned: 0 in 0.197s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Lock "459501bcfccfaec0db1be9fbec75d5813f56216d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.895s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Acquiring lock "459501bcfccfaec0db1be9fbec75d5813f56216d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Lock "459501bcfccfaec0db1be9fbec75d5813f56216d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/459501bcfccfaec0db1be9fbec75d5813f56216d --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/459501bcfccfaec0db1be9fbec75d5813f56216d --force-share --output=json" returned: 0 in 0.188s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/459501bcfccfaec0db1be9fbec75d5813f56216d,backing_fmt=raw /opt/stack/data/nova/instances/fcc2bfb6-fd6b-4229-9664-42f33b138444/disk.rescue {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/459501bcfccfaec0db1be9fbec75d5813f56216d,backing_fmt=raw /opt/stack/data/nova/instances/fcc2bfb6-fd6b-4229-9664-42f33b138444/disk.rescue" returned: 0 in 0.048s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Lock "459501bcfccfaec0db1be9fbec75d5813f56216d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG nova.objects.instance [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Lazy-loading 'migration_context' on Instance uuid fcc2bfb6-fd6b-4229-9664-42f33b138444 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG nova.objects.base [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Object Instance<fcc2bfb6-fd6b-4229-9664-42f33b138444> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Start _get_guest_xml network_info=[{"id": "8c7dcf78-fc4a-4fcb-905e-ce75143a9450", "address": "fa:16:3e:be:ec:38", "network": {"id": "20522623-c29d-44f8-9047-68dde7f763c1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1770250829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1770250829-network", "vif_mac": "fa:16:3e:be:ec:38"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2871e8755b32497d901be0f062fad858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7dcf78-fc", "ovs_interfaceid": "8c7dcf78-fc4a-4fcb-905e-ce75143a9450", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '71837eac-5af6-43af-b782-0d078fd28244', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'e3cc5321-4d40-49ee-885c-700e14741732'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OEmBVZoT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'fcc2bfb6-fd6b-4229-9664-42f33b138444', 'attached_at': '', 'detached_at': '', 'volume_id': 'd4dc8883-7b87-4d41-85cd-d810824c1281', 'serial': 'd4dc8883-7b87-4d41-85cd-d810824c1281'}, 'mount_device': '/dev/vdb', 'attachment_id': 'f02f6c39-f4ca-459a-b0f0-39ef06af38d1', 'device_type': 'disk', 'guest_format': None, 'boot_index': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG nova.objects.instance [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Lazy-loading 'resources' on Instance uuid fcc2bfb6-fd6b-4229-9664-42f33b138444 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG nova.objects.base [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Object Instance<fcc2bfb6-fd6b-4229-9664-42f33b138444> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG nova.objects.instance [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Lazy-loading 'numa_topology' on Instance uuid fcc2bfb6-fd6b-4229-9664-42f33b138444 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG nova.objects.base [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Object Instance<fcc2bfb6-fd6b-4229-9664-42f33b138444> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 18:04:40 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:04:40 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:04:40 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T17:40:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG nova.objects.instance [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Lazy-loading 'vcpu_model' on Instance uuid fcc2bfb6-fd6b-4229-9664-42f33b138444 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG nova.objects.base [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Object Instance<fcc2bfb6-fd6b-4229-9664-42f33b138444> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OEmBVZoT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:04:40 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:04:40 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:04:40 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:04:40 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:04:40 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 18:04:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 -p 172.16.0.220:3260 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 -p 172.16.0.220:3260" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[62541d38-35a6-4184-bffa-0339ea3470d5]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = OEmBVZoT\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 10 18:04:40 user nova-compute[75100]: node.name = iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281
Nov 10 18:04:40 user nova-compute[75100]: node.tpgt = -1
Nov 10 18:04:40 user nova-compute[75100]: node.startup = automatic
Nov 10 18:04:40 user nova-compute[75100]: node.leading_login = No
Nov 10 18:04:40 user nova-compute[75100]: iface.iscsi_ifacename = default
Nov 10 18:04:40 user nova-compute[75100]: iface.net_ifacename = <empty>
Nov 10 18:04:40 user nova-compute[75100]: iface.ipaddress = <empty>
Nov 10 18:04:40 user nova-compute[75100]: iface.prefix_len = 0
Nov 10 18:04:40 user nova-compute[75100]: iface.hwaddress = <empty>
Nov 10 18:04:40 user nova-compute[75100]: iface.transport_name = tcp
Nov 10 18:04:40 user nova-compute[75100]: iface.initiatorname = <empty>
Nov 10 18:04:40 user nova-compute[75100]: iface.state = <empty>
Nov 10 18:04:40 user nova-compute[75100]: iface.vlan_id = 0
Nov 10 18:04:40 user nova-compute[75100]: iface.vlan_priority = 0
Nov 10 18:04:40 user nova-compute[75100]: iface.vlan_state = <empty>
Nov 10 18:04:40 user nova-compute[75100]: iface.iface_num = 0
Nov 10 18:04:40 user nova-compute[75100]: iface.mtu = 0
Nov 10 18:04:40 user nova-compute[75100]: iface.port = 0
Nov 10 18:04:40 user nova-compute[75100]: iface.bootproto = <empty>
Nov 10 18:04:40 user nova-compute[75100]: iface.subnet_mask = <empty>
Nov 10 18:04:40 user nova-compute[75100]: iface.gateway = <empty>
Nov 10 18:04:40 user nova-compute[75100]: iface.dhcp_alt_client_id_state = <empty>
Nov 10 18:04:40 user nova-compute[75100]: iface.dhcp_alt_client_id = <empty>
Nov 10 18:04:40 user nova-compute[75100]: iface.dhcp_dns = <empty>
Nov 10 18:04:40 user nova-compute[75100]: iface.dhcp_learn_iqn = <empty>
Nov 10 18:04:40 user nova-compute[75100]: iface.dhcp_req_vendor_id_state = <empty>
Nov 10 18:04:40 user nova-compute[75100]: iface.dhcp_vendor_id_state = <empty>
Nov 10 18:04:40 user nova-compute[75100]: iface.dhcp_vendor_id = <empty>
Nov 10 18:04:40 user nova-compute[75100]: iface.dhcp_slp_da = <empty>
Nov 10 18:04:40 user nova-compute[75100]: iface.fragmentation = <empty>
Nov 10 18:04:40 user nova-compute[75100]: iface.gratuitous_arp = <empty>
Nov 10 18:04:40 user nova-compute[75100]: iface.incoming_forwarding = <empty>
Nov 10 18:04:40 user nova-compute[75100]: iface.tos_state = <empty>
Nov 10 18:04:40 user nova-compute[75100]: iface.tos = 0
Nov 10 18:04:40 user nova-compute[75100]: iface.ttl = 0
Nov 10 18:04:40 user nova-compute[75100]: iface.delayed_ack = <empty>
Nov 10 18:04:40 user nova-compute[75100]: iface.tcp_nagle = <empty>
Nov 10 18:04:40 user nova-compute[75100]: iface.tcp_wsf_state = <empty>
Nov 10 18:04:40 user nova-compute[75100]: iface.tcp_wsf = 0
Nov 10 18:04:40 user nova-compute[75100]: iface.tcp_timer_scale = 0
Nov 10 18:04:40 user nova-compute[75100]: iface.tcp_timestamp = <empty>
Nov 10 18:04:40 user nova-compute[75100]: iface.redirect = <empty>
Nov 10 18:04:40 user nova-compute[75100]: iface.def_task_mgmt_timeout = 0
Nov 10 18:04:40 user nova-compute[75100]: iface.header_digest = <empty>
Nov 10 18:04:40 user nova-compute[75100]: iface.data_digest = <empty>
Nov 10 18:04:40 user nova-compute[75100]: iface.immediate_data = <empty>
Nov 10 18:04:40 user nova-compute[75100]: iface.initial_r2t = <empty>
Nov 10 18:04:40 user nova-compute[75100]: iface.data_seq_inorder = <empty>
Nov 10 18:04:40 user nova-compute[75100]: iface.data_pdu_inorder = <empty>
Nov 10 18:04:40 user nova-compute[75100]: iface.erl = 0
Nov 10 18:04:40 user nova-compute[75100]: iface.max_receive_data_len = 0
Nov 10 18:04:40 user nova-compute[75100]: iface.first_burst_len = 0
Nov 10 18:04:40 user nova-compute[75100]: iface.max_outstanding_r2t = 0
Nov 10 18:04:40 user nova-compute[75100]: iface.max_burst_len = 0
Nov 10 18:04:40 user nova-compute[75100]: iface.chap_auth = <empty>
Nov 10 18:04:40 user nova-compute[75100]: iface.bidi_chap = <empty>
Nov 10 18:04:40 user nova-compute[75100]: iface.strict_login_compliance = <empty>
Nov 10 18:04:40 user nova-compute[75100]: iface.discovery_auth = <empty>
Nov 10 18:04:40 user nova-compute[75100]: iface.discovery_logout = <empty>
Nov 10 18:04:40 user nova-compute[75100]: node.discovery_address = <empty>
Nov 10 18:04:40 user nova-compute[75100]: node.discovery_port = 0
Nov 10 18:04:40 user nova-compute[75100]: node.discovery_type = static
Nov 10 18:04:40 user nova-compute[75100]: node.session.initial_cmdsn = 0
Nov 10 18:04:40 user nova-compute[75100]: node.session.initial_login_retry_max = 8
Nov 10 18:04:40 user nova-compute[75100]: node.session.xmit_thread_priority = -20
Nov 10 18:04:40 user nova-compute[75100]: node.session.cmds_max = 128
Nov 10 18:04:40 user nova-compute[75100]: node.session.queue_depth = 32
Nov 10 18:04:40 user nova-compute[75100]: node.session.nr_sessions = 1
Nov 10 18:04:40 user nova-compute[75100]: node.session.auth.authmethod = CHAP
Nov 10 18:04:40 user nova-compute[75100]: node.session.auth.username = OEmBVZoT
Nov 10 18:04:40 user nova-compute[75100]: node.session.auth.password = ***
Nov 10 18:04:40 user nova-compute[75100]: node.session.auth.username_in = <empty>
Nov 10 18:04:40 user nova-compute[75100]: node.session.auth.password_in = <empty>
Nov 10 18:04:40 user nova-compute[75100]: node.session.auth.chap_algs = MD5
Nov 10 18:04:40 user nova-compute[75100]: node.session.timeo.replacement_timeout = 120
Nov 10 18:04:40 user nova-compute[75100]: node.session.err_timeo.abort_timeout = 15
Nov 10 18:04:40 user nova-compute[75100]: node.session.err_timeo.lu_reset_timeout = 30
Nov 10 18:04:40 user nova-compute[75100]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 10 18:04:40 user nova-compute[75100]: node.session.err_timeo.host_reset_timeout = 60
Nov 10 18:04:40 user nova-compute[75100]: node.session.iscsi.FastAbort = Yes
Nov 10 18:04:40 user nova-compute[75100]: node.session.iscsi.InitialR2T = No
Nov 10 18:04:40 user nova-compute[75100]: node.session.iscsi.ImmediateData = Yes
Nov 10 18:04:40 user nova-compute[75100]: node.session.iscsi.FirstBurstLength = 262144
Nov 10 18:04:40 user nova-compute[75100]: node.session.iscsi.MaxBurstLength = 16776192
Nov 10 18:04:40 user nova-compute[75100]: node.session.iscsi.DefaultTime2Retain = 0
Nov 10 18:04:40 user nova-compute[75100]: node.session.iscsi.DefaultTime2Wait = 2
Nov 10 18:04:40 user nova-compute[75100]: node.session.iscsi.MaxConnections = 1
Nov 10 18:04:40 user nova-compute[75100]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 10 18:04:40 user nova-compute[75100]: node.session.iscsi.ERL = 0
Nov 10 18:04:40 user nova-compute[75100]: node.session.scan = manual
Nov 10 18:04:40 user nova-compute[75100]: node.session.reopen_max = 0
Nov 10 18:04:40 user nova-compute[75100]: node.conn[0].address = 172.16.0.220
Nov 10 18:04:40 user nova-compute[75100]: node.conn[0].port = 3260
Nov 10 18:04:40 user nova-compute[75100]: node.conn[0].startup = manual
Nov 10 18:04:40 user nova-compute[75100]: node.conn[0].tcp.window_size = 524288
Nov 10 18:04:40 user nova-compute[75100]: node.conn[0].tcp.type_of_service = 0
Nov 10 18:04:40 user nova-compute[75100]: node.conn[0].timeo.logout_timeout = 15
Nov 10 18:04:40 user nova-compute[75100]: node.conn[0].timeo.login_timeout = 15
Nov 10 18:04:40 user nova-compute[75100]: node.conn[0].timeo.auth_timeout = 45
Nov 10 18:04:40 user nova-compute[75100]: node.conn[0].timeo.noop_out_interval = 5
Nov 10 18:04:40 user nova-compute[75100]: node.conn[0].timeo.noop_out_timeout = 5
Nov 10 18:04:40 user nova-compute[75100]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 10 18:04:40 user nova-compute[75100]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 10 18:04:40 user nova-compute[75100]: node.conn[0].iscsi.HeaderDigest = None
Nov 10 18:04:40 user nova-compute[75100]: node.conn[0].iscsi.DataDigest = None
Nov 10 18:04:40 user nova-compute[75100]: node.conn[0].iscsi.IFMarker = No
Nov 10 18:04:40 user nova-compute[75100]: node.conn[0].iscsi.OFMarker = No
Nov 10 18:04:40 user nova-compute[75100]: # END RECORD
Nov 10 18:04:40 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[791c518d-ed53-4935-a4cd-d9373a8ee2b7]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2408dea-0510-42a0-bdd2-d4c17f7e09b4]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OEmBVZoT {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OEmBVZoT" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d47ef1-2564-4f5c-b6f7-e54ab242d38d]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OEmBVZoT'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3875083-03ae-4938-b042-2d26e1dc967f]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0e0836-300e-47a2-8888-a16e1d6cb689]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)
Nov 10 18:04:40 user nova-compute[75100]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 (non-flash)
Nov 10 18:04:40 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)
Nov 10 18:04:40 user nova-compute[75100]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 (non-flash)
Nov 10 18:04:40 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.153s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] HCTL ('34', '0', '0', 0) found on session 26 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b3c020-11be-457a-80d5-185ea7486c3f]: (4, ('0 0 0', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Searching for a device in session 26 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OEmBVZoT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.182s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] <== connect_volume: return (184ms) {'type': 'block', 'scsi_wwn': '26233636331383466', 'path': '/dev/sdc'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233636331383466', 'path': '/dev/sdc'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:00:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1881005608',display_name='tempest-ServerStableDeviceRescueTest-server-1881005608',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1881005608',id=32,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDdFRCCVJjzF0al+SNDE7QVNwX8dpmNqM9NipR0GOwNcsjdYao4SsL1LfUC8C5UM4/qd1AeQBDezJxHm1binUeTwV3tWbJbrH4Uz3nBjNILZwiQ2cJMmyowJPFCnynvZfw==',key_name='tempest-keypair-1213048421',keypairs=<?>,launch_index=0,launched_at=2023-11-10T18:00:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2871e8755b32497d901be0f062fad858',ramdisk_id='',reservation_id='r-m01bxec1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-921350323',owner_user_name='tempest-ServerStableDeviceRescueTest-921350323-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T18:02:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ca4c02860b54cc68d0a7d1f6088cf8f',uuid=fcc2bfb6-fd6b-4229-9664-42f33b138444,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c7dcf78-fc4a-4fcb-905e-ce75143a9450", "address": "fa:16:3e:be:ec:38", "network": {"id": "20522623-c29d-44f8-9047-68dde7f763c1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1770250829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1770250829-network", "vif_mac": "fa:16:3e:be:ec:38"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2871e8755b32497d901be0f062fad858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7dcf78-fc", "ovs_interfaceid": "8c7dcf78-fc4a-4fcb-905e-ce75143a9450", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Converting VIF {"id": "8c7dcf78-fc4a-4fcb-905e-ce75143a9450", "address": "fa:16:3e:be:ec:38", "network": {"id": "20522623-c29d-44f8-9047-68dde7f763c1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1770250829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1770250829-network", "vif_mac": "fa:16:3e:be:ec:38"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2871e8755b32497d901be0f062fad858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7dcf78-fc", "ovs_interfaceid": "8c7dcf78-fc4a-4fcb-905e-ce75143a9450", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:be:ec:38,bridge_name='br-int',has_traffic_filtering=True,id=8c7dcf78-fc4a-4fcb-905e-ce75143a9450,network=Network(20522623-c29d-44f8-9047-68dde7f763c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c7dcf78-fc') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG nova.objects.instance [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Lazy-loading 'pci_devices' on Instance uuid fcc2bfb6-fd6b-4229-9664-42f33b138444 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG nova.objects.base [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Object Instance<fcc2bfb6-fd6b-4229-9664-42f33b138444> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] End _get_guest_xml xml=<domain type="kvm">
Nov 10 18:04:40 user nova-compute[75100]:   <uuid>fcc2bfb6-fd6b-4229-9664-42f33b138444</uuid>
Nov 10 18:04:40 user nova-compute[75100]:   <name>instance-00000020</name>
Nov 10 18:04:40 user nova-compute[75100]:   <memory>524288</memory>
Nov 10 18:04:40 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 10 18:04:40 user nova-compute[75100]:   <metadata>
Nov 10 18:04:40 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 18:04:40 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 10 18:04:40 user nova-compute[75100]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1881005608</nova:name>
Nov 10 18:04:40 user nova-compute[75100]:       <nova:creationTime>2023-11-10 18:04:40</nova:creationTime>
Nov 10 18:04:40 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 10 18:04:40 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 10 18:04:40 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 10 18:04:40 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 10 18:04:40 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 18:04:40 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 10 18:04:40 user nova-compute[75100]:       </nova:flavor>
Nov 10 18:04:40 user nova-compute[75100]:       <nova:owner>
Nov 10 18:04:40 user nova-compute[75100]:         <nova:user uuid="5ca4c02860b54cc68d0a7d1f6088cf8f">tempest-ServerStableDeviceRescueTest-921350323-project-member</nova:user>
Nov 10 18:04:40 user nova-compute[75100]:         <nova:project uuid="2871e8755b32497d901be0f062fad858">tempest-ServerStableDeviceRescueTest-921350323</nova:project>
Nov 10 18:04:40 user nova-compute[75100]:       </nova:owner>
Nov 10 18:04:40 user nova-compute[75100]:       <nova:root type="image" uuid="e3cc5321-4d40-49ee-885c-700e14741732"/>
Nov 10 18:04:40 user nova-compute[75100]:       <nova:ports>
Nov 10 18:04:40 user nova-compute[75100]:         <nova:port uuid="8c7dcf78-fc4a-4fcb-905e-ce75143a9450">
Nov 10 18:04:40 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 10 18:04:40 user nova-compute[75100]:         </nova:port>
Nov 10 18:04:40 user nova-compute[75100]:       </nova:ports>
Nov 10 18:04:40 user nova-compute[75100]:     </nova:instance>
Nov 10 18:04:40 user nova-compute[75100]:   </metadata>
Nov 10 18:04:40 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 10 18:04:40 user nova-compute[75100]:     <system>
Nov 10 18:04:40 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 18:04:40 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 10 18:04:40 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 10 18:04:40 user nova-compute[75100]:       <entry name="serial">fcc2bfb6-fd6b-4229-9664-42f33b138444</entry>
Nov 10 18:04:40 user nova-compute[75100]:       <entry name="uuid">fcc2bfb6-fd6b-4229-9664-42f33b138444</entry>
Nov 10 18:04:40 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 10 18:04:40 user nova-compute[75100]:     </system>
Nov 10 18:04:40 user nova-compute[75100]:   </sysinfo>
Nov 10 18:04:40 user nova-compute[75100]:   <os>
Nov 10 18:04:40 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 18:04:40 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 10 18:04:40 user nova-compute[75100]:   </os>
Nov 10 18:04:40 user nova-compute[75100]:   <features>
Nov 10 18:04:40 user nova-compute[75100]:     <acpi/>
Nov 10 18:04:40 user nova-compute[75100]:     <apic/>
Nov 10 18:04:40 user nova-compute[75100]:     <vmcoreinfo/>
Nov 10 18:04:40 user nova-compute[75100]:   </features>
Nov 10 18:04:40 user nova-compute[75100]:   <clock offset="utc">
Nov 10 18:04:40 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 18:04:40 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 18:04:40 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 10 18:04:40 user nova-compute[75100]:   </clock>
Nov 10 18:04:40 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 10 18:04:40 user nova-compute[75100]:     <model>Nehalem</model>
Nov 10 18:04:40 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 18:04:40 user nova-compute[75100]:   </cpu>
Nov 10 18:04:40 user nova-compute[75100]:   <devices>
Nov 10 18:04:40 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 10 18:04:40 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 18:04:40 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/fcc2bfb6-fd6b-4229-9664-42f33b138444/disk"/>
Nov 10 18:04:40 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 10 18:04:40 user nova-compute[75100]:     </disk>
Nov 10 18:04:40 user nova-compute[75100]:     <disk type="block" device="disk">
Nov 10 18:04:40 user nova-compute[75100]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:04:40 user nova-compute[75100]:       <source dev="/dev/sdc"/>
Nov 10 18:04:40 user nova-compute[75100]:       <target dev="vdb" bus="virtio"/>
Nov 10 18:04:40 user nova-compute[75100]:       <serial>d4dc8883-7b87-4d41-85cd-d810824c1281</serial>
Nov 10 18:04:40 user nova-compute[75100]:     </disk>
Nov 10 18:04:40 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 10 18:04:40 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 18:04:40 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/fcc2bfb6-fd6b-4229-9664-42f33b138444/disk.rescue"/>
Nov 10 18:04:40 user nova-compute[75100]:       <target dev="vdc" bus="virtio"/>
Nov 10 18:04:40 user nova-compute[75100]:       <boot order="1"/>
Nov 10 18:04:40 user nova-compute[75100]:     </disk>
Nov 10 18:04:40 user nova-compute[75100]:     <interface type="ethernet">
Nov 10 18:04:40 user nova-compute[75100]:       <mac address="fa:16:3e:be:ec:38"/>
Nov 10 18:04:40 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 18:04:40 user nova-compute[75100]:       <mtu size="1442"/>
Nov 10 18:04:40 user nova-compute[75100]:       <target dev="tap8c7dcf78-fc"/>
Nov 10 18:04:40 user nova-compute[75100]:     </interface>
Nov 10 18:04:40 user nova-compute[75100]:     <serial type="pty">
Nov 10 18:04:40 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/fcc2bfb6-fd6b-4229-9664-42f33b138444/console.log" append="off"/>
Nov 10 18:04:40 user nova-compute[75100]:     </serial>
Nov 10 18:04:40 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 18:04:40 user nova-compute[75100]:     <video>
Nov 10 18:04:40 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 18:04:40 user nova-compute[75100]:     </video>
Nov 10 18:04:40 user nova-compute[75100]:     <rng model="virtio">
Nov 10 18:04:40 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 10 18:04:40 user nova-compute[75100]:     </rng>
Nov 10 18:04:40 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 10 18:04:40 user nova-compute[75100]:     <memballoon model="virtio">
Nov 10 18:04:40 user nova-compute[75100]:       <stats period="10"/>
Nov 10 18:04:40 user nova-compute[75100]:     </memballoon>
Nov 10 18:04:40 user nova-compute[75100]:   </devices>
Nov 10 18:04:40 user nova-compute[75100]: </domain>
Nov 10 18:04:40 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 18:04:40 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Instance destroyed successfully.
Nov 10 18:04:40 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 18:04:40 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] No VIF found with MAC fa:16:3e:be:ec:38, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 18:04:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:04:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:04:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:04:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:04:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:04:42 user nova-compute[75100]: DEBUG nova.compute.manager [req-8ab21971-5729-4e2f-b080-e4f53242e183 req-4d1bdb24-3284-4e0a-b1e4-fb89dd3fe556 service nova] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Received event network-vif-plugged-8c7dcf78-fc4a-4fcb-905e-ce75143a9450 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:04:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8ab21971-5729-4e2f-b080-e4f53242e183 req-4d1bdb24-3284-4e0a-b1e4-fb89dd3fe556 service nova] Acquiring lock "fcc2bfb6-fd6b-4229-9664-42f33b138444-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:04:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8ab21971-5729-4e2f-b080-e4f53242e183 req-4d1bdb24-3284-4e0a-b1e4-fb89dd3fe556 service nova] Lock "fcc2bfb6-fd6b-4229-9664-42f33b138444-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:04:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8ab21971-5729-4e2f-b080-e4f53242e183 req-4d1bdb24-3284-4e0a-b1e4-fb89dd3fe556 service nova] Lock "fcc2bfb6-fd6b-4229-9664-42f33b138444-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:04:42 user nova-compute[75100]: DEBUG nova.compute.manager [req-8ab21971-5729-4e2f-b080-e4f53242e183 req-4d1bdb24-3284-4e0a-b1e4-fb89dd3fe556 service nova] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] No waiting events found dispatching network-vif-plugged-8c7dcf78-fc4a-4fcb-905e-ce75143a9450 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:04:42 user nova-compute[75100]: WARNING nova.compute.manager [req-8ab21971-5729-4e2f-b080-e4f53242e183 req-4d1bdb24-3284-4e0a-b1e4-fb89dd3fe556 service nova] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Received unexpected event network-vif-plugged-8c7dcf78-fc4a-4fcb-905e-ce75143a9450 for instance with vm_state active and task_state rescuing.
Nov 10 18:04:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:04:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:04:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:04:44 user nova-compute[75100]: DEBUG nova.compute.manager [None req-98fb41db-ee5c-4a42-b789-5e611d692f11 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 18:04:44 user nova-compute[75100]: DEBUG nova.compute.manager [req-cf6afc93-eb31-4ce5-a56f-92f9b8d24617 req-496986b5-bb64-4bd3-bc2d-c64493493af3 service nova] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Received event network-vif-plugged-8c7dcf78-fc4a-4fcb-905e-ce75143a9450 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:04:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cf6afc93-eb31-4ce5-a56f-92f9b8d24617 req-496986b5-bb64-4bd3-bc2d-c64493493af3 service nova] Acquiring lock "fcc2bfb6-fd6b-4229-9664-42f33b138444-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:04:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cf6afc93-eb31-4ce5-a56f-92f9b8d24617 req-496986b5-bb64-4bd3-bc2d-c64493493af3 service nova] Lock "fcc2bfb6-fd6b-4229-9664-42f33b138444-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:04:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cf6afc93-eb31-4ce5-a56f-92f9b8d24617 req-496986b5-bb64-4bd3-bc2d-c64493493af3 service nova] Lock "fcc2bfb6-fd6b-4229-9664-42f33b138444-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:04:44 user nova-compute[75100]: DEBUG nova.compute.manager [req-cf6afc93-eb31-4ce5-a56f-92f9b8d24617 req-496986b5-bb64-4bd3-bc2d-c64493493af3 service nova] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] No waiting events found dispatching network-vif-plugged-8c7dcf78-fc4a-4fcb-905e-ce75143a9450 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:04:44 user nova-compute[75100]: WARNING nova.compute.manager [req-cf6afc93-eb31-4ce5-a56f-92f9b8d24617 req-496986b5-bb64-4bd3-bc2d-c64493493af3 service nova] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Received unexpected event network-vif-plugged-8c7dcf78-fc4a-4fcb-905e-ce75143a9450 for instance with vm_state active and task_state rescuing.
Nov 10 18:04:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:04:45 user nova-compute[75100]: DEBUG nova.compute.manager [req-38894530-8d21-4a8f-8b9e-a70220830ece req-d987b866-6bd7-4c79-a623-88f5fcbe079c service nova] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] Received event network-changed-75bd6d86-2609-4694-969e-edd1cc65c12b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:04:45 user nova-compute[75100]: DEBUG nova.compute.manager [req-38894530-8d21-4a8f-8b9e-a70220830ece req-d987b866-6bd7-4c79-a623-88f5fcbe079c service nova] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] Refreshing instance network info cache due to event network-changed-75bd6d86-2609-4694-969e-edd1cc65c12b. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 18:04:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-38894530-8d21-4a8f-8b9e-a70220830ece req-d987b866-6bd7-4c79-a623-88f5fcbe079c service nova] Acquiring lock "refresh_cache-9dabb40d-299b-4c8a-bc92-63e5c0932047" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:04:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-38894530-8d21-4a8f-8b9e-a70220830ece req-d987b866-6bd7-4c79-a623-88f5fcbe079c service nova] Acquired lock "refresh_cache-9dabb40d-299b-4c8a-bc92-63e5c0932047" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:04:45 user nova-compute[75100]: DEBUG nova.network.neutron [req-38894530-8d21-4a8f-8b9e-a70220830ece req-d987b866-6bd7-4c79-a623-88f5fcbe079c service nova] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] Refreshing network info cache for port 75bd6d86-2609-4694-969e-edd1cc65c12b {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 18:04:46 user nova-compute[75100]: DEBUG nova.network.neutron [req-38894530-8d21-4a8f-8b9e-a70220830ece req-d987b866-6bd7-4c79-a623-88f5fcbe079c service nova] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] Updated VIF entry in instance network info cache for port 75bd6d86-2609-4694-969e-edd1cc65c12b. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 18:04:46 user nova-compute[75100]: DEBUG nova.network.neutron [req-38894530-8d21-4a8f-8b9e-a70220830ece req-d987b866-6bd7-4c79-a623-88f5fcbe079c service nova] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] Updating instance_info_cache with network_info: [{"id": "75bd6d86-2609-4694-969e-edd1cc65c12b", "address": "fa:16:3e:64:1d:f2", "network": {"id": "4dda5b3e-106d-4eb9-b939-ac553b155aad", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1558952398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b43954bd11143f2a7df5b5a81d47291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75bd6d86-26", "ovs_interfaceid": "75bd6d86-2609-4694-969e-edd1cc65c12b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:04:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-38894530-8d21-4a8f-8b9e-a70220830ece req-d987b866-6bd7-4c79-a623-88f5fcbe079c service nova] Releasing lock "refresh_cache-9dabb40d-299b-4c8a-bc92-63e5c0932047" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:04:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:04:49 user nova-compute[75100]: DEBUG nova.compute.manager [req-9d11d31c-e4ea-4469-817e-e7e17a36c0b7 req-c29b9ac3-2be7-47e3-b9b2-a92ff5956174 service nova] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Received event network-changed-9829f1f6-ef24-440f-964b-1ae5326963dd {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:04:49 user nova-compute[75100]: DEBUG nova.compute.manager [req-9d11d31c-e4ea-4469-817e-e7e17a36c0b7 req-c29b9ac3-2be7-47e3-b9b2-a92ff5956174 service nova] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Refreshing instance network info cache due to event network-changed-9829f1f6-ef24-440f-964b-1ae5326963dd. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 18:04:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9d11d31c-e4ea-4469-817e-e7e17a36c0b7 req-c29b9ac3-2be7-47e3-b9b2-a92ff5956174 service nova] Acquiring lock "refresh_cache-5194f111-ba1a-43bc-9564-b744d1960307" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:04:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9d11d31c-e4ea-4469-817e-e7e17a36c0b7 req-c29b9ac3-2be7-47e3-b9b2-a92ff5956174 service nova] Acquired lock "refresh_cache-5194f111-ba1a-43bc-9564-b744d1960307" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:04:49 user nova-compute[75100]: DEBUG nova.network.neutron [req-9d11d31c-e4ea-4469-817e-e7e17a36c0b7 req-c29b9ac3-2be7-47e3-b9b2-a92ff5956174 service nova] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Refreshing network info cache for port 9829f1f6-ef24-440f-964b-1ae5326963dd {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 18:04:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:04:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-28ea8976-61bb-49e7-9ec3-2fdf6230e201 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Acquiring lock "5194f111-ba1a-43bc-9564-b744d1960307" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:04:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-28ea8976-61bb-49e7-9ec3-2fdf6230e201 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lock "5194f111-ba1a-43bc-9564-b744d1960307" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:04:49 user nova-compute[75100]: DEBUG nova.objects.instance [None req-28ea8976-61bb-49e7-9ec3-2fdf6230e201 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lazy-loading 'flavor' on Instance uuid 5194f111-ba1a-43bc-9564-b744d1960307 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:04:49 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-28ea8976-61bb-49e7-9ec3-2fdf6230e201 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Ignoring supplied device name: /dev/vdb
Nov 10 18:04:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-28ea8976-61bb-49e7-9ec3-2fdf6230e201 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lock "5194f111-ba1a-43bc-9564-b744d1960307" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:04:49 user nova-compute[75100]: DEBUG nova.network.neutron [req-9d11d31c-e4ea-4469-817e-e7e17a36c0b7 req-c29b9ac3-2be7-47e3-b9b2-a92ff5956174 service nova] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Updated VIF entry in instance network info cache for port 9829f1f6-ef24-440f-964b-1ae5326963dd. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 18:04:49 user nova-compute[75100]: DEBUG nova.network.neutron [req-9d11d31c-e4ea-4469-817e-e7e17a36c0b7 req-c29b9ac3-2be7-47e3-b9b2-a92ff5956174 service nova] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Updating instance_info_cache with network_info: [{"id": "9829f1f6-ef24-440f-964b-1ae5326963dd", "address": "fa:16:3e:49:3b:cc", "network": {"id": "fa38ae2b-75a1-4312-9b92-462a4240d792", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-822691382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27994d50bda0480f8964e687ed76805c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9829f1f6-ef", "ovs_interfaceid": "9829f1f6-ef24-440f-964b-1ae5326963dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:04:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9d11d31c-e4ea-4469-817e-e7e17a36c0b7 req-c29b9ac3-2be7-47e3-b9b2-a92ff5956174 service nova] Releasing lock "refresh_cache-5194f111-ba1a-43bc-9564-b744d1960307" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:04:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-28ea8976-61bb-49e7-9ec3-2fdf6230e201 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Acquiring lock "5194f111-ba1a-43bc-9564-b744d1960307" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:04:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-28ea8976-61bb-49e7-9ec3-2fdf6230e201 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lock "5194f111-ba1a-43bc-9564-b744d1960307" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:04:49 user nova-compute[75100]: INFO nova.compute.manager [None req-28ea8976-61bb-49e7-9ec3-2fdf6230e201 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Attaching volume 85677e03-86ea-4986-a4db-d477c739c6be to /dev/vdb
Nov 10 18:04:50 user nova-compute[75100]: DEBUG os_brick.utils [None req-28ea8976-61bb-49e7-9ec3-2fdf6230e201 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:04:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:04:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[829bde49-282e-4811-94b1-61e877f3fb53]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90b1a229568f\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:04:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:04:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1ad6ea-44a7-495e-b770-ac784f7aaa3e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:04:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:04:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[35dff474-9d9e-4b3d-b7a8-3600a902b162]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:04:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a974b119-303e-47f8-88cb-76e4565dc438]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:04:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-28ea8976-61bb-49e7-9ec3-2fdf6230e201 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-28ea8976-61bb-49e7-9ec3-2fdf6230e201 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 18:04:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-28ea8976-61bb-49e7-9ec3-2fdf6230e201 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 18:04:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 18:04:50 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 18:04:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb6c883-cd79-4da0-a570-94cb2b25f0a4]: (4, '') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:04:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-28ea8976-61bb-49e7-9ec3-2fdf6230e201 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 18:04:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-28ea8976-61bb-49e7-9ec3-2fdf6230e201 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 18:04:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-28ea8976-61bb-49e7-9ec3-2fdf6230e201 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 18:04:50 user nova-compute[75100]: DEBUG os_brick.utils [None req-28ea8976-61bb-49e7-9ec3-2fdf6230e201 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90b1a229568f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:04:50 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-28ea8976-61bb-49e7-9ec3-2fdf6230e201 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Updating existing volume attachment record: b12f3132-1695-4c5c-93eb-19df844d8cb8 {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 18:04:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:04:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d722879a-da83-4101-b05d-fe73ba20d9d2 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Acquiring lock "9dabb40d-299b-4c8a-bc92-63e5c0932047" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:04:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d722879a-da83-4101-b05d-fe73ba20d9d2 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Lock "9dabb40d-299b-4c8a-bc92-63e5c0932047" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:04:52 user nova-compute[75100]: DEBUG nova.objects.instance [None req-d722879a-da83-4101-b05d-fe73ba20d9d2 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Lazy-loading 'flavor' on Instance uuid 9dabb40d-299b-4c8a-bc92-63e5c0932047 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:04:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d722879a-da83-4101-b05d-fe73ba20d9d2 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Lock "9dabb40d-299b-4c8a-bc92-63e5c0932047" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:04:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d722879a-da83-4101-b05d-fe73ba20d9d2 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Acquiring lock "9dabb40d-299b-4c8a-bc92-63e5c0932047" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:04:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d722879a-da83-4101-b05d-fe73ba20d9d2 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Lock "9dabb40d-299b-4c8a-bc92-63e5c0932047" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:04:52 user nova-compute[75100]: INFO nova.compute.manager [None req-d722879a-da83-4101-b05d-fe73ba20d9d2 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] Attaching volume 9e777185-e622-48b2-af17-fa73919b33b5 to /dev/vdb
Nov 10 18:04:52 user nova-compute[75100]: DEBUG os_brick.utils [None req-d722879a-da83-4101-b05d-fe73ba20d9d2 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:04:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:04:52 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7693b9fc-162b-481e-a31c-90deddaaca73]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90b1a229568f\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:04:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:04:52 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[265e8b57-3311-458c-9661-e82a7a65c7e1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:04:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:04:52 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30e8a16-100d-486f-ac9c-13ad45e5070f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:04:52 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[229fc88c-e3b4-4d25-81dd-9f49e60ccda2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:04:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-d722879a-da83-4101-b05d-fe73ba20d9d2 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-d722879a-da83-4101-b05d-fe73ba20d9d2 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 18:04:52 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d722879a-da83-4101-b05d-fe73ba20d9d2 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 18:04:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:04:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 18:04:52 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 18:04:52 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[846ac853-ddeb-422d-a37f-47cccc7c4f65]: (4, '') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:04:52 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-d722879a-da83-4101-b05d-fe73ba20d9d2 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 18:04:52 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-d722879a-da83-4101-b05d-fe73ba20d9d2 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 18:04:52 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-d722879a-da83-4101-b05d-fe73ba20d9d2 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 18:04:52 user nova-compute[75100]: DEBUG os_brick.utils [None req-d722879a-da83-4101-b05d-fe73ba20d9d2 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90b1a229568f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:04:52 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-d722879a-da83-4101-b05d-fe73ba20d9d2 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] Updating existing volume attachment record: 1a28e3a2-68a8-4bfb-a261-8fd1f9c3df11 {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 18:04:54 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:04:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:04:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:05:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:05:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:05:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:05:08 user nova-compute[75100]: DEBUG nova.compute.manager [req-d62c6185-8f62-4abd-9a8b-33dfa17ba2ba req-97994ac7-f695-46dd-8cbd-5243aef89b53 service nova] [instance: b0bae328-2528-4562-850b-14fa108923c6] Received event network-changed-6f68d50b-62e9-4068-98e8-131d624dd612 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:05:08 user nova-compute[75100]: DEBUG nova.compute.manager [req-d62c6185-8f62-4abd-9a8b-33dfa17ba2ba req-97994ac7-f695-46dd-8cbd-5243aef89b53 service nova] [instance: b0bae328-2528-4562-850b-14fa108923c6] Refreshing instance network info cache due to event network-changed-6f68d50b-62e9-4068-98e8-131d624dd612. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 18:05:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d62c6185-8f62-4abd-9a8b-33dfa17ba2ba req-97994ac7-f695-46dd-8cbd-5243aef89b53 service nova] Acquiring lock "refresh_cache-b0bae328-2528-4562-850b-14fa108923c6" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:05:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d62c6185-8f62-4abd-9a8b-33dfa17ba2ba req-97994ac7-f695-46dd-8cbd-5243aef89b53 service nova] Acquired lock "refresh_cache-b0bae328-2528-4562-850b-14fa108923c6" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:05:08 user nova-compute[75100]: DEBUG nova.network.neutron [req-d62c6185-8f62-4abd-9a8b-33dfa17ba2ba req-97994ac7-f695-46dd-8cbd-5243aef89b53 service nova] [instance: b0bae328-2528-4562-850b-14fa108923c6] Refreshing network info cache for port 6f68d50b-62e9-4068-98e8-131d624dd612 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 18:05:08 user nova-compute[75100]: DEBUG nova.network.neutron [req-d62c6185-8f62-4abd-9a8b-33dfa17ba2ba req-97994ac7-f695-46dd-8cbd-5243aef89b53 service nova] [instance: b0bae328-2528-4562-850b-14fa108923c6] Updated VIF entry in instance network info cache for port 6f68d50b-62e9-4068-98e8-131d624dd612. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 18:05:08 user nova-compute[75100]: DEBUG nova.network.neutron [req-d62c6185-8f62-4abd-9a8b-33dfa17ba2ba req-97994ac7-f695-46dd-8cbd-5243aef89b53 service nova] [instance: b0bae328-2528-4562-850b-14fa108923c6] Updating instance_info_cache with network_info: [{"id": "6f68d50b-62e9-4068-98e8-131d624dd612", "address": "fa:16:3e:ae:03:fd", "network": {"id": "e906a397-504d-48d8-8726-187cfbb1f270", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2095832274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4e5cb8bdc24a009dcb3dbee36a6bce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f68d50b-62", "ovs_interfaceid": "6f68d50b-62e9-4068-98e8-131d624dd612", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:05:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d62c6185-8f62-4abd-9a8b-33dfa17ba2ba req-97994ac7-f695-46dd-8cbd-5243aef89b53 service nova] Releasing lock "refresh_cache-b0bae328-2528-4562-850b-14fa108923c6" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:05:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Acquiring lock "dc8c4fa7-668a-4348-be16-9eb06420b01f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:05:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "dc8c4fa7-668a-4348-be16-9eb06420b01f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:05:09 user nova-compute[75100]: DEBUG nova.compute.manager [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 18:05:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:05:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:05:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:05:09 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 18:05:09 user nova-compute[75100]: INFO nova.compute.claims [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Claim successful on node user
Nov 10 18:05:09 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:05:10 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:05:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.408s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:05:10 user nova-compute[75100]: DEBUG nova.compute.manager [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 18:05:10 user nova-compute[75100]: DEBUG nova.compute.manager [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 18:05:10 user nova-compute[75100]: DEBUG nova.network.neutron [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 18:05:10 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 18:05:10 user nova-compute[75100]: DEBUG nova.compute.manager [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 18:05:10 user nova-compute[75100]: DEBUG nova.policy [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '323c5738ca424a379f666b4ca60825ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd441a46aa4a579feff608d6ff9bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 18:05:10 user nova-compute[75100]: INFO nova.virt.block_device [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Booting with volume a54f8ddb-2769-4cf8-9e3e-e199b57b3005 at /dev/vda
Nov 10 18:05:10 user nova-compute[75100]: DEBUG os_brick.utils [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:05:10 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:10 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:10 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cbc26cf-b6f8-4738-92fe-20975152b737]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90b1a229568f\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:10 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:10 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:10 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f70e3d5f-69b3-46a8-b211-1e6d462f60cc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:10 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:10 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:10 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ff94f2-ef3c-4957-b4cc-44a979753f94]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:10 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f2db3f-2db0-461a-b63c-e102790407d7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:10 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:10 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 18:05:10 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 18:05:10 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:10 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 18:05:10 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 18:05:10 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e346204d-d0eb-41cf-a02d-d56c3b383cae]: (4, '') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:10 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 18:05:10 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 18:05:10 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 18:05:10 user nova-compute[75100]: DEBUG os_brick.utils [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90b1a229568f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:05:10 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Updating existing volume attachment record: e0ba7bdf-acac-4a25-aea9-c334941ade83 {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 18:05:10 user nova-compute[75100]: DEBUG nova.network.neutron [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Successfully created port: d65a39e5-d2df-4de4-943c-fb71b88fc381 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 18:05:11 user nova-compute[75100]: DEBUG nova.network.neutron [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Successfully updated port: d65a39e5-d2df-4de4-943c-fb71b88fc381 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 18:05:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Acquiring lock "refresh_cache-dc8c4fa7-668a-4348-be16-9eb06420b01f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:05:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Acquired lock "refresh_cache-dc8c4fa7-668a-4348-be16-9eb06420b01f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:05:11 user nova-compute[75100]: DEBUG nova.network.neutron [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 18:05:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:05:11 user nova-compute[75100]: DEBUG nova.network.neutron [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 18:05:11 user nova-compute[75100]: DEBUG nova.compute.manager [req-aa14687d-9b28-4ed6-bc65-2bdd6561db21 req-c24350c0-dec5-47ea-b302-9f42fbd571ef service nova] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Received event network-changed-d65a39e5-d2df-4de4-943c-fb71b88fc381 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:05:11 user nova-compute[75100]: DEBUG nova.compute.manager [req-aa14687d-9b28-4ed6-bc65-2bdd6561db21 req-c24350c0-dec5-47ea-b302-9f42fbd571ef service nova] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Refreshing instance network info cache due to event network-changed-d65a39e5-d2df-4de4-943c-fb71b88fc381. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 18:05:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-aa14687d-9b28-4ed6-bc65-2bdd6561db21 req-c24350c0-dec5-47ea-b302-9f42fbd571ef service nova] Acquiring lock "refresh_cache-dc8c4fa7-668a-4348-be16-9eb06420b01f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:05:12 user nova-compute[75100]: DEBUG nova.network.neutron [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Updating instance_info_cache with network_info: [{"id": "d65a39e5-d2df-4de4-943c-fb71b88fc381", "address": "fa:16:3e:01:98:2f", "network": {"id": "2a85480b-f67d-4ef1-b967-3e93af57d7c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1717495768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9cd441a46aa4a579feff608d6ff9bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd65a39e5-d2", "ovs_interfaceid": "d65a39e5-d2df-4de4-943c-fb71b88fc381", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:05:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Releasing lock "refresh_cache-dc8c4fa7-668a-4348-be16-9eb06420b01f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:05:12 user nova-compute[75100]: DEBUG nova.compute.manager [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Instance network_info: |[{"id": "d65a39e5-d2df-4de4-943c-fb71b88fc381", "address": "fa:16:3e:01:98:2f", "network": {"id": "2a85480b-f67d-4ef1-b967-3e93af57d7c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1717495768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9cd441a46aa4a579feff608d6ff9bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd65a39e5-d2", "ovs_interfaceid": "d65a39e5-d2df-4de4-943c-fb71b88fc381", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 18:05:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-aa14687d-9b28-4ed6-bc65-2bdd6561db21 req-c24350c0-dec5-47ea-b302-9f42fbd571ef service nova] Acquired lock "refresh_cache-dc8c4fa7-668a-4348-be16-9eb06420b01f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:05:12 user nova-compute[75100]: DEBUG nova.network.neutron [req-aa14687d-9b28-4ed6-bc65-2bdd6561db21 req-c24350c0-dec5-47ea-b302-9f42fbd571ef service nova] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Refreshing network info cache for port d65a39e5-d2df-4de4-943c-fb71b88fc381 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 18:05:12 user nova-compute[75100]: DEBUG nova.network.neutron [req-aa14687d-9b28-4ed6-bc65-2bdd6561db21 req-c24350c0-dec5-47ea-b302-9f42fbd571ef service nova] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Updated VIF entry in instance network info cache for port d65a39e5-d2df-4de4-943c-fb71b88fc381. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 18:05:12 user nova-compute[75100]: DEBUG nova.network.neutron [req-aa14687d-9b28-4ed6-bc65-2bdd6561db21 req-c24350c0-dec5-47ea-b302-9f42fbd571ef service nova] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Updating instance_info_cache with network_info: [{"id": "d65a39e5-d2df-4de4-943c-fb71b88fc381", "address": "fa:16:3e:01:98:2f", "network": {"id": "2a85480b-f67d-4ef1-b967-3e93af57d7c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1717495768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9cd441a46aa4a579feff608d6ff9bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd65a39e5-d2", "ovs_interfaceid": "d65a39e5-d2df-4de4-943c-fb71b88fc381", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:05:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-aa14687d-9b28-4ed6-bc65-2bdd6561db21 req-c24350c0-dec5-47ea-b302-9f42fbd571ef service nova] Releasing lock "refresh_cache-dc8c4fa7-668a-4348-be16-9eb06420b01f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:05:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:05:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28ea8976-61bb-49e7-9ec3-2fdf6230e201 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 18:05:15 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ea8976-61bb-49e7-9ec3-2fdf6230e201 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'afxMoIvG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:05:15 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-28ea8976-61bb-49e7-9ec3-2fdf6230e201 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:05:15 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-28ea8976-61bb-49e7-9ec3-2fdf6230e201 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:05:15 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-28ea8976-61bb-49e7-9ec3-2fdf6230e201 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:05:15 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-28ea8976-61bb-49e7-9ec3-2fdf6230e201 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:05:15 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-28ea8976-61bb-49e7-9ec3-2fdf6230e201 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:05:15 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-28ea8976-61bb-49e7-9ec3-2fdf6230e201 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:05:15 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-28ea8976-61bb-49e7-9ec3-2fdf6230e201 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 18:05:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be -p 172.16.0.220:3260 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:15 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbcbad23-c284-40c0-be73-857efef6d649]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:15 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ea8976-61bb-49e7-9ec3-2fdf6230e201 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 18:05:15 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:05:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be -p 172.16.0.220:3260 --interface default --op new {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:15 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6763dfca-183c-47b8-8663-c9c92617e456]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be] added\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:15 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ea8976-61bb-49e7-9ec3-2fdf6230e201 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be] added
Nov 10 18:05:15 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:05:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:15 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c72192-9d55-48dd-9688-bd8628eb47d8]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:15 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ea8976-61bb-49e7-9ec3-2fdf6230e201 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:05:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:15 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[232d8a89-a780-4b7d-8888-4e276957f9a3]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:15 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ea8976-61bb-49e7-9ec3-2fdf6230e201 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:05:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v afxMoIvG {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v afxMoIvG" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:15 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a580f59e-7fed-40c0-bb29-6c25f83ab392]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:15 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ea8976-61bb-49e7-9ec3-2fdf6230e201 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'afxMoIvG'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:05:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:15 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[536611af-6f15-4b59-8418-5bc773af7ec3]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:15 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ea8976-61bb-49e7-9ec3-2fdf6230e201 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:05:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:15 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15d9960-e96c-43c7-9cf6-7e4335731692]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:15 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ea8976-61bb-49e7-9ec3-2fdf6230e201 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)
Nov 10 18:05:15 user nova-compute[75100]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 (non-flash)
Nov 10 18:05:15 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:05:15 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ea8976-61bb-49e7-9ec3-2fdf6230e201 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)
Nov 10 18:05:15 user nova-compute[75100]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 (non-flash)
Nov 10 18:05:15 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:05:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be -p 172.16.0.220:3260 --login {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:15 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae70090-2958-40e9-897b-2c1ca8a06010]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:15 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ea8976-61bb-49e7-9ec3-2fdf6230e201 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be, portal: 172.16.0.220,3260]
Nov 10 18:05:15 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be, portal: 172.16.0.220,3260] successful.
Nov 10 18:05:15 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:05:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e08b4a-ae1f-4bcd-b537-a96239c531c6]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ea8976-61bb-49e7-9ec3-2fdf6230e201 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:05:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38cdef8-d3e2-4acf-92fd-4556a0f72db2]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ea8976-61bb-49e7-9ec3-2fdf6230e201 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)
Nov 10 18:05:16 user nova-compute[75100]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 (non-flash)
Nov 10 18:05:16 user nova-compute[75100]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be (non-flash)
Nov 10 18:05:16 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:05:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ea8976-61bb-49e7-9ec3-2fdf6230e201 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)
Nov 10 18:05:16 user nova-compute[75100]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 (non-flash)
Nov 10 18:05:16 user nova-compute[75100]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be (non-flash)
Nov 10 18:05:16 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:05:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-28ea8976-61bb-49e7-9ec3-2fdf6230e201 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:05:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ea8976-61bb-49e7-9ec3-2fdf6230e201 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 18:05:16 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-28ea8976-61bb-49e7-9ec3-2fdf6230e201 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] HCTL ('35', '-', '-', 0) found on session 27 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 18:05:16 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-28ea8976-61bb-49e7-9ec3-2fdf6230e201 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 18:05:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5562b8cb-b498-4afd-9ef5-04049c02d0fa]: (4, ('- - 0', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:16 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-28ea8976-61bb-49e7-9ec3-2fdf6230e201 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Searching for a device in session 27 and hctl ['35', '*', '*', 0] yield: None {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 18:05:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:05:17 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-28ea8976-61bb-49e7-9ec3-2fdf6230e201 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Searching for a device in session 27 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 18:05:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ea8976-61bb-49e7-9ec3-2fdf6230e201 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'afxMoIvG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 18:05:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-28ea8976-61bb-49e7-9ec3-2fdf6230e201 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:05:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ea8976-61bb-49e7-9ec3-2fdf6230e201 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23132663135353634', 'path': '/dev/sdd'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:05:17 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28ea8976-61bb-49e7-9ec3-2fdf6230e201 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23132663135353634', 'path': '/dev/sdd'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 18:05:17 user nova-compute[75100]: DEBUG nova.objects.instance [None req-28ea8976-61bb-49e7-9ec3-2fdf6230e201 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lazy-loading 'flavor' on Instance uuid 5194f111-ba1a-43bc-9564-b744d1960307 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:05:17 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-28ea8976-61bb-49e7-9ec3-2fdf6230e201 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 18:05:17 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:05:17 user nova-compute[75100]:   <source dev="/dev/sdd"/>
Nov 10 18:05:17 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 18:05:17 user nova-compute[75100]:   <serial>85677e03-86ea-4986-a4db-d477c739c6be</serial>
Nov 10 18:05:17 user nova-compute[75100]: </disk>
Nov 10 18:05:17 user nova-compute[75100]:  {{(pid=75100) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 18:05:17 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-28ea8976-61bb-49e7-9ec3-2fdf6230e201 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 18:05:17 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-28ea8976-61bb-49e7-9ec3-2fdf6230e201 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 18:05:17 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-28ea8976-61bb-49e7-9ec3-2fdf6230e201 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] No VIF found with MAC fa:16:3e:49:3b:cc, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 18:05:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-28ea8976-61bb-49e7-9ec3-2fdf6230e201 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lock "5194f111-ba1a-43bc-9564-b744d1960307" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.705s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:05:17 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d722879a-da83-4101-b05d-fe73ba20d9d2 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 18:05:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d722879a-da83-4101-b05d-fe73ba20d9d2 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9e777185-e622-48b2-af17-fa73919b33b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oPAczBjY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:05:17 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-d722879a-da83-4101-b05d-fe73ba20d9d2 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:05:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-d722879a-da83-4101-b05d-fe73ba20d9d2 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:05:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-d722879a-da83-4101-b05d-fe73ba20d9d2 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:05:17 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-d722879a-da83-4101-b05d-fe73ba20d9d2 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:05:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-d722879a-da83-4101-b05d-fe73ba20d9d2 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e777185-e622-48b2-af17-fa73919b33b5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:05:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-d722879a-da83-4101-b05d-fe73ba20d9d2 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e777185-e622-48b2-af17-fa73919b33b5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:05:17 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-d722879a-da83-4101-b05d-fe73ba20d9d2 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 18:05:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e777185-e622-48b2-af17-fa73919b33b5 -p 172.16.0.220:3260 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e777185-e622-48b2-af17-fa73919b33b5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:18 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb9e771-d3d2-43cf-8ff7-72e60f2a25d5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d722879a-da83-4101-b05d-fe73ba20d9d2 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 18:05:18 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:05:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e777185-e622-48b2-af17-fa73919b33b5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e777185-e622-48b2-af17-fa73919b33b5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:18 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e62e5b7-253a-4329-8711-f9cf5c8224c7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e777185-e622-48b2-af17-fa73919b33b5] added\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d722879a-da83-4101-b05d-fe73ba20d9d2 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e777185-e622-48b2-af17-fa73919b33b5] added
Nov 10 18:05:18 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:05:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e777185-e622-48b2-af17-fa73919b33b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e777185-e622-48b2-af17-fa73919b33b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:18 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d732c6-3d23-429d-90d1-2e0447ee00b7]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d722879a-da83-4101-b05d-fe73ba20d9d2 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:05:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e777185-e622-48b2-af17-fa73919b33b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e777185-e622-48b2-af17-fa73919b33b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:18 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b78b363-2696-4fe7-9889-aea57db476fc]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d722879a-da83-4101-b05d-fe73ba20d9d2 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:05:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e777185-e622-48b2-af17-fa73919b33b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oPAczBjY {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e777185-e622-48b2-af17-fa73919b33b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oPAczBjY" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:18 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98664b6-c7dc-493b-b023-8933a536a733]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d722879a-da83-4101-b05d-fe73ba20d9d2 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oPAczBjY'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:05:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e777185-e622-48b2-af17-fa73919b33b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e777185-e622-48b2-af17-fa73919b33b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:18 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ddaf34-5e12-45a9-b3ef-463396a67690]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d722879a-da83-4101-b05d-fe73ba20d9d2 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:05:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:18 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[25084ad8-9246-444a-a682-081c7c4ca0d1]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d722879a-da83-4101-b05d-fe73ba20d9d2 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)
Nov 10 18:05:18 user nova-compute[75100]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 (non-flash)
Nov 10 18:05:18 user nova-compute[75100]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be (non-flash)
Nov 10 18:05:18 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:05:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d722879a-da83-4101-b05d-fe73ba20d9d2 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)
Nov 10 18:05:18 user nova-compute[75100]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 (non-flash)
Nov 10 18:05:18 user nova-compute[75100]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be (non-flash)
Nov 10 18:05:18 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:05:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e777185-e622-48b2-af17-fa73919b33b5 -p 172.16.0.220:3260 --login {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e777185-e622-48b2-af17-fa73919b33b5 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:18 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38d9855-5aa0-47a6-a33b-0cffb8914910]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e777185-e622-48b2-af17-fa73919b33b5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9e777185-e622-48b2-af17-fa73919b33b5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d722879a-da83-4101-b05d-fe73ba20d9d2 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e777185-e622-48b2-af17-fa73919b33b5, portal: 172.16.0.220,3260]
Nov 10 18:05:18 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:9e777185-e622-48b2-af17-fa73919b33b5, portal: 172.16.0.220,3260] successful.
Nov 10 18:05:18 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:05:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e777185-e622-48b2-af17-fa73919b33b5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e777185-e622-48b2-af17-fa73919b33b5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:18 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e551aefa-669a-4812-924b-5c155196a738]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d722879a-da83-4101-b05d-fe73ba20d9d2 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:05:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:18 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe0ab98-0059-438e-af40-1d18d8ae00e8]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e777185-e622-48b2-af17-fa73919b33b5 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d722879a-da83-4101-b05d-fe73ba20d9d2 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)
Nov 10 18:05:18 user nova-compute[75100]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 (non-flash)
Nov 10 18:05:18 user nova-compute[75100]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be (non-flash)
Nov 10 18:05:18 user nova-compute[75100]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e777185-e622-48b2-af17-fa73919b33b5 (non-flash)
Nov 10 18:05:18 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:05:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d722879a-da83-4101-b05d-fe73ba20d9d2 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)
Nov 10 18:05:18 user nova-compute[75100]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 (non-flash)
Nov 10 18:05:18 user nova-compute[75100]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be (non-flash)
Nov 10 18:05:18 user nova-compute[75100]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e777185-e622-48b2-af17-fa73919b33b5 (non-flash)
Nov 10 18:05:18 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:05:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-d722879a-da83-4101-b05d-fe73ba20d9d2 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e777185-e622-48b2-af17-fa73919b33b5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:05:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d722879a-da83-4101-b05d-fe73ba20d9d2 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 18:05:18 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-d722879a-da83-4101-b05d-fe73ba20d9d2 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] HCTL ('36', '-', '-', 0) found on session 28 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 18:05:18 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-d722879a-da83-4101-b05d-fe73ba20d9d2 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 18:05:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.024s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:18 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8bb5bf7-a851-4cdc-8787-276f390179cb]: (4, ('- - 0', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:18 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-d722879a-da83-4101-b05d-fe73ba20d9d2 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Searching for a device in session 28 and hctl ['36', '*', '*', 0] yield: None {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 18:05:19 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-d722879a-da83-4101-b05d-fe73ba20d9d2 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Searching for a device in session 28 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 18:05:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d722879a-da83-4101-b05d-fe73ba20d9d2 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:9e777185-e622-48b2-af17-fa73919b33b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oPAczBjY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 18:05:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-d722879a-da83-4101-b05d-fe73ba20d9d2 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:05:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d722879a-da83-4101-b05d-fe73ba20d9d2 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '23130353562393263', 'path': '/dev/sde'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:05:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d722879a-da83-4101-b05d-fe73ba20d9d2 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130353562393263', 'path': '/dev/sde'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 18:05:19 user nova-compute[75100]: DEBUG nova.objects.instance [None req-d722879a-da83-4101-b05d-fe73ba20d9d2 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Lazy-loading 'flavor' on Instance uuid 9dabb40d-299b-4c8a-bc92-63e5c0932047 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:05:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-d722879a-da83-4101-b05d-fe73ba20d9d2 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 18:05:19 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:05:19 user nova-compute[75100]:   <source dev="/dev/sde"/>
Nov 10 18:05:19 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 18:05:19 user nova-compute[75100]:   <serial>9e777185-e622-48b2-af17-fa73919b33b5</serial>
Nov 10 18:05:19 user nova-compute[75100]: </disk>
Nov 10 18:05:19 user nova-compute[75100]:  {{(pid=75100) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 18:05:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:05:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d722879a-da83-4101-b05d-fe73ba20d9d2 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 18:05:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d722879a-da83-4101-b05d-fe73ba20d9d2 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 18:05:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d722879a-da83-4101-b05d-fe73ba20d9d2 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] No VIF found with MAC fa:16:3e:64:1d:f2, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 18:05:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d722879a-da83-4101-b05d-fe73ba20d9d2 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Lock "9dabb40d-299b-4c8a-bc92-63e5c0932047" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.647s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:05:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:05:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d952c1ad-4c9f-4a41-97fb-6f70bbf79854 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Acquiring lock "9dabb40d-299b-4c8a-bc92-63e5c0932047" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:05:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d952c1ad-4c9f-4a41-97fb-6f70bbf79854 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Lock "9dabb40d-299b-4c8a-bc92-63e5c0932047" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:05:21 user nova-compute[75100]: INFO nova.compute.manager [None req-d952c1ad-4c9f-4a41-97fb-6f70bbf79854 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] Detaching volume 9e777185-e622-48b2-af17-fa73919b33b5
Nov 10 18:05:21 user nova-compute[75100]: INFO nova.virt.block_device [None req-d952c1ad-4c9f-4a41-97fb-6f70bbf79854 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] Attempting to driver detach volume 9e777185-e622-48b2-af17-fa73919b33b5 from mountpoint /dev/vdb
Nov 10 18:05:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d952c1ad-4c9f-4a41-97fb-6f70bbf79854 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Attempting to detach device vdb from instance 9dabb40d-299b-4c8a-bc92-63e5c0932047 from the persistent domain config. {{(pid=75100) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 18:05:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-d952c1ad-4c9f-4a41-97fb-6f70bbf79854 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 18:05:21 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:05:21 user nova-compute[75100]:   <source dev="/dev/sde"/>
Nov 10 18:05:21 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 18:05:21 user nova-compute[75100]:   <serial>9e777185-e622-48b2-af17-fa73919b33b5</serial>
Nov 10 18:05:21 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 18:05:21 user nova-compute[75100]: </disk>
Nov 10 18:05:21 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 18:05:21 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-d952c1ad-4c9f-4a41-97fb-6f70bbf79854 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Successfully detached device vdb from instance 9dabb40d-299b-4c8a-bc92-63e5c0932047 from the persistent domain config.
Nov 10 18:05:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d952c1ad-4c9f-4a41-97fb-6f70bbf79854 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9dabb40d-299b-4c8a-bc92-63e5c0932047 from the live domain config. {{(pid=75100) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 18:05:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-d952c1ad-4c9f-4a41-97fb-6f70bbf79854 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 18:05:21 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:05:21 user nova-compute[75100]:   <source dev="/dev/sde"/>
Nov 10 18:05:21 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 18:05:21 user nova-compute[75100]:   <serial>9e777185-e622-48b2-af17-fa73919b33b5</serial>
Nov 10 18:05:21 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 18:05:21 user nova-compute[75100]: </disk>
Nov 10 18:05:21 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 18:05:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d952c1ad-4c9f-4a41-97fb-6f70bbf79854 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9dabb40d-299b-4c8a-bc92-63e5c0932047 {{(pid=75100) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 18:05:23 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:05:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9610bfc5-c134-4bc0-b34c-6d1d4c85c689 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Acquiring lock "ce634a11-5628-4f1c-8437-95f26519d8a0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:05:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9610bfc5-c134-4bc0-b34c-6d1d4c85c689 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "ce634a11-5628-4f1c-8437-95f26519d8a0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:05:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9610bfc5-c134-4bc0-b34c-6d1d4c85c689 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Acquiring lock "ce634a11-5628-4f1c-8437-95f26519d8a0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:05:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9610bfc5-c134-4bc0-b34c-6d1d4c85c689 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "ce634a11-5628-4f1c-8437-95f26519d8a0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:05:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9610bfc5-c134-4bc0-b34c-6d1d4c85c689 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "ce634a11-5628-4f1c-8437-95f26519d8a0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:05:23 user nova-compute[75100]: INFO nova.compute.manager [None req-9610bfc5-c134-4bc0-b34c-6d1d4c85c689 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Terminating instance
Nov 10 18:05:23 user nova-compute[75100]: DEBUG nova.compute.manager [None req-9610bfc5-c134-4bc0-b34c-6d1d4c85c689 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 18:05:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:05:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:05:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:05:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:05:24 user nova-compute[75100]: DEBUG nova.compute.manager [req-bca4320a-848c-42cc-9686-c4198773d8ad req-918c7ca8-d57c-4cae-9f80-a638e336b374 service nova] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Received event network-vif-unplugged-4c3793c8-de6c-4246-9a29-46ac085f065e {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:05:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-bca4320a-848c-42cc-9686-c4198773d8ad req-918c7ca8-d57c-4cae-9f80-a638e336b374 service nova] Acquiring lock "ce634a11-5628-4f1c-8437-95f26519d8a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:05:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-bca4320a-848c-42cc-9686-c4198773d8ad req-918c7ca8-d57c-4cae-9f80-a638e336b374 service nova] Lock "ce634a11-5628-4f1c-8437-95f26519d8a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:05:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-bca4320a-848c-42cc-9686-c4198773d8ad req-918c7ca8-d57c-4cae-9f80-a638e336b374 service nova] Lock "ce634a11-5628-4f1c-8437-95f26519d8a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:05:24 user nova-compute[75100]: DEBUG nova.compute.manager [req-bca4320a-848c-42cc-9686-c4198773d8ad req-918c7ca8-d57c-4cae-9f80-a638e336b374 service nova] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] No waiting events found dispatching network-vif-unplugged-4c3793c8-de6c-4246-9a29-46ac085f065e {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:05:24 user nova-compute[75100]: DEBUG nova.compute.manager [req-bca4320a-848c-42cc-9686-c4198773d8ad req-918c7ca8-d57c-4cae-9f80-a638e336b374 service nova] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Received event network-vif-unplugged-4c3793c8-de6c-4246-9a29-46ac085f065e for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 18:05:24 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:05:24 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Instance destroyed successfully.
Nov 10 18:05:24 user nova-compute[75100]: DEBUG nova.objects.instance [None req-9610bfc5-c134-4bc0-b34c-6d1d4c85c689 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lazy-loading 'resources' on Instance uuid ce634a11-5628-4f1c-8437-95f26519d8a0 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:05:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-9610bfc5-c134-4bc0-b34c-6d1d4c85c689 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T17:59:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-727841680',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-727841680',id=31,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNXJUSH8ImyQEQfIfFe1NG91+SubEBrWrTHrr4HPhH4qdxn71cE+Nbpwrengk/NgRguInZ4Ho95ee7g3Uxxbl34+PMj5HYderPpgNTv1f1rj1py60lD1qnogBB8DmNmDCg==',key_name='tempest-keypair-461573842',keypairs=<?>,launch_index=0,launched_at=2023-11-10T18:03:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ae38bb92c5474a578f3827bdae12cd74',ramdisk_id='',reservation_id='r-i78hj9rl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2073508773',owner_user_name='tempest-AttachVolumeShelveTestJSON-2073508773-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T18:03:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='805917c846f34264b51388bfd9a8413f',uuid=ce634a11-5628-4f1c-8437-95f26519d8a0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c3793c8-de6c-4246-9a29-46ac085f065e", "address": "fa:16:3e:a0:b0:b8", "network": {"id": "7a78ac5d-8f24-436d-9cb9-05f4efecb101", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-476509015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae38bb92c5474a578f3827bdae12cd74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c3793c8-de", "ovs_interfaceid": "4c3793c8-de6c-4246-9a29-46ac085f065e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 18:05:24 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-9610bfc5-c134-4bc0-b34c-6d1d4c85c689 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Converting VIF {"id": "4c3793c8-de6c-4246-9a29-46ac085f065e", "address": "fa:16:3e:a0:b0:b8", "network": {"id": "7a78ac5d-8f24-436d-9cb9-05f4efecb101", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-476509015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae38bb92c5474a578f3827bdae12cd74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c3793c8-de", "ovs_interfaceid": "4c3793c8-de6c-4246-9a29-46ac085f065e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:05:24 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-9610bfc5-c134-4bc0-b34c-6d1d4c85c689 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:b0:b8,bridge_name='br-int',has_traffic_filtering=True,id=4c3793c8-de6c-4246-9a29-46ac085f065e,network=Network(7a78ac5d-8f24-436d-9cb9-05f4efecb101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c3793c8-de') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:05:24 user nova-compute[75100]: DEBUG os_vif [None req-9610bfc5-c134-4bc0-b34c-6d1d4c85c689 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:b0:b8,bridge_name='br-int',has_traffic_filtering=True,id=4c3793c8-de6c-4246-9a29-46ac085f065e,network=Network(7a78ac5d-8f24-436d-9cb9-05f4efecb101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c3793c8-de') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 18:05:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:05:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c3793c8-de, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:05:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:05:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:05:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cc930951-214b-41b1-a9c1-9402c60cc91a) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:05:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:05:24 user nova-compute[75100]: INFO os_vif [None req-9610bfc5-c134-4bc0-b34c-6d1d4c85c689 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:b0:b8,bridge_name='br-int',has_traffic_filtering=True,id=4c3793c8-de6c-4246-9a29-46ac085f065e,network=Network(7a78ac5d-8f24-436d-9cb9-05f4efecb101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c3793c8-de')
Nov 10 18:05:24 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-9610bfc5-c134-4bc0-b34c-6d1d4c85c689 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Deleting instance files /opt/stack/data/nova/instances/ce634a11-5628-4f1c-8437-95f26519d8a0_del
Nov 10 18:05:24 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-9610bfc5-c134-4bc0-b34c-6d1d4c85c689 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Deletion of /opt/stack/data/nova/instances/ce634a11-5628-4f1c-8437-95f26519d8a0_del complete
Nov 10 18:05:24 user nova-compute[75100]: INFO nova.compute.manager [None req-9610bfc5-c134-4bc0-b34c-6d1d4c85c689 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 10 18:05:24 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-9610bfc5-c134-4bc0-b34c-6d1d4c85c689 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 18:05:24 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 18:05:24 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 18:05:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2f4f360d-1754-4f6d-9de6-aff7606eab0d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Acquiring lock "b0bae328-2528-4562-850b-14fa108923c6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:05:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2f4f360d-1754-4f6d-9de6-aff7606eab0d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "b0bae328-2528-4562-850b-14fa108923c6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:05:24 user nova-compute[75100]: DEBUG nova.objects.instance [None req-2f4f360d-1754-4f6d-9de6-aff7606eab0d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lazy-loading 'flavor' on Instance uuid b0bae328-2528-4562-850b-14fa108923c6 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:05:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2f4f360d-1754-4f6d-9de6-aff7606eab0d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "b0bae328-2528-4562-850b-14fa108923c6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:05:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:05:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2f4f360d-1754-4f6d-9de6-aff7606eab0d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Acquiring lock "b0bae328-2528-4562-850b-14fa108923c6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:05:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2f4f360d-1754-4f6d-9de6-aff7606eab0d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "b0bae328-2528-4562-850b-14fa108923c6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:05:24 user nova-compute[75100]: INFO nova.compute.manager [None req-2f4f360d-1754-4f6d-9de6-aff7606eab0d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: b0bae328-2528-4562-850b-14fa108923c6] Attaching volume 8c1a4aa0-d680-4608-b4a4-56115b4d5cbf to /dev/vdb
Nov 10 18:05:24 user nova-compute[75100]: DEBUG os_brick.utils [None req-2f4f360d-1754-4f6d-9de6-aff7606eab0d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:05:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:24 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[52626839-06c7-4846-b3a9-a149580528cd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90b1a229568f\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:24 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ca1b34-4e69-4360-a511-2e5f9581fe78]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:24 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b17be571-db10-445c-81ca-a9c895dccfe7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:24 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[693fb9f7-ebae-436b-9224-fd1109d8cde4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-2f4f360d-1754-4f6d-9de6-aff7606eab0d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-2f4f360d-1754-4f6d-9de6-aff7606eab0d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 18:05:24 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2f4f360d-1754-4f6d-9de6-aff7606eab0d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 18:05:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 18:05:24 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 18:05:24 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1672ec9d-51e4-4f1e-b977-4d4dfde121bf]: (4, '') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:24 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-2f4f360d-1754-4f6d-9de6-aff7606eab0d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 18:05:24 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-2f4f360d-1754-4f6d-9de6-aff7606eab0d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 18:05:24 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-2f4f360d-1754-4f6d-9de6-aff7606eab0d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 18:05:24 user nova-compute[75100]: DEBUG os_brick.utils [None req-2f4f360d-1754-4f6d-9de6-aff7606eab0d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90b1a229568f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:05:24 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-2f4f360d-1754-4f6d-9de6-aff7606eab0d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: b0bae328-2528-4562-850b-14fa108923c6] Updating existing volume attachment record: 6bfe260e-1fc4-4df0-8893-8f3158e79d46 {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 18:05:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:05:25 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:05:25 user nova-compute[75100]: DEBUG nova.compute.manager [req-8d0fae4b-35ff-41eb-a69c-8ca0eefb0157 req-f7434f76-ad87-4edd-bb9c-8ac3244d3927 service nova] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Received event network-vif-deleted-4c3793c8-de6c-4246-9a29-46ac085f065e {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:05:25 user nova-compute[75100]: INFO nova.compute.manager [req-8d0fae4b-35ff-41eb-a69c-8ca0eefb0157 req-f7434f76-ad87-4edd-bb9c-8ac3244d3927 service nova] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Neutron deleted interface 4c3793c8-de6c-4246-9a29-46ac085f065e; detaching it from the instance and deleting it from the info cache
Nov 10 18:05:25 user nova-compute[75100]: DEBUG nova.network.neutron [req-8d0fae4b-35ff-41eb-a69c-8ca0eefb0157 req-f7434f76-ad87-4edd-bb9c-8ac3244d3927 service nova] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:05:25 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Took 1.18 seconds to deallocate network for instance.
Nov 10 18:05:25 user nova-compute[75100]: DEBUG nova.compute.manager [req-8d0fae4b-35ff-41eb-a69c-8ca0eefb0157 req-f7434f76-ad87-4edd-bb9c-8ac3244d3927 service nova] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Detach interface failed, port_id=4c3793c8-de6c-4246-9a29-46ac085f065e, reason: Instance ce634a11-5628-4f1c-8437-95f26519d8a0 could not be found. {{(pid=75100) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 18:05:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9610bfc5-c134-4bc0-b34c-6d1d4c85c689 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:05:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9610bfc5-c134-4bc0-b34c-6d1d4c85c689 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:05:26 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-9610bfc5-c134-4bc0-b34c-6d1d4c85c689 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:05:26 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-9610bfc5-c134-4bc0-b34c-6d1d4c85c689 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:05:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9610bfc5-c134-4bc0-b34c-6d1d4c85c689 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.373s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:05:26 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-9610bfc5-c134-4bc0-b34c-6d1d4c85c689 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Deleted allocations for instance ce634a11-5628-4f1c-8437-95f26519d8a0
Nov 10 18:05:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9610bfc5-c134-4bc0-b34c-6d1d4c85c689 tempest-AttachVolumeShelveTestJSON-2073508773 tempest-AttachVolumeShelveTestJSON-2073508773-project-member] Lock "ce634a11-5628-4f1c-8437-95f26519d8a0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.611s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:05:26 user nova-compute[75100]: DEBUG nova.compute.manager [req-d6bb0b8e-e7d6-4300-9cf3-1f4c05fa8239 req-d4e7f295-b891-4e2c-b01f-cc7d5d03946e service nova] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Received event network-vif-plugged-4c3793c8-de6c-4246-9a29-46ac085f065e {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:05:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d6bb0b8e-e7d6-4300-9cf3-1f4c05fa8239 req-d4e7f295-b891-4e2c-b01f-cc7d5d03946e service nova] Acquiring lock "ce634a11-5628-4f1c-8437-95f26519d8a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:05:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d6bb0b8e-e7d6-4300-9cf3-1f4c05fa8239 req-d4e7f295-b891-4e2c-b01f-cc7d5d03946e service nova] Lock "ce634a11-5628-4f1c-8437-95f26519d8a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:05:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d6bb0b8e-e7d6-4300-9cf3-1f4c05fa8239 req-d4e7f295-b891-4e2c-b01f-cc7d5d03946e service nova] Lock "ce634a11-5628-4f1c-8437-95f26519d8a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:05:26 user nova-compute[75100]: DEBUG nova.compute.manager [req-d6bb0b8e-e7d6-4300-9cf3-1f4c05fa8239 req-d4e7f295-b891-4e2c-b01f-cc7d5d03946e service nova] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] No waiting events found dispatching network-vif-plugged-4c3793c8-de6c-4246-9a29-46ac085f065e {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:05:26 user nova-compute[75100]: WARNING nova.compute.manager [req-d6bb0b8e-e7d6-4300-9cf3-1f4c05fa8239 req-d4e7f295-b891-4e2c-b01f-cc7d5d03946e service nova] [instance: ce634a11-5628-4f1c-8437-95f26519d8a0] Received unexpected event network-vif-plugged-4c3793c8-de6c-4246-9a29-46ac085f065e for instance with vm_state deleted and task_state None.
Nov 10 18:05:27 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:05:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:05:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:05:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:05:27 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 18:05:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5194f111-ba1a-43bc-9564-b744d1960307/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5194f111-ba1a-43bc-9564-b744d1960307/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5194f111-ba1a-43bc-9564-b744d1960307/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5194f111-ba1a-43bc-9564-b744d1960307/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 18:05:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0bae328-2528-4562-850b-14fa108923c6/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0bae328-2528-4562-850b-14fa108923c6/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0bae328-2528-4562-850b-14fa108923c6/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0bae328-2528-4562-850b-14fa108923c6/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1937fab6-d892-406e-b8ff-52194021eea4/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1937fab6-d892-406e-b8ff-52194021eea4/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1937fab6-d892-406e-b8ff-52194021eea4/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1937fab6-d892-406e-b8ff-52194021eea4/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b704998f-d059-4525-9089-2083ae863ad3 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Acquiring lock "1937fab6-d892-406e-b8ff-52194021eea4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:05:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b704998f-d059-4525-9089-2083ae863ad3 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "1937fab6-d892-406e-b8ff-52194021eea4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:05:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dabb40d-299b-4c8a-bc92-63e5c0932047/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:29 user nova-compute[75100]: DEBUG nova.objects.instance [None req-b704998f-d059-4525-9089-2083ae863ad3 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lazy-loading 'flavor' on Instance uuid 1937fab6-d892-406e-b8ff-52194021eea4 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:05:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:05:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b704998f-d059-4525-9089-2083ae863ad3 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "1937fab6-d892-406e-b8ff-52194021eea4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.127s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:05:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dabb40d-299b-4c8a-bc92-63e5c0932047/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dabb40d-299b-4c8a-bc92-63e5c0932047/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b704998f-d059-4525-9089-2083ae863ad3 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Acquiring lock "1937fab6-d892-406e-b8ff-52194021eea4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:05:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b704998f-d059-4525-9089-2083ae863ad3 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "1937fab6-d892-406e-b8ff-52194021eea4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:05:29 user nova-compute[75100]: INFO nova.compute.manager [None req-b704998f-d059-4525-9089-2083ae863ad3 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Attaching volume 48e48c44-c29c-4086-820f-2a8afbdcd6a8 to /dev/vdb
Nov 10 18:05:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dabb40d-299b-4c8a-bc92-63e5c0932047/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:29 user nova-compute[75100]: DEBUG os_brick.utils [None req-b704998f-d059-4525-9089-2083ae863ad3 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:05:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc2bfb6-fd6b-4229-9664-42f33b138444/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:29 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b4c554-8d48-47c5-a02e-28a58633d238]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90b1a229568f\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:29 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd657c16-7427-48ca-9a81-b8e45829699f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:29 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[43510b6e-6c1f-49bc-8a09-93887448c9b2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:29 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ead25f-717f-4567-8f5e-edd8189b2191]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-b704998f-d059-4525-9089-2083ae863ad3 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-b704998f-d059-4525-9089-2083ae863ad3 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 18:05:29 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b704998f-d059-4525-9089-2083ae863ad3 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 18:05:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 18:05:29 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 18:05:29 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a770fdc5-4ea1-4e4b-a111-cb79ac2c2fdc]: (4, '') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:29 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-b704998f-d059-4525-9089-2083ae863ad3 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 18:05:29 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-b704998f-d059-4525-9089-2083ae863ad3 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 18:05:29 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-b704998f-d059-4525-9089-2083ae863ad3 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 18:05:29 user nova-compute[75100]: DEBUG os_brick.utils [None req-b704998f-d059-4525-9089-2083ae863ad3 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90b1a229568f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:05:29 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-b704998f-d059-4525-9089-2083ae863ad3 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Updating existing volume attachment record: 52491d32-1591-4f4a-b484-6615057978fe {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 18:05:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc2bfb6-fd6b-4229-9664-42f33b138444/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc2bfb6-fd6b-4229-9664-42f33b138444/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc2bfb6-fd6b-4229-9664-42f33b138444/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 18:05:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc2bfb6-fd6b-4229-9664-42f33b138444/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc2bfb6-fd6b-4229-9664-42f33b138444/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc2bfb6-fd6b-4229-9664-42f33b138444/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc2bfb6-fd6b-4229-9664-42f33b138444/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 18:05:30 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:05:30 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:05:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Hypervisor/Node resource view: name=user free_ram=7796MB free_disk=24.28915786743164GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 18:05:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:05:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:05:31 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:05:31 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance fcc2bfb6-fd6b-4229-9664-42f33b138444 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:05:31 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 9dabb40d-299b-4c8a-bc92-63e5c0932047 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:05:31 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 5194f111-ba1a-43bc-9564-b744d1960307 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:05:31 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance b0bae328-2528-4562-850b-14fa108923c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:05:31 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 1937fab6-d892-406e-b8ff-52194021eea4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:05:31 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 4ebd9d80-365d-4334-8421-3b22a846321a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:05:31 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance dc8c4fa7-668a-4348-be16-9eb06420b01f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:05:31 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 18:05:31 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 18:05:31 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:05:31 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:05:31 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 18:05:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.581s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:05:33 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:05:33 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:05:33 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:05:33 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:05:33 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75100) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 18:05:33 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:05:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:05:35 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG nova.compute.manager [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 18:05:37 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Creating image(s)
Nov 10 18:05:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Did not create local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Ensure instance console log exists: /opt/stack/data/nova/instances/dc8c4fa7-668a-4348-be16-9eb06420b01f/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Start _get_guest_xml network_info=[{"id": "d65a39e5-d2df-4de4-943c-fb71b88fc381", "address": "fa:16:3e:01:98:2f", "network": {"id": "2a85480b-f67d-4ef1-b967-3e93af57d7c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1717495768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9cd441a46aa4a579feff608d6ff9bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd65a39e5-d2", "ovs_interfaceid": "d65a39e5-d2df-4de4-943c-fb71b88fc381", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JEPndhyG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dc8c4fa7-668a-4348-be16-9eb06420b01f', 'attached_at': '', 'detached_at': '', 'volume_id': 'a54f8ddb-2769-4cf8-9e3e-e199b57b3005', 'serial': 'a54f8ddb-2769-4cf8-9e3e-e199b57b3005'}, 'mount_device': '/dev/vda', 'attachment_id': 'e0ba7bdf-acac-4a25-aea9-c334941ade83', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 18:05:37 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:05:37 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:05:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T17:40:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JEPndhyG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:05:37 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:05:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:05:37 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:05:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:05:37 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 18:05:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 -p 172.16.0.220:3260 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9547ff2b-bb7b-4ab9-a23f-dafe2229ed05]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 18:05:37 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 -p 172.16.0.220:3260 --interface default --op new {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f35b96-8c24-4989-874e-16bfe1914a4b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005] added\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005] added
Nov 10 18:05:37 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[005f5682-2a6f-41f7-a88d-f743d7a35d7e]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.111s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7641434f-5a27-448b-a4da-f94681f78d6b]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JEPndhyG {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JEPndhyG" returned: 0 in 0.024s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[458327da-000e-40a9-b046-5fd7087a9f2c]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JEPndhyG'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27ae760-5335-4edd-b332-69707efd1174]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ede4b2-a29d-47a8-8913-80abea51fccb]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e777185-e622-48b2-af17-fa73919b33b5 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)
Nov 10 18:05:37 user nova-compute[75100]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 (non-flash)
Nov 10 18:05:37 user nova-compute[75100]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be (non-flash)
Nov 10 18:05:37 user nova-compute[75100]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e777185-e622-48b2-af17-fa73919b33b5 (non-flash)
Nov 10 18:05:37 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)
Nov 10 18:05:37 user nova-compute[75100]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 (non-flash)
Nov 10 18:05:37 user nova-compute[75100]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be (non-flash)
Nov 10 18:05:37 user nova-compute[75100]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e777185-e622-48b2-af17-fa73919b33b5 (non-flash)
Nov 10 18:05:37 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 -p 172.16.0.220:3260 --login {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b13ca6-2813-43f0-b6fd-fc4f4a900490]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005, portal: 172.16.0.220,3260]
Nov 10 18:05:37 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005, portal: 172.16.0.220,3260] successful.
Nov 10 18:05:37 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a285b4ec-b277-4e2c-bab5-21ed9c86b1df]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[664aab87-b05c-4ddc-82c6-c2a4b58f3c66]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e777185-e622-48b2-af17-fa73919b33b5 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)
Nov 10 18:05:37 user nova-compute[75100]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 (non-flash)
Nov 10 18:05:37 user nova-compute[75100]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be (non-flash)
Nov 10 18:05:37 user nova-compute[75100]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e777185-e622-48b2-af17-fa73919b33b5 (non-flash)
Nov 10 18:05:37 user nova-compute[75100]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 (non-flash)
Nov 10 18:05:37 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)
Nov 10 18:05:37 user nova-compute[75100]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 (non-flash)
Nov 10 18:05:37 user nova-compute[75100]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be (non-flash)
Nov 10 18:05:37 user nova-compute[75100]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e777185-e622-48b2-af17-fa73919b33b5 (non-flash)
Nov 10 18:05:37 user nova-compute[75100]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 (non-flash)
Nov 10 18:05:37 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.403s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] HCTL ('37', '-', '-', 0) found on session 29 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57a7be0-1be8-4cdd-b6e1-245097d8f1ac]: (4, ('- - 0', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Searching for a device in session 29 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 18:05:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JEPndhyG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 18:05:38 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:05:38 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 18:05:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "refresh_cache-fcc2bfb6-fd6b-4229-9664-42f33b138444" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:05:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquired lock "refresh_cache-fcc2bfb6-fd6b-4229-9664-42f33b138444" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:05:38 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 18:05:38 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.440s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:05:38 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] <== connect_volume: return (1442ms) {'type': 'block', 'scsi_wwn': '23637303233313361', 'path': '/dev/sdf'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:05:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637303233313361', 'path': '/dev/sdf'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 18:05:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:05:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1987059142',display_name='tempest-TestVolumeBootPattern-server-1987059142',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1987059142',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILrjRswgoJPqA+suzoqc8EEXkFg1B3St2cTU0CL5tiD3TI/qO87+FOfxjV/dwwN6UPPBmEGN67tPxZrctQdNsOvA6IRt0kMT8eF3nDG1qAx3cky0fCNWo1RZsce/R29pA==',key_name='tempest-TestVolumeBootPattern-1607857152',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9cd441a46aa4a579feff608d6ff9bb4',ramdisk_id='',reservation_id='r-c37qv8k5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-706331648',owner_user_name='tempest-TestVolumeBootPattern-706331648-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T18:05:10Z,user_data=None,user_id='323c5738ca424a379f666b4ca60825ac',uuid=dc8c4fa7-668a-4348-be16-9eb06420b01f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d65a39e5-d2df-4de4-943c-fb71b88fc381", "address": "fa:16:3e:01:98:2f", "network": {"id": "2a85480b-f67d-4ef1-b967-3e93af57d7c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1717495768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9cd441a46aa4a579feff608d6ff9bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd65a39e5-d2", "ovs_interfaceid": "d65a39e5-d2df-4de4-943c-fb71b88fc381", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 18:05:38 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Converting VIF {"id": "d65a39e5-d2df-4de4-943c-fb71b88fc381", "address": "fa:16:3e:01:98:2f", "network": {"id": "2a85480b-f67d-4ef1-b967-3e93af57d7c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1717495768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9cd441a46aa4a579feff608d6ff9bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd65a39e5-d2", "ovs_interfaceid": "d65a39e5-d2df-4de4-943c-fb71b88fc381", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:05:38 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:98:2f,bridge_name='br-int',has_traffic_filtering=True,id=d65a39e5-d2df-4de4-943c-fb71b88fc381,network=Network(2a85480b-f67d-4ef1-b967-3e93af57d7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd65a39e5-d2') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:05:38 user nova-compute[75100]: DEBUG nova.objects.instance [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lazy-loading 'pci_devices' on Instance uuid dc8c4fa7-668a-4348-be16-9eb06420b01f {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:05:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] End _get_guest_xml xml=<domain type="kvm">
Nov 10 18:05:38 user nova-compute[75100]:   <uuid>dc8c4fa7-668a-4348-be16-9eb06420b01f</uuid>
Nov 10 18:05:38 user nova-compute[75100]:   <name>instance-00000027</name>
Nov 10 18:05:38 user nova-compute[75100]:   <memory>524288</memory>
Nov 10 18:05:38 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 10 18:05:38 user nova-compute[75100]:   <metadata>
Nov 10 18:05:38 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 18:05:38 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 10 18:05:38 user nova-compute[75100]:       <nova:name>tempest-TestVolumeBootPattern-server-1987059142</nova:name>
Nov 10 18:05:38 user nova-compute[75100]:       <nova:creationTime>2023-11-10 18:05:37</nova:creationTime>
Nov 10 18:05:38 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 10 18:05:38 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 10 18:05:38 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 10 18:05:38 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 10 18:05:38 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 18:05:38 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 10 18:05:38 user nova-compute[75100]:       </nova:flavor>
Nov 10 18:05:38 user nova-compute[75100]:       <nova:owner>
Nov 10 18:05:38 user nova-compute[75100]:         <nova:user uuid="323c5738ca424a379f666b4ca60825ac">tempest-TestVolumeBootPattern-706331648-project-member</nova:user>
Nov 10 18:05:38 user nova-compute[75100]:         <nova:project uuid="b9cd441a46aa4a579feff608d6ff9bb4">tempest-TestVolumeBootPattern-706331648</nova:project>
Nov 10 18:05:38 user nova-compute[75100]:       </nova:owner>
Nov 10 18:05:38 user nova-compute[75100]:       <nova:ports>
Nov 10 18:05:38 user nova-compute[75100]:         <nova:port uuid="d65a39e5-d2df-4de4-943c-fb71b88fc381">
Nov 10 18:05:38 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 10 18:05:38 user nova-compute[75100]:         </nova:port>
Nov 10 18:05:38 user nova-compute[75100]:       </nova:ports>
Nov 10 18:05:38 user nova-compute[75100]:     </nova:instance>
Nov 10 18:05:38 user nova-compute[75100]:   </metadata>
Nov 10 18:05:38 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 10 18:05:38 user nova-compute[75100]:     <system>
Nov 10 18:05:38 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 18:05:38 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 10 18:05:38 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 10 18:05:38 user nova-compute[75100]:       <entry name="serial">dc8c4fa7-668a-4348-be16-9eb06420b01f</entry>
Nov 10 18:05:38 user nova-compute[75100]:       <entry name="uuid">dc8c4fa7-668a-4348-be16-9eb06420b01f</entry>
Nov 10 18:05:38 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 10 18:05:38 user nova-compute[75100]:     </system>
Nov 10 18:05:38 user nova-compute[75100]:   </sysinfo>
Nov 10 18:05:38 user nova-compute[75100]:   <os>
Nov 10 18:05:38 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 18:05:38 user nova-compute[75100]:     <boot dev="hd"/>
Nov 10 18:05:38 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 10 18:05:38 user nova-compute[75100]:   </os>
Nov 10 18:05:38 user nova-compute[75100]:   <features>
Nov 10 18:05:38 user nova-compute[75100]:     <acpi/>
Nov 10 18:05:38 user nova-compute[75100]:     <apic/>
Nov 10 18:05:38 user nova-compute[75100]:     <vmcoreinfo/>
Nov 10 18:05:38 user nova-compute[75100]:   </features>
Nov 10 18:05:38 user nova-compute[75100]:   <clock offset="utc">
Nov 10 18:05:38 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 18:05:38 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 18:05:38 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 10 18:05:38 user nova-compute[75100]:   </clock>
Nov 10 18:05:38 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 10 18:05:38 user nova-compute[75100]:     <model>Nehalem</model>
Nov 10 18:05:38 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 18:05:38 user nova-compute[75100]:   </cpu>
Nov 10 18:05:38 user nova-compute[75100]:   <devices>
Nov 10 18:05:38 user nova-compute[75100]:     <disk type="block" device="disk">
Nov 10 18:05:38 user nova-compute[75100]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:05:38 user nova-compute[75100]:       <source dev="/dev/sdf"/>
Nov 10 18:05:38 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 10 18:05:38 user nova-compute[75100]:       <serial>a54f8ddb-2769-4cf8-9e3e-e199b57b3005</serial>
Nov 10 18:05:38 user nova-compute[75100]:     </disk>
Nov 10 18:05:38 user nova-compute[75100]:     <interface type="ethernet">
Nov 10 18:05:38 user nova-compute[75100]:       <mac address="fa:16:3e:01:98:2f"/>
Nov 10 18:05:38 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 18:05:38 user nova-compute[75100]:       <mtu size="1442"/>
Nov 10 18:05:38 user nova-compute[75100]:       <target dev="tapd65a39e5-d2"/>
Nov 10 18:05:38 user nova-compute[75100]:     </interface>
Nov 10 18:05:38 user nova-compute[75100]:     <serial type="pty">
Nov 10 18:05:38 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/dc8c4fa7-668a-4348-be16-9eb06420b01f/console.log" append="off"/>
Nov 10 18:05:38 user nova-compute[75100]:     </serial>
Nov 10 18:05:38 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 18:05:38 user nova-compute[75100]:     <video>
Nov 10 18:05:38 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 18:05:38 user nova-compute[75100]:     </video>
Nov 10 18:05:38 user nova-compute[75100]:     <rng model="virtio">
Nov 10 18:05:38 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 10 18:05:38 user nova-compute[75100]:     </rng>
Nov 10 18:05:38 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 10 18:05:38 user nova-compute[75100]:     <memballoon model="virtio">
Nov 10 18:05:38 user nova-compute[75100]:       <stats period="10"/>
Nov 10 18:05:38 user nova-compute[75100]:     </memballoon>
Nov 10 18:05:38 user nova-compute[75100]:   </devices>
Nov 10 18:05:38 user nova-compute[75100]: </domain>
Nov 10 18:05:38 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 18:05:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:05:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1987059142',display_name='tempest-TestVolumeBootPattern-server-1987059142',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1987059142',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILrjRswgoJPqA+suzoqc8EEXkFg1B3St2cTU0CL5tiD3TI/qO87+FOfxjV/dwwN6UPPBmEGN67tPxZrctQdNsOvA6IRt0kMT8eF3nDG1qAx3cky0fCNWo1RZsce/R29pA==',key_name='tempest-TestVolumeBootPattern-1607857152',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9cd441a46aa4a579feff608d6ff9bb4',ramdisk_id='',reservation_id='r-c37qv8k5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-706331648',owner_user_name='tempest-TestVolumeBootPattern-706331648-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T18:05:10Z,user_data=None,user_id='323c5738ca424a379f666b4ca60825ac',uuid=dc8c4fa7-668a-4348-be16-9eb06420b01f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d65a39e5-d2df-4de4-943c-fb71b88fc381", "address": "fa:16:3e:01:98:2f", "network": {"id": "2a85480b-f67d-4ef1-b967-3e93af57d7c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1717495768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9cd441a46aa4a579feff608d6ff9bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd65a39e5-d2", "ovs_interfaceid": "d65a39e5-d2df-4de4-943c-fb71b88fc381", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 18:05:38 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Converting VIF {"id": "d65a39e5-d2df-4de4-943c-fb71b88fc381", "address": "fa:16:3e:01:98:2f", "network": {"id": "2a85480b-f67d-4ef1-b967-3e93af57d7c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1717495768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9cd441a46aa4a579feff608d6ff9bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd65a39e5-d2", "ovs_interfaceid": "d65a39e5-d2df-4de4-943c-fb71b88fc381", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:05:38 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:98:2f,bridge_name='br-int',has_traffic_filtering=True,id=d65a39e5-d2df-4de4-943c-fb71b88fc381,network=Network(2a85480b-f67d-4ef1-b967-3e93af57d7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd65a39e5-d2') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:05:38 user nova-compute[75100]: DEBUG os_vif [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:98:2f,bridge_name='br-int',has_traffic_filtering=True,id=d65a39e5-d2df-4de4-943c-fb71b88fc381,network=Network(2a85480b-f67d-4ef1-b967-3e93af57d7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd65a39e5-d2') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 18:05:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:05:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:05:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 18:05:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:05:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd2093ff3-4446-5899-81f3-3295699d61dd', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:05:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:05:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:05:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd65a39e5-d2, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:05:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd65a39e5-d2, col_values=(('qos', UUID('408e0486-bb87-4c79-a098-9ecd6e269b3a')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:05:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd65a39e5-d2, col_values=(('external_ids', {'iface-id': 'd65a39e5-d2df-4de4-943c-fb71b88fc381', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:98:2f', 'vm-uuid': 'dc8c4fa7-668a-4348-be16-9eb06420b01f'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:05:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:05:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:05:38 user nova-compute[75100]: INFO os_vif [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:98:2f,bridge_name='br-int',has_traffic_filtering=True,id=d65a39e5-d2df-4de4-943c-fb71b88fc381,network=Network(2a85480b-f67d-4ef1-b967-3e93af57d7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd65a39e5-d2')
Nov 10 18:05:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 18:05:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] No VIF found with MAC fa:16:3e:01:98:2f, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 18:05:39 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Updating instance_info_cache with network_info: [{"id": "8c7dcf78-fc4a-4fcb-905e-ce75143a9450", "address": "fa:16:3e:be:ec:38", "network": {"id": "20522623-c29d-44f8-9047-68dde7f763c1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1770250829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2871e8755b32497d901be0f062fad858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7dcf78-fc", "ovs_interfaceid": "8c7dcf78-fc4a-4fcb-905e-ce75143a9450", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:05:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Releasing lock "refresh_cache-fcc2bfb6-fd6b-4229-9664-42f33b138444" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:05:39 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 18:05:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:05:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:05:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:05:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:05:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:05:40 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:05:40 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Cleaning up deleted instances {{(pid=75100) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 18:05:40 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] There are 0 instances to clean {{(pid=75100) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 18:05:40 user nova-compute[75100]: DEBUG nova.compute.manager [req-fb8f6087-22f8-4bba-bb59-2fd85d6fb99d req-39582389-1757-45bb-ae4f-21b33ac6894d service nova] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Received event network-vif-plugged-d65a39e5-d2df-4de4-943c-fb71b88fc381 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:05:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-fb8f6087-22f8-4bba-bb59-2fd85d6fb99d req-39582389-1757-45bb-ae4f-21b33ac6894d service nova] Acquiring lock "dc8c4fa7-668a-4348-be16-9eb06420b01f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:05:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-fb8f6087-22f8-4bba-bb59-2fd85d6fb99d req-39582389-1757-45bb-ae4f-21b33ac6894d service nova] Lock "dc8c4fa7-668a-4348-be16-9eb06420b01f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:05:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-fb8f6087-22f8-4bba-bb59-2fd85d6fb99d req-39582389-1757-45bb-ae4f-21b33ac6894d service nova] Lock "dc8c4fa7-668a-4348-be16-9eb06420b01f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:05:40 user nova-compute[75100]: DEBUG nova.compute.manager [req-fb8f6087-22f8-4bba-bb59-2fd85d6fb99d req-39582389-1757-45bb-ae4f-21b33ac6894d service nova] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] No waiting events found dispatching network-vif-plugged-d65a39e5-d2df-4de4-943c-fb71b88fc381 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:05:40 user nova-compute[75100]: WARNING nova.compute.manager [req-fb8f6087-22f8-4bba-bb59-2fd85d6fb99d req-39582389-1757-45bb-ae4f-21b33ac6894d service nova] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Received unexpected event network-vif-plugged-d65a39e5-d2df-4de4-943c-fb71b88fc381 for instance with vm_state building and task_state spawning.
Nov 10 18:05:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:05:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:05:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:05:42 user nova-compute[75100]: DEBUG nova.compute.manager [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 18:05:42 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 18:05:42 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Instance spawned successfully.
Nov 10 18:05:42 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 18:05:42 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:05:42 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:05:42 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:05:42 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:05:42 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:05:42 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:05:42 user nova-compute[75100]: INFO nova.compute.manager [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Took 5.21 seconds to spawn the instance on the hypervisor.
Nov 10 18:05:42 user nova-compute[75100]: DEBUG nova.compute.manager [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 18:05:42 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-d952c1ad-4c9f-4a41-97fb-6f70bbf79854 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9dabb40d-299b-4c8a-bc92-63e5c0932047 is timed out.
Nov 10 18:05:42 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-d952c1ad-4c9f-4a41-97fb-6f70bbf79854 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Successfully detached device vdb from instance 9dabb40d-299b-4c8a-bc92-63e5c0932047 from the live domain config.
Nov 10 18:05:42 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d952c1ad-4c9f-4a41-97fb-6f70bbf79854 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 18:05:42 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d952c1ad-4c9f-4a41-97fb-6f70bbf79854 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, {'target_iqn': 'iqn.2010-10.org.openstack:9e777185-e622-48b2-af17-fa73919b33b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oPAczBjY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:05:42 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-d952c1ad-4c9f-4a41-97fb-6f70bbf79854 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:05:42 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-d952c1ad-4c9f-4a41-97fb-6f70bbf79854 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:05:42 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-d952c1ad-4c9f-4a41-97fb-6f70bbf79854 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:05:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:42 user nova-compute[75100]: DEBUG nova.compute.manager [req-3626a71b-255a-4114-afce-501aa25357c6 req-bf2ef71a-305a-48b5-afaf-9800de58b3b4 service nova] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Received event network-vif-plugged-d65a39e5-d2df-4de4-943c-fb71b88fc381 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:05:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3626a71b-255a-4114-afce-501aa25357c6 req-bf2ef71a-305a-48b5-afaf-9800de58b3b4 service nova] Acquiring lock "dc8c4fa7-668a-4348-be16-9eb06420b01f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:05:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3626a71b-255a-4114-afce-501aa25357c6 req-bf2ef71a-305a-48b5-afaf-9800de58b3b4 service nova] Lock "dc8c4fa7-668a-4348-be16-9eb06420b01f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:05:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3626a71b-255a-4114-afce-501aa25357c6 req-bf2ef71a-305a-48b5-afaf-9800de58b3b4 service nova] Lock "dc8c4fa7-668a-4348-be16-9eb06420b01f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:05:42 user nova-compute[75100]: DEBUG nova.compute.manager [req-3626a71b-255a-4114-afce-501aa25357c6 req-bf2ef71a-305a-48b5-afaf-9800de58b3b4 service nova] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] No waiting events found dispatching network-vif-plugged-d65a39e5-d2df-4de4-943c-fb71b88fc381 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:05:42 user nova-compute[75100]: WARNING nova.compute.manager [req-3626a71b-255a-4114-afce-501aa25357c6 req-bf2ef71a-305a-48b5-afaf-9800de58b3b4 service nova] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Received unexpected event network-vif-plugged-d65a39e5-d2df-4de4-943c-fb71b88fc381 for instance with vm_state building and task_state spawning.
Nov 10 18:05:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:42 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8f13dd-26b4-4460-b92c-b349fca1be1f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e777185-e622-48b2-af17-fa73919b33b5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:42 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d952c1ad-4c9f-4a41-97fb-6f70bbf79854 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 18:05:42 user nova-compute[75100]: No targets found.
Nov 10 18:05:42 user nova-compute[75100]: iSNS:
Nov 10 18:05:42 user nova-compute[75100]: No targets found.
Nov 10 18:05:42 user nova-compute[75100]: STATIC:
Nov 10 18:05:42 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be
Nov 10 18:05:42 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:05:42 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:05:42 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281
Nov 10 18:05:42 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:05:42 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:05:42 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:9e777185-e622-48b2-af17-fa73919b33b5
Nov 10 18:05:42 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:05:42 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:05:42 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005
Nov 10 18:05:42 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:05:42 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:05:42 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7
Nov 10 18:05:42 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:05:42 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:05:42 user nova-compute[75100]: FIRMWARE:
Nov 10 18:05:42 user nova-compute[75100]: No targets found.
Nov 10 18:05:42 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:05:42 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d952c1ad-4c9f-4a41-97fb-6f70bbf79854 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 18:05:42 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 18:05:42 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 18:05:42 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d952c1ad-4c9f-4a41-97fb-6f70bbf79854 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e777185-e622-48b2-af17-fa73919b33b5', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 18:05:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:42 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dfecb12-025b-40f1-9604-01fdc67568ed]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e777185-e622-48b2-af17-fa73919b33b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:42 user nova-compute[75100]: INFO nova.compute.manager [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Took 32.85 seconds to build instance.
Nov 10 18:05:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fe7dfe75-2402-4968-a673-44ba77d41d05 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "dc8c4fa7-668a-4348-be16-9eb06420b01f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 32.985s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:05:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:42 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1e9b5b-5dbb-45d3-8bf3-36383a8847c5]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e777185-e622-48b2-af17-fa73919b33b5 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:42 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d952c1ad-4c9f-4a41-97fb-6f70bbf79854 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)
Nov 10 18:05:42 user nova-compute[75100]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 (non-flash)
Nov 10 18:05:42 user nova-compute[75100]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be (non-flash)
Nov 10 18:05:42 user nova-compute[75100]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e777185-e622-48b2-af17-fa73919b33b5 (non-flash)
Nov 10 18:05:42 user nova-compute[75100]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 (non-flash)
Nov 10 18:05:42 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:05:42 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d952c1ad-4c9f-4a41-97fb-6f70bbf79854 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)
Nov 10 18:05:42 user nova-compute[75100]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 (non-flash)
Nov 10 18:05:42 user nova-compute[75100]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be (non-flash)
Nov 10 18:05:42 user nova-compute[75100]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e777185-e622-48b2-af17-fa73919b33b5 (non-flash)
Nov 10 18:05:42 user nova-compute[75100]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 (non-flash)
Nov 10 18:05:42 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:05:42 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d952c1ad-4c9f-4a41-97fb-6f70bbf79854 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3986b1b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e777185-e622-48b2-af17-fa73919b33b5'): ({'sde'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 18:05:42 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-d952c1ad-4c9f-4a41-97fb-6f70bbf79854 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Removing single pathed devices sde {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 18:05:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:42 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[70522005-dbd4-4794-a58e-8202266467d7]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:42 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc2522c-48b4-4c7f-a005-5c444cb07f81]: (4, ('ok\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:42 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-d952c1ad-4c9f-4a41-97fb-6f70bbf79854 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Flushing IO for device /dev/sde {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 18:05:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:42 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3054f901-b120-4ce0-a770-9f2206a29a18]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:42 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-d952c1ad-4c9f-4a41-97fb-6f70bbf79854 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 18:05:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.050s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:42 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc98894-2751-4cb0-8de1-8e746aee4ecb]: (4, ('1', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:42 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-d952c1ad-4c9f-4a41-97fb-6f70bbf79854 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 18:05:42 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-d952c1ad-4c9f-4a41-97fb-6f70bbf79854 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] SCSI volumes sde have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 18:05:42 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d952c1ad-4c9f-4a41-97fb-6f70bbf79854 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e777185-e622-48b2-af17-fa73919b33b5')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 18:05:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e777185-e622-48b2-af17-fa73919b33b5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e777185-e622-48b2-af17-fa73919b33b5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:42 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d720068-ca5d-4190-8575-ff63c60912a5]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:42 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d952c1ad-4c9f-4a41-97fb-6f70bbf79854 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:05:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e777185-e622-48b2-af17-fa73919b33b5 -p 172.16.0.220:3260 --logout {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e777185-e622-48b2-af17-fa73919b33b5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:42 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1285d29e-f451-46a5-95cb-2a7a8d48dbb7]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:9e777185-e622-48b2-af17-fa73919b33b5, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:9e777185-e622-48b2-af17-fa73919b33b5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:42 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d952c1ad-4c9f-4a41-97fb-6f70bbf79854 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:9e777185-e622-48b2-af17-fa73919b33b5, portal: 172.16.0.220,3260]
Nov 10 18:05:42 user nova-compute[75100]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:9e777185-e622-48b2-af17-fa73919b33b5, portal: 172.16.0.220,3260] successful.
Nov 10 18:05:42 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:05:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e777185-e622-48b2-af17-fa73919b33b5 -p 172.16.0.220:3260 --op delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e777185-e622-48b2-af17-fa73919b33b5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:42 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[34894e17-3e13-4f35-9ffe-e1c9e3291087]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:42 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d952c1ad-4c9f-4a41-97fb-6f70bbf79854 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:05:42 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-d952c1ad-4c9f-4a41-97fb-6f70bbf79854 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:05:42 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d952c1ad-4c9f-4a41-97fb-6f70bbf79854 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] <== disconnect_volume: return (367ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:05:42 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d952c1ad-4c9f-4a41-97fb-6f70bbf79854 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 18:05:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:05:43 user nova-compute[75100]: DEBUG nova.objects.instance [None req-d952c1ad-4c9f-4a41-97fb-6f70bbf79854 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Lazy-loading 'flavor' on Instance uuid 9dabb40d-299b-4c8a-bc92-63e5c0932047 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:05:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d952c1ad-4c9f-4a41-97fb-6f70bbf79854 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Lock "9dabb40d-299b-4c8a-bc92-63e5c0932047" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.160s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:05:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:05:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:05:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:05:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:05:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:05:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:05:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:05:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:05:54 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:05:57 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b704998f-d059-4525-9089-2083ae863ad3 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 18:05:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b704998f-d059-4525-9089-2083ae863ad3 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'abviHDfP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:05:57 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-b704998f-d059-4525-9089-2083ae863ad3 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:05:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-b704998f-d059-4525-9089-2083ae863ad3 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:05:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-b704998f-d059-4525-9089-2083ae863ad3 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:05:57 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-b704998f-d059-4525-9089-2083ae863ad3 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:05:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-b704998f-d059-4525-9089-2083ae863ad3 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:05:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-b704998f-d059-4525-9089-2083ae863ad3 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:05:57 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-b704998f-d059-4525-9089-2083ae863ad3 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 18:05:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8 -p 172.16.0.220:3260 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:57 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba5a11d-f08c-4f2e-8474-2fa43098927f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b704998f-d059-4525-9089-2083ae863ad3 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 18:05:57 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:05:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:57 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[825a6ae7-b776-41fe-8e2c-c9bb4b99db32]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8] added\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b704998f-d059-4525-9089-2083ae863ad3 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8] added
Nov 10 18:05:57 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:05:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:57 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a034b80-1c91-4b45-92cd-2bdea83fdd8d]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b704998f-d059-4525-9089-2083ae863ad3 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:05:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:57 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54415a8-7566-4e23-9dbe-1c74a324ecf3]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b704998f-d059-4525-9089-2083ae863ad3 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:05:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v abviHDfP {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v abviHDfP" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:57 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e54522-a5b6-46c0-91b8-6946976fb4a0]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b704998f-d059-4525-9089-2083ae863ad3 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'abviHDfP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:05:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:57 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f117c8-10e9-4df9-b342-fcb18f01c2d2]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b704998f-d059-4525-9089-2083ae863ad3 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:05:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:57 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[71873d2e-a921-48f3-9aa3-e4c0416344ca]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b704998f-d059-4525-9089-2083ae863ad3 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)
Nov 10 18:05:57 user nova-compute[75100]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 (non-flash)
Nov 10 18:05:57 user nova-compute[75100]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be (non-flash)
Nov 10 18:05:57 user nova-compute[75100]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 (non-flash)
Nov 10 18:05:57 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:05:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b704998f-d059-4525-9089-2083ae863ad3 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)
Nov 10 18:05:57 user nova-compute[75100]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 (non-flash)
Nov 10 18:05:57 user nova-compute[75100]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be (non-flash)
Nov 10 18:05:57 user nova-compute[75100]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 (non-flash)
Nov 10 18:05:57 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:05:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8 -p 172.16.0.220:3260 --login {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:57 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca3f420f-8d76-4015-80a4-3a7902ed0518]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b704998f-d059-4525-9089-2083ae863ad3 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8, portal: 172.16.0.220,3260]
Nov 10 18:05:57 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8, portal: 172.16.0.220,3260] successful.
Nov 10 18:05:57 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:05:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:57 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[612e47f0-792c-4565-bf1d-059f81fb2ded]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b704998f-d059-4525-9089-2083ae863ad3 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:05:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:57 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3033b63a-0bd5-47b7-b689-e6707a90ccec]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b704998f-d059-4525-9089-2083ae863ad3 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)
Nov 10 18:05:57 user nova-compute[75100]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 (non-flash)
Nov 10 18:05:57 user nova-compute[75100]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be (non-flash)
Nov 10 18:05:57 user nova-compute[75100]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 (non-flash)
Nov 10 18:05:57 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8 (non-flash)
Nov 10 18:05:57 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:05:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b704998f-d059-4525-9089-2083ae863ad3 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)
Nov 10 18:05:57 user nova-compute[75100]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 (non-flash)
Nov 10 18:05:57 user nova-compute[75100]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be (non-flash)
Nov 10 18:05:57 user nova-compute[75100]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 (non-flash)
Nov 10 18:05:57 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8 (non-flash)
Nov 10 18:05:57 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:05:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-b704998f-d059-4525-9089-2083ae863ad3 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:05:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b704998f-d059-4525-9089-2083ae863ad3 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 18:05:57 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-b704998f-d059-4525-9089-2083ae863ad3 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] HCTL ('36', '-', '-', 0) found on session 30 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 18:05:57 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-b704998f-d059-4525-9089-2083ae863ad3 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 18:05:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:05:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:05:57 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[95bab7ad-bb3e-4975-9ad2-da2c7ea7b2d8]: (4, ('- - 0', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:05:57 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-b704998f-d059-4525-9089-2083ae863ad3 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Searching for a device in session 30 and hctl ['36', '*', '*', 0] yield: None {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 18:05:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:05:58 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-b704998f-d059-4525-9089-2083ae863ad3 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Searching for a device in session 30 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 18:05:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b704998f-d059-4525-9089-2083ae863ad3 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'abviHDfP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 18:05:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-b704998f-d059-4525-9089-2083ae863ad3 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:05:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b704998f-d059-4525-9089-2083ae863ad3 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '23064373936623531', 'path': '/dev/sde'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:05:58 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b704998f-d059-4525-9089-2083ae863ad3 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23064373936623531', 'path': '/dev/sde'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 18:05:58 user nova-compute[75100]: DEBUG nova.objects.instance [None req-b704998f-d059-4525-9089-2083ae863ad3 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lazy-loading 'flavor' on Instance uuid 1937fab6-d892-406e-b8ff-52194021eea4 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:05:58 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-b704998f-d059-4525-9089-2083ae863ad3 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 18:05:58 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:05:58 user nova-compute[75100]:   <source dev="/dev/sde"/>
Nov 10 18:05:58 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 18:05:58 user nova-compute[75100]:   <serial>48e48c44-c29c-4086-820f-2a8afbdcd6a8</serial>
Nov 10 18:05:58 user nova-compute[75100]: </disk>
Nov 10 18:05:58 user nova-compute[75100]:  {{(pid=75100) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 18:05:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-b704998f-d059-4525-9089-2083ae863ad3 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 18:05:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-b704998f-d059-4525-9089-2083ae863ad3 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 18:05:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-b704998f-d059-4525-9089-2083ae863ad3 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] No VIF found with MAC fa:16:3e:ba:d7:b9, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 18:05:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b704998f-d059-4525-9089-2083ae863ad3 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "1937fab6-d892-406e-b8ff-52194021eea4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 29.950s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:05:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:02 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f4f360d-1754-4f6d-9de6-aff7606eab0d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: b0bae328-2528-4562-850b-14fa108923c6] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 18:06:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f4f360d-1754-4f6d-9de6-aff7606eab0d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ctuDnhGv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:06:02 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-2f4f360d-1754-4f6d-9de6-aff7606eab0d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:06:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-2f4f360d-1754-4f6d-9de6-aff7606eab0d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:06:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-2f4f360d-1754-4f6d-9de6-aff7606eab0d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:06:02 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-2f4f360d-1754-4f6d-9de6-aff7606eab0d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:06:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-2f4f360d-1754-4f6d-9de6-aff7606eab0d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:06:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-2f4f360d-1754-4f6d-9de6-aff7606eab0d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:06:02 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-2f4f360d-1754-4f6d-9de6-aff7606eab0d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 18:06:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf -p 172.16.0.220:3260 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:02 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[306153fd-6116-438b-a976-7c3792ff70c7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:06:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f4f360d-1754-4f6d-9de6-aff7606eab0d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 18:06:02 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:06:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf -p 172.16.0.220:3260 --interface default --op new {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:02 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[863f7acc-3ccc-49a0-b4c7-f3c9a7ca9ae7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf] added\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:06:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f4f360d-1754-4f6d-9de6-aff7606eab0d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf] added
Nov 10 18:06:02 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:06:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:02 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e7dd60-b27d-4156-b991-4c5dfaaa5ed4]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:06:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f4f360d-1754-4f6d-9de6-aff7606eab0d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:06:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:02 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2352aa-41f9-42e1-9e5e-bc8116966b61]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:06:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f4f360d-1754-4f6d-9de6-aff7606eab0d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:06:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ctuDnhGv {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ctuDnhGv" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:02 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad57e49-44e3-4dd8-9ee7-7a90132cc55e]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:06:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f4f360d-1754-4f6d-9de6-aff7606eab0d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ctuDnhGv'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:06:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:02 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[21fb43c0-b222-42f5-ba49-c5a2e94af155]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:06:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f4f360d-1754-4f6d-9de6-aff7606eab0d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:06:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:02 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea6faa6-97e3-47b3-9dd6-8dabfb932f76]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:06:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f4f360d-1754-4f6d-9de6-aff7606eab0d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)
Nov 10 18:06:02 user nova-compute[75100]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 (non-flash)
Nov 10 18:06:02 user nova-compute[75100]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be (non-flash)
Nov 10 18:06:02 user nova-compute[75100]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 (non-flash)
Nov 10 18:06:02 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8 (non-flash)
Nov 10 18:06:02 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:06:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f4f360d-1754-4f6d-9de6-aff7606eab0d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)
Nov 10 18:06:02 user nova-compute[75100]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 (non-flash)
Nov 10 18:06:02 user nova-compute[75100]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be (non-flash)
Nov 10 18:06:02 user nova-compute[75100]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 (non-flash)
Nov 10 18:06:02 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8 (non-flash)
Nov 10 18:06:02 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:06:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf -p 172.16.0.220:3260 --login {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:02 user nova-compute[75100]: DEBUG nova.compute.manager [req-829df83a-9f39-41f0-96c3-d1508ae61c67 req-a53ac1cb-792f-4476-998d-712ff6a6b3c2 service nova] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Received event network-changed-c19c4cab-962c-4915-806a-9dbffdf4bfa4 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:06:02 user nova-compute[75100]: DEBUG nova.compute.manager [req-829df83a-9f39-41f0-96c3-d1508ae61c67 req-a53ac1cb-792f-4476-998d-712ff6a6b3c2 service nova] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Refreshing instance network info cache due to event network-changed-c19c4cab-962c-4915-806a-9dbffdf4bfa4. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 18:06:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-829df83a-9f39-41f0-96c3-d1508ae61c67 req-a53ac1cb-792f-4476-998d-712ff6a6b3c2 service nova] Acquiring lock "refresh_cache-1937fab6-d892-406e-b8ff-52194021eea4" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:06:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-829df83a-9f39-41f0-96c3-d1508ae61c67 req-a53ac1cb-792f-4476-998d-712ff6a6b3c2 service nova] Acquired lock "refresh_cache-1937fab6-d892-406e-b8ff-52194021eea4" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:06:02 user nova-compute[75100]: DEBUG nova.network.neutron [req-829df83a-9f39-41f0-96c3-d1508ae61c67 req-a53ac1cb-792f-4476-998d-712ff6a6b3c2 service nova] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Refreshing network info cache for port c19c4cab-962c-4915-806a-9dbffdf4bfa4 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 18:06:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:02 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c80eea2-7f5b-4492-84ad-92ffedd8d348]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:06:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f4f360d-1754-4f6d-9de6-aff7606eab0d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf, portal: 172.16.0.220,3260]
Nov 10 18:06:02 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf, portal: 172.16.0.220,3260] successful.
Nov 10 18:06:02 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:06:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:02 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d3892c-01af-4510-ab2a-c2c7aed423ff]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:06:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f4f360d-1754-4f6d-9de6-aff7606eab0d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:06:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:02 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0864d39-80fc-4754-b089-b118e206d8b0]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:06:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f4f360d-1754-4f6d-9de6-aff7606eab0d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)
Nov 10 18:06:02 user nova-compute[75100]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 (non-flash)
Nov 10 18:06:02 user nova-compute[75100]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be (non-flash)
Nov 10 18:06:02 user nova-compute[75100]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 (non-flash)
Nov 10 18:06:02 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8 (non-flash)
Nov 10 18:06:02 user nova-compute[75100]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf (non-flash)
Nov 10 18:06:02 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:06:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f4f360d-1754-4f6d-9de6-aff7606eab0d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)
Nov 10 18:06:02 user nova-compute[75100]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 (non-flash)
Nov 10 18:06:02 user nova-compute[75100]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be (non-flash)
Nov 10 18:06:02 user nova-compute[75100]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 (non-flash)
Nov 10 18:06:02 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8 (non-flash)
Nov 10 18:06:02 user nova-compute[75100]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf (non-flash)
Nov 10 18:06:02 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:06:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-2f4f360d-1754-4f6d-9de6-aff7606eab0d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:06:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f4f360d-1754-4f6d-9de6-aff7606eab0d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 18:06:02 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-2f4f360d-1754-4f6d-9de6-aff7606eab0d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] HCTL ('38', '-', '-', 0) found on session 31 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 18:06:02 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-2f4f360d-1754-4f6d-9de6-aff7606eab0d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 18:06:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:02 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07e433a-b9dd-4376-bbe5-9bc229cee8e7]: (4, ('- - 0', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:06:02 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-2f4f360d-1754-4f6d-9de6-aff7606eab0d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Searching for a device in session 31 and hctl ['38', '*', '*', 0] yield: None {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 18:06:02 user nova-compute[75100]: DEBUG nova.network.neutron [req-829df83a-9f39-41f0-96c3-d1508ae61c67 req-a53ac1cb-792f-4476-998d-712ff6a6b3c2 service nova] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Updated VIF entry in instance network info cache for port c19c4cab-962c-4915-806a-9dbffdf4bfa4. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 18:06:02 user nova-compute[75100]: DEBUG nova.network.neutron [req-829df83a-9f39-41f0-96c3-d1508ae61c67 req-a53ac1cb-792f-4476-998d-712ff6a6b3c2 service nova] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Updating instance_info_cache with network_info: [{"id": "c19c4cab-962c-4915-806a-9dbffdf4bfa4", "address": "fa:16:3e:ba:d7:b9", "network": {"id": "78d86418-c0e0-4cc2-8f4f-262f600f7d66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2054827063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19cfb454e59745bf9c77d7a7ede2bc0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc19c4cab-96", "ovs_interfaceid": "c19c4cab-962c-4915-806a-9dbffdf4bfa4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:06:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-829df83a-9f39-41f0-96c3-d1508ae61c67 req-a53ac1cb-792f-4476-998d-712ff6a6b3c2 service nova] Releasing lock "refresh_cache-1937fab6-d892-406e-b8ff-52194021eea4" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:06:03 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-2f4f360d-1754-4f6d-9de6-aff7606eab0d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Searching for a device in session 31 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 18:06:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f4f360d-1754-4f6d-9de6-aff7606eab0d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ctuDnhGv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 18:06:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-2f4f360d-1754-4f6d-9de6-aff7606eab0d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:06:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f4f360d-1754-4f6d-9de6-aff7606eab0d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '23136303938353764', 'path': '/dev/sdg'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:06:03 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f4f360d-1754-4f6d-9de6-aff7606eab0d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: b0bae328-2528-4562-850b-14fa108923c6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23136303938353764', 'path': '/dev/sdg'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 18:06:03 user nova-compute[75100]: DEBUG nova.objects.instance [None req-2f4f360d-1754-4f6d-9de6-aff7606eab0d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lazy-loading 'flavor' on Instance uuid b0bae328-2528-4562-850b-14fa108923c6 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:06:03 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-2f4f360d-1754-4f6d-9de6-aff7606eab0d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 18:06:03 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:06:03 user nova-compute[75100]:   <source dev="/dev/sdg"/>
Nov 10 18:06:03 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 18:06:03 user nova-compute[75100]:   <serial>8c1a4aa0-d680-4608-b4a4-56115b4d5cbf</serial>
Nov 10 18:06:03 user nova-compute[75100]: </disk>
Nov 10 18:06:03 user nova-compute[75100]:  {{(pid=75100) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 18:06:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-2f4f360d-1754-4f6d-9de6-aff7606eab0d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 18:06:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-2f4f360d-1754-4f6d-9de6-aff7606eab0d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 18:06:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-2f4f360d-1754-4f6d-9de6-aff7606eab0d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] No VIF found with MAC fa:16:3e:ae:03:fd, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 18:06:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2f4f360d-1754-4f6d-9de6-aff7606eab0d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "b0bae328-2528-4562-850b-14fa108923c6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 39.581s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:06:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:05 user nova-compute[75100]: DEBUG nova.compute.manager [req-df251e29-fb56-4f97-a625-dcbd0ebe05d9 req-3ef11afb-604c-4556-aa88-c93974e909ab service nova] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Received event network-changed-c19c4cab-962c-4915-806a-9dbffdf4bfa4 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:06:05 user nova-compute[75100]: DEBUG nova.compute.manager [req-df251e29-fb56-4f97-a625-dcbd0ebe05d9 req-3ef11afb-604c-4556-aa88-c93974e909ab service nova] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Refreshing instance network info cache due to event network-changed-c19c4cab-962c-4915-806a-9dbffdf4bfa4. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 18:06:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-df251e29-fb56-4f97-a625-dcbd0ebe05d9 req-3ef11afb-604c-4556-aa88-c93974e909ab service nova] Acquiring lock "refresh_cache-1937fab6-d892-406e-b8ff-52194021eea4" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:06:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-df251e29-fb56-4f97-a625-dcbd0ebe05d9 req-3ef11afb-604c-4556-aa88-c93974e909ab service nova] Acquired lock "refresh_cache-1937fab6-d892-406e-b8ff-52194021eea4" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:06:05 user nova-compute[75100]: DEBUG nova.network.neutron [req-df251e29-fb56-4f97-a625-dcbd0ebe05d9 req-3ef11afb-604c-4556-aa88-c93974e909ab service nova] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Refreshing network info cache for port c19c4cab-962c-4915-806a-9dbffdf4bfa4 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 18:06:06 user nova-compute[75100]: DEBUG nova.network.neutron [req-df251e29-fb56-4f97-a625-dcbd0ebe05d9 req-3ef11afb-604c-4556-aa88-c93974e909ab service nova] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Updated VIF entry in instance network info cache for port c19c4cab-962c-4915-806a-9dbffdf4bfa4. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 18:06:06 user nova-compute[75100]: DEBUG nova.network.neutron [req-df251e29-fb56-4f97-a625-dcbd0ebe05d9 req-3ef11afb-604c-4556-aa88-c93974e909ab service nova] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Updating instance_info_cache with network_info: [{"id": "c19c4cab-962c-4915-806a-9dbffdf4bfa4", "address": "fa:16:3e:ba:d7:b9", "network": {"id": "78d86418-c0e0-4cc2-8f4f-262f600f7d66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2054827063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19cfb454e59745bf9c77d7a7ede2bc0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc19c4cab-96", "ovs_interfaceid": "c19c4cab-962c-4915-806a-9dbffdf4bfa4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:06:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c52fc03b-7104-409f-9a12-bc4dfb6a3328 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Acquiring lock "1937fab6-d892-406e-b8ff-52194021eea4" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:06:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c52fc03b-7104-409f-9a12-bc4dfb6a3328 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "1937fab6-d892-406e-b8ff-52194021eea4" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:06:06 user nova-compute[75100]: INFO nova.compute.manager [None req-c52fc03b-7104-409f-9a12-bc4dfb6a3328 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Rebooting instance
Nov 10 18:06:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-df251e29-fb56-4f97-a625-dcbd0ebe05d9 req-3ef11afb-604c-4556-aa88-c93974e909ab service nova] Releasing lock "refresh_cache-1937fab6-d892-406e-b8ff-52194021eea4" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:06:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c52fc03b-7104-409f-9a12-bc4dfb6a3328 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Acquiring lock "refresh_cache-1937fab6-d892-406e-b8ff-52194021eea4" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:06:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c52fc03b-7104-409f-9a12-bc4dfb6a3328 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Acquired lock "refresh_cache-1937fab6-d892-406e-b8ff-52194021eea4" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:06:06 user nova-compute[75100]: DEBUG nova.network.neutron [None req-c52fc03b-7104-409f-9a12-bc4dfb6a3328 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 18:06:07 user nova-compute[75100]: DEBUG nova.network.neutron [None req-c52fc03b-7104-409f-9a12-bc4dfb6a3328 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Updating instance_info_cache with network_info: [{"id": "c19c4cab-962c-4915-806a-9dbffdf4bfa4", "address": "fa:16:3e:ba:d7:b9", "network": {"id": "78d86418-c0e0-4cc2-8f4f-262f600f7d66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2054827063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19cfb454e59745bf9c77d7a7ede2bc0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc19c4cab-96", "ovs_interfaceid": "c19c4cab-962c-4915-806a-9dbffdf4bfa4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:06:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c52fc03b-7104-409f-9a12-bc4dfb6a3328 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Releasing lock "refresh_cache-1937fab6-d892-406e-b8ff-52194021eea4" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:06:07 user nova-compute[75100]: DEBUG nova.compute.manager [None req-c52fc03b-7104-409f-9a12-bc4dfb6a3328 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 18:06:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Acquiring lock "4fb32aa2-0dbf-4f54-ae68-18c609604b53" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:06:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "4fb32aa2-0dbf-4f54-ae68-18c609604b53" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:06:09 user nova-compute[75100]: DEBUG nova.compute.manager [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 18:06:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:06:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:06:09 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 18:06:09 user nova-compute[75100]: INFO nova.compute.claims [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] Claim successful on node user
Nov 10 18:06:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:09 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Refreshing inventories for resource provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 18:06:09 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Updating ProviderTree inventory for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 18:06:09 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Updating inventory in ProviderTree for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 18:06:09 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Refreshing aggregate associations for resource provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64, aggregates: None {{(pid=75100) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 18:06:09 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Refreshing trait associations for resource provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2 {{(pid=75100) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 18:06:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:09 user nova-compute[75100]: DEBUG nova.compute.manager [req-e7b19baf-336d-49cc-b127-256d7d56d250 req-3d1c05fc-89ed-4b48-ae27-4af40eeda68a service nova] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Received event network-vif-unplugged-c19c4cab-962c-4915-806a-9dbffdf4bfa4 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:06:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-e7b19baf-336d-49cc-b127-256d7d56d250 req-3d1c05fc-89ed-4b48-ae27-4af40eeda68a service nova] Acquiring lock "1937fab6-d892-406e-b8ff-52194021eea4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:06:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-e7b19baf-336d-49cc-b127-256d7d56d250 req-3d1c05fc-89ed-4b48-ae27-4af40eeda68a service nova] Lock "1937fab6-d892-406e-b8ff-52194021eea4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:06:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-e7b19baf-336d-49cc-b127-256d7d56d250 req-3d1c05fc-89ed-4b48-ae27-4af40eeda68a service nova] Lock "1937fab6-d892-406e-b8ff-52194021eea4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:06:09 user nova-compute[75100]: DEBUG nova.compute.manager [req-e7b19baf-336d-49cc-b127-256d7d56d250 req-3d1c05fc-89ed-4b48-ae27-4af40eeda68a service nova] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] No waiting events found dispatching network-vif-unplugged-c19c4cab-962c-4915-806a-9dbffdf4bfa4 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:06:09 user nova-compute[75100]: WARNING nova.compute.manager [req-e7b19baf-336d-49cc-b127-256d7d56d250 req-3d1c05fc-89ed-4b48-ae27-4af40eeda68a service nova] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Received unexpected event network-vif-unplugged-c19c4cab-962c-4915-806a-9dbffdf4bfa4 for instance with vm_state active and task_state reboot_started.
Nov 10 18:06:10 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:06:10 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:06:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.796s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:06:10 user nova-compute[75100]: DEBUG nova.compute.manager [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 18:06:10 user nova-compute[75100]: DEBUG nova.compute.manager [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 18:06:10 user nova-compute[75100]: DEBUG nova.network.neutron [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 18:06:10 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-c52fc03b-7104-409f-9a12-bc4dfb6a3328 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Instance shutdown successfully.
Nov 10 18:06:10 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 18:06:10 user nova-compute[75100]: DEBUG nova.compute.manager [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 18:06:10 user nova-compute[75100]: DEBUG nova.policy [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'efe92a172011414e8507cb6ddbfab0bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4e5cb8bdc24a009dcb3dbee36a6bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 18:06:10 user nova-compute[75100]: DEBUG nova.compute.manager [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 18:06:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 18:06:10 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] Creating image(s)
Nov 10 18:06:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Acquiring lock "/opt/stack/data/nova/instances/4fb32aa2-0dbf-4f54-ae68-18c609604b53/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:06:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "/opt/stack/data/nova/instances/4fb32aa2-0dbf-4f54-ae68-18c609604b53/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:06:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "/opt/stack/data/nova/instances/4fb32aa2-0dbf-4f54-ae68-18c609604b53/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:06:10 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:10 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.182s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Acquiring lock "818b9e28e061d41a38d903968b229be2ed9ba520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:06:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:06:10 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:10 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.185s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:10 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/4fb32aa2-0dbf-4f54-ae68-18c609604b53/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:10 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/4fb32aa2-0dbf-4f54-ae68-18c609604b53/disk 1073741824" returned: 0 in 0.119s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.315s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:06:10 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:11 user nova-compute[75100]: DEBUG nova.network.neutron [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] Successfully created port: 49cc2b3a-d37c-4602-ae33-9ebdccc70bf1 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 18:06:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.250s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:11 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4fb32aa2-0dbf-4f54-ae68-18c609604b53/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 18:06:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fb32aa2-0dbf-4f54-ae68-18c609604b53/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fb32aa2-0dbf-4f54-ae68-18c609604b53/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:11 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Cannot resize image /opt/stack/data/nova/instances/4fb32aa2-0dbf-4f54-ae68-18c609604b53/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 18:06:11 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 18:06:11 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] Ensure instance console log exists: /opt/stack/data/nova/instances/4fb32aa2-0dbf-4f54-ae68-18c609604b53/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 18:06:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:06:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:06:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:06:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:11 user nova-compute[75100]: DEBUG nova.compute.manager [req-5547b1ee-95ea-4a61-8855-43c5a0ed2f15 req-f01e034b-b4a1-4ff3-acdb-72a6ea418f22 service nova] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Received event network-vif-plugged-c19c4cab-962c-4915-806a-9dbffdf4bfa4 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:06:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5547b1ee-95ea-4a61-8855-43c5a0ed2f15 req-f01e034b-b4a1-4ff3-acdb-72a6ea418f22 service nova] Acquiring lock "1937fab6-d892-406e-b8ff-52194021eea4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:06:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5547b1ee-95ea-4a61-8855-43c5a0ed2f15 req-f01e034b-b4a1-4ff3-acdb-72a6ea418f22 service nova] Lock "1937fab6-d892-406e-b8ff-52194021eea4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:06:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5547b1ee-95ea-4a61-8855-43c5a0ed2f15 req-f01e034b-b4a1-4ff3-acdb-72a6ea418f22 service nova] Lock "1937fab6-d892-406e-b8ff-52194021eea4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:06:11 user nova-compute[75100]: DEBUG nova.compute.manager [req-5547b1ee-95ea-4a61-8855-43c5a0ed2f15 req-f01e034b-b4a1-4ff3-acdb-72a6ea418f22 service nova] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] No waiting events found dispatching network-vif-plugged-c19c4cab-962c-4915-806a-9dbffdf4bfa4 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:06:11 user nova-compute[75100]: WARNING nova.compute.manager [req-5547b1ee-95ea-4a61-8855-43c5a0ed2f15 req-f01e034b-b4a1-4ff3-acdb-72a6ea418f22 service nova] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Received unexpected event network-vif-plugged-c19c4cab-962c-4915-806a-9dbffdf4bfa4 for instance with vm_state active and task_state reboot_started.
Nov 10 18:06:12 user nova-compute[75100]: DEBUG nova.network.neutron [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] Successfully updated port: 49cc2b3a-d37c-4602-ae33-9ebdccc70bf1 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 18:06:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Acquiring lock "refresh_cache-4fb32aa2-0dbf-4f54-ae68-18c609604b53" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:06:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Acquired lock "refresh_cache-4fb32aa2-0dbf-4f54-ae68-18c609604b53" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:06:12 user nova-compute[75100]: DEBUG nova.network.neutron [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 18:06:12 user nova-compute[75100]: DEBUG nova.network.neutron [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 18:06:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:12 user nova-compute[75100]: DEBUG nova.network.neutron [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] Updating instance_info_cache with network_info: [{"id": "49cc2b3a-d37c-4602-ae33-9ebdccc70bf1", "address": "fa:16:3e:50:83:d1", "network": {"id": "e906a397-504d-48d8-8726-187cfbb1f270", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2095832274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4e5cb8bdc24a009dcb3dbee36a6bce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49cc2b3a-d3", "ovs_interfaceid": "49cc2b3a-d37c-4602-ae33-9ebdccc70bf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:06:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Releasing lock "refresh_cache-4fb32aa2-0dbf-4f54-ae68-18c609604b53" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:06:12 user nova-compute[75100]: DEBUG nova.compute.manager [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] Instance network_info: |[{"id": "49cc2b3a-d37c-4602-ae33-9ebdccc70bf1", "address": "fa:16:3e:50:83:d1", "network": {"id": "e906a397-504d-48d8-8726-187cfbb1f270", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2095832274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4e5cb8bdc24a009dcb3dbee36a6bce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49cc2b3a-d3", "ovs_interfaceid": "49cc2b3a-d37c-4602-ae33-9ebdccc70bf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 18:06:12 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] Start _get_guest_xml network_info=[{"id": "49cc2b3a-d37c-4602-ae33-9ebdccc70bf1", "address": "fa:16:3e:50:83:d1", "network": {"id": "e906a397-504d-48d8-8726-187cfbb1f270", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2095832274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4e5cb8bdc24a009dcb3dbee36a6bce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49cc2b3a-d3", "ovs_interfaceid": "49cc2b3a-d37c-4602-ae33-9ebdccc70bf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'e3cc5321-4d40-49ee-885c-700e14741732'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 18:06:12 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:06:12 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:06:12 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 18:06:12 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 18:06:12 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 18:06:12 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 18:06:12 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 18:06:12 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T17:40:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 18:06:12 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 18:06:12 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 18:06:12 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 18:06:12 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 18:06:12 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 18:06:12 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 18:06:12 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 18:06:12 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 18:06:12 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 18:06:12 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 18:06:12 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:06:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1997728155',display_name='tempest-AttachVolumeNegativeTest-server-1997728155',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1997728155',id=40,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGXs+xcr6Dp/10m38ocV2E9/NKM/a+6C1eR/ftXwXw7noTv2gZ0DaneZJYlyODVW3rRCFX4GWP4NIIjlgrllRRDd+kwAuRq7UOP4jp2UBM5nvs7I3DvDIc+mIDt8uqkf1A==',key_name='tempest-keypair-3276225',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d4e5cb8bdc24a009dcb3dbee36a6bce',ramdisk_id='',reservation_id='r-rpqwzqud',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1395057280',owner_user_name='tempest-AttachVolumeNegativeTest-1395057280-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T18:06:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efe92a172011414e8507cb6ddbfab0bb',uuid=4fb32aa2-0dbf-4f54-ae68-18c609604b53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49cc2b3a-d37c-4602-ae33-9ebdccc70bf1", "address": "fa:16:3e:50:83:d1", "network": {"id": "e906a397-504d-48d8-8726-187cfbb1f270", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2095832274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4e5cb8bdc24a009dcb3dbee36a6bce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49cc2b3a-d3", "ovs_interfaceid": "49cc2b3a-d37c-4602-ae33-9ebdccc70bf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 18:06:12 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Converting VIF {"id": "49cc2b3a-d37c-4602-ae33-9ebdccc70bf1", "address": "fa:16:3e:50:83:d1", "network": {"id": "e906a397-504d-48d8-8726-187cfbb1f270", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2095832274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4e5cb8bdc24a009dcb3dbee36a6bce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49cc2b3a-d3", "ovs_interfaceid": "49cc2b3a-d37c-4602-ae33-9ebdccc70bf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:06:12 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:83:d1,bridge_name='br-int',has_traffic_filtering=True,id=49cc2b3a-d37c-4602-ae33-9ebdccc70bf1,network=Network(e906a397-504d-48d8-8726-187cfbb1f270),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49cc2b3a-d3') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:06:12 user nova-compute[75100]: DEBUG nova.objects.instance [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lazy-loading 'pci_devices' on Instance uuid 4fb32aa2-0dbf-4f54-ae68-18c609604b53 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:06:12 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] End _get_guest_xml xml=<domain type="kvm">
Nov 10 18:06:12 user nova-compute[75100]:   <uuid>4fb32aa2-0dbf-4f54-ae68-18c609604b53</uuid>
Nov 10 18:06:12 user nova-compute[75100]:   <name>instance-00000028</name>
Nov 10 18:06:12 user nova-compute[75100]:   <memory>524288</memory>
Nov 10 18:06:12 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 10 18:06:12 user nova-compute[75100]:   <metadata>
Nov 10 18:06:12 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 18:06:12 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 10 18:06:12 user nova-compute[75100]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1997728155</nova:name>
Nov 10 18:06:12 user nova-compute[75100]:       <nova:creationTime>2023-11-10 18:06:12</nova:creationTime>
Nov 10 18:06:12 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 10 18:06:12 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 10 18:06:12 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 10 18:06:12 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 10 18:06:12 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 18:06:12 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 10 18:06:12 user nova-compute[75100]:       </nova:flavor>
Nov 10 18:06:12 user nova-compute[75100]:       <nova:owner>
Nov 10 18:06:12 user nova-compute[75100]:         <nova:user uuid="efe92a172011414e8507cb6ddbfab0bb">tempest-AttachVolumeNegativeTest-1395057280-project-member</nova:user>
Nov 10 18:06:12 user nova-compute[75100]:         <nova:project uuid="9d4e5cb8bdc24a009dcb3dbee36a6bce">tempest-AttachVolumeNegativeTest-1395057280</nova:project>
Nov 10 18:06:12 user nova-compute[75100]:       </nova:owner>
Nov 10 18:06:12 user nova-compute[75100]:       <nova:root type="image" uuid="e3cc5321-4d40-49ee-885c-700e14741732"/>
Nov 10 18:06:12 user nova-compute[75100]:       <nova:ports>
Nov 10 18:06:12 user nova-compute[75100]:         <nova:port uuid="49cc2b3a-d37c-4602-ae33-9ebdccc70bf1">
Nov 10 18:06:12 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 10 18:06:12 user nova-compute[75100]:         </nova:port>
Nov 10 18:06:12 user nova-compute[75100]:       </nova:ports>
Nov 10 18:06:12 user nova-compute[75100]:     </nova:instance>
Nov 10 18:06:12 user nova-compute[75100]:   </metadata>
Nov 10 18:06:12 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 10 18:06:12 user nova-compute[75100]:     <system>
Nov 10 18:06:12 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 18:06:12 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 10 18:06:12 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 10 18:06:12 user nova-compute[75100]:       <entry name="serial">4fb32aa2-0dbf-4f54-ae68-18c609604b53</entry>
Nov 10 18:06:12 user nova-compute[75100]:       <entry name="uuid">4fb32aa2-0dbf-4f54-ae68-18c609604b53</entry>
Nov 10 18:06:12 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 10 18:06:12 user nova-compute[75100]:     </system>
Nov 10 18:06:12 user nova-compute[75100]:   </sysinfo>
Nov 10 18:06:12 user nova-compute[75100]:   <os>
Nov 10 18:06:12 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 18:06:12 user nova-compute[75100]:     <boot dev="hd"/>
Nov 10 18:06:12 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 10 18:06:12 user nova-compute[75100]:   </os>
Nov 10 18:06:12 user nova-compute[75100]:   <features>
Nov 10 18:06:12 user nova-compute[75100]:     <acpi/>
Nov 10 18:06:12 user nova-compute[75100]:     <apic/>
Nov 10 18:06:12 user nova-compute[75100]:     <vmcoreinfo/>
Nov 10 18:06:12 user nova-compute[75100]:   </features>
Nov 10 18:06:12 user nova-compute[75100]:   <clock offset="utc">
Nov 10 18:06:12 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 18:06:12 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 18:06:12 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 10 18:06:12 user nova-compute[75100]:   </clock>
Nov 10 18:06:12 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 10 18:06:12 user nova-compute[75100]:     <model>Nehalem</model>
Nov 10 18:06:12 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 18:06:12 user nova-compute[75100]:   </cpu>
Nov 10 18:06:12 user nova-compute[75100]:   <devices>
Nov 10 18:06:12 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 10 18:06:12 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 18:06:12 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/4fb32aa2-0dbf-4f54-ae68-18c609604b53/disk"/>
Nov 10 18:06:12 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 10 18:06:12 user nova-compute[75100]:     </disk>
Nov 10 18:06:12 user nova-compute[75100]:     <interface type="ethernet">
Nov 10 18:06:12 user nova-compute[75100]:       <mac address="fa:16:3e:50:83:d1"/>
Nov 10 18:06:12 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 18:06:12 user nova-compute[75100]:       <mtu size="1442"/>
Nov 10 18:06:12 user nova-compute[75100]:       <target dev="tap49cc2b3a-d3"/>
Nov 10 18:06:12 user nova-compute[75100]:     </interface>
Nov 10 18:06:12 user nova-compute[75100]:     <serial type="pty">
Nov 10 18:06:12 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/4fb32aa2-0dbf-4f54-ae68-18c609604b53/console.log" append="off"/>
Nov 10 18:06:12 user nova-compute[75100]:     </serial>
Nov 10 18:06:12 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 18:06:12 user nova-compute[75100]:     <video>
Nov 10 18:06:12 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 18:06:12 user nova-compute[75100]:     </video>
Nov 10 18:06:12 user nova-compute[75100]:     <rng model="virtio">
Nov 10 18:06:12 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 10 18:06:12 user nova-compute[75100]:     </rng>
Nov 10 18:06:12 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 10 18:06:12 user nova-compute[75100]:     <memballoon model="virtio">
Nov 10 18:06:12 user nova-compute[75100]:       <stats period="10"/>
Nov 10 18:06:12 user nova-compute[75100]:     </memballoon>
Nov 10 18:06:12 user nova-compute[75100]:   </devices>
Nov 10 18:06:12 user nova-compute[75100]: </domain>
Nov 10 18:06:12 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 18:06:12 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:06:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1997728155',display_name='tempest-AttachVolumeNegativeTest-server-1997728155',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1997728155',id=40,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGXs+xcr6Dp/10m38ocV2E9/NKM/a+6C1eR/ftXwXw7noTv2gZ0DaneZJYlyODVW3rRCFX4GWP4NIIjlgrllRRDd+kwAuRq7UOP4jp2UBM5nvs7I3DvDIc+mIDt8uqkf1A==',key_name='tempest-keypair-3276225',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d4e5cb8bdc24a009dcb3dbee36a6bce',ramdisk_id='',reservation_id='r-rpqwzqud',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1395057280',owner_user_name='tempest-AttachVolumeNegativeTest-1395057280-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T18:06:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efe92a172011414e8507cb6ddbfab0bb',uuid=4fb32aa2-0dbf-4f54-ae68-18c609604b53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49cc2b3a-d37c-4602-ae33-9ebdccc70bf1", "address": "fa:16:3e:50:83:d1", "network": {"id": "e906a397-504d-48d8-8726-187cfbb1f270", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2095832274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4e5cb8bdc24a009dcb3dbee36a6bce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49cc2b3a-d3", "ovs_interfaceid": "49cc2b3a-d37c-4602-ae33-9ebdccc70bf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 18:06:12 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Converting VIF {"id": "49cc2b3a-d37c-4602-ae33-9ebdccc70bf1", "address": "fa:16:3e:50:83:d1", "network": {"id": "e906a397-504d-48d8-8726-187cfbb1f270", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2095832274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4e5cb8bdc24a009dcb3dbee36a6bce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49cc2b3a-d3", "ovs_interfaceid": "49cc2b3a-d37c-4602-ae33-9ebdccc70bf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:06:12 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:83:d1,bridge_name='br-int',has_traffic_filtering=True,id=49cc2b3a-d37c-4602-ae33-9ebdccc70bf1,network=Network(e906a397-504d-48d8-8726-187cfbb1f270),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49cc2b3a-d3') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:06:12 user nova-compute[75100]: DEBUG os_vif [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:83:d1,bridge_name='br-int',has_traffic_filtering=True,id=49cc2b3a-d37c-4602-ae33-9ebdccc70bf1,network=Network(e906a397-504d-48d8-8726-187cfbb1f270),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49cc2b3a-d3') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 18:06:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:06:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 18:06:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '85eff69e-192b-51d6-a124-1bbd851c5e61', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:06:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap49cc2b3a-d3, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:06:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap49cc2b3a-d3, col_values=(('qos', UUID('b3e8dd73-320a-42a9-b8f5-9bff0dd880ef')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:06:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap49cc2b3a-d3, col_values=(('external_ids', {'iface-id': '49cc2b3a-d37c-4602-ae33-9ebdccc70bf1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:83:d1', 'vm-uuid': '4fb32aa2-0dbf-4f54-ae68-18c609604b53'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:06:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:06:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:12 user nova-compute[75100]: INFO os_vif [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:83:d1,bridge_name='br-int',has_traffic_filtering=True,id=49cc2b3a-d37c-4602-ae33-9ebdccc70bf1,network=Network(e906a397-504d-48d8-8726-187cfbb1f270),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49cc2b3a-d3')
Nov 10 18:06:12 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 18:06:12 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] No VIF found with MAC fa:16:3e:50:83:d1, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 18:06:13 user nova-compute[75100]: DEBUG nova.compute.manager [req-cbdef0ee-f5c5-4ebc-ae06-c252ea1ff1d6 req-4c5fe99a-6988-4aec-8422-4397af3c1b15 service nova] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Received event network-vif-plugged-c19c4cab-962c-4915-806a-9dbffdf4bfa4 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:06:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cbdef0ee-f5c5-4ebc-ae06-c252ea1ff1d6 req-4c5fe99a-6988-4aec-8422-4397af3c1b15 service nova] Acquiring lock "1937fab6-d892-406e-b8ff-52194021eea4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:06:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cbdef0ee-f5c5-4ebc-ae06-c252ea1ff1d6 req-4c5fe99a-6988-4aec-8422-4397af3c1b15 service nova] Lock "1937fab6-d892-406e-b8ff-52194021eea4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:06:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cbdef0ee-f5c5-4ebc-ae06-c252ea1ff1d6 req-4c5fe99a-6988-4aec-8422-4397af3c1b15 service nova] Lock "1937fab6-d892-406e-b8ff-52194021eea4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:06:13 user nova-compute[75100]: DEBUG nova.compute.manager [req-cbdef0ee-f5c5-4ebc-ae06-c252ea1ff1d6 req-4c5fe99a-6988-4aec-8422-4397af3c1b15 service nova] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] No waiting events found dispatching network-vif-plugged-c19c4cab-962c-4915-806a-9dbffdf4bfa4 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:06:13 user nova-compute[75100]: WARNING nova.compute.manager [req-cbdef0ee-f5c5-4ebc-ae06-c252ea1ff1d6 req-4c5fe99a-6988-4aec-8422-4397af3c1b15 service nova] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Received unexpected event network-vif-plugged-c19c4cab-962c-4915-806a-9dbffdf4bfa4 for instance with vm_state active and task_state reboot_started.
Nov 10 18:06:13 user nova-compute[75100]: DEBUG nova.compute.manager [req-cbdef0ee-f5c5-4ebc-ae06-c252ea1ff1d6 req-4c5fe99a-6988-4aec-8422-4397af3c1b15 service nova] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] Received event network-changed-49cc2b3a-d37c-4602-ae33-9ebdccc70bf1 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:06:13 user nova-compute[75100]: DEBUG nova.compute.manager [req-cbdef0ee-f5c5-4ebc-ae06-c252ea1ff1d6 req-4c5fe99a-6988-4aec-8422-4397af3c1b15 service nova] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] Refreshing instance network info cache due to event network-changed-49cc2b3a-d37c-4602-ae33-9ebdccc70bf1. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 18:06:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cbdef0ee-f5c5-4ebc-ae06-c252ea1ff1d6 req-4c5fe99a-6988-4aec-8422-4397af3c1b15 service nova] Acquiring lock "refresh_cache-4fb32aa2-0dbf-4f54-ae68-18c609604b53" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:06:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cbdef0ee-f5c5-4ebc-ae06-c252ea1ff1d6 req-4c5fe99a-6988-4aec-8422-4397af3c1b15 service nova] Acquired lock "refresh_cache-4fb32aa2-0dbf-4f54-ae68-18c609604b53" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:06:13 user nova-compute[75100]: DEBUG nova.network.neutron [req-cbdef0ee-f5c5-4ebc-ae06-c252ea1ff1d6 req-4c5fe99a-6988-4aec-8422-4397af3c1b15 service nova] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] Refreshing network info cache for port 49cc2b3a-d37c-4602-ae33-9ebdccc70bf1 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 18:06:14 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Instance running successfully.
Nov 10 18:06:14 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-c52fc03b-7104-409f-9a12-bc4dfb6a3328 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Instance soft rebooted successfully.
Nov 10 18:06:14 user nova-compute[75100]: DEBUG nova.compute.manager [None req-c52fc03b-7104-409f-9a12-bc4dfb6a3328 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 18:06:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c52fc03b-7104-409f-9a12-bc4dfb6a3328 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "1937fab6-d892-406e-b8ff-52194021eea4" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.801s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:06:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:14 user nova-compute[75100]: DEBUG nova.network.neutron [req-cbdef0ee-f5c5-4ebc-ae06-c252ea1ff1d6 req-4c5fe99a-6988-4aec-8422-4397af3c1b15 service nova] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] Updated VIF entry in instance network info cache for port 49cc2b3a-d37c-4602-ae33-9ebdccc70bf1. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 18:06:14 user nova-compute[75100]: DEBUG nova.network.neutron [req-cbdef0ee-f5c5-4ebc-ae06-c252ea1ff1d6 req-4c5fe99a-6988-4aec-8422-4397af3c1b15 service nova] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] Updating instance_info_cache with network_info: [{"id": "49cc2b3a-d37c-4602-ae33-9ebdccc70bf1", "address": "fa:16:3e:50:83:d1", "network": {"id": "e906a397-504d-48d8-8726-187cfbb1f270", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2095832274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4e5cb8bdc24a009dcb3dbee36a6bce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49cc2b3a-d3", "ovs_interfaceid": "49cc2b3a-d37c-4602-ae33-9ebdccc70bf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:06:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cbdef0ee-f5c5-4ebc-ae06-c252ea1ff1d6 req-4c5fe99a-6988-4aec-8422-4397af3c1b15 service nova] Releasing lock "refresh_cache-4fb32aa2-0dbf-4f54-ae68-18c609604b53" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:06:14 user nova-compute[75100]: DEBUG nova.compute.manager [req-cbdef0ee-f5c5-4ebc-ae06-c252ea1ff1d6 req-4c5fe99a-6988-4aec-8422-4397af3c1b15 service nova] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Received event network-vif-plugged-c19c4cab-962c-4915-806a-9dbffdf4bfa4 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:06:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cbdef0ee-f5c5-4ebc-ae06-c252ea1ff1d6 req-4c5fe99a-6988-4aec-8422-4397af3c1b15 service nova] Acquiring lock "1937fab6-d892-406e-b8ff-52194021eea4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:06:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cbdef0ee-f5c5-4ebc-ae06-c252ea1ff1d6 req-4c5fe99a-6988-4aec-8422-4397af3c1b15 service nova] Lock "1937fab6-d892-406e-b8ff-52194021eea4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:06:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cbdef0ee-f5c5-4ebc-ae06-c252ea1ff1d6 req-4c5fe99a-6988-4aec-8422-4397af3c1b15 service nova] Lock "1937fab6-d892-406e-b8ff-52194021eea4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:06:14 user nova-compute[75100]: DEBUG nova.compute.manager [req-cbdef0ee-f5c5-4ebc-ae06-c252ea1ff1d6 req-4c5fe99a-6988-4aec-8422-4397af3c1b15 service nova] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] No waiting events found dispatching network-vif-plugged-c19c4cab-962c-4915-806a-9dbffdf4bfa4 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:06:14 user nova-compute[75100]: WARNING nova.compute.manager [req-cbdef0ee-f5c5-4ebc-ae06-c252ea1ff1d6 req-4c5fe99a-6988-4aec-8422-4397af3c1b15 service nova] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Received unexpected event network-vif-plugged-c19c4cab-962c-4915-806a-9dbffdf4bfa4 for instance with vm_state active and task_state reboot_started.
Nov 10 18:06:15 user nova-compute[75100]: DEBUG nova.compute.manager [req-10cd6d2b-574b-46cc-989a-73136cba20e1 req-a693ceff-d778-4452-b5a5-7cd70dc0534f service nova] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] Received event network-vif-plugged-49cc2b3a-d37c-4602-ae33-9ebdccc70bf1 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:06:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-10cd6d2b-574b-46cc-989a-73136cba20e1 req-a693ceff-d778-4452-b5a5-7cd70dc0534f service nova] Acquiring lock "4fb32aa2-0dbf-4f54-ae68-18c609604b53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:06:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-10cd6d2b-574b-46cc-989a-73136cba20e1 req-a693ceff-d778-4452-b5a5-7cd70dc0534f service nova] Lock "4fb32aa2-0dbf-4f54-ae68-18c609604b53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:06:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-10cd6d2b-574b-46cc-989a-73136cba20e1 req-a693ceff-d778-4452-b5a5-7cd70dc0534f service nova] Lock "4fb32aa2-0dbf-4f54-ae68-18c609604b53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:06:15 user nova-compute[75100]: DEBUG nova.compute.manager [req-10cd6d2b-574b-46cc-989a-73136cba20e1 req-a693ceff-d778-4452-b5a5-7cd70dc0534f service nova] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] No waiting events found dispatching network-vif-plugged-49cc2b3a-d37c-4602-ae33-9ebdccc70bf1 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:06:15 user nova-compute[75100]: WARNING nova.compute.manager [req-10cd6d2b-574b-46cc-989a-73136cba20e1 req-a693ceff-d778-4452-b5a5-7cd70dc0534f service nova] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] Received unexpected event network-vif-plugged-49cc2b3a-d37c-4602-ae33-9ebdccc70bf1 for instance with vm_state building and task_state spawning.
Nov 10 18:06:15 user nova-compute[75100]: DEBUG nova.compute.manager [req-10cd6d2b-574b-46cc-989a-73136cba20e1 req-a693ceff-d778-4452-b5a5-7cd70dc0534f service nova] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] Received event network-vif-plugged-49cc2b3a-d37c-4602-ae33-9ebdccc70bf1 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:06:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-10cd6d2b-574b-46cc-989a-73136cba20e1 req-a693ceff-d778-4452-b5a5-7cd70dc0534f service nova] Acquiring lock "4fb32aa2-0dbf-4f54-ae68-18c609604b53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:06:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-10cd6d2b-574b-46cc-989a-73136cba20e1 req-a693ceff-d778-4452-b5a5-7cd70dc0534f service nova] Lock "4fb32aa2-0dbf-4f54-ae68-18c609604b53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:06:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-10cd6d2b-574b-46cc-989a-73136cba20e1 req-a693ceff-d778-4452-b5a5-7cd70dc0534f service nova] Lock "4fb32aa2-0dbf-4f54-ae68-18c609604b53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:06:15 user nova-compute[75100]: DEBUG nova.compute.manager [req-10cd6d2b-574b-46cc-989a-73136cba20e1 req-a693ceff-d778-4452-b5a5-7cd70dc0534f service nova] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] No waiting events found dispatching network-vif-plugged-49cc2b3a-d37c-4602-ae33-9ebdccc70bf1 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:06:15 user nova-compute[75100]: WARNING nova.compute.manager [req-10cd6d2b-574b-46cc-989a-73136cba20e1 req-a693ceff-d778-4452-b5a5-7cd70dc0534f service nova] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] Received unexpected event network-vif-plugged-49cc2b3a-d37c-4602-ae33-9ebdccc70bf1 for instance with vm_state building and task_state spawning.
Nov 10 18:06:16 user nova-compute[75100]: DEBUG nova.compute.manager [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 18:06:16 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 18:06:16 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] Instance spawned successfully.
Nov 10 18:06:16 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 18:06:16 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:06:16 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:06:16 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:06:16 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:06:16 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:06:16 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:06:16 user nova-compute[75100]: INFO nova.compute.manager [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] Took 6.49 seconds to spawn the instance on the hypervisor.
Nov 10 18:06:16 user nova-compute[75100]: DEBUG nova.compute.manager [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 18:06:16 user nova-compute[75100]: INFO nova.compute.manager [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] Took 7.67 seconds to build instance.
Nov 10 18:06:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-623e271a-4618-4f23-8d2a-e7f153456e0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "4fb32aa2-0dbf-4f54-ae68-18c609604b53" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.787s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:06:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:21 user nova-compute[75100]: DEBUG nova.compute.manager [req-def3ec9c-5a22-488c-8726-6e1b8733bd60 req-c3f44a64-8354-4959-baac-33649149592b service nova] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Received event network-changed-9855a14c-55c7-4a35-a4cc-7085dfbda684 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:06:21 user nova-compute[75100]: DEBUG nova.compute.manager [req-def3ec9c-5a22-488c-8726-6e1b8733bd60 req-c3f44a64-8354-4959-baac-33649149592b service nova] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Refreshing instance network info cache due to event network-changed-9855a14c-55c7-4a35-a4cc-7085dfbda684. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 18:06:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-def3ec9c-5a22-488c-8726-6e1b8733bd60 req-c3f44a64-8354-4959-baac-33649149592b service nova] Acquiring lock "refresh_cache-22c021d9-c8e4-455d-8e2a-a9cdfbb38f75" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:06:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-def3ec9c-5a22-488c-8726-6e1b8733bd60 req-c3f44a64-8354-4959-baac-33649149592b service nova] Acquired lock "refresh_cache-22c021d9-c8e4-455d-8e2a-a9cdfbb38f75" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:06:21 user nova-compute[75100]: DEBUG nova.network.neutron [req-def3ec9c-5a22-488c-8726-6e1b8733bd60 req-c3f44a64-8354-4959-baac-33649149592b service nova] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Refreshing network info cache for port 9855a14c-55c7-4a35-a4cc-7085dfbda684 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 18:06:21 user nova-compute[75100]: DEBUG nova.network.neutron [req-def3ec9c-5a22-488c-8726-6e1b8733bd60 req-c3f44a64-8354-4959-baac-33649149592b service nova] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Updated VIF entry in instance network info cache for port 9855a14c-55c7-4a35-a4cc-7085dfbda684. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 18:06:21 user nova-compute[75100]: DEBUG nova.network.neutron [req-def3ec9c-5a22-488c-8726-6e1b8733bd60 req-c3f44a64-8354-4959-baac-33649149592b service nova] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Updating instance_info_cache with network_info: [{"id": "9855a14c-55c7-4a35-a4cc-7085dfbda684", "address": "fa:16:3e:02:b1:a1", "network": {"id": "bf1edb58-ef26-40ca-8ec9-853fa05de13d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1416469583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7bb141ef59487dbb2ce6243c5002af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9855a14c-55", "ovs_interfaceid": "9855a14c-55c7-4a35-a4cc-7085dfbda684", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:06:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-def3ec9c-5a22-488c-8726-6e1b8733bd60 req-c3f44a64-8354-4959-baac-33649149592b service nova] Releasing lock "refresh_cache-22c021d9-c8e4-455d-8e2a-a9cdfbb38f75" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:06:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:23 user nova-compute[75100]: DEBUG nova.compute.manager [req-31921d63-dcf6-4774-970b-e45861a7ed49 req-0ddfb6cd-e902-481e-b1fa-de7dca793a8d service nova] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Received event network-changed-c9011ff5-53de-43f3-be8e-ba86274b2c99 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:06:23 user nova-compute[75100]: DEBUG nova.compute.manager [req-31921d63-dcf6-4774-970b-e45861a7ed49 req-0ddfb6cd-e902-481e-b1fa-de7dca793a8d service nova] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Refreshing instance network info cache due to event network-changed-c9011ff5-53de-43f3-be8e-ba86274b2c99. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 18:06:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-31921d63-dcf6-4774-970b-e45861a7ed49 req-0ddfb6cd-e902-481e-b1fa-de7dca793a8d service nova] Acquiring lock "refresh_cache-4ebd9d80-365d-4334-8421-3b22a846321a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:06:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-31921d63-dcf6-4774-970b-e45861a7ed49 req-0ddfb6cd-e902-481e-b1fa-de7dca793a8d service nova] Acquired lock "refresh_cache-4ebd9d80-365d-4334-8421-3b22a846321a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:06:23 user nova-compute[75100]: DEBUG nova.network.neutron [req-31921d63-dcf6-4774-970b-e45861a7ed49 req-0ddfb6cd-e902-481e-b1fa-de7dca793a8d service nova] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Refreshing network info cache for port c9011ff5-53de-43f3-be8e-ba86274b2c99 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 18:06:23 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Stashing vm_state: active {{(pid=75100) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 10 18:06:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:06:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:06:23 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 18:06:23 user nova-compute[75100]: INFO nova.compute.claims [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Claim successful on node user
Nov 10 18:06:23 user nova-compute[75100]: INFO nova.compute.resource_tracker [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Updating resource usage from migration ba414159-d274-4472-b362-fccac93007d8
Nov 10 18:06:23 user nova-compute[75100]: DEBUG nova.network.neutron [req-31921d63-dcf6-4774-970b-e45861a7ed49 req-0ddfb6cd-e902-481e-b1fa-de7dca793a8d service nova] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Updated VIF entry in instance network info cache for port c9011ff5-53de-43f3-be8e-ba86274b2c99. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 18:06:23 user nova-compute[75100]: DEBUG nova.network.neutron [req-31921d63-dcf6-4774-970b-e45861a7ed49 req-0ddfb6cd-e902-481e-b1fa-de7dca793a8d service nova] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Updating instance_info_cache with network_info: [{"id": "c9011ff5-53de-43f3-be8e-ba86274b2c99", "address": "fa:16:3e:a7:f8:6b", "network": {"id": "bf1edb58-ef26-40ca-8ec9-853fa05de13d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1416469583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7bb141ef59487dbb2ce6243c5002af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9011ff5-53", "ovs_interfaceid": "c9011ff5-53de-43f3-be8e-ba86274b2c99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:06:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-31921d63-dcf6-4774-970b-e45861a7ed49 req-0ddfb6cd-e902-481e-b1fa-de7dca793a8d service nova] Releasing lock "refresh_cache-4ebd9d80-365d-4334-8421-3b22a846321a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:06:24 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:06:24 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:06:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.481s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:06:24 user nova-compute[75100]: INFO nova.compute.manager [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Migrating
Nov 10 18:06:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Acquiring lock "refresh_cache-4ebd9d80-365d-4334-8421-3b22a846321a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:06:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Acquired lock "refresh_cache-4ebd9d80-365d-4334-8421-3b22a846321a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:06:24 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 18:06:24 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:06:24 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Updating instance_info_cache with network_info: [{"id": "c9011ff5-53de-43f3-be8e-ba86274b2c99", "address": "fa:16:3e:a7:f8:6b", "network": {"id": "bf1edb58-ef26-40ca-8ec9-853fa05de13d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1416469583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7bb141ef59487dbb2ce6243c5002af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9011ff5-53", "ovs_interfaceid": "c9011ff5-53de-43f3-be8e-ba86274b2c99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:06:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Releasing lock "refresh_cache-4ebd9d80-365d-4334-8421-3b22a846321a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:06:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Starting migrate_disk_and_power_off {{(pid=75100) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 10 18:06:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:25 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:06:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-337e8ca9-bb6a-4390-8f91-f72e1d7debd5 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Acquiring lock "9dabb40d-299b-4c8a-bc92-63e5c0932047" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:06:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-337e8ca9-bb6a-4390-8f91-f72e1d7debd5 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Lock "9dabb40d-299b-4c8a-bc92-63e5c0932047" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:06:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-337e8ca9-bb6a-4390-8f91-f72e1d7debd5 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Acquiring lock "9dabb40d-299b-4c8a-bc92-63e5c0932047-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:06:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-337e8ca9-bb6a-4390-8f91-f72e1d7debd5 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Lock "9dabb40d-299b-4c8a-bc92-63e5c0932047-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:06:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-337e8ca9-bb6a-4390-8f91-f72e1d7debd5 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Lock "9dabb40d-299b-4c8a-bc92-63e5c0932047-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:06:25 user nova-compute[75100]: INFO nova.compute.manager [None req-337e8ca9-bb6a-4390-8f91-f72e1d7debd5 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] Terminating instance
Nov 10 18:06:25 user nova-compute[75100]: DEBUG nova.compute.manager [None req-337e8ca9-bb6a-4390-8f91-f72e1d7debd5 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 18:06:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:25 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Instance destroyed successfully.
Nov 10 18:06:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:03:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-541372061',display_name='tempest-ServerActionsTestOtherA-server-541372061',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-541372061',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJad9dm/VlgxkcoctzSOteh4UYTuKPNeJ9f0qso9IjuH6DpxTyWo1Jqw77DQ9s/VWyRmakd0roi/G14M/XBa/3VT72t8942zFgmm3ckvSnycGMTUzmFZ+zGnWexds7KMSQ==',key_name='tempest-keypair-1062541421',keypairs=<?>,launch_index=0,launched_at=2023-11-10T18:04:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ce7bb141ef59487dbb2ce6243c5002af',ramdisk_id='',reservation_id='r-bes8zsqu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1364670684',owner_user_name='tempest-ServerActionsTestOtherA-1364670684-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T18:06:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f4df424af2343a2a27e869502651216',uuid=4ebd9d80-365d-4334-8421-3b22a846321a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c9011ff5-53de-43f3-be8e-ba86274b2c99", "address": "fa:16:3e:a7:f8:6b", "network": {"id": "bf1edb58-ef26-40ca-8ec9-853fa05de13d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1416469583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1416469583-network", "vif_mac": "fa:16:3e:a7:f8:6b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7bb141ef59487dbb2ce6243c5002af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9011ff5-53", "ovs_interfaceid": "c9011ff5-53de-43f3-be8e-ba86274b2c99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 18:06:25 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Converting VIF {"id": "c9011ff5-53de-43f3-be8e-ba86274b2c99", "address": "fa:16:3e:a7:f8:6b", "network": {"id": "bf1edb58-ef26-40ca-8ec9-853fa05de13d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1416469583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1416469583-network", "vif_mac": "fa:16:3e:a7:f8:6b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7bb141ef59487dbb2ce6243c5002af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9011ff5-53", "ovs_interfaceid": "c9011ff5-53de-43f3-be8e-ba86274b2c99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:06:25 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:f8:6b,bridge_name='br-int',has_traffic_filtering=True,id=c9011ff5-53de-43f3-be8e-ba86274b2c99,network=Network(bf1edb58-ef26-40ca-8ec9-853fa05de13d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9011ff5-53') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:06:25 user nova-compute[75100]: DEBUG os_vif [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:f8:6b,bridge_name='br-int',has_traffic_filtering=True,id=c9011ff5-53de-43f3-be8e-ba86274b2c99,network=Network(bf1edb58-ef26-40ca-8ec9-853fa05de13d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9011ff5-53') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 18:06:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc9011ff5-53, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:06:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:06:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=555be521-61ef-4890-8ed6-20ffcaca4c39) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:06:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:06:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:25 user nova-compute[75100]: INFO os_vif [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:f8:6b,bridge_name='br-int',has_traffic_filtering=True,id=c9011ff5-53de-43f3-be8e-ba86274b2c99,network=Network(bf1edb58-ef26-40ca-8ec9-853fa05de13d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9011ff5-53')
Nov 10 18:06:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 18:06:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, {'target_iqn': 'iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'esQJvHgS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:06:25 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:06:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:06:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:06:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:25 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9193510-7ae2-4d9d-84f7-1673595c333e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:06:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 18:06:25 user nova-compute[75100]: No targets found.
Nov 10 18:06:25 user nova-compute[75100]: iSNS:
Nov 10 18:06:25 user nova-compute[75100]: No targets found.
Nov 10 18:06:25 user nova-compute[75100]: STATIC:
Nov 10 18:06:25 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be
Nov 10 18:06:25 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:06:25 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:06:25 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8
Nov 10 18:06:25 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:06:25 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:06:25 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf
Nov 10 18:06:25 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:06:25 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:06:25 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281
Nov 10 18:06:25 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:06:25 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:06:25 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005
Nov 10 18:06:25 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:06:25 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:06:25 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7
Nov 10 18:06:25 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:06:25 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:06:25 user nova-compute[75100]: FIRMWARE:
Nov 10 18:06:25 user nova-compute[75100]: No targets found.
Nov 10 18:06:25 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:06:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 18:06:25 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 18:06:25 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 18:06:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 18:06:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.036s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:25 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[43673d86-3c3e-4e78-ac92-a1be4f44a439]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:06:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:25 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[20dac9ea-94e6-45b4-821c-aa85c5d6f085]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:06:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)
Nov 10 18:06:25 user nova-compute[75100]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 (non-flash)
Nov 10 18:06:25 user nova-compute[75100]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be (non-flash)
Nov 10 18:06:25 user nova-compute[75100]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 (non-flash)
Nov 10 18:06:25 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8 (non-flash)
Nov 10 18:06:25 user nova-compute[75100]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf (non-flash)
Nov 10 18:06:25 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:06:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)
Nov 10 18:06:25 user nova-compute[75100]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 (non-flash)
Nov 10 18:06:25 user nova-compute[75100]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be (non-flash)
Nov 10 18:06:25 user nova-compute[75100]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 (non-flash)
Nov 10 18:06:25 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8 (non-flash)
Nov 10 18:06:25 user nova-compute[75100]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf (non-flash)
Nov 10 18:06:25 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:06:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3d429f130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7'): ({'sdb'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 18:06:25 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Removing single pathed devices sdb {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 18:06:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:25 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b11917a-3403-4b8b-911d-45ad0795ac1d]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:06:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.028s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:25 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e432875d-b495-48f1-9cf9-6fbf472dccab]: (4, ('ok\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:06:25 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Flushing IO for device /dev/sdb {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 18:06:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:25 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c9263d-5a94-45c7-a4aa-de1c91a7762b]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:06:25 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 18:06:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:25 user nova-compute[75100]: DEBUG nova.compute.manager [req-64c44b95-d943-459b-b402-a98c500b664c req-37a25c9b-5e5e-4b9f-9ebd-3add56bbfa01 service nova] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] Received event network-vif-unplugged-75bd6d86-2609-4694-969e-edd1cc65c12b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:06:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-64c44b95-d943-459b-b402-a98c500b664c req-37a25c9b-5e5e-4b9f-9ebd-3add56bbfa01 service nova] Acquiring lock "9dabb40d-299b-4c8a-bc92-63e5c0932047-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:06:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-64c44b95-d943-459b-b402-a98c500b664c req-37a25c9b-5e5e-4b9f-9ebd-3add56bbfa01 service nova] Lock "9dabb40d-299b-4c8a-bc92-63e5c0932047-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:06:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-64c44b95-d943-459b-b402-a98c500b664c req-37a25c9b-5e5e-4b9f-9ebd-3add56bbfa01 service nova] Lock "9dabb40d-299b-4c8a-bc92-63e5c0932047-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:06:25 user nova-compute[75100]: DEBUG nova.compute.manager [req-64c44b95-d943-459b-b402-a98c500b664c req-37a25c9b-5e5e-4b9f-9ebd-3add56bbfa01 service nova] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] No waiting events found dispatching network-vif-unplugged-75bd6d86-2609-4694-969e-edd1cc65c12b {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:06:25 user nova-compute[75100]: DEBUG nova.compute.manager [req-64c44b95-d943-459b-b402-a98c500b664c req-37a25c9b-5e5e-4b9f-9ebd-3add56bbfa01 service nova] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] Received event network-vif-unplugged-75bd6d86-2609-4694-969e-edd1cc65c12b for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 18:06:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:25 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[668c2df6-4e29-47ca-9293-26d426428fcb]: (4, ('1', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:06:25 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 18:06:25 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 18:06:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 18:06:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:26 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1e1545-0588-48c8-a9d5-10ccc7d7cb4a]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:06:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:06:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 -p 172.16.0.220:3260 --logout {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:26 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce009611-e6e3-4aed-94b3-9e2954705483]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:06:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7, portal: 172.16.0.220,3260]
Nov 10 18:06:26 user nova-compute[75100]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7, portal: 172.16.0.220,3260] successful.
Nov 10 18:06:26 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:06:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 -p 172.16.0.220:3260 --op delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:26 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6a6287-ab92-4879-a4fe-a4a5dd3f14ab]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:06:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:06:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.408s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:06:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] <== disconnect_volume: return (411ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:06:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 18:06:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 18:06:26 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] Instance destroyed successfully.
Nov 10 18:06:26 user nova-compute[75100]: DEBUG nova.objects.instance [None req-337e8ca9-bb6a-4390-8f91-f72e1d7debd5 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Lazy-loading 'resources' on Instance uuid 9dabb40d-299b-4c8a-bc92-63e5c0932047 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:06:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-337e8ca9-bb6a-4390-8f91-f72e1d7debd5 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:02:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-326371896',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-326371896',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-3263718',id=34,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0ob87C9vzLmMTEmRODF1om+p59G6Xa01yLKDlAKbRJ90oEkO+WUw7uc0wiIsmxnhd81lJ9UziVzXOCO/FWXxGrpTxOVvlgA9RP7cRHhX9s6TNwws/HHIFmRAbmoPo6cw==',key_name='tempest-keypair-1088211268',keypairs=<?>,launch_index=0,launched_at=2023-11-10T18:03:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b43954bd11143f2a7df5b5a81d47291',ramdisk_id='',reservation_id='r-rqq09rcs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-151723916',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T18:03:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51318008e5db48f6ad9973d8bc3f3123',uuid=9dabb40d-299b-4c8a-bc92-63e5c0932047,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "75bd6d86-2609-4694-969e-edd1cc65c12b", "address": "fa:16:3e:64:1d:f2", "network": {"id": "4dda5b3e-106d-4eb9-b939-ac553b155aad", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1558952398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b43954bd11143f2a7df5b5a81d47291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75bd6d86-26", "ovs_interfaceid": "75bd6d86-2609-4694-969e-edd1cc65c12b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 18:06:26 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-337e8ca9-bb6a-4390-8f91-f72e1d7debd5 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Converting VIF {"id": "75bd6d86-2609-4694-969e-edd1cc65c12b", "address": "fa:16:3e:64:1d:f2", "network": {"id": "4dda5b3e-106d-4eb9-b939-ac553b155aad", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1558952398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b43954bd11143f2a7df5b5a81d47291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75bd6d86-26", "ovs_interfaceid": "75bd6d86-2609-4694-969e-edd1cc65c12b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:06:26 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-337e8ca9-bb6a-4390-8f91-f72e1d7debd5 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:64:1d:f2,bridge_name='br-int',has_traffic_filtering=True,id=75bd6d86-2609-4694-969e-edd1cc65c12b,network=Network(4dda5b3e-106d-4eb9-b939-ac553b155aad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75bd6d86-26') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:06:26 user nova-compute[75100]: DEBUG os_vif [None req-337e8ca9-bb6a-4390-8f91-f72e1d7debd5 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:1d:f2,bridge_name='br-int',has_traffic_filtering=True,id=75bd6d86-2609-4694-969e-edd1cc65c12b,network=Network(4dda5b3e-106d-4eb9-b939-ac553b155aad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75bd6d86-26') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 18:06:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap75bd6d86-26, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:06:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:06:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cac2302c-8779-4566-977d-ca5f605b3232) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:06:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:06:26 user nova-compute[75100]: INFO os_vif [None req-337e8ca9-bb6a-4390-8f91-f72e1d7debd5 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:1d:f2,bridge_name='br-int',has_traffic_filtering=True,id=75bd6d86-2609-4694-969e-edd1cc65c12b,network=Network(4dda5b3e-106d-4eb9-b939-ac553b155aad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75bd6d86-26')
Nov 10 18:06:26 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-337e8ca9-bb6a-4390-8f91-f72e1d7debd5 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] Deleting instance files /opt/stack/data/nova/instances/9dabb40d-299b-4c8a-bc92-63e5c0932047_del
Nov 10 18:06:26 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-337e8ca9-bb6a-4390-8f91-f72e1d7debd5 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] Deletion of /opt/stack/data/nova/instances/9dabb40d-299b-4c8a-bc92-63e5c0932047_del complete
Nov 10 18:06:26 user nova-compute[75100]: INFO nova.compute.manager [None req-337e8ca9-bb6a-4390-8f91-f72e1d7debd5 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] Took 1.08 seconds to destroy the instance on the hypervisor.
Nov 10 18:06:26 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-337e8ca9-bb6a-4390-8f91-f72e1d7debd5 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 18:06:26 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 18:06:26 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 18:06:27 user nova-compute[75100]: DEBUG nova.compute.manager [req-a47af635-f769-4719-8d54-83756093787d req-8e333cce-a164-4f53-832f-a59cc8d20faf service nova] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Received event network-vif-unplugged-c9011ff5-53de-43f3-be8e-ba86274b2c99 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:06:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a47af635-f769-4719-8d54-83756093787d req-8e333cce-a164-4f53-832f-a59cc8d20faf service nova] Acquiring lock "4ebd9d80-365d-4334-8421-3b22a846321a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:06:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a47af635-f769-4719-8d54-83756093787d req-8e333cce-a164-4f53-832f-a59cc8d20faf service nova] Lock "4ebd9d80-365d-4334-8421-3b22a846321a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:06:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a47af635-f769-4719-8d54-83756093787d req-8e333cce-a164-4f53-832f-a59cc8d20faf service nova] Lock "4ebd9d80-365d-4334-8421-3b22a846321a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:06:27 user nova-compute[75100]: DEBUG nova.compute.manager [req-a47af635-f769-4719-8d54-83756093787d req-8e333cce-a164-4f53-832f-a59cc8d20faf service nova] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] No waiting events found dispatching network-vif-unplugged-c9011ff5-53de-43f3-be8e-ba86274b2c99 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:06:27 user nova-compute[75100]: WARNING nova.compute.manager [req-a47af635-f769-4719-8d54-83756093787d req-8e333cce-a164-4f53-832f-a59cc8d20faf service nova] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Received unexpected event network-vif-unplugged-c9011ff5-53de-43f3-be8e-ba86274b2c99 for instance with vm_state active and task_state resize_migrating.
Nov 10 18:06:27 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:06:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:06:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:06:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:06:27 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 18:06:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5194f111-ba1a-43bc-9564-b744d1960307/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:27 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Port c9011ff5-53de-43f3-be8e-ba86274b2c99 binding to destination host user is already ACTIVE {{(pid=75100) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 10 18:06:27 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:06:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5194f111-ba1a-43bc-9564-b744d1960307/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5194f111-ba1a-43bc-9564-b744d1960307/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:27 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] Took 1.24 seconds to deallocate network for instance.
Nov 10 18:06:27 user nova-compute[75100]: DEBUG nova.compute.manager [req-c860efbc-815d-45c1-9fda-b487a201e12d req-dde9decb-aacf-4b16-b83f-73b77380ce7f service nova] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] Received event network-vif-deleted-75bd6d86-2609-4694-969e-edd1cc65c12b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:06:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Acquiring lock "4ebd9d80-365d-4334-8421-3b22a846321a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:06:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "4ebd9d80-365d-4334-8421-3b22a846321a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:06:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "4ebd9d80-365d-4334-8421-3b22a846321a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:06:27 user nova-compute[75100]: INFO nova.compute.manager [None req-64ae9a14-5a3e-478a-a272-de54e22ab303 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Unrescuing
Nov 10 18:06:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-64ae9a14-5a3e-478a-a272-de54e22ab303 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Acquiring lock "refresh_cache-fcc2bfb6-fd6b-4229-9664-42f33b138444" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:06:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-64ae9a14-5a3e-478a-a272-de54e22ab303 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Acquired lock "refresh_cache-fcc2bfb6-fd6b-4229-9664-42f33b138444" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:06:27 user nova-compute[75100]: DEBUG nova.network.neutron [None req-64ae9a14-5a3e-478a-a272-de54e22ab303 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 18:06:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-337e8ca9-bb6a-4390-8f91-f72e1d7debd5 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:06:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-337e8ca9-bb6a-4390-8f91-f72e1d7debd5 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:06:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5194f111-ba1a-43bc-9564-b744d1960307/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 18:06:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Acquiring lock "refresh_cache-4ebd9d80-365d-4334-8421-3b22a846321a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:06:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Acquired lock "refresh_cache-4ebd9d80-365d-4334-8421-3b22a846321a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:06:27 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 18:06:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0bae328-2528-4562-850b-14fa108923c6/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:28 user nova-compute[75100]: DEBUG nova.compute.manager [req-d7c69739-7049-43d4-b203-7d2af04bbda0 req-d3caf346-3f0a-410e-baec-b3b0c338aa45 service nova] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] Received event network-vif-plugged-75bd6d86-2609-4694-969e-edd1cc65c12b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:06:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d7c69739-7049-43d4-b203-7d2af04bbda0 req-d3caf346-3f0a-410e-baec-b3b0c338aa45 service nova] Acquiring lock "9dabb40d-299b-4c8a-bc92-63e5c0932047-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:06:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d7c69739-7049-43d4-b203-7d2af04bbda0 req-d3caf346-3f0a-410e-baec-b3b0c338aa45 service nova] Lock "9dabb40d-299b-4c8a-bc92-63e5c0932047-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:06:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d7c69739-7049-43d4-b203-7d2af04bbda0 req-d3caf346-3f0a-410e-baec-b3b0c338aa45 service nova] Lock "9dabb40d-299b-4c8a-bc92-63e5c0932047-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:06:28 user nova-compute[75100]: DEBUG nova.compute.manager [req-d7c69739-7049-43d4-b203-7d2af04bbda0 req-d3caf346-3f0a-410e-baec-b3b0c338aa45 service nova] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] No waiting events found dispatching network-vif-plugged-75bd6d86-2609-4694-969e-edd1cc65c12b {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:06:28 user nova-compute[75100]: WARNING nova.compute.manager [req-d7c69739-7049-43d4-b203-7d2af04bbda0 req-d3caf346-3f0a-410e-baec-b3b0c338aa45 service nova] [instance: 9dabb40d-299b-4c8a-bc92-63e5c0932047] Received unexpected event network-vif-plugged-75bd6d86-2609-4694-969e-edd1cc65c12b for instance with vm_state deleted and task_state None.
Nov 10 18:06:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0bae328-2528-4562-850b-14fa108923c6/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0bae328-2528-4562-850b-14fa108923c6/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:28 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-337e8ca9-bb6a-4390-8f91-f72e1d7debd5 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:06:28 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-337e8ca9-bb6a-4390-8f91-f72e1d7debd5 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:06:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0bae328-2528-4562-850b-14fa108923c6/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:28 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 18:06:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-337e8ca9-bb6a-4390-8f91-f72e1d7debd5 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.466s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:06:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:28 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-337e8ca9-bb6a-4390-8f91-f72e1d7debd5 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Deleted allocations for instance 9dabb40d-299b-4c8a-bc92-63e5c0932047
Nov 10 18:06:28 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Updating instance_info_cache with network_info: [{"id": "c9011ff5-53de-43f3-be8e-ba86274b2c99", "address": "fa:16:3e:a7:f8:6b", "network": {"id": "bf1edb58-ef26-40ca-8ec9-853fa05de13d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1416469583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7bb141ef59487dbb2ce6243c5002af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9011ff5-53", "ovs_interfaceid": "c9011ff5-53de-43f3-be8e-ba86274b2c99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:06:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Releasing lock "refresh_cache-4ebd9d80-365d-4334-8421-3b22a846321a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:06:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-337e8ca9-bb6a-4390-8f91-f72e1d7debd5 tempest-TestServerVolumeAttachScenarioOldVersion-151723916 tempest-TestServerVolumeAttachScenarioOldVersion-151723916-project-member] Lock "9dabb40d-299b-4c8a-bc92-63e5c0932047" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.244s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:06:28 user nova-compute[75100]: DEBUG os_brick.utils [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:06:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:28 user nova-compute[75100]: DEBUG nova.network.neutron [None req-64ae9a14-5a3e-478a-a272-de54e22ab303 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Updating instance_info_cache with network_info: [{"id": "8c7dcf78-fc4a-4fcb-905e-ce75143a9450", "address": "fa:16:3e:be:ec:38", "network": {"id": "20522623-c29d-44f8-9047-68dde7f763c1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1770250829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2871e8755b32497d901be0f062fad858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7dcf78-fc", "ovs_interfaceid": "8c7dcf78-fc4a-4fcb-905e-ce75143a9450", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:06:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.065s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:28 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[191ddf13-e905-4691-ac94-24efce3a0a9a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90b1a229568f\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:06:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-64ae9a14-5a3e-478a-a272-de54e22ab303 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Releasing lock "refresh_cache-fcc2bfb6-fd6b-4229-9664-42f33b138444" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:06:28 user nova-compute[75100]: DEBUG nova.objects.instance [None req-64ae9a14-5a3e-478a-a272-de54e22ab303 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Lazy-loading 'flavor' on Instance uuid fcc2bfb6-fd6b-4229-9664-42f33b138444 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:06:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.030s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:28 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3acd3b-4b21-4584-b1d6-72986262a2cd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:06:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:28 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9acc79f-9dad-4aaa-aaca-9bfb6fd4d2d7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:06:28 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 18:06:28 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c01f44-e24d-425a-9e04-67c7caece366]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:06:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 18:06:28 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 18:06:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1937fab6-d892-406e-b8ff-52194021eea4/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 18:06:28 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 18:06:28 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee29690-1000-411b-b3ff-74515bacb9ab]: (4, '') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:06:28 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 18:06:28 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 18:06:28 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 18:06:28 user nova-compute[75100]: DEBUG os_brick.utils [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] <== get_connector_properties: return (304ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90b1a229568f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:06:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1937fab6-d892-406e-b8ff-52194021eea4/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1937fab6-d892-406e-b8ff-52194021eea4/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-641ac5f8-e57c-4db9-aa9e-9a918b97cfe1 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Acquiring lock "5194f111-ba1a-43bc-9564-b744d1960307" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:06:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-641ac5f8-e57c-4db9-aa9e-9a918b97cfe1 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lock "5194f111-ba1a-43bc-9564-b744d1960307" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.004s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:06:29 user nova-compute[75100]: INFO nova.compute.manager [None req-641ac5f8-e57c-4db9-aa9e-9a918b97cfe1 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Detaching volume 85677e03-86ea-4986-a4db-d477c739c6be
Nov 10 18:06:29 user nova-compute[75100]: DEBUG nova.compute.manager [req-7b90fec9-c567-4ed0-8644-b6a416722d5d req-64db5eb7-2bb7-4362-b17d-bcd7942e5332 service nova] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Received event network-vif-plugged-c9011ff5-53de-43f3-be8e-ba86274b2c99 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:06:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7b90fec9-c567-4ed0-8644-b6a416722d5d req-64db5eb7-2bb7-4362-b17d-bcd7942e5332 service nova] Acquiring lock "4ebd9d80-365d-4334-8421-3b22a846321a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:06:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7b90fec9-c567-4ed0-8644-b6a416722d5d req-64db5eb7-2bb7-4362-b17d-bcd7942e5332 service nova] Lock "4ebd9d80-365d-4334-8421-3b22a846321a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:06:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7b90fec9-c567-4ed0-8644-b6a416722d5d req-64db5eb7-2bb7-4362-b17d-bcd7942e5332 service nova] Lock "4ebd9d80-365d-4334-8421-3b22a846321a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:06:29 user nova-compute[75100]: DEBUG nova.compute.manager [req-7b90fec9-c567-4ed0-8644-b6a416722d5d req-64db5eb7-2bb7-4362-b17d-bcd7942e5332 service nova] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] No waiting events found dispatching network-vif-plugged-c9011ff5-53de-43f3-be8e-ba86274b2c99 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:06:29 user nova-compute[75100]: WARNING nova.compute.manager [req-7b90fec9-c567-4ed0-8644-b6a416722d5d req-64db5eb7-2bb7-4362-b17d-bcd7942e5332 service nova] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Received unexpected event network-vif-plugged-c9011ff5-53de-43f3-be8e-ba86274b2c99 for instance with vm_state active and task_state resize_finish.
Nov 10 18:06:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5ba57d64-6304-4355-9c4b-8be17a1b005d tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Acquiring lock "5194f111-ba1a-43bc-9564-b744d1960307" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:06:29 user nova-compute[75100]: INFO nova.virt.block_device [None req-641ac5f8-e57c-4db9-aa9e-9a918b97cfe1 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Attempting to driver detach volume 85677e03-86ea-4986-a4db-d477c739c6be from mountpoint /dev/vdb
Nov 10 18:06:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-641ac5f8-e57c-4db9-aa9e-9a918b97cfe1 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Attempting to detach device vdb from instance 5194f111-ba1a-43bc-9564-b744d1960307 from the persistent domain config. {{(pid=75100) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 18:06:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-641ac5f8-e57c-4db9-aa9e-9a918b97cfe1 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 18:06:29 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:06:29 user nova-compute[75100]:   <source dev="/dev/sdd"/>
Nov 10 18:06:29 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 18:06:29 user nova-compute[75100]:   <serial>85677e03-86ea-4986-a4db-d477c739c6be</serial>
Nov 10 18:06:29 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 18:06:29 user nova-compute[75100]: </disk>
Nov 10 18:06:29 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 18:06:29 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-641ac5f8-e57c-4db9-aa9e-9a918b97cfe1 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Successfully detached device vdb from instance 5194f111-ba1a-43bc-9564-b744d1960307 from the persistent domain config.
Nov 10 18:06:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-641ac5f8-e57c-4db9-aa9e-9a918b97cfe1 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5194f111-ba1a-43bc-9564-b744d1960307 from the live domain config. {{(pid=75100) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 18:06:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-641ac5f8-e57c-4db9-aa9e-9a918b97cfe1 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 18:06:29 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:06:29 user nova-compute[75100]:   <source dev="/dev/sdd"/>
Nov 10 18:06:29 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 18:06:29 user nova-compute[75100]:   <serial>85677e03-86ea-4986-a4db-d477c739c6be</serial>
Nov 10 18:06:29 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 18:06:29 user nova-compute[75100]: </disk>
Nov 10 18:06:29 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 18:06:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1937fab6-d892-406e-b8ff-52194021eea4/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 18:06:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fb32aa2-0dbf-4f54-ae68-18c609604b53/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fb32aa2-0dbf-4f54-ae68-18c609604b53/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fb32aa2-0dbf-4f54-ae68-18c609604b53/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:29 user nova-compute[75100]: DEBUG nova.compute.manager [req-214ce0b9-3b91-4272-9355-5fda97cb4dbe req-298d12d1-0fa7-472d-b62d-6325de139221 service nova] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Received event network-vif-unplugged-8c7dcf78-fc4a-4fcb-905e-ce75143a9450 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:06:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-214ce0b9-3b91-4272-9355-5fda97cb4dbe req-298d12d1-0fa7-472d-b62d-6325de139221 service nova] Acquiring lock "fcc2bfb6-fd6b-4229-9664-42f33b138444-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:06:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-214ce0b9-3b91-4272-9355-5fda97cb4dbe req-298d12d1-0fa7-472d-b62d-6325de139221 service nova] Lock "fcc2bfb6-fd6b-4229-9664-42f33b138444-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:06:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-214ce0b9-3b91-4272-9355-5fda97cb4dbe req-298d12d1-0fa7-472d-b62d-6325de139221 service nova] Lock "fcc2bfb6-fd6b-4229-9664-42f33b138444-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:06:29 user nova-compute[75100]: DEBUG nova.compute.manager [req-214ce0b9-3b91-4272-9355-5fda97cb4dbe req-298d12d1-0fa7-472d-b62d-6325de139221 service nova] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] No waiting events found dispatching network-vif-unplugged-8c7dcf78-fc4a-4fcb-905e-ce75143a9450 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:06:29 user nova-compute[75100]: WARNING nova.compute.manager [req-214ce0b9-3b91-4272-9355-5fda97cb4dbe req-298d12d1-0fa7-472d-b62d-6325de139221 service nova] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Received unexpected event network-vif-unplugged-8c7dcf78-fc4a-4fcb-905e-ce75143a9450 for instance with vm_state rescued and task_state unrescuing.
Nov 10 18:06:29 user nova-compute[75100]: DEBUG nova.compute.manager [req-214ce0b9-3b91-4272-9355-5fda97cb4dbe req-298d12d1-0fa7-472d-b62d-6325de139221 service nova] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Received event network-vif-plugged-8c7dcf78-fc4a-4fcb-905e-ce75143a9450 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:06:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-214ce0b9-3b91-4272-9355-5fda97cb4dbe req-298d12d1-0fa7-472d-b62d-6325de139221 service nova] Acquiring lock "fcc2bfb6-fd6b-4229-9664-42f33b138444-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:06:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-214ce0b9-3b91-4272-9355-5fda97cb4dbe req-298d12d1-0fa7-472d-b62d-6325de139221 service nova] Lock "fcc2bfb6-fd6b-4229-9664-42f33b138444-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:06:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-214ce0b9-3b91-4272-9355-5fda97cb4dbe req-298d12d1-0fa7-472d-b62d-6325de139221 service nova] Lock "fcc2bfb6-fd6b-4229-9664-42f33b138444-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:06:29 user nova-compute[75100]: DEBUG nova.compute.manager [req-214ce0b9-3b91-4272-9355-5fda97cb4dbe req-298d12d1-0fa7-472d-b62d-6325de139221 service nova] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] No waiting events found dispatching network-vif-plugged-8c7dcf78-fc4a-4fcb-905e-ce75143a9450 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:06:29 user nova-compute[75100]: WARNING nova.compute.manager [req-214ce0b9-3b91-4272-9355-5fda97cb4dbe req-298d12d1-0fa7-472d-b62d-6325de139221 service nova] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Received unexpected event network-vif-plugged-8c7dcf78-fc4a-4fcb-905e-ce75143a9450 for instance with vm_state rescued and task_state unrescuing.
Nov 10 18:06:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fb32aa2-0dbf-4f54-ae68-18c609604b53/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-641ac5f8-e57c-4db9-aa9e-9a918b97cfe1 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5194f111-ba1a-43bc-9564-b744d1960307 {{(pid=75100) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 18:06:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc2bfb6-fd6b-4229-9664-42f33b138444/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:30 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Instance destroyed successfully.
Nov 10 18:06:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc2bfb6-fd6b-4229-9664-42f33b138444/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc2bfb6-fd6b-4229-9664-42f33b138444/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Acquiring lock "7bc34cf6-1f79-4127-8c35-0ae2d93406ff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:06:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Lock "7bc34cf6-1f79-4127-8c35-0ae2d93406ff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:06:30 user nova-compute[75100]: DEBUG nova.compute.manager [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 7bc34cf6-1f79-4127-8c35-0ae2d93406ff] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 18:06:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc2bfb6-fd6b-4229-9664-42f33b138444/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 18:06:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc2bfb6-fd6b-4229-9664-42f33b138444/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:06:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:06:30 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 18:06:30 user nova-compute[75100]: INFO nova.compute.claims [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 7bc34cf6-1f79-4127-8c35-0ae2d93406ff] Claim successful on node user
Nov 10 18:06:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc2bfb6-fd6b-4229-9664-42f33b138444/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc2bfb6-fd6b-4229-9664-42f33b138444/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc2bfb6-fd6b-4229-9664-42f33b138444/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 18:06:31 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:06:31 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:06:31 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Hypervisor/Node resource view: name=user free_ram=7721MB free_disk=24.302616119384766GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 18:06:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:06:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:31 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:06:31 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:06:31 user nova-compute[75100]: DEBUG nova.compute.manager [req-a8681718-69e5-4243-8324-0f3c2da5afde req-fd936811-ce69-4331-a692-3fabf477c64f service nova] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Received event network-changed-8c7dcf78-fc4a-4fcb-905e-ce75143a9450 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:06:31 user nova-compute[75100]: DEBUG nova.compute.manager [req-a8681718-69e5-4243-8324-0f3c2da5afde req-fd936811-ce69-4331-a692-3fabf477c64f service nova] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Refreshing instance network info cache due to event network-changed-8c7dcf78-fc4a-4fcb-905e-ce75143a9450. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 18:06:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a8681718-69e5-4243-8324-0f3c2da5afde req-fd936811-ce69-4331-a692-3fabf477c64f service nova] Acquiring lock "refresh_cache-fcc2bfb6-fd6b-4229-9664-42f33b138444" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:06:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a8681718-69e5-4243-8324-0f3c2da5afde req-fd936811-ce69-4331-a692-3fabf477c64f service nova] Acquired lock "refresh_cache-fcc2bfb6-fd6b-4229-9664-42f33b138444" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:06:31 user nova-compute[75100]: DEBUG nova.network.neutron [req-a8681718-69e5-4243-8324-0f3c2da5afde req-fd936811-ce69-4331-a692-3fabf477c64f service nova] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Refreshing network info cache for port 8c7dcf78-fc4a-4fcb-905e-ce75143a9450 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 18:06:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.890s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:06:31 user nova-compute[75100]: DEBUG nova.compute.manager [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 7bc34cf6-1f79-4127-8c35-0ae2d93406ff] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 18:06:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.126s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:06:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:31 user nova-compute[75100]: DEBUG nova.compute.manager [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 7bc34cf6-1f79-4127-8c35-0ae2d93406ff] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 18:06:31 user nova-compute[75100]: DEBUG nova.network.neutron [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 7bc34cf6-1f79-4127-8c35-0ae2d93406ff] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 18:06:31 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 7bc34cf6-1f79-4127-8c35-0ae2d93406ff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 18:06:31 user nova-compute[75100]: DEBUG nova.compute.manager [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 7bc34cf6-1f79-4127-8c35-0ae2d93406ff] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 18:06:31 user nova-compute[75100]: DEBUG nova.policy [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '130a36dd61074d99855f44d5ebb20eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e369208c0a486fa4cceb6de3620b6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 18:06:31 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Applying migration context for instance 4ebd9d80-365d-4334-8421-3b22a846321a as it has an incoming, in-progress migration ba414159-d274-4472-b362-fccac93007d8. Migration status is post-migrating {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 10 18:06:31 user nova-compute[75100]: INFO nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Updating resource usage from migration ba414159-d274-4472-b362-fccac93007d8
Nov 10 18:06:31 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:06:31 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance fcc2bfb6-fd6b-4229-9664-42f33b138444 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:06:31 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 5194f111-ba1a-43bc-9564-b744d1960307 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:06:31 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance b0bae328-2528-4562-850b-14fa108923c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:06:31 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 1937fab6-d892-406e-b8ff-52194021eea4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:06:31 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance dc8c4fa7-668a-4348-be16-9eb06420b01f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:06:31 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 4fb32aa2-0dbf-4f54-ae68-18c609604b53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:06:31 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Migration ba414159-d274-4472-b362-fccac93007d8 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 10 18:06:31 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 4ebd9d80-365d-4334-8421-3b22a846321a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:06:31 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 7bc34cf6-1f79-4127-8c35-0ae2d93406ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:06:31 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 18:06:31 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 18:06:31 user nova-compute[75100]: DEBUG nova.compute.manager [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 7bc34cf6-1f79-4127-8c35-0ae2d93406ff] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 18:06:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 7bc34cf6-1f79-4127-8c35-0ae2d93406ff] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 18:06:31 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 7bc34cf6-1f79-4127-8c35-0ae2d93406ff] Creating image(s)
Nov 10 18:06:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Acquiring lock "/opt/stack/data/nova/instances/7bc34cf6-1f79-4127-8c35-0ae2d93406ff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:06:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Lock "/opt/stack/data/nova/instances/7bc34cf6-1f79-4127-8c35-0ae2d93406ff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:06:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Lock "/opt/stack/data/nova/instances/7bc34cf6-1f79-4127-8c35-0ae2d93406ff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.016s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:06:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.193s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Acquiring lock "818b9e28e061d41a38d903968b229be2ed9ba520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:06:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:06:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:31 user nova-compute[75100]: DEBUG nova.compute.manager [req-fe9892ec-c2de-4e72-b9a7-7f46c9d0d05e req-78040afb-ba15-44e0-9b8a-9f2ef3f92f90 service nova] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Received event network-vif-plugged-8c7dcf78-fc4a-4fcb-905e-ce75143a9450 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:06:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-fe9892ec-c2de-4e72-b9a7-7f46c9d0d05e req-78040afb-ba15-44e0-9b8a-9f2ef3f92f90 service nova] Acquiring lock "fcc2bfb6-fd6b-4229-9664-42f33b138444-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:06:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-fe9892ec-c2de-4e72-b9a7-7f46c9d0d05e req-78040afb-ba15-44e0-9b8a-9f2ef3f92f90 service nova] Lock "fcc2bfb6-fd6b-4229-9664-42f33b138444-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:06:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-fe9892ec-c2de-4e72-b9a7-7f46c9d0d05e req-78040afb-ba15-44e0-9b8a-9f2ef3f92f90 service nova] Lock "fcc2bfb6-fd6b-4229-9664-42f33b138444-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:06:31 user nova-compute[75100]: DEBUG nova.compute.manager [req-fe9892ec-c2de-4e72-b9a7-7f46c9d0d05e req-78040afb-ba15-44e0-9b8a-9f2ef3f92f90 service nova] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] No waiting events found dispatching network-vif-plugged-8c7dcf78-fc4a-4fcb-905e-ce75143a9450 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:06:31 user nova-compute[75100]: WARNING nova.compute.manager [req-fe9892ec-c2de-4e72-b9a7-7f46c9d0d05e req-78040afb-ba15-44e0-9b8a-9f2ef3f92f90 service nova] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Received unexpected event network-vif-plugged-8c7dcf78-fc4a-4fcb-905e-ce75143a9450 for instance with vm_state rescued and task_state unrescuing.
Nov 10 18:06:32 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:06:32 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:06:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.244s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/7bc34cf6-1f79-4127-8c35-0ae2d93406ff/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:32 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 18:06:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.855s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:06:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/7bc34cf6-1f79-4127-8c35-0ae2d93406ff/disk 1073741824" returned: 0 in 0.128s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.375s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:06:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:32 user nova-compute[75100]: DEBUG nova.network.neutron [req-a8681718-69e5-4243-8324-0f3c2da5afde req-fd936811-ce69-4331-a692-3fabf477c64f service nova] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Updated VIF entry in instance network info cache for port 8c7dcf78-fc4a-4fcb-905e-ce75143a9450. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 18:06:32 user nova-compute[75100]: DEBUG nova.network.neutron [req-a8681718-69e5-4243-8324-0f3c2da5afde req-fd936811-ce69-4331-a692-3fabf477c64f service nova] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Updating instance_info_cache with network_info: [{"id": "8c7dcf78-fc4a-4fcb-905e-ce75143a9450", "address": "fa:16:3e:be:ec:38", "network": {"id": "20522623-c29d-44f8-9047-68dde7f763c1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1770250829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2871e8755b32497d901be0f062fad858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7dcf78-fc", "ovs_interfaceid": "8c7dcf78-fc4a-4fcb-905e-ce75143a9450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:06:32 user nova-compute[75100]: DEBUG nova.network.neutron [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 7bc34cf6-1f79-4127-8c35-0ae2d93406ff] Successfully created port: 3d66e837-0a05-47ec-9605-5eb2973203d5 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 18:06:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a8681718-69e5-4243-8324-0f3c2da5afde req-fd936811-ce69-4331-a692-3fabf477c64f service nova] Releasing lock "refresh_cache-fcc2bfb6-fd6b-4229-9664-42f33b138444" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:06:32 user nova-compute[75100]: DEBUG nova.compute.manager [req-a8681718-69e5-4243-8324-0f3c2da5afde req-fd936811-ce69-4331-a692-3fabf477c64f service nova] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Received event network-changed-8c7dcf78-fc4a-4fcb-905e-ce75143a9450 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:06:32 user nova-compute[75100]: DEBUG nova.compute.manager [req-a8681718-69e5-4243-8324-0f3c2da5afde req-fd936811-ce69-4331-a692-3fabf477c64f service nova] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Refreshing instance network info cache due to event network-changed-8c7dcf78-fc4a-4fcb-905e-ce75143a9450. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 18:06:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a8681718-69e5-4243-8324-0f3c2da5afde req-fd936811-ce69-4331-a692-3fabf477c64f service nova] Acquiring lock "refresh_cache-fcc2bfb6-fd6b-4229-9664-42f33b138444" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:06:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a8681718-69e5-4243-8324-0f3c2da5afde req-fd936811-ce69-4331-a692-3fabf477c64f service nova] Acquired lock "refresh_cache-fcc2bfb6-fd6b-4229-9664-42f33b138444" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:06:32 user nova-compute[75100]: DEBUG nova.network.neutron [req-a8681718-69e5-4243-8324-0f3c2da5afde req-fd936811-ce69-4331-a692-3fabf477c64f service nova] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Refreshing network info cache for port 8c7dcf78-fc4a-4fcb-905e-ce75143a9450 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 18:06:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.193s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:32 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7bc34cf6-1f79-4127-8c35-0ae2d93406ff/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 18:06:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bc34cf6-1f79-4127-8c35-0ae2d93406ff/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bc34cf6-1f79-4127-8c35-0ae2d93406ff/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:32 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Cannot resize image /opt/stack/data/nova/instances/7bc34cf6-1f79-4127-8c35-0ae2d93406ff/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 18:06:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 7bc34cf6-1f79-4127-8c35-0ae2d93406ff] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 18:06:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 7bc34cf6-1f79-4127-8c35-0ae2d93406ff] Ensure instance console log exists: /opt/stack/data/nova/instances/7bc34cf6-1f79-4127-8c35-0ae2d93406ff/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 18:06:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:06:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:06:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:06:32 user nova-compute[75100]: DEBUG nova.network.neutron [req-a8681718-69e5-4243-8324-0f3c2da5afde req-fd936811-ce69-4331-a692-3fabf477c64f service nova] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Updated VIF entry in instance network info cache for port 8c7dcf78-fc4a-4fcb-905e-ce75143a9450. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 18:06:32 user nova-compute[75100]: DEBUG nova.network.neutron [req-a8681718-69e5-4243-8324-0f3c2da5afde req-fd936811-ce69-4331-a692-3fabf477c64f service nova] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Updating instance_info_cache with network_info: [{"id": "8c7dcf78-fc4a-4fcb-905e-ce75143a9450", "address": "fa:16:3e:be:ec:38", "network": {"id": "20522623-c29d-44f8-9047-68dde7f763c1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1770250829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2871e8755b32497d901be0f062fad858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7dcf78-fc", "ovs_interfaceid": "8c7dcf78-fc4a-4fcb-905e-ce75143a9450", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:06:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a8681718-69e5-4243-8324-0f3c2da5afde req-fd936811-ce69-4331-a692-3fabf477c64f service nova] Releasing lock "refresh_cache-fcc2bfb6-fd6b-4229-9664-42f33b138444" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:06:32 user nova-compute[75100]: DEBUG nova.network.neutron [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 7bc34cf6-1f79-4127-8c35-0ae2d93406ff] Successfully updated port: 3d66e837-0a05-47ec-9605-5eb2973203d5 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 18:06:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Acquiring lock "refresh_cache-7bc34cf6-1f79-4127-8c35-0ae2d93406ff" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:06:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Acquired lock "refresh_cache-7bc34cf6-1f79-4127-8c35-0ae2d93406ff" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:06:33 user nova-compute[75100]: DEBUG nova.network.neutron [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 7bc34cf6-1f79-4127-8c35-0ae2d93406ff] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 18:06:33 user nova-compute[75100]: DEBUG nova.compute.manager [req-3e125067-efed-4391-bb77-3deb99e95344 req-47f659cd-f1cd-444b-afe6-2339b6a0a2a1 service nova] [instance: 7bc34cf6-1f79-4127-8c35-0ae2d93406ff] Received event network-changed-3d66e837-0a05-47ec-9605-5eb2973203d5 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:06:33 user nova-compute[75100]: DEBUG nova.compute.manager [req-3e125067-efed-4391-bb77-3deb99e95344 req-47f659cd-f1cd-444b-afe6-2339b6a0a2a1 service nova] [instance: 7bc34cf6-1f79-4127-8c35-0ae2d93406ff] Refreshing instance network info cache due to event network-changed-3d66e837-0a05-47ec-9605-5eb2973203d5. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 18:06:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3e125067-efed-4391-bb77-3deb99e95344 req-47f659cd-f1cd-444b-afe6-2339b6a0a2a1 service nova] Acquiring lock "refresh_cache-7bc34cf6-1f79-4127-8c35-0ae2d93406ff" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:06:33 user nova-compute[75100]: DEBUG nova.network.neutron [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 7bc34cf6-1f79-4127-8c35-0ae2d93406ff] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 18:06:33 user nova-compute[75100]: DEBUG nova.network.neutron [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 7bc34cf6-1f79-4127-8c35-0ae2d93406ff] Updating instance_info_cache with network_info: [{"id": "3d66e837-0a05-47ec-9605-5eb2973203d5", "address": "fa:16:3e:1b:7b:f6", "network": {"id": "f22ce8bd-85d3-4596-849e-9e04d728af34", "bridge": "br-int", "label": "tempest-VolumesActionsTest-979416963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42e369208c0a486fa4cceb6de3620b6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d66e837-0a", "ovs_interfaceid": "3d66e837-0a05-47ec-9605-5eb2973203d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:06:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Releasing lock "refresh_cache-7bc34cf6-1f79-4127-8c35-0ae2d93406ff" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:06:33 user nova-compute[75100]: DEBUG nova.compute.manager [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 7bc34cf6-1f79-4127-8c35-0ae2d93406ff] Instance network_info: |[{"id": "3d66e837-0a05-47ec-9605-5eb2973203d5", "address": "fa:16:3e:1b:7b:f6", "network": {"id": "f22ce8bd-85d3-4596-849e-9e04d728af34", "bridge": "br-int", "label": "tempest-VolumesActionsTest-979416963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42e369208c0a486fa4cceb6de3620b6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d66e837-0a", "ovs_interfaceid": "3d66e837-0a05-47ec-9605-5eb2973203d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 18:06:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3e125067-efed-4391-bb77-3deb99e95344 req-47f659cd-f1cd-444b-afe6-2339b6a0a2a1 service nova] Acquired lock "refresh_cache-7bc34cf6-1f79-4127-8c35-0ae2d93406ff" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:06:33 user nova-compute[75100]: DEBUG nova.network.neutron [req-3e125067-efed-4391-bb77-3deb99e95344 req-47f659cd-f1cd-444b-afe6-2339b6a0a2a1 service nova] [instance: 7bc34cf6-1f79-4127-8c35-0ae2d93406ff] Refreshing network info cache for port 3d66e837-0a05-47ec-9605-5eb2973203d5 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 18:06:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 7bc34cf6-1f79-4127-8c35-0ae2d93406ff] Start _get_guest_xml network_info=[{"id": "3d66e837-0a05-47ec-9605-5eb2973203d5", "address": "fa:16:3e:1b:7b:f6", "network": {"id": "f22ce8bd-85d3-4596-849e-9e04d728af34", "bridge": "br-int", "label": "tempest-VolumesActionsTest-979416963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42e369208c0a486fa4cceb6de3620b6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d66e837-0a", "ovs_interfaceid": "3d66e837-0a05-47ec-9605-5eb2973203d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'e3cc5321-4d40-49ee-885c-700e14741732'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 18:06:33 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:06:33 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:06:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 18:06:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 18:06:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 18:06:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 18:06:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 18:06:33 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T17:40:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 18:06:33 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 18:06:33 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 18:06:33 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 18:06:33 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 18:06:33 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 18:06:33 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 18:06:33 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 18:06:33 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 18:06:33 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 18:06:33 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 18:06:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:06:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1119078084',display_name='tempest-VolumesActionsTest-instance-1119078084',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1119078084',id=41,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42e369208c0a486fa4cceb6de3620b6a',ramdisk_id='',reservation_id='r-u280l67a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-275059269',owner_user_name='tempest-VolumesActionsTest-275059269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T18:06:32Z,user_data=None,user_id='130a36dd61074d99855f44d5ebb20eb3',uuid=7bc34cf6-1f79-4127-8c35-0ae2d93406ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d66e837-0a05-47ec-9605-5eb2973203d5", "address": "fa:16:3e:1b:7b:f6", "network": {"id": "f22ce8bd-85d3-4596-849e-9e04d728af34", "bridge": "br-int", "label": "tempest-VolumesActionsTest-979416963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42e369208c0a486fa4cceb6de3620b6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d66e837-0a", "ovs_interfaceid": "3d66e837-0a05-47ec-9605-5eb2973203d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 18:06:33 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Converting VIF {"id": "3d66e837-0a05-47ec-9605-5eb2973203d5", "address": "fa:16:3e:1b:7b:f6", "network": {"id": "f22ce8bd-85d3-4596-849e-9e04d728af34", "bridge": "br-int", "label": "tempest-VolumesActionsTest-979416963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42e369208c0a486fa4cceb6de3620b6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d66e837-0a", "ovs_interfaceid": "3d66e837-0a05-47ec-9605-5eb2973203d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:06:33 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:7b:f6,bridge_name='br-int',has_traffic_filtering=True,id=3d66e837-0a05-47ec-9605-5eb2973203d5,network=Network(f22ce8bd-85d3-4596-849e-9e04d728af34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d66e837-0a') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:06:33 user nova-compute[75100]: DEBUG nova.objects.instance [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Lazy-loading 'pci_devices' on Instance uuid 7bc34cf6-1f79-4127-8c35-0ae2d93406ff {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:06:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 7bc34cf6-1f79-4127-8c35-0ae2d93406ff] End _get_guest_xml xml=<domain type="kvm">
Nov 10 18:06:33 user nova-compute[75100]:   <uuid>7bc34cf6-1f79-4127-8c35-0ae2d93406ff</uuid>
Nov 10 18:06:33 user nova-compute[75100]:   <name>instance-00000029</name>
Nov 10 18:06:33 user nova-compute[75100]:   <memory>524288</memory>
Nov 10 18:06:33 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 10 18:06:33 user nova-compute[75100]:   <metadata>
Nov 10 18:06:33 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 18:06:33 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 10 18:06:33 user nova-compute[75100]:       <nova:name>tempest-VolumesActionsTest-instance-1119078084</nova:name>
Nov 10 18:06:33 user nova-compute[75100]:       <nova:creationTime>2023-11-10 18:06:33</nova:creationTime>
Nov 10 18:06:33 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 10 18:06:33 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 10 18:06:33 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 10 18:06:33 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 10 18:06:33 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 18:06:33 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 10 18:06:33 user nova-compute[75100]:       </nova:flavor>
Nov 10 18:06:33 user nova-compute[75100]:       <nova:owner>
Nov 10 18:06:33 user nova-compute[75100]:         <nova:user uuid="130a36dd61074d99855f44d5ebb20eb3">tempest-VolumesActionsTest-275059269-project-member</nova:user>
Nov 10 18:06:33 user nova-compute[75100]:         <nova:project uuid="42e369208c0a486fa4cceb6de3620b6a">tempest-VolumesActionsTest-275059269</nova:project>
Nov 10 18:06:33 user nova-compute[75100]:       </nova:owner>
Nov 10 18:06:33 user nova-compute[75100]:       <nova:root type="image" uuid="e3cc5321-4d40-49ee-885c-700e14741732"/>
Nov 10 18:06:33 user nova-compute[75100]:       <nova:ports>
Nov 10 18:06:33 user nova-compute[75100]:         <nova:port uuid="3d66e837-0a05-47ec-9605-5eb2973203d5">
Nov 10 18:06:33 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 10 18:06:33 user nova-compute[75100]:         </nova:port>
Nov 10 18:06:33 user nova-compute[75100]:       </nova:ports>
Nov 10 18:06:33 user nova-compute[75100]:     </nova:instance>
Nov 10 18:06:33 user nova-compute[75100]:   </metadata>
Nov 10 18:06:33 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 10 18:06:33 user nova-compute[75100]:     <system>
Nov 10 18:06:33 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 18:06:33 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 10 18:06:33 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 10 18:06:33 user nova-compute[75100]:       <entry name="serial">7bc34cf6-1f79-4127-8c35-0ae2d93406ff</entry>
Nov 10 18:06:33 user nova-compute[75100]:       <entry name="uuid">7bc34cf6-1f79-4127-8c35-0ae2d93406ff</entry>
Nov 10 18:06:33 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 10 18:06:33 user nova-compute[75100]:     </system>
Nov 10 18:06:33 user nova-compute[75100]:   </sysinfo>
Nov 10 18:06:33 user nova-compute[75100]:   <os>
Nov 10 18:06:33 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 18:06:33 user nova-compute[75100]:     <boot dev="hd"/>
Nov 10 18:06:33 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 10 18:06:33 user nova-compute[75100]:   </os>
Nov 10 18:06:33 user nova-compute[75100]:   <features>
Nov 10 18:06:33 user nova-compute[75100]:     <acpi/>
Nov 10 18:06:33 user nova-compute[75100]:     <apic/>
Nov 10 18:06:33 user nova-compute[75100]:     <vmcoreinfo/>
Nov 10 18:06:33 user nova-compute[75100]:   </features>
Nov 10 18:06:33 user nova-compute[75100]:   <clock offset="utc">
Nov 10 18:06:33 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 18:06:33 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 18:06:33 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 10 18:06:33 user nova-compute[75100]:   </clock>
Nov 10 18:06:33 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 10 18:06:33 user nova-compute[75100]:     <model>Nehalem</model>
Nov 10 18:06:33 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 18:06:33 user nova-compute[75100]:   </cpu>
Nov 10 18:06:33 user nova-compute[75100]:   <devices>
Nov 10 18:06:33 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 10 18:06:33 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 18:06:33 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/7bc34cf6-1f79-4127-8c35-0ae2d93406ff/disk"/>
Nov 10 18:06:33 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 10 18:06:33 user nova-compute[75100]:     </disk>
Nov 10 18:06:33 user nova-compute[75100]:     <interface type="ethernet">
Nov 10 18:06:33 user nova-compute[75100]:       <mac address="fa:16:3e:1b:7b:f6"/>
Nov 10 18:06:33 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 18:06:33 user nova-compute[75100]:       <mtu size="1442"/>
Nov 10 18:06:33 user nova-compute[75100]:       <target dev="tap3d66e837-0a"/>
Nov 10 18:06:33 user nova-compute[75100]:     </interface>
Nov 10 18:06:33 user nova-compute[75100]:     <serial type="pty">
Nov 10 18:06:33 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/7bc34cf6-1f79-4127-8c35-0ae2d93406ff/console.log" append="off"/>
Nov 10 18:06:33 user nova-compute[75100]:     </serial>
Nov 10 18:06:33 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 18:06:33 user nova-compute[75100]:     <video>
Nov 10 18:06:33 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 18:06:33 user nova-compute[75100]:     </video>
Nov 10 18:06:33 user nova-compute[75100]:     <rng model="virtio">
Nov 10 18:06:33 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 10 18:06:33 user nova-compute[75100]:     </rng>
Nov 10 18:06:33 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 10 18:06:33 user nova-compute[75100]:     <memballoon model="virtio">
Nov 10 18:06:33 user nova-compute[75100]:       <stats period="10"/>
Nov 10 18:06:33 user nova-compute[75100]:     </memballoon>
Nov 10 18:06:33 user nova-compute[75100]:   </devices>
Nov 10 18:06:33 user nova-compute[75100]: </domain>
Nov 10 18:06:33 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 18:06:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:06:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1119078084',display_name='tempest-VolumesActionsTest-instance-1119078084',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1119078084',id=41,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42e369208c0a486fa4cceb6de3620b6a',ramdisk_id='',reservation_id='r-u280l67a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-275059269',owner_user_name='tempest-VolumesActionsTest-275059269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T18:06:32Z,user_data=None,user_id='130a36dd61074d99855f44d5ebb20eb3',uuid=7bc34cf6-1f79-4127-8c35-0ae2d93406ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d66e837-0a05-47ec-9605-5eb2973203d5", "address": "fa:16:3e:1b:7b:f6", "network": {"id": "f22ce8bd-85d3-4596-849e-9e04d728af34", "bridge": "br-int", "label": "tempest-VolumesActionsTest-979416963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42e369208c0a486fa4cceb6de3620b6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d66e837-0a", "ovs_interfaceid": "3d66e837-0a05-47ec-9605-5eb2973203d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 18:06:33 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Converting VIF {"id": "3d66e837-0a05-47ec-9605-5eb2973203d5", "address": "fa:16:3e:1b:7b:f6", "network": {"id": "f22ce8bd-85d3-4596-849e-9e04d728af34", "bridge": "br-int", "label": "tempest-VolumesActionsTest-979416963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42e369208c0a486fa4cceb6de3620b6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d66e837-0a", "ovs_interfaceid": "3d66e837-0a05-47ec-9605-5eb2973203d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:06:33 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:7b:f6,bridge_name='br-int',has_traffic_filtering=True,id=3d66e837-0a05-47ec-9605-5eb2973203d5,network=Network(f22ce8bd-85d3-4596-849e-9e04d728af34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d66e837-0a') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:06:33 user nova-compute[75100]: DEBUG os_vif [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:7b:f6,bridge_name='br-int',has_traffic_filtering=True,id=3d66e837-0a05-47ec-9605-5eb2973203d5,network=Network(f22ce8bd-85d3-4596-849e-9e04d728af34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d66e837-0a') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 18:06:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:06:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 18:06:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dc189c44-f5e6-5a36-abf3-2d1f3a751e0d', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:06:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d66e837-0a, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:06:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3d66e837-0a, col_values=(('qos', UUID('660d5ea9-4a1f-42cd-a69a-da600b48b942')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:06:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3d66e837-0a, col_values=(('external_ids', {'iface-id': '3d66e837-0a05-47ec-9605-5eb2973203d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:7b:f6', 'vm-uuid': '7bc34cf6-1f79-4127-8c35-0ae2d93406ff'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:06:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:06:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:33 user nova-compute[75100]: INFO os_vif [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:7b:f6,bridge_name='br-int',has_traffic_filtering=True,id=3d66e837-0a05-47ec-9605-5eb2973203d5,network=Network(f22ce8bd-85d3-4596-849e-9e04d728af34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d66e837-0a')
Nov 10 18:06:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 18:06:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] No VIF found with MAC fa:16:3e:1b:7b:f6, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 18:06:33 user nova-compute[75100]: DEBUG nova.network.neutron [req-3e125067-efed-4391-bb77-3deb99e95344 req-47f659cd-f1cd-444b-afe6-2339b6a0a2a1 service nova] [instance: 7bc34cf6-1f79-4127-8c35-0ae2d93406ff] Updated VIF entry in instance network info cache for port 3d66e837-0a05-47ec-9605-5eb2973203d5. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 18:06:33 user nova-compute[75100]: DEBUG nova.network.neutron [req-3e125067-efed-4391-bb77-3deb99e95344 req-47f659cd-f1cd-444b-afe6-2339b6a0a2a1 service nova] [instance: 7bc34cf6-1f79-4127-8c35-0ae2d93406ff] Updating instance_info_cache with network_info: [{"id": "3d66e837-0a05-47ec-9605-5eb2973203d5", "address": "fa:16:3e:1b:7b:f6", "network": {"id": "f22ce8bd-85d3-4596-849e-9e04d728af34", "bridge": "br-int", "label": "tempest-VolumesActionsTest-979416963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42e369208c0a486fa4cceb6de3620b6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d66e837-0a", "ovs_interfaceid": "3d66e837-0a05-47ec-9605-5eb2973203d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:06:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3e125067-efed-4391-bb77-3deb99e95344 req-47f659cd-f1cd-444b-afe6-2339b6a0a2a1 service nova] Releasing lock "refresh_cache-7bc34cf6-1f79-4127-8c35-0ae2d93406ff" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:06:33 user nova-compute[75100]: DEBUG nova.compute.manager [None req-64ae9a14-5a3e-478a-a272-de54e22ab303 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 18:06:33 user nova-compute[75100]: DEBUG nova.compute.manager [req-2f2474c4-bbac-42e2-bf4d-99a6448a8baa req-d7f2cb86-3423-45dd-90e3-8f6d31d5a46e service nova] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Received event network-vif-plugged-8c7dcf78-fc4a-4fcb-905e-ce75143a9450 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:06:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2f2474c4-bbac-42e2-bf4d-99a6448a8baa req-d7f2cb86-3423-45dd-90e3-8f6d31d5a46e service nova] Acquiring lock "fcc2bfb6-fd6b-4229-9664-42f33b138444-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:06:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2f2474c4-bbac-42e2-bf4d-99a6448a8baa req-d7f2cb86-3423-45dd-90e3-8f6d31d5a46e service nova] Lock "fcc2bfb6-fd6b-4229-9664-42f33b138444-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:06:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2f2474c4-bbac-42e2-bf4d-99a6448a8baa req-d7f2cb86-3423-45dd-90e3-8f6d31d5a46e service nova] Lock "fcc2bfb6-fd6b-4229-9664-42f33b138444-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:06:33 user nova-compute[75100]: DEBUG nova.compute.manager [req-2f2474c4-bbac-42e2-bf4d-99a6448a8baa req-d7f2cb86-3423-45dd-90e3-8f6d31d5a46e service nova] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] No waiting events found dispatching network-vif-plugged-8c7dcf78-fc4a-4fcb-905e-ce75143a9450 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:06:33 user nova-compute[75100]: WARNING nova.compute.manager [req-2f2474c4-bbac-42e2-bf4d-99a6448a8baa req-d7f2cb86-3423-45dd-90e3-8f6d31d5a46e service nova] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Received unexpected event network-vif-plugged-8c7dcf78-fc4a-4fcb-905e-ce75143a9450 for instance with vm_state active and task_state None.
Nov 10 18:06:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:35 user nova-compute[75100]: DEBUG nova.compute.manager [req-41c690d9-2a9a-49e8-8ac4-e2ad77a5cd9c req-5f7db85f-1330-4fd2-a586-4b69bcb8601e service nova] [instance: 7bc34cf6-1f79-4127-8c35-0ae2d93406ff] Received event network-vif-plugged-3d66e837-0a05-47ec-9605-5eb2973203d5 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:06:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-41c690d9-2a9a-49e8-8ac4-e2ad77a5cd9c req-5f7db85f-1330-4fd2-a586-4b69bcb8601e service nova] Acquiring lock "7bc34cf6-1f79-4127-8c35-0ae2d93406ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:06:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-41c690d9-2a9a-49e8-8ac4-e2ad77a5cd9c req-5f7db85f-1330-4fd2-a586-4b69bcb8601e service nova] Lock "7bc34cf6-1f79-4127-8c35-0ae2d93406ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:06:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-41c690d9-2a9a-49e8-8ac4-e2ad77a5cd9c req-5f7db85f-1330-4fd2-a586-4b69bcb8601e service nova] Lock "7bc34cf6-1f79-4127-8c35-0ae2d93406ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:06:35 user nova-compute[75100]: DEBUG nova.compute.manager [req-41c690d9-2a9a-49e8-8ac4-e2ad77a5cd9c req-5f7db85f-1330-4fd2-a586-4b69bcb8601e service nova] [instance: 7bc34cf6-1f79-4127-8c35-0ae2d93406ff] No waiting events found dispatching network-vif-plugged-3d66e837-0a05-47ec-9605-5eb2973203d5 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:06:35 user nova-compute[75100]: WARNING nova.compute.manager [req-41c690d9-2a9a-49e8-8ac4-e2ad77a5cd9c req-5f7db85f-1330-4fd2-a586-4b69bcb8601e service nova] [instance: 7bc34cf6-1f79-4127-8c35-0ae2d93406ff] Received unexpected event network-vif-plugged-3d66e837-0a05-47ec-9605-5eb2973203d5 for instance with vm_state building and task_state spawning.
Nov 10 18:06:35 user nova-compute[75100]: DEBUG nova.compute.manager [req-41c690d9-2a9a-49e8-8ac4-e2ad77a5cd9c req-5f7db85f-1330-4fd2-a586-4b69bcb8601e service nova] [instance: 7bc34cf6-1f79-4127-8c35-0ae2d93406ff] Received event network-vif-plugged-3d66e837-0a05-47ec-9605-5eb2973203d5 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:06:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-41c690d9-2a9a-49e8-8ac4-e2ad77a5cd9c req-5f7db85f-1330-4fd2-a586-4b69bcb8601e service nova] Acquiring lock "7bc34cf6-1f79-4127-8c35-0ae2d93406ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:06:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-41c690d9-2a9a-49e8-8ac4-e2ad77a5cd9c req-5f7db85f-1330-4fd2-a586-4b69bcb8601e service nova] Lock "7bc34cf6-1f79-4127-8c35-0ae2d93406ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:06:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-41c690d9-2a9a-49e8-8ac4-e2ad77a5cd9c req-5f7db85f-1330-4fd2-a586-4b69bcb8601e service nova] Lock "7bc34cf6-1f79-4127-8c35-0ae2d93406ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:06:36 user nova-compute[75100]: DEBUG nova.compute.manager [req-41c690d9-2a9a-49e8-8ac4-e2ad77a5cd9c req-5f7db85f-1330-4fd2-a586-4b69bcb8601e service nova] [instance: 7bc34cf6-1f79-4127-8c35-0ae2d93406ff] No waiting events found dispatching network-vif-plugged-3d66e837-0a05-47ec-9605-5eb2973203d5 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:06:36 user nova-compute[75100]: WARNING nova.compute.manager [req-41c690d9-2a9a-49e8-8ac4-e2ad77a5cd9c req-5f7db85f-1330-4fd2-a586-4b69bcb8601e service nova] [instance: 7bc34cf6-1f79-4127-8c35-0ae2d93406ff] Received unexpected event network-vif-plugged-3d66e837-0a05-47ec-9605-5eb2973203d5 for instance with vm_state building and task_state spawning.
Nov 10 18:06:37 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:06:37 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:06:37 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:06:37 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:06:37 user nova-compute[75100]: DEBUG nova.compute.manager [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 7bc34cf6-1f79-4127-8c35-0ae2d93406ff] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 18:06:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 7bc34cf6-1f79-4127-8c35-0ae2d93406ff] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 18:06:37 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 7bc34cf6-1f79-4127-8c35-0ae2d93406ff] Instance spawned successfully.
Nov 10 18:06:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 7bc34cf6-1f79-4127-8c35-0ae2d93406ff] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 18:06:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 7bc34cf6-1f79-4127-8c35-0ae2d93406ff] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:06:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 7bc34cf6-1f79-4127-8c35-0ae2d93406ff] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:06:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 7bc34cf6-1f79-4127-8c35-0ae2d93406ff] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:06:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 7bc34cf6-1f79-4127-8c35-0ae2d93406ff] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:06:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 7bc34cf6-1f79-4127-8c35-0ae2d93406ff] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:06:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 7bc34cf6-1f79-4127-8c35-0ae2d93406ff] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:06:37 user nova-compute[75100]: INFO nova.compute.manager [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 7bc34cf6-1f79-4127-8c35-0ae2d93406ff] Took 5.69 seconds to spawn the instance on the hypervisor.
Nov 10 18:06:37 user nova-compute[75100]: DEBUG nova.compute.manager [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 7bc34cf6-1f79-4127-8c35-0ae2d93406ff] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 18:06:37 user nova-compute[75100]: INFO nova.compute.manager [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 7bc34cf6-1f79-4127-8c35-0ae2d93406ff] Took 7.04 seconds to build instance.
Nov 10 18:06:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5c379934-7ea9-4a0c-8149-f205f1402ce8 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Lock "7bc34cf6-1f79-4127-8c35-0ae2d93406ff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.165s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:06:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:39 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:06:39 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:06:39 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 18:06:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:40 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:06:40 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 18:06:40 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Skipping network cache update for instance because it is being deleted. {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9971}}
Nov 10 18:06:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "refresh_cache-b0bae328-2528-4562-850b-14fa108923c6" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:06:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquired lock "refresh_cache-b0bae328-2528-4562-850b-14fa108923c6" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:06:40 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: b0bae328-2528-4562-850b-14fa108923c6] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 18:06:40 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: b0bae328-2528-4562-850b-14fa108923c6] Updating instance_info_cache with network_info: [{"id": "6f68d50b-62e9-4068-98e8-131d624dd612", "address": "fa:16:3e:ae:03:fd", "network": {"id": "e906a397-504d-48d8-8726-187cfbb1f270", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2095832274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4e5cb8bdc24a009dcb3dbee36a6bce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f68d50b-62", "ovs_interfaceid": "6f68d50b-62e9-4068-98e8-131d624dd612", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:06:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Releasing lock "refresh_cache-b0bae328-2528-4562-850b-14fa108923c6" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:06:40 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: b0bae328-2528-4562-850b-14fa108923c6] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 18:06:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:49 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-641ac5f8-e57c-4db9-aa9e-9a918b97cfe1 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5194f111-ba1a-43bc-9564-b744d1960307 is timed out.
Nov 10 18:06:49 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-641ac5f8-e57c-4db9-aa9e-9a918b97cfe1 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Successfully detached device vdb from instance 5194f111-ba1a-43bc-9564-b744d1960307 from the live domain config.
Nov 10 18:06:49 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-641ac5f8-e57c-4db9-aa9e-9a918b97cfe1 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 18:06:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-641ac5f8-e57c-4db9-aa9e-9a918b97cfe1 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, {'target_iqn': 'iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'afxMoIvG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:06:49 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-641ac5f8-e57c-4db9-aa9e-9a918b97cfe1 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:06:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-641ac5f8-e57c-4db9-aa9e-9a918b97cfe1 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:06:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-641ac5f8-e57c-4db9-aa9e-9a918b97cfe1 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:06:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:49 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a000dd-e40e-4287-b669-86dcc4ec9d64]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:06:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-641ac5f8-e57c-4db9-aa9e-9a918b97cfe1 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 18:06:49 user nova-compute[75100]: No targets found.
Nov 10 18:06:49 user nova-compute[75100]: iSNS:
Nov 10 18:06:49 user nova-compute[75100]: No targets found.
Nov 10 18:06:49 user nova-compute[75100]: STATIC:
Nov 10 18:06:49 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be
Nov 10 18:06:49 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:06:49 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:06:49 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8
Nov 10 18:06:49 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:06:49 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:06:49 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf
Nov 10 18:06:49 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:06:49 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:06:49 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281
Nov 10 18:06:49 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:06:49 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:06:49 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005
Nov 10 18:06:49 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:06:49 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:06:49 user nova-compute[75100]: FIRMWARE:
Nov 10 18:06:49 user nova-compute[75100]: No targets found.
Nov 10 18:06:49 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:06:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-641ac5f8-e57c-4db9-aa9e-9a918b97cfe1 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 18:06:49 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 18:06:49 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 18:06:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-641ac5f8-e57c-4db9-aa9e-9a918b97cfe1 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 18:06:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:49 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[496324cf-6db5-4eae-a97e-2766d442b136]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:06:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0eb8c60-1fd5-4e34-9c00-18b652779e19]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:06:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-641ac5f8-e57c-4db9-aa9e-9a918b97cfe1 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 (non-flash)
Nov 10 18:06:50 user nova-compute[75100]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be (non-flash)
Nov 10 18:06:50 user nova-compute[75100]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 (non-flash)
Nov 10 18:06:50 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8 (non-flash)
Nov 10 18:06:50 user nova-compute[75100]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf (non-flash)
Nov 10 18:06:50 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:06:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-641ac5f8-e57c-4db9-aa9e-9a918b97cfe1 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 (non-flash)
Nov 10 18:06:50 user nova-compute[75100]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be (non-flash)
Nov 10 18:06:50 user nova-compute[75100]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 (non-flash)
Nov 10 18:06:50 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8 (non-flash)
Nov 10 18:06:50 user nova-compute[75100]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf (non-flash)
Nov 10 18:06:50 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:06:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-641ac5f8-e57c-4db9-aa9e-9a918b97cfe1 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3986b2830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be'): ({'sdd'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 18:06:50 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-641ac5f8-e57c-4db9-aa9e-9a918b97cfe1 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Removing single pathed devices sdd {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 18:06:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a008ac-26fb-44d7-8d77-27af363416e3]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:06:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[80289648-b743-4ef2-b378-66618089c05f]: (4, ('ok\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:06:50 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-641ac5f8-e57c-4db9-aa9e-9a918b97cfe1 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Flushing IO for device /dev/sdd {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 18:06:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b530ad-d787-4008-b999-67fe9eb5f017]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:06:50 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-641ac5f8-e57c-4db9-aa9e-9a918b97cfe1 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 18:06:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.029s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7b77f9-a947-40fa-86d4-a2671561333d]: (4, ('1', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:06:50 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-641ac5f8-e57c-4db9-aa9e-9a918b97cfe1 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 18:06:50 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-641ac5f8-e57c-4db9-aa9e-9a918b97cfe1 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] SCSI volumes sdd have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 18:06:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-641ac5f8-e57c-4db9-aa9e-9a918b97cfe1 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 18:06:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0202b2ce-4d2d-43ea-bb71-8751ef10dc02]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:06:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-641ac5f8-e57c-4db9-aa9e-9a918b97cfe1 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:06:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be -p 172.16.0.220:3260 --logout {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6352354c-19d6-4627-8845-867dff2adad7]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:06:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-641ac5f8-e57c-4db9-aa9e-9a918b97cfe1 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be, portal: 172.16.0.220,3260]
Nov 10 18:06:50 user nova-compute[75100]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be, portal: 172.16.0.220,3260] successful.
Nov 10 18:06:50 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:06:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be -p 172.16.0.220:3260 --op delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb15a890-5984-451f-8ddf-95f2bacced5b]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:06:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-641ac5f8-e57c-4db9-aa9e-9a918b97cfe1 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:06:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-641ac5f8-e57c-4db9-aa9e-9a918b97cfe1 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:06:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-641ac5f8-e57c-4db9-aa9e-9a918b97cfe1 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] <== disconnect_volume: return (298ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:06:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-641ac5f8-e57c-4db9-aa9e-9a918b97cfe1 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 18:06:51 user nova-compute[75100]: DEBUG nova.objects.instance [None req-641ac5f8-e57c-4db9-aa9e-9a918b97cfe1 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lazy-loading 'flavor' on Instance uuid 5194f111-ba1a-43bc-9564-b744d1960307 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:06:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-641ac5f8-e57c-4db9-aa9e-9a918b97cfe1 tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lock "5194f111-ba1a-43bc-9564-b744d1960307" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.073s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:06:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5ba57d64-6304-4355-9c4b-8be17a1b005d tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lock "5194f111-ba1a-43bc-9564-b744d1960307" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.996s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:06:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5ba57d64-6304-4355-9c4b-8be17a1b005d tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Acquiring lock "5194f111-ba1a-43bc-9564-b744d1960307-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:06:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5ba57d64-6304-4355-9c4b-8be17a1b005d tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lock "5194f111-ba1a-43bc-9564-b744d1960307-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:06:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5ba57d64-6304-4355-9c4b-8be17a1b005d tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lock "5194f111-ba1a-43bc-9564-b744d1960307-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:06:51 user nova-compute[75100]: INFO nova.compute.manager [None req-5ba57d64-6304-4355-9c4b-8be17a1b005d tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Terminating instance
Nov 10 18:06:51 user nova-compute[75100]: DEBUG nova.compute.manager [None req-5ba57d64-6304-4355-9c4b-8be17a1b005d tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 18:06:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:51 user nova-compute[75100]: DEBUG nova.compute.manager [req-34a6e494-cdf6-4f9a-87ba-4339d8bde704 req-c2bc4111-ccf2-4ff0-90f6-47355682a525 service nova] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Received event network-vif-unplugged-9829f1f6-ef24-440f-964b-1ae5326963dd {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:06:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-34a6e494-cdf6-4f9a-87ba-4339d8bde704 req-c2bc4111-ccf2-4ff0-90f6-47355682a525 service nova] Acquiring lock "5194f111-ba1a-43bc-9564-b744d1960307-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:06:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-34a6e494-cdf6-4f9a-87ba-4339d8bde704 req-c2bc4111-ccf2-4ff0-90f6-47355682a525 service nova] Lock "5194f111-ba1a-43bc-9564-b744d1960307-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:06:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-34a6e494-cdf6-4f9a-87ba-4339d8bde704 req-c2bc4111-ccf2-4ff0-90f6-47355682a525 service nova] Lock "5194f111-ba1a-43bc-9564-b744d1960307-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:06:51 user nova-compute[75100]: DEBUG nova.compute.manager [req-34a6e494-cdf6-4f9a-87ba-4339d8bde704 req-c2bc4111-ccf2-4ff0-90f6-47355682a525 service nova] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] No waiting events found dispatching network-vif-unplugged-9829f1f6-ef24-440f-964b-1ae5326963dd {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:06:51 user nova-compute[75100]: DEBUG nova.compute.manager [req-34a6e494-cdf6-4f9a-87ba-4339d8bde704 req-c2bc4111-ccf2-4ff0-90f6-47355682a525 service nova] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Received event network-vif-unplugged-9829f1f6-ef24-440f-964b-1ae5326963dd for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 18:06:51 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Instance destroyed successfully.
Nov 10 18:06:51 user nova-compute[75100]: DEBUG nova.objects.instance [None req-5ba57d64-6304-4355-9c4b-8be17a1b005d tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lazy-loading 'resources' on Instance uuid 5194f111-ba1a-43bc-9564-b744d1960307 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:06:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-5ba57d64-6304-4355-9c4b-8be17a1b005d tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:02:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1780838620',display_name='tempest-VolumesSnapshotTestJSON-instance-1780838620',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1780838620',id=35,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWXxJUqFl/Mx/bXB9u1e6+JWdt7NoHJnU736ah9MdZCpHCcsT75QVAvwHNJhx4DTay9iFVzuWJu1rTlzXdX4J4xdmyCleO56jJkXd79j2xM6USvsKJMZlS2wP7+mUv2dQ==',key_name='tempest-keypair-684408520',keypairs=<?>,launch_index=0,launched_at=2023-11-10T18:03:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='27994d50bda0480f8964e687ed76805c',ramdisk_id='',reservation_id='r-29m7w8lo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1608810188',owner_user_name='tempest-VolumesSnapshotTestJSON-1608810188-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T18:03:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='695874f914a149a6a432598bee57a80e',uuid=5194f111-ba1a-43bc-9564-b744d1960307,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9829f1f6-ef24-440f-964b-1ae5326963dd", "address": "fa:16:3e:49:3b:cc", "network": {"id": "fa38ae2b-75a1-4312-9b92-462a4240d792", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-822691382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27994d50bda0480f8964e687ed76805c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9829f1f6-ef", "ovs_interfaceid": "9829f1f6-ef24-440f-964b-1ae5326963dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 18:06:51 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-5ba57d64-6304-4355-9c4b-8be17a1b005d tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Converting VIF {"id": "9829f1f6-ef24-440f-964b-1ae5326963dd", "address": "fa:16:3e:49:3b:cc", "network": {"id": "fa38ae2b-75a1-4312-9b92-462a4240d792", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-822691382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27994d50bda0480f8964e687ed76805c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9829f1f6-ef", "ovs_interfaceid": "9829f1f6-ef24-440f-964b-1ae5326963dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:06:51 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-5ba57d64-6304-4355-9c4b-8be17a1b005d tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:49:3b:cc,bridge_name='br-int',has_traffic_filtering=True,id=9829f1f6-ef24-440f-964b-1ae5326963dd,network=Network(fa38ae2b-75a1-4312-9b92-462a4240d792),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9829f1f6-ef') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:06:51 user nova-compute[75100]: DEBUG os_vif [None req-5ba57d64-6304-4355-9c4b-8be17a1b005d tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:3b:cc,bridge_name='br-int',has_traffic_filtering=True,id=9829f1f6-ef24-440f-964b-1ae5326963dd,network=Network(fa38ae2b-75a1-4312-9b92-462a4240d792),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9829f1f6-ef') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 18:06:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9829f1f6-ef, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:06:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e3f1b510-0de2-4b4e-87f9-0a5d51c3f51f) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:06:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:06:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:51 user nova-compute[75100]: INFO os_vif [None req-5ba57d64-6304-4355-9c4b-8be17a1b005d tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:3b:cc,bridge_name='br-int',has_traffic_filtering=True,id=9829f1f6-ef24-440f-964b-1ae5326963dd,network=Network(fa38ae2b-75a1-4312-9b92-462a4240d792),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9829f1f6-ef')
Nov 10 18:06:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ba57d64-6304-4355-9c4b-8be17a1b005d tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 18:06:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ba57d64-6304-4355-9c4b-8be17a1b005d tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, {'target_iqn': 'iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'afxMoIvG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:06:51 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-5ba57d64-6304-4355-9c4b-8be17a1b005d tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:06:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-5ba57d64-6304-4355-9c4b-8be17a1b005d tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:06:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-5ba57d64-6304-4355-9c4b-8be17a1b005d tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:06:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:51 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4677f192-3e5f-4624-9379-d0d320236adc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:06:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ba57d64-6304-4355-9c4b-8be17a1b005d tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 18:06:51 user nova-compute[75100]: No targets found.
Nov 10 18:06:51 user nova-compute[75100]: iSNS:
Nov 10 18:06:51 user nova-compute[75100]: No targets found.
Nov 10 18:06:51 user nova-compute[75100]: STATIC:
Nov 10 18:06:51 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8
Nov 10 18:06:51 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:06:51 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:06:51 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf
Nov 10 18:06:51 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:06:51 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:06:51 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281
Nov 10 18:06:51 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:06:51 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:06:51 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005
Nov 10 18:06:51 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:06:51 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:06:51 user nova-compute[75100]: FIRMWARE:
Nov 10 18:06:51 user nova-compute[75100]: No targets found.
Nov 10 18:06:51 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:06:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ba57d64-6304-4355-9c4b-8be17a1b005d tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 18:06:51 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 18:06:51 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 18:06:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ba57d64-6304-4355-9c4b-8be17a1b005d tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85677e03-86ea-4986-a4db-d477c739c6be', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 18:06:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:51 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e973ddad-e073-4e2d-9559-4585c909ff37]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:06:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:51 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4444382-ac87-46ae-8a9a-c6eeb177af91]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:06:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ba57d64-6304-4355-9c4b-8be17a1b005d tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 (non-flash)
Nov 10 18:06:51 user nova-compute[75100]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 (non-flash)
Nov 10 18:06:51 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8 (non-flash)
Nov 10 18:06:51 user nova-compute[75100]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf (non-flash)
Nov 10 18:06:51 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:06:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ba57d64-6304-4355-9c4b-8be17a1b005d tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 (non-flash)
Nov 10 18:06:51 user nova-compute[75100]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 (non-flash)
Nov 10 18:06:51 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8 (non-flash)
Nov 10 18:06:51 user nova-compute[75100]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf (non-flash)
Nov 10 18:06:51 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:06:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ba57d64-6304-4355-9c4b-8be17a1b005d tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3986b2560>, {}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 18:06:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ba57d64-6304-4355-9c4b-8be17a1b005d tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Disconnecting from: [] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 18:06:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-5ba57d64-6304-4355-9c4b-8be17a1b005d tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.073s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:06:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ba57d64-6304-4355-9c4b-8be17a1b005d tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] <== disconnect_volume: return (74ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:06:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ba57d64-6304-4355-9c4b-8be17a1b005d tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 18:06:51 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-5ba57d64-6304-4355-9c4b-8be17a1b005d tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Deleting instance files /opt/stack/data/nova/instances/5194f111-ba1a-43bc-9564-b744d1960307_del
Nov 10 18:06:51 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-5ba57d64-6304-4355-9c4b-8be17a1b005d tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Deletion of /opt/stack/data/nova/instances/5194f111-ba1a-43bc-9564-b744d1960307_del complete
Nov 10 18:06:52 user nova-compute[75100]: INFO nova.compute.manager [None req-5ba57d64-6304-4355-9c4b-8be17a1b005d tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Took 0.77 seconds to destroy the instance on the hypervisor.
Nov 10 18:06:52 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-5ba57d64-6304-4355-9c4b-8be17a1b005d tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 18:06:52 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 18:06:52 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 18:06:53 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:06:53 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Took 1.58 seconds to deallocate network for instance.
Nov 10 18:06:53 user nova-compute[75100]: DEBUG nova.compute.manager [req-ada3319d-c310-4c3f-b750-99f8d9600da3 req-e2916c84-834d-436b-a85a-63f79ae1b2fb service nova] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Received event network-vif-deleted-9829f1f6-ef24-440f-964b-1ae5326963dd {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:06:53 user nova-compute[75100]: WARNING nova.volume.cinder [None req-5ba57d64-6304-4355-9c4b-8be17a1b005d tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Attachment b12f3132-1695-4c5c-93eb-19df844d8cb8 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = b12f3132-1695-4c5c-93eb-19df844d8cb8. (HTTP 404) (Request-ID: req-06398d45-2236-446c-89e2-f719d25e2ace)
Nov 10 18:06:53 user nova-compute[75100]: INFO nova.compute.manager [None req-5ba57d64-6304-4355-9c4b-8be17a1b005d tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Took 0.03 seconds to detach 1 volumes for instance.
Nov 10 18:06:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5ba57d64-6304-4355-9c4b-8be17a1b005d tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:06:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5ba57d64-6304-4355-9c4b-8be17a1b005d tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:06:53 user nova-compute[75100]: DEBUG nova.compute.manager [req-03068a3b-bea3-4817-a65d-93df6120bf0d req-0b0ab402-7be5-455f-9cf1-47240d23dba7 service nova] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Received event network-vif-plugged-9829f1f6-ef24-440f-964b-1ae5326963dd {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:06:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-03068a3b-bea3-4817-a65d-93df6120bf0d req-0b0ab402-7be5-455f-9cf1-47240d23dba7 service nova] Acquiring lock "5194f111-ba1a-43bc-9564-b744d1960307-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:06:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-03068a3b-bea3-4817-a65d-93df6120bf0d req-0b0ab402-7be5-455f-9cf1-47240d23dba7 service nova] Lock "5194f111-ba1a-43bc-9564-b744d1960307-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:06:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-03068a3b-bea3-4817-a65d-93df6120bf0d req-0b0ab402-7be5-455f-9cf1-47240d23dba7 service nova] Lock "5194f111-ba1a-43bc-9564-b744d1960307-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:06:53 user nova-compute[75100]: DEBUG nova.compute.manager [req-03068a3b-bea3-4817-a65d-93df6120bf0d req-0b0ab402-7be5-455f-9cf1-47240d23dba7 service nova] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] No waiting events found dispatching network-vif-plugged-9829f1f6-ef24-440f-964b-1ae5326963dd {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:06:53 user nova-compute[75100]: WARNING nova.compute.manager [req-03068a3b-bea3-4817-a65d-93df6120bf0d req-0b0ab402-7be5-455f-9cf1-47240d23dba7 service nova] [instance: 5194f111-ba1a-43bc-9564-b744d1960307] Received unexpected event network-vif-plugged-9829f1f6-ef24-440f-964b-1ae5326963dd for instance with vm_state deleted and task_state None.
Nov 10 18:06:53 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-5ba57d64-6304-4355-9c4b-8be17a1b005d tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:06:54 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-5ba57d64-6304-4355-9c4b-8be17a1b005d tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:06:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5ba57d64-6304-4355-9c4b-8be17a1b005d tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.321s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:06:54 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-5ba57d64-6304-4355-9c4b-8be17a1b005d tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Deleted allocations for instance 5194f111-ba1a-43bc-9564-b744d1960307
Nov 10 18:06:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5ba57d64-6304-4355-9c4b-8be17a1b005d tempest-VolumesSnapshotTestJSON-1608810188 tempest-VolumesSnapshotTestJSON-1608810188-project-member] Lock "5194f111-ba1a-43bc-9564-b744d1960307" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.878s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:06:54 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Starting finish_migration {{(pid=75100) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 10 18:06:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Instance directory exists: not creating {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 10 18:06:55 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Creating image(s)
Nov 10 18:06:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Did not create local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 18:06:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Ensure instance console log exists: /opt/stack/data/nova/instances/4ebd9d80-365d-4334-8421-3b22a846321a/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 18:06:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:06:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:06:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:06:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Start _get_guest_xml network_info=[{"id": "c9011ff5-53de-43f3-be8e-ba86274b2c99", "address": "fa:16:3e:a7:f8:6b", "network": {"id": "bf1edb58-ef26-40ca-8ec9-853fa05de13d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1416469583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1416469583-network", "vif_mac": "fa:16:3e:a7:f8:6b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7bb141ef59487dbb2ce6243c5002af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9011ff5-53", "ovs_interfaceid": "c9011ff5-53de-43f3-be8e-ba86274b2c99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'esQJvHgS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '4ebd9d80-365d-4334-8421-3b22a846321a', 'attached_at': '2023-11-10T18:06:56.000000', 'detached_at': '', 'volume_id': '9942ef0e-de84-4e1e-b62b-34ab4d72d5d7', 'serial': '9942ef0e-de84-4e1e-b62b-34ab4d72d5d7'}, 'mount_device': '/dev/vda', 'attachment_id': '4b73aef6-1417-4acd-b519-b44c4bdf3d24', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 18:06:55 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:06:55 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:06:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 18:06:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 18:06:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 18:06:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 18:06:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 18:06:55 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T17:40:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 18:06:55 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 18:06:55 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 18:06:55 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 18:06:55 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 18:06:55 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 18:06:55 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 18:06:55 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 18:06:55 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 18:06:55 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 18:06:55 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 18:06:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 18:06:55 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'esQJvHgS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:06:55 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:06:55 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:06:55 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:06:55 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:06:55 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:06:55 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:06:55 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 18:06:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 -p 172.16.0.220:3260 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:55 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0be54dc-90f6-4133-bdaf-2a0980f99fca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:06:55 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 18:06:55 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:06:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:55 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67de24b-cd05-4ead-9c2b-f14b0c031af6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7] added\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:06:55 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7] added
Nov 10 18:06:55 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:06:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:55 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2150b9b6-259f-48b1-8924-b71ad5ff3a7e]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:06:55 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:06:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:56 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:56 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba6340a-4c09-4334-82a9-338fb18505c5]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:06:56 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:06:56 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v esQJvHgS {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:56 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v esQJvHgS" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:56 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f91bcb-152c-4b1c-b436-24e3cc288f73]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:06:56 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'esQJvHgS'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:06:56 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:56 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:56 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[175ca238-bc14-402e-881e-5034103d5a2a]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:06:56 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:06:56 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:56 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:56 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d8c196-8370-4bf4-b9dd-c2e5d2ddcedc]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:06:56 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 (non-flash)
Nov 10 18:06:56 user nova-compute[75100]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 (non-flash)
Nov 10 18:06:56 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8 (non-flash)
Nov 10 18:06:56 user nova-compute[75100]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf (non-flash)
Nov 10 18:06:56 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:06:56 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 (non-flash)
Nov 10 18:06:56 user nova-compute[75100]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 (non-flash)
Nov 10 18:06:56 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8 (non-flash)
Nov 10 18:06:56 user nova-compute[75100]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf (non-flash)
Nov 10 18:06:56 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:06:56 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 -p 172.16.0.220:3260 --login {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:56 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:56 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ea61a9-61a8-4275-be91-d9d5d4fc968d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:06:56 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7, portal: 172.16.0.220,3260]
Nov 10 18:06:56 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7, portal: 172.16.0.220,3260] successful.
Nov 10 18:06:56 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:06:56 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:56 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:56 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[218f42fb-294d-4494-8237-fc0475f0f436]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:06:56 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:06:56 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:56 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:56 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2b97db-8305-44f6-a3a8-a9a5ff1e504f]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:06:56 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 (non-flash)
Nov 10 18:06:56 user nova-compute[75100]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 (non-flash)
Nov 10 18:06:56 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8 (non-flash)
Nov 10 18:06:56 user nova-compute[75100]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf (non-flash)
Nov 10 18:06:56 user nova-compute[75100]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)
Nov 10 18:06:56 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:06:56 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 (non-flash)
Nov 10 18:06:56 user nova-compute[75100]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 (non-flash)
Nov 10 18:06:56 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8 (non-flash)
Nov 10 18:06:56 user nova-compute[75100]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf (non-flash)
Nov 10 18:06:56 user nova-compute[75100]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)
Nov 10 18:06:56 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:06:56 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:06:56 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 18:06:56 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] HCTL ('33', '-', '-', 0) found on session 32 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 18:06:56 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 18:06:56 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:06:56 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:06:56 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab3fe767-5c20-442e-955d-a4d03418c05d]: (4, ('- - 0', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:06:56 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Searching for a device in session 32 and hctl ['33', '*', '*', 0] yield: None {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 18:06:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:57 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Searching for a device in session 32 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 18:06:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'esQJvHgS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 18:06:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:06:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23261633231656262', 'path': '/dev/sdb'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:06:57 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23261633231656262', 'path': '/dev/sdb'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 18:06:57 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:03:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-541372061',display_name='tempest-ServerActionsTestOtherA-server-541372061',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-541372061',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJad9dm/VlgxkcoctzSOteh4UYTuKPNeJ9f0qso9IjuH6DpxTyWo1Jqw77DQ9s/VWyRmakd0roi/G14M/XBa/3VT72t8942zFgmm3ckvSnycGMTUzmFZ+zGnWexds7KMSQ==',key_name='tempest-keypair-1062541421',keypairs=<?>,launch_index=0,launched_at=2023-11-10T18:04:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ce7bb141ef59487dbb2ce6243c5002af',ramdisk_id='',reservation_id='r-bes8zsqu',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1364670684',owner_user_name='tempest-ServerActionsTestOtherA-1364670684-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T18:06:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f4df424af2343a2a27e869502651216',uuid=4ebd9d80-365d-4334-8421-3b22a846321a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c9011ff5-53de-43f3-be8e-ba86274b2c99", "address": "fa:16:3e:a7:f8:6b", "network": {"id": "bf1edb58-ef26-40ca-8ec9-853fa05de13d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1416469583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1416469583-network", "vif_mac": "fa:16:3e:a7:f8:6b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7bb141ef59487dbb2ce6243c5002af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9011ff5-53", "ovs_interfaceid": "c9011ff5-53de-43f3-be8e-ba86274b2c99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 18:06:57 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Converting VIF {"id": "c9011ff5-53de-43f3-be8e-ba86274b2c99", "address": "fa:16:3e:a7:f8:6b", "network": {"id": "bf1edb58-ef26-40ca-8ec9-853fa05de13d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1416469583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1416469583-network", "vif_mac": "fa:16:3e:a7:f8:6b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7bb141ef59487dbb2ce6243c5002af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9011ff5-53", "ovs_interfaceid": "c9011ff5-53de-43f3-be8e-ba86274b2c99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:06:57 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:f8:6b,bridge_name='br-int',has_traffic_filtering=True,id=c9011ff5-53de-43f3-be8e-ba86274b2c99,network=Network(bf1edb58-ef26-40ca-8ec9-853fa05de13d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9011ff5-53') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:06:57 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] End _get_guest_xml xml=<domain type="kvm">
Nov 10 18:06:57 user nova-compute[75100]:   <uuid>4ebd9d80-365d-4334-8421-3b22a846321a</uuid>
Nov 10 18:06:57 user nova-compute[75100]:   <name>instance-00000026</name>
Nov 10 18:06:57 user nova-compute[75100]:   <memory>2097152</memory>
Nov 10 18:06:57 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 10 18:06:57 user nova-compute[75100]:   <metadata>
Nov 10 18:06:57 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 18:06:57 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 10 18:06:57 user nova-compute[75100]:       <nova:name>tempest-ServerActionsTestOtherA-server-541372061</nova:name>
Nov 10 18:06:57 user nova-compute[75100]:       <nova:creationTime>2023-11-10 18:06:55</nova:creationTime>
Nov 10 18:06:57 user nova-compute[75100]:       <nova:flavor name="m1.small">
Nov 10 18:06:57 user nova-compute[75100]:         <nova:memory>2048</nova:memory>
Nov 10 18:06:57 user nova-compute[75100]:         <nova:disk>20</nova:disk>
Nov 10 18:06:57 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 10 18:06:57 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 18:06:57 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 10 18:06:57 user nova-compute[75100]:       </nova:flavor>
Nov 10 18:06:57 user nova-compute[75100]:       <nova:owner>
Nov 10 18:06:57 user nova-compute[75100]:         <nova:user uuid="9f4df424af2343a2a27e869502651216">tempest-ServerActionsTestOtherA-1364670684-project-member</nova:user>
Nov 10 18:06:57 user nova-compute[75100]:         <nova:project uuid="ce7bb141ef59487dbb2ce6243c5002af">tempest-ServerActionsTestOtherA-1364670684</nova:project>
Nov 10 18:06:57 user nova-compute[75100]:       </nova:owner>
Nov 10 18:06:57 user nova-compute[75100]:       <nova:ports>
Nov 10 18:06:57 user nova-compute[75100]:         <nova:port uuid="c9011ff5-53de-43f3-be8e-ba86274b2c99">
Nov 10 18:06:57 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 10 18:06:57 user nova-compute[75100]:         </nova:port>
Nov 10 18:06:57 user nova-compute[75100]:       </nova:ports>
Nov 10 18:06:57 user nova-compute[75100]:     </nova:instance>
Nov 10 18:06:57 user nova-compute[75100]:   </metadata>
Nov 10 18:06:57 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 10 18:06:57 user nova-compute[75100]:     <system>
Nov 10 18:06:57 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 18:06:57 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 10 18:06:57 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 10 18:06:57 user nova-compute[75100]:       <entry name="serial">4ebd9d80-365d-4334-8421-3b22a846321a</entry>
Nov 10 18:06:57 user nova-compute[75100]:       <entry name="uuid">4ebd9d80-365d-4334-8421-3b22a846321a</entry>
Nov 10 18:06:57 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 10 18:06:57 user nova-compute[75100]:     </system>
Nov 10 18:06:57 user nova-compute[75100]:   </sysinfo>
Nov 10 18:06:57 user nova-compute[75100]:   <os>
Nov 10 18:06:57 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 18:06:57 user nova-compute[75100]:     <boot dev="hd"/>
Nov 10 18:06:57 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 10 18:06:57 user nova-compute[75100]:   </os>
Nov 10 18:06:57 user nova-compute[75100]:   <features>
Nov 10 18:06:57 user nova-compute[75100]:     <acpi/>
Nov 10 18:06:57 user nova-compute[75100]:     <apic/>
Nov 10 18:06:57 user nova-compute[75100]:     <vmcoreinfo/>
Nov 10 18:06:57 user nova-compute[75100]:   </features>
Nov 10 18:06:57 user nova-compute[75100]:   <clock offset="utc">
Nov 10 18:06:57 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 18:06:57 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 18:06:57 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 10 18:06:57 user nova-compute[75100]:   </clock>
Nov 10 18:06:57 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 10 18:06:57 user nova-compute[75100]:     <model>Nehalem</model>
Nov 10 18:06:57 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 18:06:57 user nova-compute[75100]:   </cpu>
Nov 10 18:06:57 user nova-compute[75100]:   <devices>
Nov 10 18:06:57 user nova-compute[75100]:     <disk type="block" device="disk">
Nov 10 18:06:57 user nova-compute[75100]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:06:57 user nova-compute[75100]:       <source dev="/dev/sdb"/>
Nov 10 18:06:57 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 10 18:06:57 user nova-compute[75100]:       <serial>9942ef0e-de84-4e1e-b62b-34ab4d72d5d7</serial>
Nov 10 18:06:57 user nova-compute[75100]:     </disk>
Nov 10 18:06:57 user nova-compute[75100]:     <interface type="ethernet">
Nov 10 18:06:57 user nova-compute[75100]:       <mac address="fa:16:3e:a7:f8:6b"/>
Nov 10 18:06:57 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 18:06:57 user nova-compute[75100]:       <mtu size="1442"/>
Nov 10 18:06:57 user nova-compute[75100]:       <target dev="tapc9011ff5-53"/>
Nov 10 18:06:57 user nova-compute[75100]:     </interface>
Nov 10 18:06:57 user nova-compute[75100]:     <serial type="pty">
Nov 10 18:06:57 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/4ebd9d80-365d-4334-8421-3b22a846321a/console.log" append="off"/>
Nov 10 18:06:57 user nova-compute[75100]:     </serial>
Nov 10 18:06:57 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 18:06:57 user nova-compute[75100]:     <video>
Nov 10 18:06:57 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 18:06:57 user nova-compute[75100]:     </video>
Nov 10 18:06:57 user nova-compute[75100]:     <rng model="virtio">
Nov 10 18:06:57 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 10 18:06:57 user nova-compute[75100]:     </rng>
Nov 10 18:06:57 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 10 18:06:57 user nova-compute[75100]:     <memballoon model="virtio">
Nov 10 18:06:57 user nova-compute[75100]:       <stats period="10"/>
Nov 10 18:06:57 user nova-compute[75100]:     </memballoon>
Nov 10 18:06:57 user nova-compute[75100]:   </devices>
Nov 10 18:06:57 user nova-compute[75100]: </domain>
Nov 10 18:06:57 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 18:06:57 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:03:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-541372061',display_name='tempest-ServerActionsTestOtherA-server-541372061',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-541372061',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJad9dm/VlgxkcoctzSOteh4UYTuKPNeJ9f0qso9IjuH6DpxTyWo1Jqw77DQ9s/VWyRmakd0roi/G14M/XBa/3VT72t8942zFgmm3ckvSnycGMTUzmFZ+zGnWexds7KMSQ==',key_name='tempest-keypair-1062541421',keypairs=<?>,launch_index=0,launched_at=2023-11-10T18:04:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ce7bb141ef59487dbb2ce6243c5002af',ramdisk_id='',reservation_id='r-bes8zsqu',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1364670684',owner_user_name='tempest-ServerActionsTestOtherA-1364670684-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T18:06:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f4df424af2343a2a27e869502651216',uuid=4ebd9d80-365d-4334-8421-3b22a846321a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c9011ff5-53de-43f3-be8e-ba86274b2c99", "address": "fa:16:3e:a7:f8:6b", "network": {"id": "bf1edb58-ef26-40ca-8ec9-853fa05de13d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1416469583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1416469583-network", "vif_mac": "fa:16:3e:a7:f8:6b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7bb141ef59487dbb2ce6243c5002af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9011ff5-53", "ovs_interfaceid": "c9011ff5-53de-43f3-be8e-ba86274b2c99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 18:06:57 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Converting VIF {"id": "c9011ff5-53de-43f3-be8e-ba86274b2c99", "address": "fa:16:3e:a7:f8:6b", "network": {"id": "bf1edb58-ef26-40ca-8ec9-853fa05de13d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1416469583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1416469583-network", "vif_mac": "fa:16:3e:a7:f8:6b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7bb141ef59487dbb2ce6243c5002af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9011ff5-53", "ovs_interfaceid": "c9011ff5-53de-43f3-be8e-ba86274b2c99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:06:57 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:f8:6b,bridge_name='br-int',has_traffic_filtering=True,id=c9011ff5-53de-43f3-be8e-ba86274b2c99,network=Network(bf1edb58-ef26-40ca-8ec9-853fa05de13d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9011ff5-53') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:06:57 user nova-compute[75100]: DEBUG os_vif [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:f8:6b,bridge_name='br-int',has_traffic_filtering=True,id=c9011ff5-53de-43f3-be8e-ba86274b2c99,network=Network(bf1edb58-ef26-40ca-8ec9-853fa05de13d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9011ff5-53') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 18:06:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:06:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 18:06:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2bc1ea4a-9b5b-51df-b684-8e1aeb162e59', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:06:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:06:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc9011ff5-53, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:06:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc9011ff5-53, col_values=(('qos', UUID('29e29206-55f2-4828-bc89-e5e515a6d16b')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:06:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc9011ff5-53, col_values=(('external_ids', {'iface-id': 'c9011ff5-53de-43f3-be8e-ba86274b2c99', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:f8:6b', 'vm-uuid': '4ebd9d80-365d-4334-8421-3b22a846321a'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:06:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:06:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:57 user nova-compute[75100]: INFO os_vif [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:f8:6b,bridge_name='br-int',has_traffic_filtering=True,id=c9011ff5-53de-43f3-be8e-ba86274b2c99,network=Network(bf1edb58-ef26-40ca-8ec9-853fa05de13d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9011ff5-53')
Nov 10 18:06:57 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 18:06:57 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] No VIF found with MAC fa:16:3e:a7:f8:6b, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 18:06:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:58 user nova-compute[75100]: DEBUG nova.compute.manager [req-1496c811-58b2-4647-a116-5e70b69e80c7 req-99db343b-ad45-4679-99b6-669e0a7e4f49 service nova] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Received event network-vif-plugged-c9011ff5-53de-43f3-be8e-ba86274b2c99 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:06:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-1496c811-58b2-4647-a116-5e70b69e80c7 req-99db343b-ad45-4679-99b6-669e0a7e4f49 service nova] Acquiring lock "4ebd9d80-365d-4334-8421-3b22a846321a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:06:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-1496c811-58b2-4647-a116-5e70b69e80c7 req-99db343b-ad45-4679-99b6-669e0a7e4f49 service nova] Lock "4ebd9d80-365d-4334-8421-3b22a846321a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:06:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-1496c811-58b2-4647-a116-5e70b69e80c7 req-99db343b-ad45-4679-99b6-669e0a7e4f49 service nova] Lock "4ebd9d80-365d-4334-8421-3b22a846321a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:06:58 user nova-compute[75100]: DEBUG nova.compute.manager [req-1496c811-58b2-4647-a116-5e70b69e80c7 req-99db343b-ad45-4679-99b6-669e0a7e4f49 service nova] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] No waiting events found dispatching network-vif-plugged-c9011ff5-53de-43f3-be8e-ba86274b2c99 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:06:58 user nova-compute[75100]: WARNING nova.compute.manager [req-1496c811-58b2-4647-a116-5e70b69e80c7 req-99db343b-ad45-4679-99b6-669e0a7e4f49 service nova] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Received unexpected event network-vif-plugged-c9011ff5-53de-43f3-be8e-ba86274b2c99 for instance with vm_state active and task_state resize_finish.
Nov 10 18:06:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:06:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:07:00 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 18:07:00 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Instance running successfully.
Nov 10 18:07:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Failed to set time: agent not configured {{(pid=75100) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 10 18:07:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ccced900-df6b-4cb7-97cf-5b256d4a8b28 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] finish_migration finished successfully. {{(pid=75100) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 10 18:07:00 user nova-compute[75100]: DEBUG nova.compute.manager [req-caabd1d8-55e8-4e26-826b-4f427e85a901 req-2e1abae3-2ce3-481b-bc0d-d089ce95190f service nova] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Received event network-vif-plugged-c9011ff5-53de-43f3-be8e-ba86274b2c99 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:07:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-caabd1d8-55e8-4e26-826b-4f427e85a901 req-2e1abae3-2ce3-481b-bc0d-d089ce95190f service nova] Acquiring lock "4ebd9d80-365d-4334-8421-3b22a846321a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:07:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-caabd1d8-55e8-4e26-826b-4f427e85a901 req-2e1abae3-2ce3-481b-bc0d-d089ce95190f service nova] Lock "4ebd9d80-365d-4334-8421-3b22a846321a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:07:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-caabd1d8-55e8-4e26-826b-4f427e85a901 req-2e1abae3-2ce3-481b-bc0d-d089ce95190f service nova] Lock "4ebd9d80-365d-4334-8421-3b22a846321a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:07:00 user nova-compute[75100]: DEBUG nova.compute.manager [req-caabd1d8-55e8-4e26-826b-4f427e85a901 req-2e1abae3-2ce3-481b-bc0d-d089ce95190f service nova] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] No waiting events found dispatching network-vif-plugged-c9011ff5-53de-43f3-be8e-ba86274b2c99 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:07:00 user nova-compute[75100]: WARNING nova.compute.manager [req-caabd1d8-55e8-4e26-826b-4f427e85a901 req-2e1abae3-2ce3-481b-bc0d-d089ce95190f service nova] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Received unexpected event network-vif-plugged-c9011ff5-53de-43f3-be8e-ba86274b2c99 for instance with vm_state active and task_state resize_finish.
Nov 10 18:07:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-59ac5453-2b51-4264-8c8e-c6ce83f36213 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Acquiring lock "fcc2bfb6-fd6b-4229-9664-42f33b138444" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:07:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-59ac5453-2b51-4264-8c8e-c6ce83f36213 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Lock "fcc2bfb6-fd6b-4229-9664-42f33b138444" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:07:01 user nova-compute[75100]: INFO nova.compute.manager [None req-59ac5453-2b51-4264-8c8e-c6ce83f36213 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Detaching volume d4dc8883-7b87-4d41-85cd-d810824c1281
Nov 10 18:07:01 user nova-compute[75100]: INFO nova.virt.block_device [None req-59ac5453-2b51-4264-8c8e-c6ce83f36213 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Attempting to driver detach volume d4dc8883-7b87-4d41-85cd-d810824c1281 from mountpoint /dev/vdb
Nov 10 18:07:01 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-59ac5453-2b51-4264-8c8e-c6ce83f36213 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Attempting to detach device vdb from instance fcc2bfb6-fd6b-4229-9664-42f33b138444 from the persistent domain config. {{(pid=75100) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 18:07:01 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-59ac5453-2b51-4264-8c8e-c6ce83f36213 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 18:07:01 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:07:01 user nova-compute[75100]:   <source dev="/dev/sdc"/>
Nov 10 18:07:01 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 18:07:01 user nova-compute[75100]:   <serial>d4dc8883-7b87-4d41-85cd-d810824c1281</serial>
Nov 10 18:07:01 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 18:07:01 user nova-compute[75100]: </disk>
Nov 10 18:07:01 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 18:07:01 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-59ac5453-2b51-4264-8c8e-c6ce83f36213 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Successfully detached device vdb from instance fcc2bfb6-fd6b-4229-9664-42f33b138444 from the persistent domain config.
Nov 10 18:07:01 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-59ac5453-2b51-4264-8c8e-c6ce83f36213 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fcc2bfb6-fd6b-4229-9664-42f33b138444 from the live domain config. {{(pid=75100) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 18:07:01 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-59ac5453-2b51-4264-8c8e-c6ce83f36213 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 18:07:01 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:07:01 user nova-compute[75100]:   <source dev="/dev/sdc"/>
Nov 10 18:07:01 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 18:07:01 user nova-compute[75100]:   <serial>d4dc8883-7b87-4d41-85cd-d810824c1281</serial>
Nov 10 18:07:01 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 18:07:01 user nova-compute[75100]: </disk>
Nov 10 18:07:01 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 18:07:01 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-59ac5453-2b51-4264-8c8e-c6ce83f36213 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fcc2bfb6-fd6b-4229-9664-42f33b138444 {{(pid=75100) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 18:07:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:07:02 user nova-compute[75100]: DEBUG nova.compute.manager [req-3aca5411-2175-41cb-98d2-e4b0661642d7 req-a13374ab-5bf8-46de-8c7a-8088d787a338 service nova] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Received event network-changed-d65a39e5-d2df-4de4-943c-fb71b88fc381 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:07:02 user nova-compute[75100]: DEBUG nova.compute.manager [req-3aca5411-2175-41cb-98d2-e4b0661642d7 req-a13374ab-5bf8-46de-8c7a-8088d787a338 service nova] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Refreshing instance network info cache due to event network-changed-d65a39e5-d2df-4de4-943c-fb71b88fc381. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 18:07:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3aca5411-2175-41cb-98d2-e4b0661642d7 req-a13374ab-5bf8-46de-8c7a-8088d787a338 service nova] Acquiring lock "refresh_cache-dc8c4fa7-668a-4348-be16-9eb06420b01f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:07:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3aca5411-2175-41cb-98d2-e4b0661642d7 req-a13374ab-5bf8-46de-8c7a-8088d787a338 service nova] Acquired lock "refresh_cache-dc8c4fa7-668a-4348-be16-9eb06420b01f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:07:02 user nova-compute[75100]: DEBUG nova.network.neutron [req-3aca5411-2175-41cb-98d2-e4b0661642d7 req-a13374ab-5bf8-46de-8c7a-8088d787a338 service nova] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Refreshing network info cache for port d65a39e5-d2df-4de4-943c-fb71b88fc381 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 18:07:03 user nova-compute[75100]: DEBUG nova.network.neutron [req-3aca5411-2175-41cb-98d2-e4b0661642d7 req-a13374ab-5bf8-46de-8c7a-8088d787a338 service nova] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Updated VIF entry in instance network info cache for port d65a39e5-d2df-4de4-943c-fb71b88fc381. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 18:07:03 user nova-compute[75100]: DEBUG nova.network.neutron [req-3aca5411-2175-41cb-98d2-e4b0661642d7 req-a13374ab-5bf8-46de-8c7a-8088d787a338 service nova] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Updating instance_info_cache with network_info: [{"id": "d65a39e5-d2df-4de4-943c-fb71b88fc381", "address": "fa:16:3e:01:98:2f", "network": {"id": "2a85480b-f67d-4ef1-b967-3e93af57d7c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1717495768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9cd441a46aa4a579feff608d6ff9bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd65a39e5-d2", "ovs_interfaceid": "d65a39e5-d2df-4de4-943c-fb71b88fc381", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:07:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3aca5411-2175-41cb-98d2-e4b0661642d7 req-a13374ab-5bf8-46de-8c7a-8088d787a338 service nova] Releasing lock "refresh_cache-dc8c4fa7-668a-4348-be16-9eb06420b01f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:07:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:07:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:07:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:07:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:07:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:07:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:07:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:07:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:07:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:07:21 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-59ac5453-2b51-4264-8c8e-c6ce83f36213 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fcc2bfb6-fd6b-4229-9664-42f33b138444 is timed out.
Nov 10 18:07:21 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-59ac5453-2b51-4264-8c8e-c6ce83f36213 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Successfully detached device vdb from instance fcc2bfb6-fd6b-4229-9664-42f33b138444 from the live domain config.
Nov 10 18:07:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59ac5453-2b51-4264-8c8e-c6ce83f36213 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 18:07:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ac5453-2b51-4264-8c8e-c6ce83f36213 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, {'target_iqn': 'iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OEmBVZoT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:07:21 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-59ac5453-2b51-4264-8c8e-c6ce83f36213 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:07:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-59ac5453-2b51-4264-8c8e-c6ce83f36213 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:07:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-59ac5453-2b51-4264-8c8e-c6ce83f36213 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:07:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:07:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:07:21 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f33cc40-35f1-4545-a327-dcc400052e90]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:07:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ac5453-2b51-4264-8c8e-c6ce83f36213 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 18:07:21 user nova-compute[75100]: No targets found.
Nov 10 18:07:21 user nova-compute[75100]: iSNS:
Nov 10 18:07:21 user nova-compute[75100]: No targets found.
Nov 10 18:07:21 user nova-compute[75100]: STATIC:
Nov 10 18:07:21 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8
Nov 10 18:07:21 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:07:21 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:07:21 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf
Nov 10 18:07:21 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:07:21 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:07:21 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281
Nov 10 18:07:21 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:07:21 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:07:21 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005
Nov 10 18:07:21 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:07:21 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:07:21 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7
Nov 10 18:07:21 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:07:21 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:07:21 user nova-compute[75100]: FIRMWARE:
Nov 10 18:07:21 user nova-compute[75100]: No targets found.
Nov 10 18:07:21 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:07:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ac5453-2b51-4264-8c8e-c6ce83f36213 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 18:07:21 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 18:07:21 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 18:07:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ac5453-2b51-4264-8c8e-c6ce83f36213 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 18:07:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:07:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:07:21 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe071a88-9051-49e1-b4c6-3e6057d102df]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:07:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:07:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:07:21 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7058b6-51fc-4c91-a352-6281022f653f]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:07:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ac5453-2b51-4264-8c8e-c6ce83f36213 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 (non-flash)
Nov 10 18:07:21 user nova-compute[75100]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 (non-flash)
Nov 10 18:07:21 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8 (non-flash)
Nov 10 18:07:21 user nova-compute[75100]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf (non-flash)
Nov 10 18:07:21 user nova-compute[75100]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)
Nov 10 18:07:21 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:07:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ac5453-2b51-4264-8c8e-c6ce83f36213 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 (non-flash)
Nov 10 18:07:21 user nova-compute[75100]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 (non-flash)
Nov 10 18:07:21 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8 (non-flash)
Nov 10 18:07:21 user nova-compute[75100]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf (non-flash)
Nov 10 18:07:21 user nova-compute[75100]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)
Nov 10 18:07:21 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:07:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ac5453-2b51-4264-8c8e-c6ce83f36213 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3986f2b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281'): ({'sdc'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 18:07:21 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-59ac5453-2b51-4264-8c8e-c6ce83f36213 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Removing single pathed devices sdc {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 18:07:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:07:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:07:21 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb21253e-22de-4931-8096-a510664a000e]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:07:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:07:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:07:21 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e643deae-147e-494f-8e9d-067c4dbd8aea]: (4, ('ok\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:07:21 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-59ac5453-2b51-4264-8c8e-c6ce83f36213 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Flushing IO for device /dev/sdc {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 18:07:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:07:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:07:21 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[916816ec-08c5-4a7d-b0a1-411b57e52638]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:07:21 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-59ac5453-2b51-4264-8c8e-c6ce83f36213 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 18:07:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:07:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:07:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e3ec78-1b32-482a-a096-1d9925529b71]: (4, ('1', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:07:22 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-59ac5453-2b51-4264-8c8e-c6ce83f36213 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 18:07:22 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-59ac5453-2b51-4264-8c8e-c6ce83f36213 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] SCSI volumes sdc have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 18:07:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ac5453-2b51-4264-8c8e-c6ce83f36213 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 18:07:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:07:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:07:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[453789f1-3c32-43e7-aec5-6c775eb56826]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:07:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ac5453-2b51-4264-8c8e-c6ce83f36213 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:07:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 -p 172.16.0.220:3260 --logout {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:07:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:07:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99ec904-339c-4b64-aace-8dfee80536d9]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:07:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ac5453-2b51-4264-8c8e-c6ce83f36213 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281, portal: 172.16.0.220,3260]
Nov 10 18:07:22 user nova-compute[75100]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281, portal: 172.16.0.220,3260] successful.
Nov 10 18:07:22 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:07:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 -p 172.16.0.220:3260 --op delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:07:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Acquiring lock "aa469ab9-92c2-4e7f-ae66-bbe48b11511a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:07:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "aa469ab9-92c2-4e7f-ae66-bbe48b11511a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:07:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4dc8883-7b87-4d41-85cd-d810824c1281 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:07:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e95681-fab6-4812-9072-18e89a95c863]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:07:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ac5453-2b51-4264-8c8e-c6ce83f36213 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:07:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-59ac5453-2b51-4264-8c8e-c6ce83f36213 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:07:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ac5453-2b51-4264-8c8e-c6ce83f36213 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] <== disconnect_volume: return (349ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:07:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59ac5453-2b51-4264-8c8e-c6ce83f36213 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 18:07:22 user nova-compute[75100]: DEBUG nova.compute.manager [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 18:07:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:07:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:07:22 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 18:07:22 user nova-compute[75100]: INFO nova.compute.claims [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Claim successful on node user
Nov 10 18:07:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:07:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:07:22 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:07:22 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:07:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.422s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:07:22 user nova-compute[75100]: DEBUG nova.compute.manager [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 18:07:22 user nova-compute[75100]: DEBUG nova.compute.manager [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 18:07:22 user nova-compute[75100]: DEBUG nova.network.neutron [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 18:07:22 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 18:07:22 user nova-compute[75100]: DEBUG nova.compute.manager [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 18:07:22 user nova-compute[75100]: INFO nova.virt.block_device [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Booting with volume fb1593e0-4a1c-4ae3-8e97-7ae6215f8143 at /dev/vda
Nov 10 18:07:22 user nova-compute[75100]: DEBUG nova.policy [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '323c5738ca424a379f666b4ca60825ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd441a46aa4a579feff608d6ff9bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 18:07:22 user nova-compute[75100]: DEBUG os_brick.utils [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:07:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:07:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:07:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0b49b0-6840-4cf9-9877-e8efa2f427aa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90b1a229568f\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:07:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:07:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:07:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3094249-5f55-4986-be80-777efea03d05]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:07:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:07:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:07:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc4932c-58da-48eb-b42a-a1365503704b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:07:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[504a0423-3597-4008-ac60-fe809a4ea336]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:07:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:07:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 18:07:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 18:07:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:07:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 18:07:23 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 18:07:23 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[004eab3a-0188-4cd6-ac32-2e570ee997fa]: (4, '') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:07:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 18:07:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 18:07:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 18:07:23 user nova-compute[75100]: DEBUG os_brick.utils [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90b1a229568f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:07:23 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Updating existing volume attachment record: b6770b12-5b34-4548-9e4e-fa0ca81e3aa1 {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 18:07:23 user nova-compute[75100]: DEBUG nova.objects.instance [None req-59ac5453-2b51-4264-8c8e-c6ce83f36213 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Lazy-loading 'flavor' on Instance uuid fcc2bfb6-fd6b-4229-9664-42f33b138444 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:07:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-59ac5453-2b51-4264-8c8e-c6ce83f36213 tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Lock "fcc2bfb6-fd6b-4229-9664-42f33b138444" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.031s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:07:23 user nova-compute[75100]: DEBUG nova.network.neutron [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Successfully created port: c538aab4-e12a-4800-b8a5-48dcf1124862 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 18:07:24 user nova-compute[75100]: DEBUG nova.network.neutron [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Successfully updated port: c538aab4-e12a-4800-b8a5-48dcf1124862 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 18:07:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Acquiring lock "refresh_cache-aa469ab9-92c2-4e7f-ae66-bbe48b11511a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:07:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Acquired lock "refresh_cache-aa469ab9-92c2-4e7f-ae66-bbe48b11511a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:07:24 user nova-compute[75100]: DEBUG nova.network.neutron [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 18:07:24 user nova-compute[75100]: DEBUG nova.compute.manager [req-ead1afa7-44ed-432a-888c-9c04c892a9b1 req-25bae09b-bfe5-481b-a7d1-d254fd1c877c service nova] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Received event network-changed-c538aab4-e12a-4800-b8a5-48dcf1124862 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:07:24 user nova-compute[75100]: DEBUG nova.compute.manager [req-ead1afa7-44ed-432a-888c-9c04c892a9b1 req-25bae09b-bfe5-481b-a7d1-d254fd1c877c service nova] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Refreshing instance network info cache due to event network-changed-c538aab4-e12a-4800-b8a5-48dcf1124862. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 18:07:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ead1afa7-44ed-432a-888c-9c04c892a9b1 req-25bae09b-bfe5-481b-a7d1-d254fd1c877c service nova] Acquiring lock "refresh_cache-aa469ab9-92c2-4e7f-ae66-bbe48b11511a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:07:24 user nova-compute[75100]: DEBUG nova.network.neutron [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 18:07:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:07:24 user nova-compute[75100]: DEBUG nova.network.neutron [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Updating instance_info_cache with network_info: [{"id": "c538aab4-e12a-4800-b8a5-48dcf1124862", "address": "fa:16:3e:01:77:a1", "network": {"id": "2a85480b-f67d-4ef1-b967-3e93af57d7c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1717495768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9cd441a46aa4a579feff608d6ff9bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc538aab4-e1", "ovs_interfaceid": "c538aab4-e12a-4800-b8a5-48dcf1124862", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:07:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Releasing lock "refresh_cache-aa469ab9-92c2-4e7f-ae66-bbe48b11511a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:07:24 user nova-compute[75100]: DEBUG nova.compute.manager [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Instance network_info: |[{"id": "c538aab4-e12a-4800-b8a5-48dcf1124862", "address": "fa:16:3e:01:77:a1", "network": {"id": "2a85480b-f67d-4ef1-b967-3e93af57d7c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1717495768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9cd441a46aa4a579feff608d6ff9bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc538aab4-e1", "ovs_interfaceid": "c538aab4-e12a-4800-b8a5-48dcf1124862", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 18:07:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ead1afa7-44ed-432a-888c-9c04c892a9b1 req-25bae09b-bfe5-481b-a7d1-d254fd1c877c service nova] Acquired lock "refresh_cache-aa469ab9-92c2-4e7f-ae66-bbe48b11511a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:07:24 user nova-compute[75100]: DEBUG nova.network.neutron [req-ead1afa7-44ed-432a-888c-9c04c892a9b1 req-25bae09b-bfe5-481b-a7d1-d254fd1c877c service nova] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Refreshing network info cache for port c538aab4-e12a-4800-b8a5-48dcf1124862 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 18:07:25 user nova-compute[75100]: DEBUG nova.network.neutron [req-ead1afa7-44ed-432a-888c-9c04c892a9b1 req-25bae09b-bfe5-481b-a7d1-d254fd1c877c service nova] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Updated VIF entry in instance network info cache for port c538aab4-e12a-4800-b8a5-48dcf1124862. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 18:07:25 user nova-compute[75100]: DEBUG nova.network.neutron [req-ead1afa7-44ed-432a-888c-9c04c892a9b1 req-25bae09b-bfe5-481b-a7d1-d254fd1c877c service nova] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Updating instance_info_cache with network_info: [{"id": "c538aab4-e12a-4800-b8a5-48dcf1124862", "address": "fa:16:3e:01:77:a1", "network": {"id": "2a85480b-f67d-4ef1-b967-3e93af57d7c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1717495768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9cd441a46aa4a579feff608d6ff9bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc538aab4-e1", "ovs_interfaceid": "c538aab4-e12a-4800-b8a5-48dcf1124862", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:07:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ead1afa7-44ed-432a-888c-9c04c892a9b1 req-25bae09b-bfe5-481b-a7d1-d254fd1c877c service nova] Releasing lock "refresh_cache-aa469ab9-92c2-4e7f-ae66-bbe48b11511a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:07:26 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:07:26 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:07:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:07:27 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:07:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:07:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:07:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:07:27 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 18:07:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0bae328-2528-4562-850b-14fa108923c6/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:07:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0bae328-2528-4562-850b-14fa108923c6/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:07:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0bae328-2528-4562-850b-14fa108923c6/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:07:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0bae328-2528-4562-850b-14fa108923c6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:07:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 18:07:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:07:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:07:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:07:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:07:28 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 18:07:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1937fab6-d892-406e-b8ff-52194021eea4/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:07:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1937fab6-d892-406e-b8ff-52194021eea4/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:07:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1937fab6-d892-406e-b8ff-52194021eea4/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:07:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1937fab6-d892-406e-b8ff-52194021eea4/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:07:28 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 18:07:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bc34cf6-1f79-4127-8c35-0ae2d93406ff/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:07:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bc34cf6-1f79-4127-8c35-0ae2d93406ff/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:07:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bc34cf6-1f79-4127-8c35-0ae2d93406ff/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:07:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bc34cf6-1f79-4127-8c35-0ae2d93406ff/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:07:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fb32aa2-0dbf-4f54-ae68-18c609604b53/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:07:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fb32aa2-0dbf-4f54-ae68-18c609604b53/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:07:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fb32aa2-0dbf-4f54-ae68-18c609604b53/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:07:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fb32aa2-0dbf-4f54-ae68-18c609604b53/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:07:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc2bfb6-fd6b-4229-9664-42f33b138444/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:07:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc2bfb6-fd6b-4229-9664-42f33b138444/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:07:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc2bfb6-fd6b-4229-9664-42f33b138444/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:07:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc2bfb6-fd6b-4229-9664-42f33b138444/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:07:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 18:07:30 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:07:30 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:07:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Hypervisor/Node resource view: name=user free_ram=7554MB free_disk=24.262134552001953GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 18:07:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:07:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:07:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Applying migration context for instance 4ebd9d80-365d-4334-8421-3b22a846321a as it has an incoming, in-progress migration ba414159-d274-4472-b362-fccac93007d8. Migration status is finished {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 10 18:07:30 user nova-compute[75100]: INFO nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Updating resource usage from migration ba414159-d274-4472-b362-fccac93007d8
Nov 10 18:07:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:07:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance fcc2bfb6-fd6b-4229-9664-42f33b138444 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:07:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance b0bae328-2528-4562-850b-14fa108923c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:07:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 1937fab6-d892-406e-b8ff-52194021eea4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:07:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance dc8c4fa7-668a-4348-be16-9eb06420b01f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:07:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 4fb32aa2-0dbf-4f54-ae68-18c609604b53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:07:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Migration ba414159-d274-4472-b362-fccac93007d8 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 10 18:07:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 4ebd9d80-365d-4334-8421-3b22a846321a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:07:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 7bc34cf6-1f79-4127-8c35-0ae2d93406ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:07:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance aa469ab9-92c2-4e7f-ae66-bbe48b11511a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:07:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 18:07:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 18:07:30 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:07:30 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:07:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 18:07:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.494s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:07:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:07:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:07:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:07:37 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:07:37 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:07:37 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:07:37 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:07:39 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:07:39 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 18:07:41 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:07:41 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 18:07:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "refresh_cache-1937fab6-d892-406e-b8ff-52194021eea4" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:07:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquired lock "refresh_cache-1937fab6-d892-406e-b8ff-52194021eea4" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:07:41 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 18:07:41 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Updating instance_info_cache with network_info: [{"id": "c19c4cab-962c-4915-806a-9dbffdf4bfa4", "address": "fa:16:3e:ba:d7:b9", "network": {"id": "78d86418-c0e0-4cc2-8f4f-262f600f7d66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2054827063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19cfb454e59745bf9c77d7a7ede2bc0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc19c4cab-96", "ovs_interfaceid": "c19c4cab-962c-4915-806a-9dbffdf4bfa4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:07:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Releasing lock "refresh_cache-1937fab6-d892-406e-b8ff-52194021eea4" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:07:41 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 18:07:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:07:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:07:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:07:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:07:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:07:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:07:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG nova.compute.manager [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 18:07:49 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Creating image(s)
Nov 10 18:07:49 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Did not create local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Ensure instance console log exists: /opt/stack/data/nova/instances/aa469ab9-92c2-4e7f-ae66-bbe48b11511a/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Start _get_guest_xml network_info=[{"id": "c538aab4-e12a-4800-b8a5-48dcf1124862", "address": "fa:16:3e:01:77:a1", "network": {"id": "2a85480b-f67d-4ef1-b967-3e93af57d7c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1717495768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9cd441a46aa4a579feff608d6ff9bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc538aab4-e1", "ovs_interfaceid": "c538aab4-e12a-4800-b8a5-48dcf1124862", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fb1593e0-4a1c-4ae3-8e97-7ae6215f8143', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XiClOfGc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'aa469ab9-92c2-4e7f-ae66-bbe48b11511a', 'attached_at': '', 'detached_at': '', 'volume_id': 'fb1593e0-4a1c-4ae3-8e97-7ae6215f8143', 'serial': 'fb1593e0-4a1c-4ae3-8e97-7ae6215f8143'}, 'mount_device': '/dev/vda', 'attachment_id': 'b6770b12-5b34-4548-9e4e-fa0ca81e3aa1', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 18:07:49 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:07:49 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:07:49 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T17:40:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fb1593e0-4a1c-4ae3-8e97-7ae6215f8143', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XiClOfGc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:07:49 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:07:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:07:49 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:07:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb1593e0-4a1c-4ae3-8e97-7ae6215f8143" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb1593e0-4a1c-4ae3-8e97-7ae6215f8143" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:07:49 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 18:07:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb1593e0-4a1c-4ae3-8e97-7ae6215f8143 -p 172.16.0.220:3260 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb1593e0-4a1c-4ae3-8e97-7ae6215f8143 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[51336c97-de53-4b48-9f72-a5d957c4aea7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 18:07:49 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb1593e0-4a1c-4ae3-8e97-7ae6215f8143 -p 172.16.0.220:3260 --interface default --op new {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb1593e0-4a1c-4ae3-8e97-7ae6215f8143 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb5931d-5ef2-4f0f-b025-b4153f997f27]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb1593e0-4a1c-4ae3-8e97-7ae6215f8143] added\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb1593e0-4a1c-4ae3-8e97-7ae6215f8143] added
Nov 10 18:07:49 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb1593e0-4a1c-4ae3-8e97-7ae6215f8143 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb1593e0-4a1c-4ae3-8e97-7ae6215f8143 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b75328-da3d-4142-b9a1-20ebb631c3b8]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb1593e0-4a1c-4ae3-8e97-7ae6215f8143 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb1593e0-4a1c-4ae3-8e97-7ae6215f8143 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7e7a8b-fe62-4d8c-a6ed-38c0801136e1]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb1593e0-4a1c-4ae3-8e97-7ae6215f8143 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XiClOfGc {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb1593e0-4a1c-4ae3-8e97-7ae6215f8143 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XiClOfGc" returned: 0 in 0.031s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f10589f-5d39-4f32-99b9-ac3af435c854]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XiClOfGc'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb1593e0-4a1c-4ae3-8e97-7ae6215f8143 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb1593e0-4a1c-4ae3-8e97-7ae6215f8143 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[017bfeb4-5722-4b9f-8ba9-feb0e5c98d97]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[df0249ce-a8f1-4bc5-b64a-a8f5ed14310b]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 (non-flash)
Nov 10 18:07:49 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8 (non-flash)
Nov 10 18:07:49 user nova-compute[75100]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf (non-flash)
Nov 10 18:07:49 user nova-compute[75100]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)
Nov 10 18:07:49 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 (non-flash)
Nov 10 18:07:49 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8 (non-flash)
Nov 10 18:07:49 user nova-compute[75100]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf (non-flash)
Nov 10 18:07:49 user nova-compute[75100]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)
Nov 10 18:07:49 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb1593e0-4a1c-4ae3-8e97-7ae6215f8143 -p 172.16.0.220:3260 --login {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb1593e0-4a1c-4ae3-8e97-7ae6215f8143 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc328dd-3cbb-4a37-9ae3-06bd636da007]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb1593e0-4a1c-4ae3-8e97-7ae6215f8143, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fb1593e0-4a1c-4ae3-8e97-7ae6215f8143, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb1593e0-4a1c-4ae3-8e97-7ae6215f8143, portal: 172.16.0.220,3260]
Nov 10 18:07:49 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:fb1593e0-4a1c-4ae3-8e97-7ae6215f8143, portal: 172.16.0.220,3260] successful.
Nov 10 18:07:49 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb1593e0-4a1c-4ae3-8e97-7ae6215f8143 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb1593e0-4a1c-4ae3-8e97-7ae6215f8143 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4367f5f4-9568-456d-8843-0a3ae5d1650c]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[446bd7c3-521a-41a0-99af-9e2d6be21aef]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1593e0-4a1c-4ae3-8e97-7ae6215f8143 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 (non-flash)
Nov 10 18:07:49 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8 (non-flash)
Nov 10 18:07:49 user nova-compute[75100]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf (non-flash)
Nov 10 18:07:49 user nova-compute[75100]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)
Nov 10 18:07:49 user nova-compute[75100]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1593e0-4a1c-4ae3-8e97-7ae6215f8143 (non-flash)
Nov 10 18:07:49 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 (non-flash)
Nov 10 18:07:49 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8 (non-flash)
Nov 10 18:07:49 user nova-compute[75100]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf (non-flash)
Nov 10 18:07:49 user nova-compute[75100]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)
Nov 10 18:07:49 user nova-compute[75100]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1593e0-4a1c-4ae3-8e97-7ae6215f8143 (non-flash)
Nov 10 18:07:49 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb1593e0-4a1c-4ae3-8e97-7ae6215f8143" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] HCTL ('34', '-', '-', 0) found on session 33 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb22a8b-f2ba-456d-9bc6-3ec073b2609a]: (4, ('- - 0', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:07:49 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Searching for a device in session 33 and hctl ['34', '*', '*', 0] yield: None {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 18:07:50 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Searching for a device in session 33 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 18:07:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:fb1593e0-4a1c-4ae3-8e97-7ae6215f8143', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XiClOfGc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 18:07:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:07:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '26661333430356538', 'path': '/dev/sdc'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:07:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661333430356538', 'path': '/dev/sdc'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 18:07:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:07:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1231469740',display_name='tempest-TestVolumeBootPattern-server-1231469740',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1231469740',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILrjRswgoJPqA+suzoqc8EEXkFg1B3St2cTU0CL5tiD3TI/qO87+FOfxjV/dwwN6UPPBmEGN67tPxZrctQdNsOvA6IRt0kMT8eF3nDG1qAx3cky0fCNWo1RZsce/R29pA==',key_name='tempest-TestVolumeBootPattern-1607857152',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9cd441a46aa4a579feff608d6ff9bb4',ramdisk_id='',reservation_id='r-exhyvghc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-706331648',owner_user_name='tempest-TestVolumeBootPattern-706331648-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T18:07:23Z,user_data=None,user_id='323c5738ca424a379f666b4ca60825ac',uuid=aa469ab9-92c2-4e7f-ae66-bbe48b11511a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c538aab4-e12a-4800-b8a5-48dcf1124862", "address": "fa:16:3e:01:77:a1", "network": {"id": "2a85480b-f67d-4ef1-b967-3e93af57d7c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1717495768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9cd441a46aa4a579feff608d6ff9bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc538aab4-e1", "ovs_interfaceid": "c538aab4-e12a-4800-b8a5-48dcf1124862", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 18:07:50 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Converting VIF {"id": "c538aab4-e12a-4800-b8a5-48dcf1124862", "address": "fa:16:3e:01:77:a1", "network": {"id": "2a85480b-f67d-4ef1-b967-3e93af57d7c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1717495768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9cd441a46aa4a579feff608d6ff9bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc538aab4-e1", "ovs_interfaceid": "c538aab4-e12a-4800-b8a5-48dcf1124862", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:07:50 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:77:a1,bridge_name='br-int',has_traffic_filtering=True,id=c538aab4-e12a-4800-b8a5-48dcf1124862,network=Network(2a85480b-f67d-4ef1-b967-3e93af57d7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc538aab4-e1') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:07:50 user nova-compute[75100]: DEBUG nova.objects.instance [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lazy-loading 'pci_devices' on Instance uuid aa469ab9-92c2-4e7f-ae66-bbe48b11511a {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:07:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] End _get_guest_xml xml=<domain type="kvm">
Nov 10 18:07:50 user nova-compute[75100]:   <uuid>aa469ab9-92c2-4e7f-ae66-bbe48b11511a</uuid>
Nov 10 18:07:50 user nova-compute[75100]:   <name>instance-0000002a</name>
Nov 10 18:07:50 user nova-compute[75100]:   <memory>524288</memory>
Nov 10 18:07:50 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 10 18:07:50 user nova-compute[75100]:   <metadata>
Nov 10 18:07:50 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 18:07:50 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 10 18:07:50 user nova-compute[75100]:       <nova:name>tempest-TestVolumeBootPattern-server-1231469740</nova:name>
Nov 10 18:07:50 user nova-compute[75100]:       <nova:creationTime>2023-11-10 18:07:49</nova:creationTime>
Nov 10 18:07:50 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 10 18:07:50 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 10 18:07:50 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 10 18:07:50 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 10 18:07:50 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 18:07:50 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 10 18:07:50 user nova-compute[75100]:       </nova:flavor>
Nov 10 18:07:50 user nova-compute[75100]:       <nova:owner>
Nov 10 18:07:50 user nova-compute[75100]:         <nova:user uuid="323c5738ca424a379f666b4ca60825ac">tempest-TestVolumeBootPattern-706331648-project-member</nova:user>
Nov 10 18:07:50 user nova-compute[75100]:         <nova:project uuid="b9cd441a46aa4a579feff608d6ff9bb4">tempest-TestVolumeBootPattern-706331648</nova:project>
Nov 10 18:07:50 user nova-compute[75100]:       </nova:owner>
Nov 10 18:07:50 user nova-compute[75100]:       <nova:ports>
Nov 10 18:07:50 user nova-compute[75100]:         <nova:port uuid="c538aab4-e12a-4800-b8a5-48dcf1124862">
Nov 10 18:07:50 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 10 18:07:50 user nova-compute[75100]:         </nova:port>
Nov 10 18:07:50 user nova-compute[75100]:       </nova:ports>
Nov 10 18:07:50 user nova-compute[75100]:     </nova:instance>
Nov 10 18:07:50 user nova-compute[75100]:   </metadata>
Nov 10 18:07:50 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 10 18:07:50 user nova-compute[75100]:     <system>
Nov 10 18:07:50 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 18:07:50 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 10 18:07:50 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 10 18:07:50 user nova-compute[75100]:       <entry name="serial">aa469ab9-92c2-4e7f-ae66-bbe48b11511a</entry>
Nov 10 18:07:50 user nova-compute[75100]:       <entry name="uuid">aa469ab9-92c2-4e7f-ae66-bbe48b11511a</entry>
Nov 10 18:07:50 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 10 18:07:50 user nova-compute[75100]:     </system>
Nov 10 18:07:50 user nova-compute[75100]:   </sysinfo>
Nov 10 18:07:50 user nova-compute[75100]:   <os>
Nov 10 18:07:50 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 18:07:50 user nova-compute[75100]:     <boot dev="hd"/>
Nov 10 18:07:50 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 10 18:07:50 user nova-compute[75100]:   </os>
Nov 10 18:07:50 user nova-compute[75100]:   <features>
Nov 10 18:07:50 user nova-compute[75100]:     <acpi/>
Nov 10 18:07:50 user nova-compute[75100]:     <apic/>
Nov 10 18:07:50 user nova-compute[75100]:     <vmcoreinfo/>
Nov 10 18:07:50 user nova-compute[75100]:   </features>
Nov 10 18:07:50 user nova-compute[75100]:   <clock offset="utc">
Nov 10 18:07:50 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 18:07:50 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 18:07:50 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 10 18:07:50 user nova-compute[75100]:   </clock>
Nov 10 18:07:50 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 10 18:07:50 user nova-compute[75100]:     <model>Nehalem</model>
Nov 10 18:07:50 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 18:07:50 user nova-compute[75100]:   </cpu>
Nov 10 18:07:50 user nova-compute[75100]:   <devices>
Nov 10 18:07:50 user nova-compute[75100]:     <disk type="block" device="disk">
Nov 10 18:07:50 user nova-compute[75100]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:07:50 user nova-compute[75100]:       <source dev="/dev/sdc"/>
Nov 10 18:07:50 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 10 18:07:50 user nova-compute[75100]:       <serial>fb1593e0-4a1c-4ae3-8e97-7ae6215f8143</serial>
Nov 10 18:07:50 user nova-compute[75100]:     </disk>
Nov 10 18:07:50 user nova-compute[75100]:     <interface type="ethernet">
Nov 10 18:07:50 user nova-compute[75100]:       <mac address="fa:16:3e:01:77:a1"/>
Nov 10 18:07:50 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 18:07:50 user nova-compute[75100]:       <mtu size="1442"/>
Nov 10 18:07:50 user nova-compute[75100]:       <target dev="tapc538aab4-e1"/>
Nov 10 18:07:50 user nova-compute[75100]:     </interface>
Nov 10 18:07:50 user nova-compute[75100]:     <serial type="pty">
Nov 10 18:07:50 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/aa469ab9-92c2-4e7f-ae66-bbe48b11511a/console.log" append="off"/>
Nov 10 18:07:50 user nova-compute[75100]:     </serial>
Nov 10 18:07:50 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 18:07:50 user nova-compute[75100]:     <video>
Nov 10 18:07:50 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 18:07:50 user nova-compute[75100]:     </video>
Nov 10 18:07:50 user nova-compute[75100]:     <rng model="virtio">
Nov 10 18:07:50 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 10 18:07:50 user nova-compute[75100]:     </rng>
Nov 10 18:07:50 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 10 18:07:50 user nova-compute[75100]:     <memballoon model="virtio">
Nov 10 18:07:50 user nova-compute[75100]:       <stats period="10"/>
Nov 10 18:07:50 user nova-compute[75100]:     </memballoon>
Nov 10 18:07:50 user nova-compute[75100]:   </devices>
Nov 10 18:07:50 user nova-compute[75100]: </domain>
Nov 10 18:07:50 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 18:07:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:07:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1231469740',display_name='tempest-TestVolumeBootPattern-server-1231469740',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1231469740',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILrjRswgoJPqA+suzoqc8EEXkFg1B3St2cTU0CL5tiD3TI/qO87+FOfxjV/dwwN6UPPBmEGN67tPxZrctQdNsOvA6IRt0kMT8eF3nDG1qAx3cky0fCNWo1RZsce/R29pA==',key_name='tempest-TestVolumeBootPattern-1607857152',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9cd441a46aa4a579feff608d6ff9bb4',ramdisk_id='',reservation_id='r-exhyvghc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-706331648',owner_user_name='tempest-TestVolumeBootPattern-706331648-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T18:07:23Z,user_data=None,user_id='323c5738ca424a379f666b4ca60825ac',uuid=aa469ab9-92c2-4e7f-ae66-bbe48b11511a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c538aab4-e12a-4800-b8a5-48dcf1124862", "address": "fa:16:3e:01:77:a1", "network": {"id": "2a85480b-f67d-4ef1-b967-3e93af57d7c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1717495768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9cd441a46aa4a579feff608d6ff9bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc538aab4-e1", "ovs_interfaceid": "c538aab4-e12a-4800-b8a5-48dcf1124862", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 18:07:50 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Converting VIF {"id": "c538aab4-e12a-4800-b8a5-48dcf1124862", "address": "fa:16:3e:01:77:a1", "network": {"id": "2a85480b-f67d-4ef1-b967-3e93af57d7c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1717495768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9cd441a46aa4a579feff608d6ff9bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc538aab4-e1", "ovs_interfaceid": "c538aab4-e12a-4800-b8a5-48dcf1124862", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:07:50 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:77:a1,bridge_name='br-int',has_traffic_filtering=True,id=c538aab4-e12a-4800-b8a5-48dcf1124862,network=Network(2a85480b-f67d-4ef1-b967-3e93af57d7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc538aab4-e1') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:07:50 user nova-compute[75100]: DEBUG os_vif [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:77:a1,bridge_name='br-int',has_traffic_filtering=True,id=c538aab4-e12a-4800-b8a5-48dcf1124862,network=Network(2a85480b-f67d-4ef1-b967-3e93af57d7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc538aab4-e1') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 18:07:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:07:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:07:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 18:07:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:07:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '33784c45-3d0d-5ce0-9753-79270122ae99', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:07:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:07:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:07:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:07:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc538aab4-e1, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:07:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc538aab4-e1, col_values=(('qos', UUID('e56dc332-b6d9-4ed9-b8bc-c7457f3b0035')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:07:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc538aab4-e1, col_values=(('external_ids', {'iface-id': 'c538aab4-e12a-4800-b8a5-48dcf1124862', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:77:a1', 'vm-uuid': 'aa469ab9-92c2-4e7f-ae66-bbe48b11511a'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:07:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:07:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:07:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:07:50 user nova-compute[75100]: INFO os_vif [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:77:a1,bridge_name='br-int',has_traffic_filtering=True,id=c538aab4-e12a-4800-b8a5-48dcf1124862,network=Network(2a85480b-f67d-4ef1-b967-3e93af57d7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc538aab4-e1')
Nov 10 18:07:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 18:07:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] No VIF found with MAC fa:16:3e:01:77:a1, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 18:07:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-47eaacb3-5ccf-43d5-a01e-9342c3da2def tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Acquiring lock "fcc2bfb6-fd6b-4229-9664-42f33b138444" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:07:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-47eaacb3-5ccf-43d5-a01e-9342c3da2def tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Lock "fcc2bfb6-fd6b-4229-9664-42f33b138444" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:07:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-47eaacb3-5ccf-43d5-a01e-9342c3da2def tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Acquiring lock "fcc2bfb6-fd6b-4229-9664-42f33b138444-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:07:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-47eaacb3-5ccf-43d5-a01e-9342c3da2def tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Lock "fcc2bfb6-fd6b-4229-9664-42f33b138444-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:07:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-47eaacb3-5ccf-43d5-a01e-9342c3da2def tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Lock "fcc2bfb6-fd6b-4229-9664-42f33b138444-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:07:51 user nova-compute[75100]: INFO nova.compute.manager [None req-47eaacb3-5ccf-43d5-a01e-9342c3da2def tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Terminating instance
Nov 10 18:07:51 user nova-compute[75100]: DEBUG nova.compute.manager [None req-47eaacb3-5ccf-43d5-a01e-9342c3da2def tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 18:07:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:07:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:07:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:07:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:07:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:07:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:07:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:07:52 user nova-compute[75100]: DEBUG nova.compute.manager [req-c5d1d2dc-f3e8-4ff4-a04b-52760ff7c991 req-cd0d1257-3a20-4b78-b5fa-7a14960f7791 service nova] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Received event network-vif-unplugged-8c7dcf78-fc4a-4fcb-905e-ce75143a9450 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:07:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c5d1d2dc-f3e8-4ff4-a04b-52760ff7c991 req-cd0d1257-3a20-4b78-b5fa-7a14960f7791 service nova] Acquiring lock "fcc2bfb6-fd6b-4229-9664-42f33b138444-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:07:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c5d1d2dc-f3e8-4ff4-a04b-52760ff7c991 req-cd0d1257-3a20-4b78-b5fa-7a14960f7791 service nova] Lock "fcc2bfb6-fd6b-4229-9664-42f33b138444-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:07:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c5d1d2dc-f3e8-4ff4-a04b-52760ff7c991 req-cd0d1257-3a20-4b78-b5fa-7a14960f7791 service nova] Lock "fcc2bfb6-fd6b-4229-9664-42f33b138444-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:07:52 user nova-compute[75100]: DEBUG nova.compute.manager [req-c5d1d2dc-f3e8-4ff4-a04b-52760ff7c991 req-cd0d1257-3a20-4b78-b5fa-7a14960f7791 service nova] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] No waiting events found dispatching network-vif-unplugged-8c7dcf78-fc4a-4fcb-905e-ce75143a9450 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:07:52 user nova-compute[75100]: DEBUG nova.compute.manager [req-c5d1d2dc-f3e8-4ff4-a04b-52760ff7c991 req-cd0d1257-3a20-4b78-b5fa-7a14960f7791 service nova] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Received event network-vif-unplugged-8c7dcf78-fc4a-4fcb-905e-ce75143a9450 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 18:07:52 user nova-compute[75100]: DEBUG nova.compute.manager [req-10f0d00d-2339-4d94-b853-421e96337bd1 req-c8fbf31e-3176-40b8-8610-038a40efdae7 service nova] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Received event network-vif-plugged-c538aab4-e12a-4800-b8a5-48dcf1124862 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:07:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-10f0d00d-2339-4d94-b853-421e96337bd1 req-c8fbf31e-3176-40b8-8610-038a40efdae7 service nova] Acquiring lock "aa469ab9-92c2-4e7f-ae66-bbe48b11511a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:07:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-10f0d00d-2339-4d94-b853-421e96337bd1 req-c8fbf31e-3176-40b8-8610-038a40efdae7 service nova] Lock "aa469ab9-92c2-4e7f-ae66-bbe48b11511a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:07:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-10f0d00d-2339-4d94-b853-421e96337bd1 req-c8fbf31e-3176-40b8-8610-038a40efdae7 service nova] Lock "aa469ab9-92c2-4e7f-ae66-bbe48b11511a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:07:52 user nova-compute[75100]: DEBUG nova.compute.manager [req-10f0d00d-2339-4d94-b853-421e96337bd1 req-c8fbf31e-3176-40b8-8610-038a40efdae7 service nova] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] No waiting events found dispatching network-vif-plugged-c538aab4-e12a-4800-b8a5-48dcf1124862 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:07:52 user nova-compute[75100]: WARNING nova.compute.manager [req-10f0d00d-2339-4d94-b853-421e96337bd1 req-c8fbf31e-3176-40b8-8610-038a40efdae7 service nova] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Received unexpected event network-vif-plugged-c538aab4-e12a-4800-b8a5-48dcf1124862 for instance with vm_state building and task_state spawning.
Nov 10 18:07:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:07:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:07:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:07:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:07:52 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Instance destroyed successfully.
Nov 10 18:07:52 user nova-compute[75100]: DEBUG nova.objects.instance [None req-47eaacb3-5ccf-43d5-a01e-9342c3da2def tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Lazy-loading 'resources' on Instance uuid fcc2bfb6-fd6b-4229-9664-42f33b138444 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:07:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-47eaacb3-5ccf-43d5-a01e-9342c3da2def tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:00:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1881005608',display_name='tempest-ServerStableDeviceRescueTest-server-1881005608',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1881005608',id=32,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDdFRCCVJjzF0al+SNDE7QVNwX8dpmNqM9NipR0GOwNcsjdYao4SsL1LfUC8C5UM4/qd1AeQBDezJxHm1binUeTwV3tWbJbrH4Uz3nBjNILZwiQ2cJMmyowJPFCnynvZfw==',key_name='tempest-keypair-1213048421',keypairs=<?>,launch_index=0,launched_at=2023-11-10T18:04:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2871e8755b32497d901be0f062fad858',ramdisk_id='',reservation_id='r-m01bxec1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-921350323',owner_user_name='tempest-ServerStableDeviceRescueTest-921350323-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T18:06:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ca4c02860b54cc68d0a7d1f6088cf8f',uuid=fcc2bfb6-fd6b-4229-9664-42f33b138444,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c7dcf78-fc4a-4fcb-905e-ce75143a9450", "address": "fa:16:3e:be:ec:38", "network": {"id": "20522623-c29d-44f8-9047-68dde7f763c1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1770250829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2871e8755b32497d901be0f062fad858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7dcf78-fc", "ovs_interfaceid": "8c7dcf78-fc4a-4fcb-905e-ce75143a9450", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 18:07:52 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-47eaacb3-5ccf-43d5-a01e-9342c3da2def tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Converting VIF {"id": "8c7dcf78-fc4a-4fcb-905e-ce75143a9450", "address": "fa:16:3e:be:ec:38", "network": {"id": "20522623-c29d-44f8-9047-68dde7f763c1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1770250829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2871e8755b32497d901be0f062fad858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7dcf78-fc", "ovs_interfaceid": "8c7dcf78-fc4a-4fcb-905e-ce75143a9450", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:07:52 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-47eaacb3-5ccf-43d5-a01e-9342c3da2def tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:be:ec:38,bridge_name='br-int',has_traffic_filtering=True,id=8c7dcf78-fc4a-4fcb-905e-ce75143a9450,network=Network(20522623-c29d-44f8-9047-68dde7f763c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c7dcf78-fc') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:07:52 user nova-compute[75100]: DEBUG os_vif [None req-47eaacb3-5ccf-43d5-a01e-9342c3da2def tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:ec:38,bridge_name='br-int',has_traffic_filtering=True,id=8c7dcf78-fc4a-4fcb-905e-ce75143a9450,network=Network(20522623-c29d-44f8-9047-68dde7f763c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c7dcf78-fc') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 18:07:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:07:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c7dcf78-fc, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:07:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:07:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:07:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e9a47dfc-a4de-4986-ab30-9945f51423de) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:07:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:07:52 user nova-compute[75100]: INFO os_vif [None req-47eaacb3-5ccf-43d5-a01e-9342c3da2def tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:ec:38,bridge_name='br-int',has_traffic_filtering=True,id=8c7dcf78-fc4a-4fcb-905e-ce75143a9450,network=Network(20522623-c29d-44f8-9047-68dde7f763c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c7dcf78-fc')
Nov 10 18:07:52 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-47eaacb3-5ccf-43d5-a01e-9342c3da2def tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Deleting instance files /opt/stack/data/nova/instances/fcc2bfb6-fd6b-4229-9664-42f33b138444_del
Nov 10 18:07:52 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-47eaacb3-5ccf-43d5-a01e-9342c3da2def tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Deletion of /opt/stack/data/nova/instances/fcc2bfb6-fd6b-4229-9664-42f33b138444_del complete
Nov 10 18:07:52 user nova-compute[75100]: INFO nova.compute.manager [None req-47eaacb3-5ccf-43d5-a01e-9342c3da2def tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Took 1.02 seconds to destroy the instance on the hypervisor.
Nov 10 18:07:52 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-47eaacb3-5ccf-43d5-a01e-9342c3da2def tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 18:07:52 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 18:07:52 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 18:07:53 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:07:53 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Took 0.64 seconds to deallocate network for instance.
Nov 10 18:07:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-47eaacb3-5ccf-43d5-a01e-9342c3da2def tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:07:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-47eaacb3-5ccf-43d5-a01e-9342c3da2def tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:07:53 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-47eaacb3-5ccf-43d5-a01e-9342c3da2def tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:07:53 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-47eaacb3-5ccf-43d5-a01e-9342c3da2def tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:07:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-47eaacb3-5ccf-43d5-a01e-9342c3da2def tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.333s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:07:53 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-47eaacb3-5ccf-43d5-a01e-9342c3da2def tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Deleted allocations for instance fcc2bfb6-fd6b-4229-9664-42f33b138444
Nov 10 18:07:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-47eaacb3-5ccf-43d5-a01e-9342c3da2def tempest-ServerStableDeviceRescueTest-921350323 tempest-ServerStableDeviceRescueTest-921350323-project-member] Lock "fcc2bfb6-fd6b-4229-9664-42f33b138444" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.190s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:07:54 user nova-compute[75100]: DEBUG nova.compute.manager [req-42c05430-7178-4dd9-91e2-1fb7415bb5de req-00cb6f8e-66e4-4e3f-8878-3d6142a86173 service nova] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Received event network-vif-plugged-8c7dcf78-fc4a-4fcb-905e-ce75143a9450 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:07:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-42c05430-7178-4dd9-91e2-1fb7415bb5de req-00cb6f8e-66e4-4e3f-8878-3d6142a86173 service nova] Acquiring lock "fcc2bfb6-fd6b-4229-9664-42f33b138444-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:07:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-42c05430-7178-4dd9-91e2-1fb7415bb5de req-00cb6f8e-66e4-4e3f-8878-3d6142a86173 service nova] Lock "fcc2bfb6-fd6b-4229-9664-42f33b138444-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:07:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-42c05430-7178-4dd9-91e2-1fb7415bb5de req-00cb6f8e-66e4-4e3f-8878-3d6142a86173 service nova] Lock "fcc2bfb6-fd6b-4229-9664-42f33b138444-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:07:54 user nova-compute[75100]: DEBUG nova.compute.manager [req-42c05430-7178-4dd9-91e2-1fb7415bb5de req-00cb6f8e-66e4-4e3f-8878-3d6142a86173 service nova] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] No waiting events found dispatching network-vif-plugged-8c7dcf78-fc4a-4fcb-905e-ce75143a9450 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:07:54 user nova-compute[75100]: WARNING nova.compute.manager [req-42c05430-7178-4dd9-91e2-1fb7415bb5de req-00cb6f8e-66e4-4e3f-8878-3d6142a86173 service nova] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Received unexpected event network-vif-plugged-8c7dcf78-fc4a-4fcb-905e-ce75143a9450 for instance with vm_state deleted and task_state None.
Nov 10 18:07:54 user nova-compute[75100]: DEBUG nova.compute.manager [req-b9870179-8729-43ba-a6c2-6a220c69181f req-8948473f-1554-4d60-993b-0684bd49e43e service nova] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Received event network-vif-plugged-c538aab4-e12a-4800-b8a5-48dcf1124862 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:07:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b9870179-8729-43ba-a6c2-6a220c69181f req-8948473f-1554-4d60-993b-0684bd49e43e service nova] Acquiring lock "aa469ab9-92c2-4e7f-ae66-bbe48b11511a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:07:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b9870179-8729-43ba-a6c2-6a220c69181f req-8948473f-1554-4d60-993b-0684bd49e43e service nova] Lock "aa469ab9-92c2-4e7f-ae66-bbe48b11511a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:07:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b9870179-8729-43ba-a6c2-6a220c69181f req-8948473f-1554-4d60-993b-0684bd49e43e service nova] Lock "aa469ab9-92c2-4e7f-ae66-bbe48b11511a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:07:54 user nova-compute[75100]: DEBUG nova.compute.manager [req-b9870179-8729-43ba-a6c2-6a220c69181f req-8948473f-1554-4d60-993b-0684bd49e43e service nova] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] No waiting events found dispatching network-vif-plugged-c538aab4-e12a-4800-b8a5-48dcf1124862 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:07:54 user nova-compute[75100]: WARNING nova.compute.manager [req-b9870179-8729-43ba-a6c2-6a220c69181f req-8948473f-1554-4d60-993b-0684bd49e43e service nova] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Received unexpected event network-vif-plugged-c538aab4-e12a-4800-b8a5-48dcf1124862 for instance with vm_state building and task_state spawning.
Nov 10 18:07:54 user nova-compute[75100]: DEBUG nova.compute.manager [req-b9870179-8729-43ba-a6c2-6a220c69181f req-8948473f-1554-4d60-993b-0684bd49e43e service nova] [instance: fcc2bfb6-fd6b-4229-9664-42f33b138444] Received event network-vif-deleted-8c7dcf78-fc4a-4fcb-905e-ce75143a9450 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:07:54 user nova-compute[75100]: DEBUG nova.compute.manager [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 18:07:54 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 18:07:54 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Instance spawned successfully.
Nov 10 18:07:54 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 18:07:54 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:07:54 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:07:54 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:07:54 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:07:54 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:07:54 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:07:54 user nova-compute[75100]: INFO nova.compute.manager [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Took 5.43 seconds to spawn the instance on the hypervisor.
Nov 10 18:07:54 user nova-compute[75100]: DEBUG nova.compute.manager [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 18:07:54 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:07:54 user nova-compute[75100]: INFO nova.compute.manager [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Took 32.58 seconds to build instance.
Nov 10 18:07:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c31e053d-eec9-4021-880b-8f3b44de475d tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "aa469ab9-92c2-4e7f-ae66-bbe48b11511a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 32.675s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:07:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:07:58 user nova-compute[75100]: DEBUG nova.compute.manager [req-ac31b748-7bba-4a81-8935-b8fbeba5e4ad req-85c9229e-e8da-4838-83ca-cd87cf30c2ea service nova] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Received event network-changed-c19c4cab-962c-4915-806a-9dbffdf4bfa4 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:07:58 user nova-compute[75100]: DEBUG nova.compute.manager [req-ac31b748-7bba-4a81-8935-b8fbeba5e4ad req-85c9229e-e8da-4838-83ca-cd87cf30c2ea service nova] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Refreshing instance network info cache due to event network-changed-c19c4cab-962c-4915-806a-9dbffdf4bfa4. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 18:07:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ac31b748-7bba-4a81-8935-b8fbeba5e4ad req-85c9229e-e8da-4838-83ca-cd87cf30c2ea service nova] Acquiring lock "refresh_cache-1937fab6-d892-406e-b8ff-52194021eea4" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:07:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ac31b748-7bba-4a81-8935-b8fbeba5e4ad req-85c9229e-e8da-4838-83ca-cd87cf30c2ea service nova] Acquired lock "refresh_cache-1937fab6-d892-406e-b8ff-52194021eea4" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:07:58 user nova-compute[75100]: DEBUG nova.network.neutron [req-ac31b748-7bba-4a81-8935-b8fbeba5e4ad req-85c9229e-e8da-4838-83ca-cd87cf30c2ea service nova] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Refreshing network info cache for port c19c4cab-962c-4915-806a-9dbffdf4bfa4 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 18:07:59 user nova-compute[75100]: DEBUG nova.network.neutron [req-ac31b748-7bba-4a81-8935-b8fbeba5e4ad req-85c9229e-e8da-4838-83ca-cd87cf30c2ea service nova] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Updated VIF entry in instance network info cache for port c19c4cab-962c-4915-806a-9dbffdf4bfa4. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 18:07:59 user nova-compute[75100]: DEBUG nova.network.neutron [req-ac31b748-7bba-4a81-8935-b8fbeba5e4ad req-85c9229e-e8da-4838-83ca-cd87cf30c2ea service nova] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Updating instance_info_cache with network_info: [{"id": "c19c4cab-962c-4915-806a-9dbffdf4bfa4", "address": "fa:16:3e:ba:d7:b9", "network": {"id": "78d86418-c0e0-4cc2-8f4f-262f600f7d66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2054827063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19cfb454e59745bf9c77d7a7ede2bc0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc19c4cab-96", "ovs_interfaceid": "c19c4cab-962c-4915-806a-9dbffdf4bfa4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:07:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ac31b748-7bba-4a81-8935-b8fbeba5e4ad req-85c9229e-e8da-4838-83ca-cd87cf30c2ea service nova] Releasing lock "refresh_cache-1937fab6-d892-406e-b8ff-52194021eea4" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:07:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:07:59 user nova-compute[75100]: DEBUG nova.compute.manager [req-166d7a0c-de1c-4dc9-a959-c817e11054fe req-9c3a5f8d-7517-47ba-8d3f-61409ee6a725 service nova] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Received event network-changed-c19c4cab-962c-4915-806a-9dbffdf4bfa4 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:07:59 user nova-compute[75100]: DEBUG nova.compute.manager [req-166d7a0c-de1c-4dc9-a959-c817e11054fe req-9c3a5f8d-7517-47ba-8d3f-61409ee6a725 service nova] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Refreshing instance network info cache due to event network-changed-c19c4cab-962c-4915-806a-9dbffdf4bfa4. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 18:07:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-166d7a0c-de1c-4dc9-a959-c817e11054fe req-9c3a5f8d-7517-47ba-8d3f-61409ee6a725 service nova] Acquiring lock "refresh_cache-1937fab6-d892-406e-b8ff-52194021eea4" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:07:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-166d7a0c-de1c-4dc9-a959-c817e11054fe req-9c3a5f8d-7517-47ba-8d3f-61409ee6a725 service nova] Acquired lock "refresh_cache-1937fab6-d892-406e-b8ff-52194021eea4" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:07:59 user nova-compute[75100]: DEBUG nova.network.neutron [req-166d7a0c-de1c-4dc9-a959-c817e11054fe req-9c3a5f8d-7517-47ba-8d3f-61409ee6a725 service nova] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Refreshing network info cache for port c19c4cab-962c-4915-806a-9dbffdf4bfa4 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 18:08:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2e2e49f0-8803-4415-af38-14ce541a4b54 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Acquiring lock "1937fab6-d892-406e-b8ff-52194021eea4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:08:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2e2e49f0-8803-4415-af38-14ce541a4b54 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "1937fab6-d892-406e-b8ff-52194021eea4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:08:00 user nova-compute[75100]: INFO nova.compute.manager [None req-2e2e49f0-8803-4415-af38-14ce541a4b54 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Detaching volume 48e48c44-c29c-4086-820f-2a8afbdcd6a8
Nov 10 18:08:00 user nova-compute[75100]: INFO nova.virt.block_device [None req-2e2e49f0-8803-4415-af38-14ce541a4b54 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Attempting to driver detach volume 48e48c44-c29c-4086-820f-2a8afbdcd6a8 from mountpoint /dev/vdb
Nov 10 18:08:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-2e2e49f0-8803-4415-af38-14ce541a4b54 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Attempting to detach device vdb from instance 1937fab6-d892-406e-b8ff-52194021eea4 from the persistent domain config. {{(pid=75100) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 18:08:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-2e2e49f0-8803-4415-af38-14ce541a4b54 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 18:08:00 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:08:00 user nova-compute[75100]:   <source dev="/dev/sde"/>
Nov 10 18:08:00 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 18:08:00 user nova-compute[75100]:   <serial>48e48c44-c29c-4086-820f-2a8afbdcd6a8</serial>
Nov 10 18:08:00 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 18:08:00 user nova-compute[75100]: </disk>
Nov 10 18:08:00 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 18:08:00 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-2e2e49f0-8803-4415-af38-14ce541a4b54 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Successfully detached device vdb from instance 1937fab6-d892-406e-b8ff-52194021eea4 from the persistent domain config.
Nov 10 18:08:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-2e2e49f0-8803-4415-af38-14ce541a4b54 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1937fab6-d892-406e-b8ff-52194021eea4 from the live domain config. {{(pid=75100) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 18:08:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-2e2e49f0-8803-4415-af38-14ce541a4b54 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 18:08:00 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:08:00 user nova-compute[75100]:   <source dev="/dev/sde"/>
Nov 10 18:08:00 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 18:08:00 user nova-compute[75100]:   <serial>48e48c44-c29c-4086-820f-2a8afbdcd6a8</serial>
Nov 10 18:08:00 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 18:08:00 user nova-compute[75100]: </disk>
Nov 10 18:08:00 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 18:08:00 user nova-compute[75100]: DEBUG nova.network.neutron [req-166d7a0c-de1c-4dc9-a959-c817e11054fe req-9c3a5f8d-7517-47ba-8d3f-61409ee6a725 service nova] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Updated VIF entry in instance network info cache for port c19c4cab-962c-4915-806a-9dbffdf4bfa4. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 18:08:00 user nova-compute[75100]: DEBUG nova.network.neutron [req-166d7a0c-de1c-4dc9-a959-c817e11054fe req-9c3a5f8d-7517-47ba-8d3f-61409ee6a725 service nova] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Updating instance_info_cache with network_info: [{"id": "c19c4cab-962c-4915-806a-9dbffdf4bfa4", "address": "fa:16:3e:ba:d7:b9", "network": {"id": "78d86418-c0e0-4cc2-8f4f-262f600f7d66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2054827063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19cfb454e59745bf9c77d7a7ede2bc0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc19c4cab-96", "ovs_interfaceid": "c19c4cab-962c-4915-806a-9dbffdf4bfa4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:08:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-166d7a0c-de1c-4dc9-a959-c817e11054fe req-9c3a5f8d-7517-47ba-8d3f-61409ee6a725 service nova] Releasing lock "refresh_cache-1937fab6-d892-406e-b8ff-52194021eea4" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:08:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-134c0598-70d7-44cd-9bb2-382c26679a0f tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Acquiring lock "4fb32aa2-0dbf-4f54-ae68-18c609604b53" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:08:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-134c0598-70d7-44cd-9bb2-382c26679a0f tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "4fb32aa2-0dbf-4f54-ae68-18c609604b53" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:08:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-134c0598-70d7-44cd-9bb2-382c26679a0f tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Acquiring lock "4fb32aa2-0dbf-4f54-ae68-18c609604b53-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:08:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-134c0598-70d7-44cd-9bb2-382c26679a0f tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "4fb32aa2-0dbf-4f54-ae68-18c609604b53-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:08:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-134c0598-70d7-44cd-9bb2-382c26679a0f tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "4fb32aa2-0dbf-4f54-ae68-18c609604b53-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:08:00 user nova-compute[75100]: INFO nova.compute.manager [None req-134c0598-70d7-44cd-9bb2-382c26679a0f tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] Terminating instance
Nov 10 18:08:00 user nova-compute[75100]: DEBUG nova.compute.manager [None req-134c0598-70d7-44cd-9bb2-382c26679a0f tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 18:08:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:08:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:08:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:08:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:08:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:08:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:08:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:08:01 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-2e2e49f0-8803-4415-af38-14ce541a4b54 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1937fab6-d892-406e-b8ff-52194021eea4 {{(pid=75100) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 18:08:01 user nova-compute[75100]: DEBUG nova.compute.manager [req-924ca429-f47f-49a2-884f-6c0811e8907a req-47bb415f-be54-44bb-99ac-ffd7631607c1 service nova] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] Received event network-changed-49cc2b3a-d37c-4602-ae33-9ebdccc70bf1 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:08:01 user nova-compute[75100]: DEBUG nova.compute.manager [req-924ca429-f47f-49a2-884f-6c0811e8907a req-47bb415f-be54-44bb-99ac-ffd7631607c1 service nova] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] Refreshing instance network info cache due to event network-changed-49cc2b3a-d37c-4602-ae33-9ebdccc70bf1. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 18:08:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-924ca429-f47f-49a2-884f-6c0811e8907a req-47bb415f-be54-44bb-99ac-ffd7631607c1 service nova] Acquiring lock "refresh_cache-4fb32aa2-0dbf-4f54-ae68-18c609604b53" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:08:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-924ca429-f47f-49a2-884f-6c0811e8907a req-47bb415f-be54-44bb-99ac-ffd7631607c1 service nova] Acquired lock "refresh_cache-4fb32aa2-0dbf-4f54-ae68-18c609604b53" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:08:01 user nova-compute[75100]: DEBUG nova.network.neutron [req-924ca429-f47f-49a2-884f-6c0811e8907a req-47bb415f-be54-44bb-99ac-ffd7631607c1 service nova] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] Refreshing network info cache for port 49cc2b3a-d37c-4602-ae33-9ebdccc70bf1 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 18:08:01 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] Instance destroyed successfully.
Nov 10 18:08:01 user nova-compute[75100]: DEBUG nova.objects.instance [None req-134c0598-70d7-44cd-9bb2-382c26679a0f tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lazy-loading 'resources' on Instance uuid 4fb32aa2-0dbf-4f54-ae68-18c609604b53 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:08:01 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-134c0598-70d7-44cd-9bb2-382c26679a0f tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:06:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1997728155',display_name='tempest-AttachVolumeNegativeTest-server-1997728155',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1997728155',id=40,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGXs+xcr6Dp/10m38ocV2E9/NKM/a+6C1eR/ftXwXw7noTv2gZ0DaneZJYlyODVW3rRCFX4GWP4NIIjlgrllRRDd+kwAuRq7UOP4jp2UBM5nvs7I3DvDIc+mIDt8uqkf1A==',key_name='tempest-keypair-3276225',keypairs=<?>,launch_index=0,launched_at=2023-11-10T18:06:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d4e5cb8bdc24a009dcb3dbee36a6bce',ramdisk_id='',reservation_id='r-rpqwzqud',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1395057280',owner_user_name='tempest-AttachVolumeNegativeTest-1395057280-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T18:06:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efe92a172011414e8507cb6ddbfab0bb',uuid=4fb32aa2-0dbf-4f54-ae68-18c609604b53,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "49cc2b3a-d37c-4602-ae33-9ebdccc70bf1", "address": "fa:16:3e:50:83:d1", "network": {"id": "e906a397-504d-48d8-8726-187cfbb1f270", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2095832274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4e5cb8bdc24a009dcb3dbee36a6bce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49cc2b3a-d3", "ovs_interfaceid": "49cc2b3a-d37c-4602-ae33-9ebdccc70bf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 18:08:01 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-134c0598-70d7-44cd-9bb2-382c26679a0f tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Converting VIF {"id": "49cc2b3a-d37c-4602-ae33-9ebdccc70bf1", "address": "fa:16:3e:50:83:d1", "network": {"id": "e906a397-504d-48d8-8726-187cfbb1f270", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2095832274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4e5cb8bdc24a009dcb3dbee36a6bce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49cc2b3a-d3", "ovs_interfaceid": "49cc2b3a-d37c-4602-ae33-9ebdccc70bf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:08:01 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-134c0598-70d7-44cd-9bb2-382c26679a0f tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:83:d1,bridge_name='br-int',has_traffic_filtering=True,id=49cc2b3a-d37c-4602-ae33-9ebdccc70bf1,network=Network(e906a397-504d-48d8-8726-187cfbb1f270),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49cc2b3a-d3') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:08:01 user nova-compute[75100]: DEBUG os_vif [None req-134c0598-70d7-44cd-9bb2-382c26679a0f tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:83:d1,bridge_name='br-int',has_traffic_filtering=True,id=49cc2b3a-d37c-4602-ae33-9ebdccc70bf1,network=Network(e906a397-504d-48d8-8726-187cfbb1f270),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49cc2b3a-d3') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 18:08:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:08:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:08:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap49cc2b3a-d3, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:08:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:08:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:08:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:08:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:08:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b3e8dd73-320a-42a9-b8f5-9bff0dd880ef) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:08:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:08:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:08:01 user nova-compute[75100]: INFO os_vif [None req-134c0598-70d7-44cd-9bb2-382c26679a0f tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:83:d1,bridge_name='br-int',has_traffic_filtering=True,id=49cc2b3a-d37c-4602-ae33-9ebdccc70bf1,network=Network(e906a397-504d-48d8-8726-187cfbb1f270),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49cc2b3a-d3')
Nov 10 18:08:01 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-134c0598-70d7-44cd-9bb2-382c26679a0f tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] Deleting instance files /opt/stack/data/nova/instances/4fb32aa2-0dbf-4f54-ae68-18c609604b53_del
Nov 10 18:08:01 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-134c0598-70d7-44cd-9bb2-382c26679a0f tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] Deletion of /opt/stack/data/nova/instances/4fb32aa2-0dbf-4f54-ae68-18c609604b53_del complete
Nov 10 18:08:01 user nova-compute[75100]: INFO nova.compute.manager [None req-134c0598-70d7-44cd-9bb2-382c26679a0f tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] Took 0.77 seconds to destroy the instance on the hypervisor.
Nov 10 18:08:01 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-134c0598-70d7-44cd-9bb2-382c26679a0f tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 18:08:01 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 18:08:01 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 18:08:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:08:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:08:01 user nova-compute[75100]: DEBUG nova.network.neutron [req-924ca429-f47f-49a2-884f-6c0811e8907a req-47bb415f-be54-44bb-99ac-ffd7631607c1 service nova] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] Updated VIF entry in instance network info cache for port 49cc2b3a-d37c-4602-ae33-9ebdccc70bf1. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 18:08:01 user nova-compute[75100]: DEBUG nova.network.neutron [req-924ca429-f47f-49a2-884f-6c0811e8907a req-47bb415f-be54-44bb-99ac-ffd7631607c1 service nova] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] Updating instance_info_cache with network_info: [{"id": "49cc2b3a-d37c-4602-ae33-9ebdccc70bf1", "address": "fa:16:3e:50:83:d1", "network": {"id": "e906a397-504d-48d8-8726-187cfbb1f270", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2095832274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4e5cb8bdc24a009dcb3dbee36a6bce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49cc2b3a-d3", "ovs_interfaceid": "49cc2b3a-d37c-4602-ae33-9ebdccc70bf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:08:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-924ca429-f47f-49a2-884f-6c0811e8907a req-47bb415f-be54-44bb-99ac-ffd7631607c1 service nova] Releasing lock "refresh_cache-4fb32aa2-0dbf-4f54-ae68-18c609604b53" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:08:02 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:08:02 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] Took 1.40 seconds to deallocate network for instance.
Nov 10 18:08:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-134c0598-70d7-44cd-9bb2-382c26679a0f tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:08:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-134c0598-70d7-44cd-9bb2-382c26679a0f tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:08:03 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-134c0598-70d7-44cd-9bb2-382c26679a0f tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:08:03 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-134c0598-70d7-44cd-9bb2-382c26679a0f tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:08:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-134c0598-70d7-44cd-9bb2-382c26679a0f tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.355s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:08:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-0290f41d-02a4-4a1d-9a4f-4dbf63bc6f8d req-39d14cc0-eb75-4854-87e5-36b09840b311 service nova] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] Received event network-vif-unplugged-49cc2b3a-d37c-4602-ae33-9ebdccc70bf1 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:08:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0290f41d-02a4-4a1d-9a4f-4dbf63bc6f8d req-39d14cc0-eb75-4854-87e5-36b09840b311 service nova] Acquiring lock "4fb32aa2-0dbf-4f54-ae68-18c609604b53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:08:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0290f41d-02a4-4a1d-9a4f-4dbf63bc6f8d req-39d14cc0-eb75-4854-87e5-36b09840b311 service nova] Lock "4fb32aa2-0dbf-4f54-ae68-18c609604b53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:08:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0290f41d-02a4-4a1d-9a4f-4dbf63bc6f8d req-39d14cc0-eb75-4854-87e5-36b09840b311 service nova] Lock "4fb32aa2-0dbf-4f54-ae68-18c609604b53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:08:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-0290f41d-02a4-4a1d-9a4f-4dbf63bc6f8d req-39d14cc0-eb75-4854-87e5-36b09840b311 service nova] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] No waiting events found dispatching network-vif-unplugged-49cc2b3a-d37c-4602-ae33-9ebdccc70bf1 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:08:03 user nova-compute[75100]: WARNING nova.compute.manager [req-0290f41d-02a4-4a1d-9a4f-4dbf63bc6f8d req-39d14cc0-eb75-4854-87e5-36b09840b311 service nova] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] Received unexpected event network-vif-unplugged-49cc2b3a-d37c-4602-ae33-9ebdccc70bf1 for instance with vm_state deleted and task_state None.
Nov 10 18:08:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-0290f41d-02a4-4a1d-9a4f-4dbf63bc6f8d req-39d14cc0-eb75-4854-87e5-36b09840b311 service nova] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] Received event network-vif-plugged-49cc2b3a-d37c-4602-ae33-9ebdccc70bf1 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:08:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0290f41d-02a4-4a1d-9a4f-4dbf63bc6f8d req-39d14cc0-eb75-4854-87e5-36b09840b311 service nova] Acquiring lock "4fb32aa2-0dbf-4f54-ae68-18c609604b53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:08:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0290f41d-02a4-4a1d-9a4f-4dbf63bc6f8d req-39d14cc0-eb75-4854-87e5-36b09840b311 service nova] Lock "4fb32aa2-0dbf-4f54-ae68-18c609604b53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:08:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0290f41d-02a4-4a1d-9a4f-4dbf63bc6f8d req-39d14cc0-eb75-4854-87e5-36b09840b311 service nova] Lock "4fb32aa2-0dbf-4f54-ae68-18c609604b53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:08:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-0290f41d-02a4-4a1d-9a4f-4dbf63bc6f8d req-39d14cc0-eb75-4854-87e5-36b09840b311 service nova] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] No waiting events found dispatching network-vif-plugged-49cc2b3a-d37c-4602-ae33-9ebdccc70bf1 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:08:03 user nova-compute[75100]: WARNING nova.compute.manager [req-0290f41d-02a4-4a1d-9a4f-4dbf63bc6f8d req-39d14cc0-eb75-4854-87e5-36b09840b311 service nova] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] Received unexpected event network-vif-plugged-49cc2b3a-d37c-4602-ae33-9ebdccc70bf1 for instance with vm_state deleted and task_state None.
Nov 10 18:08:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-0290f41d-02a4-4a1d-9a4f-4dbf63bc6f8d req-39d14cc0-eb75-4854-87e5-36b09840b311 service nova] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] Received event network-vif-plugged-49cc2b3a-d37c-4602-ae33-9ebdccc70bf1 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:08:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0290f41d-02a4-4a1d-9a4f-4dbf63bc6f8d req-39d14cc0-eb75-4854-87e5-36b09840b311 service nova] Acquiring lock "4fb32aa2-0dbf-4f54-ae68-18c609604b53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:08:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0290f41d-02a4-4a1d-9a4f-4dbf63bc6f8d req-39d14cc0-eb75-4854-87e5-36b09840b311 service nova] Lock "4fb32aa2-0dbf-4f54-ae68-18c609604b53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:08:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0290f41d-02a4-4a1d-9a4f-4dbf63bc6f8d req-39d14cc0-eb75-4854-87e5-36b09840b311 service nova] Lock "4fb32aa2-0dbf-4f54-ae68-18c609604b53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:08:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-0290f41d-02a4-4a1d-9a4f-4dbf63bc6f8d req-39d14cc0-eb75-4854-87e5-36b09840b311 service nova] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] No waiting events found dispatching network-vif-plugged-49cc2b3a-d37c-4602-ae33-9ebdccc70bf1 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:08:03 user nova-compute[75100]: WARNING nova.compute.manager [req-0290f41d-02a4-4a1d-9a4f-4dbf63bc6f8d req-39d14cc0-eb75-4854-87e5-36b09840b311 service nova] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] Received unexpected event network-vif-plugged-49cc2b3a-d37c-4602-ae33-9ebdccc70bf1 for instance with vm_state deleted and task_state None.
Nov 10 18:08:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-0290f41d-02a4-4a1d-9a4f-4dbf63bc6f8d req-39d14cc0-eb75-4854-87e5-36b09840b311 service nova] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] Received event network-vif-plugged-49cc2b3a-d37c-4602-ae33-9ebdccc70bf1 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:08:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0290f41d-02a4-4a1d-9a4f-4dbf63bc6f8d req-39d14cc0-eb75-4854-87e5-36b09840b311 service nova] Acquiring lock "4fb32aa2-0dbf-4f54-ae68-18c609604b53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:08:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0290f41d-02a4-4a1d-9a4f-4dbf63bc6f8d req-39d14cc0-eb75-4854-87e5-36b09840b311 service nova] Lock "4fb32aa2-0dbf-4f54-ae68-18c609604b53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:08:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0290f41d-02a4-4a1d-9a4f-4dbf63bc6f8d req-39d14cc0-eb75-4854-87e5-36b09840b311 service nova] Lock "4fb32aa2-0dbf-4f54-ae68-18c609604b53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:08:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-0290f41d-02a4-4a1d-9a4f-4dbf63bc6f8d req-39d14cc0-eb75-4854-87e5-36b09840b311 service nova] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] No waiting events found dispatching network-vif-plugged-49cc2b3a-d37c-4602-ae33-9ebdccc70bf1 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:08:03 user nova-compute[75100]: WARNING nova.compute.manager [req-0290f41d-02a4-4a1d-9a4f-4dbf63bc6f8d req-39d14cc0-eb75-4854-87e5-36b09840b311 service nova] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] Received unexpected event network-vif-plugged-49cc2b3a-d37c-4602-ae33-9ebdccc70bf1 for instance with vm_state deleted and task_state None.
Nov 10 18:08:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-0290f41d-02a4-4a1d-9a4f-4dbf63bc6f8d req-39d14cc0-eb75-4854-87e5-36b09840b311 service nova] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] Received event network-vif-plugged-49cc2b3a-d37c-4602-ae33-9ebdccc70bf1 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:08:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0290f41d-02a4-4a1d-9a4f-4dbf63bc6f8d req-39d14cc0-eb75-4854-87e5-36b09840b311 service nova] Acquiring lock "4fb32aa2-0dbf-4f54-ae68-18c609604b53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:08:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0290f41d-02a4-4a1d-9a4f-4dbf63bc6f8d req-39d14cc0-eb75-4854-87e5-36b09840b311 service nova] Lock "4fb32aa2-0dbf-4f54-ae68-18c609604b53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:08:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0290f41d-02a4-4a1d-9a4f-4dbf63bc6f8d req-39d14cc0-eb75-4854-87e5-36b09840b311 service nova] Lock "4fb32aa2-0dbf-4f54-ae68-18c609604b53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:08:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-0290f41d-02a4-4a1d-9a4f-4dbf63bc6f8d req-39d14cc0-eb75-4854-87e5-36b09840b311 service nova] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] No waiting events found dispatching network-vif-plugged-49cc2b3a-d37c-4602-ae33-9ebdccc70bf1 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:08:03 user nova-compute[75100]: WARNING nova.compute.manager [req-0290f41d-02a4-4a1d-9a4f-4dbf63bc6f8d req-39d14cc0-eb75-4854-87e5-36b09840b311 service nova] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] Received unexpected event network-vif-plugged-49cc2b3a-d37c-4602-ae33-9ebdccc70bf1 for instance with vm_state deleted and task_state None.
Nov 10 18:08:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-0290f41d-02a4-4a1d-9a4f-4dbf63bc6f8d req-39d14cc0-eb75-4854-87e5-36b09840b311 service nova] [instance: 4fb32aa2-0dbf-4f54-ae68-18c609604b53] Received event network-vif-deleted-49cc2b3a-d37c-4602-ae33-9ebdccc70bf1 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:08:03 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-134c0598-70d7-44cd-9bb2-382c26679a0f tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Deleted allocations for instance 4fb32aa2-0dbf-4f54-ae68-18c609604b53
Nov 10 18:08:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-134c0598-70d7-44cd-9bb2-382c26679a0f tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "4fb32aa2-0dbf-4f54-ae68-18c609604b53" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.768s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:08:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:08:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:08:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:08:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:08:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a1dafd6e-e84b-45d6-aff1-264961d46f5b tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Acquiring lock "4ebd9d80-365d-4334-8421-3b22a846321a" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:08:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a1dafd6e-e84b-45d6-aff1-264961d46f5b tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "4ebd9d80-365d-4334-8421-3b22a846321a" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:08:12 user nova-compute[75100]: DEBUG nova.compute.manager [None req-a1dafd6e-e84b-45d6-aff1-264961d46f5b tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Going to confirm migration 2 {{(pid=75100) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 10 18:08:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a1dafd6e-e84b-45d6-aff1-264961d46f5b tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Acquiring lock "refresh_cache-4ebd9d80-365d-4334-8421-3b22a846321a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:08:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a1dafd6e-e84b-45d6-aff1-264961d46f5b tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Acquired lock "refresh_cache-4ebd9d80-365d-4334-8421-3b22a846321a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:08:13 user nova-compute[75100]: DEBUG nova.network.neutron [None req-a1dafd6e-e84b-45d6-aff1-264961d46f5b tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 18:08:13 user nova-compute[75100]: DEBUG nova.objects.instance [None req-a1dafd6e-e84b-45d6-aff1-264961d46f5b tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lazy-loading 'info_cache' on Instance uuid 4ebd9d80-365d-4334-8421-3b22a846321a {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:08:13 user nova-compute[75100]: DEBUG nova.network.neutron [None req-a1dafd6e-e84b-45d6-aff1-264961d46f5b tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Updating instance_info_cache with network_info: [{"id": "c9011ff5-53de-43f3-be8e-ba86274b2c99", "address": "fa:16:3e:a7:f8:6b", "network": {"id": "bf1edb58-ef26-40ca-8ec9-853fa05de13d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1416469583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7bb141ef59487dbb2ce6243c5002af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9011ff5-53", "ovs_interfaceid": "c9011ff5-53de-43f3-be8e-ba86274b2c99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:08:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a1dafd6e-e84b-45d6-aff1-264961d46f5b tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Releasing lock "refresh_cache-4ebd9d80-365d-4334-8421-3b22a846321a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:08:13 user nova-compute[75100]: DEBUG nova.objects.instance [None req-a1dafd6e-e84b-45d6-aff1-264961d46f5b tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lazy-loading 'migration_context' on Instance uuid 4ebd9d80-365d-4334-8421-3b22a846321a {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:08:13 user nova-compute[75100]: DEBUG nova.objects.base [None req-a1dafd6e-e84b-45d6-aff1-264961d46f5b tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Object Instance<4ebd9d80-365d-4334-8421-3b22a846321a> lazy-loaded attributes: info_cache,migration_context {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 18:08:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a1dafd6e-e84b-45d6-aff1-264961d46f5b tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:08:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a1dafd6e-e84b-45d6-aff1-264961d46f5b tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:08:13 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-a1dafd6e-e84b-45d6-aff1-264961d46f5b tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:08:13 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-a1dafd6e-e84b-45d6-aff1-264961d46f5b tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:08:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a1dafd6e-e84b-45d6-aff1-264961d46f5b tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.332s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:08:14 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-a1dafd6e-e84b-45d6-aff1-264961d46f5b tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Deleted allocation for migration ba414159-d274-4472-b362-fccac93007d8
Nov 10 18:08:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a1dafd6e-e84b-45d6-aff1-264961d46f5b tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "4ebd9d80-365d-4334-8421-3b22a846321a" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.240s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:08:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:08:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:08:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:08:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-942458a1-1cc7-4842-8a14-6cb0a58901be tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Acquiring lock "7bc34cf6-1f79-4127-8c35-0ae2d93406ff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:08:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-942458a1-1cc7-4842-8a14-6cb0a58901be tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Lock "7bc34cf6-1f79-4127-8c35-0ae2d93406ff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:08:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-942458a1-1cc7-4842-8a14-6cb0a58901be tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Acquiring lock "7bc34cf6-1f79-4127-8c35-0ae2d93406ff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:08:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-942458a1-1cc7-4842-8a14-6cb0a58901be tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Lock "7bc34cf6-1f79-4127-8c35-0ae2d93406ff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:08:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-942458a1-1cc7-4842-8a14-6cb0a58901be tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Lock "7bc34cf6-1f79-4127-8c35-0ae2d93406ff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:08:20 user nova-compute[75100]: INFO nova.compute.manager [None req-942458a1-1cc7-4842-8a14-6cb0a58901be tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 7bc34cf6-1f79-4127-8c35-0ae2d93406ff] Terminating instance
Nov 10 18:08:20 user nova-compute[75100]: DEBUG nova.compute.manager [None req-942458a1-1cc7-4842-8a14-6cb0a58901be tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 7bc34cf6-1f79-4127-8c35-0ae2d93406ff] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 18:08:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:08:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:08:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:08:21 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-2e2e49f0-8803-4415-af38-14ce541a4b54 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1937fab6-d892-406e-b8ff-52194021eea4 is timed out.
Nov 10 18:08:21 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-2e2e49f0-8803-4415-af38-14ce541a4b54 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Successfully detached device vdb from instance 1937fab6-d892-406e-b8ff-52194021eea4 from the live domain config.
Nov 10 18:08:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e2e49f0-8803-4415-af38-14ce541a4b54 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2e49f0-8803-4415-af38-14ce541a4b54 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, {'target_iqn': 'iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'abviHDfP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:08:21 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-2e2e49f0-8803-4415-af38-14ce541a4b54 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:08:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-2e2e49f0-8803-4415-af38-14ce541a4b54 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-2e2e49f0-8803-4415-af38-14ce541a4b54 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6570dda3-f4a1-4467-b6d0-2a65aeff05e3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb1593e0-4a1c-4ae3-8e97-7ae6215f8143\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2e49f0-8803-4415-af38-14ce541a4b54 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 18:08:21 user nova-compute[75100]: No targets found.
Nov 10 18:08:21 user nova-compute[75100]: iSNS:
Nov 10 18:08:21 user nova-compute[75100]: No targets found.
Nov 10 18:08:21 user nova-compute[75100]: STATIC:
Nov 10 18:08:21 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8
Nov 10 18:08:21 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:08:21 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:08:21 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf
Nov 10 18:08:21 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:08:21 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:08:21 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:fb1593e0-4a1c-4ae3-8e97-7ae6215f8143
Nov 10 18:08:21 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:08:21 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:08:21 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005
Nov 10 18:08:21 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:08:21 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:08:21 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7
Nov 10 18:08:21 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:08:21 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:08:21 user nova-compute[75100]: FIRMWARE:
Nov 10 18:08:21 user nova-compute[75100]: No targets found.
Nov 10 18:08:21 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2e49f0-8803-4415-af38-14ce541a4b54 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 18:08:21 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 18:08:21 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2e49f0-8803-4415-af38-14ce541a4b54 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[de62c5bf-231d-4209-addc-921db06b11d0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb1593e0-4a1c-4ae3-8e97-7ae6215f8143\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f022b574-3aca-4d6b-b40b-bdbb71d4fed6]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1593e0-4a1c-4ae3-8e97-7ae6215f8143 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2e49f0-8803-4415-af38-14ce541a4b54 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 (non-flash)
Nov 10 18:08:21 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8 (non-flash)
Nov 10 18:08:21 user nova-compute[75100]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf (non-flash)
Nov 10 18:08:21 user nova-compute[75100]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)
Nov 10 18:08:21 user nova-compute[75100]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1593e0-4a1c-4ae3-8e97-7ae6215f8143 (non-flash)
Nov 10 18:08:21 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2e49f0-8803-4415-af38-14ce541a4b54 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 (non-flash)
Nov 10 18:08:21 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8 (non-flash)
Nov 10 18:08:21 user nova-compute[75100]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf (non-flash)
Nov 10 18:08:21 user nova-compute[75100]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)
Nov 10 18:08:21 user nova-compute[75100]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1593e0-4a1c-4ae3-8e97-7ae6215f8143 (non-flash)
Nov 10 18:08:21 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2e49f0-8803-4415-af38-14ce541a4b54 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3986f31c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8'): ({'sde'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-2e2e49f0-8803-4415-af38-14ce541a4b54 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Removing single pathed devices sde {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f01e35d4-a447-4a21-a06b-2c8cef0006d8]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[36daea36-7acc-4b40-b153-ee575d1f9b35]: (4, ('ok\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-2e2e49f0-8803-4415-af38-14ce541a4b54 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Flushing IO for device /dev/sde {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG nova.compute.manager [req-eab02f63-8e37-4c69-95b7-00a6b0edd6ee req-695397b4-5ca3-4325-8779-7fa0b1648c47 service nova] [instance: 7bc34cf6-1f79-4127-8c35-0ae2d93406ff] Received event network-vif-unplugged-3d66e837-0a05-47ec-9605-5eb2973203d5 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-eab02f63-8e37-4c69-95b7-00a6b0edd6ee req-695397b4-5ca3-4325-8779-7fa0b1648c47 service nova] Acquiring lock "7bc34cf6-1f79-4127-8c35-0ae2d93406ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-eab02f63-8e37-4c69-95b7-00a6b0edd6ee req-695397b4-5ca3-4325-8779-7fa0b1648c47 service nova] Lock "7bc34cf6-1f79-4127-8c35-0ae2d93406ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-eab02f63-8e37-4c69-95b7-00a6b0edd6ee req-695397b4-5ca3-4325-8779-7fa0b1648c47 service nova] Lock "7bc34cf6-1f79-4127-8c35-0ae2d93406ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG nova.compute.manager [req-eab02f63-8e37-4c69-95b7-00a6b0edd6ee req-695397b4-5ca3-4325-8779-7fa0b1648c47 service nova] [instance: 7bc34cf6-1f79-4127-8c35-0ae2d93406ff] No waiting events found dispatching network-vif-unplugged-3d66e837-0a05-47ec-9605-5eb2973203d5 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG nova.compute.manager [req-eab02f63-8e37-4c69-95b7-00a6b0edd6ee req-695397b4-5ca3-4325-8779-7fa0b1648c47 service nova] [instance: 7bc34cf6-1f79-4127-8c35-0ae2d93406ff] Received event network-vif-unplugged-3d66e837-0a05-47ec-9605-5eb2973203d5 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[797292c5-915e-4f03-add0-5fe9e1bdebd0]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-2e2e49f0-8803-4415-af38-14ce541a4b54 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.037s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd303134-fc36-407a-bffc-862cc0f41493]: (4, ('1', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-2e2e49f0-8803-4415-af38-14ce541a4b54 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-2e2e49f0-8803-4415-af38-14ce541a4b54 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] SCSI volumes sde have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2e49f0-8803-4415-af38-14ce541a4b54 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4699f1c2-2e37-4a3b-8249-33f9eca75ee6]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2e49f0-8803-4415-af38-14ce541a4b54 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8 -p 172.16.0.220:3260 --logout {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc66ac7-3b5a-4d0c-bb18-eb62c7b7f81e]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2e49f0-8803-4415-af38-14ce541a4b54 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8, portal: 172.16.0.220,3260]
Nov 10 18:08:21 user nova-compute[75100]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8, portal: 172.16.0.220,3260] successful.
Nov 10 18:08:21 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8 -p 172.16.0.220:3260 --op delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48e48c44-c29c-4086-820f-2a8afbdcd6a8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f564f02-3e96-49ac-9fc7-cdf250fa7851]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2e49f0-8803-4415-af38-14ce541a4b54 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-2e2e49f0-8803-4415-af38-14ce541a4b54 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2e49f0-8803-4415-af38-14ce541a4b54 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] <== disconnect_volume: return (345ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e2e49f0-8803-4415-af38-14ce541a4b54 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 18:08:21 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 7bc34cf6-1f79-4127-8c35-0ae2d93406ff] Instance destroyed successfully.
Nov 10 18:08:21 user nova-compute[75100]: DEBUG nova.objects.instance [None req-942458a1-1cc7-4842-8a14-6cb0a58901be tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Lazy-loading 'resources' on Instance uuid 7bc34cf6-1f79-4127-8c35-0ae2d93406ff {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-942458a1-1cc7-4842-8a14-6cb0a58901be tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:06:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1119078084',display_name='tempest-VolumesActionsTest-instance-1119078084',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1119078084',id=41,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T18:06:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='42e369208c0a486fa4cceb6de3620b6a',ramdisk_id='',reservation_id='r-u280l67a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-275059269',owner_user_name='tempest-VolumesActionsTest-275059269-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T18:06:37Z,user_data=None,user_id='130a36dd61074d99855f44d5ebb20eb3',uuid=7bc34cf6-1f79-4127-8c35-0ae2d93406ff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d66e837-0a05-47ec-9605-5eb2973203d5", "address": "fa:16:3e:1b:7b:f6", "network": {"id": "f22ce8bd-85d3-4596-849e-9e04d728af34", "bridge": "br-int", "label": "tempest-VolumesActionsTest-979416963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42e369208c0a486fa4cceb6de3620b6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d66e837-0a", "ovs_interfaceid": "3d66e837-0a05-47ec-9605-5eb2973203d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-942458a1-1cc7-4842-8a14-6cb0a58901be tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Converting VIF {"id": "3d66e837-0a05-47ec-9605-5eb2973203d5", "address": "fa:16:3e:1b:7b:f6", "network": {"id": "f22ce8bd-85d3-4596-849e-9e04d728af34", "bridge": "br-int", "label": "tempest-VolumesActionsTest-979416963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42e369208c0a486fa4cceb6de3620b6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d66e837-0a", "ovs_interfaceid": "3d66e837-0a05-47ec-9605-5eb2973203d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-942458a1-1cc7-4842-8a14-6cb0a58901be tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:7b:f6,bridge_name='br-int',has_traffic_filtering=True,id=3d66e837-0a05-47ec-9605-5eb2973203d5,network=Network(f22ce8bd-85d3-4596-849e-9e04d728af34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d66e837-0a') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG os_vif [None req-942458a1-1cc7-4842-8a14-6cb0a58901be tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:7b:f6,bridge_name='br-int',has_traffic_filtering=True,id=3d66e837-0a05-47ec-9605-5eb2973203d5,network=Network(f22ce8bd-85d3-4596-849e-9e04d728af34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d66e837-0a') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d66e837-0a, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=660d5ea9-4a1f-42cd-a69a-da600b48b942) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:08:21 user nova-compute[75100]: INFO os_vif [None req-942458a1-1cc7-4842-8a14-6cb0a58901be tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:7b:f6,bridge_name='br-int',has_traffic_filtering=True,id=3d66e837-0a05-47ec-9605-5eb2973203d5,network=Network(f22ce8bd-85d3-4596-849e-9e04d728af34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d66e837-0a')
Nov 10 18:08:21 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-942458a1-1cc7-4842-8a14-6cb0a58901be tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 7bc34cf6-1f79-4127-8c35-0ae2d93406ff] Deleting instance files /opt/stack/data/nova/instances/7bc34cf6-1f79-4127-8c35-0ae2d93406ff_del
Nov 10 18:08:21 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-942458a1-1cc7-4842-8a14-6cb0a58901be tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 7bc34cf6-1f79-4127-8c35-0ae2d93406ff] Deletion of /opt/stack/data/nova/instances/7bc34cf6-1f79-4127-8c35-0ae2d93406ff_del complete
Nov 10 18:08:21 user nova-compute[75100]: INFO nova.compute.manager [None req-942458a1-1cc7-4842-8a14-6cb0a58901be tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 7bc34cf6-1f79-4127-8c35-0ae2d93406ff] Took 0.68 seconds to destroy the instance on the hypervisor.
Nov 10 18:08:21 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-942458a1-1cc7-4842-8a14-6cb0a58901be tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: 7bc34cf6-1f79-4127-8c35-0ae2d93406ff] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 7bc34cf6-1f79-4127-8c35-0ae2d93406ff] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 18:08:21 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 7bc34cf6-1f79-4127-8c35-0ae2d93406ff] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:08:21 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: 7bc34cf6-1f79-4127-8c35-0ae2d93406ff] Took 0.38 seconds to deallocate network for instance.
Nov 10 18:08:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-942458a1-1cc7-4842-8a14-6cb0a58901be tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:08:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-942458a1-1cc7-4842-8a14-6cb0a58901be tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:08:22 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-942458a1-1cc7-4842-8a14-6cb0a58901be tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:08:22 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-942458a1-1cc7-4842-8a14-6cb0a58901be tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:08:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-942458a1-1cc7-4842-8a14-6cb0a58901be tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.265s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:08:22 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-942458a1-1cc7-4842-8a14-6cb0a58901be tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Deleted allocations for instance 7bc34cf6-1f79-4127-8c35-0ae2d93406ff
Nov 10 18:08:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-942458a1-1cc7-4842-8a14-6cb0a58901be tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Lock "7bc34cf6-1f79-4127-8c35-0ae2d93406ff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.547s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:08:22 user nova-compute[75100]: DEBUG nova.objects.instance [None req-2e2e49f0-8803-4415-af38-14ce541a4b54 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lazy-loading 'flavor' on Instance uuid 1937fab6-d892-406e-b8ff-52194021eea4 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:08:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2e2e49f0-8803-4415-af38-14ce541a4b54 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "1937fab6-d892-406e-b8ff-52194021eea4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.421s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:08:23 user nova-compute[75100]: DEBUG nova.compute.manager [req-c412bc4c-d589-4b0e-b4a5-b5a9930d7283 req-5377aff6-e206-49ed-bd12-2576b3544244 service nova] [instance: 7bc34cf6-1f79-4127-8c35-0ae2d93406ff] Received event network-vif-plugged-3d66e837-0a05-47ec-9605-5eb2973203d5 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:08:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c412bc4c-d589-4b0e-b4a5-b5a9930d7283 req-5377aff6-e206-49ed-bd12-2576b3544244 service nova] Acquiring lock "7bc34cf6-1f79-4127-8c35-0ae2d93406ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:08:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c412bc4c-d589-4b0e-b4a5-b5a9930d7283 req-5377aff6-e206-49ed-bd12-2576b3544244 service nova] Lock "7bc34cf6-1f79-4127-8c35-0ae2d93406ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:08:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c412bc4c-d589-4b0e-b4a5-b5a9930d7283 req-5377aff6-e206-49ed-bd12-2576b3544244 service nova] Lock "7bc34cf6-1f79-4127-8c35-0ae2d93406ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:08:23 user nova-compute[75100]: DEBUG nova.compute.manager [req-c412bc4c-d589-4b0e-b4a5-b5a9930d7283 req-5377aff6-e206-49ed-bd12-2576b3544244 service nova] [instance: 7bc34cf6-1f79-4127-8c35-0ae2d93406ff] No waiting events found dispatching network-vif-plugged-3d66e837-0a05-47ec-9605-5eb2973203d5 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:08:23 user nova-compute[75100]: WARNING nova.compute.manager [req-c412bc4c-d589-4b0e-b4a5-b5a9930d7283 req-5377aff6-e206-49ed-bd12-2576b3544244 service nova] [instance: 7bc34cf6-1f79-4127-8c35-0ae2d93406ff] Received unexpected event network-vif-plugged-3d66e837-0a05-47ec-9605-5eb2973203d5 for instance with vm_state deleted and task_state None.
Nov 10 18:08:23 user nova-compute[75100]: DEBUG nova.compute.manager [req-c412bc4c-d589-4b0e-b4a5-b5a9930d7283 req-5377aff6-e206-49ed-bd12-2576b3544244 service nova] [instance: 7bc34cf6-1f79-4127-8c35-0ae2d93406ff] Received event network-vif-deleted-3d66e837-0a05-47ec-9605-5eb2973203d5 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:08:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:08:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:08:27 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:08:27 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:08:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:08:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:08:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:08:27 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 18:08:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 18:08:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0bae328-2528-4562-850b-14fa108923c6/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:08:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0bae328-2528-4562-850b-14fa108923c6/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:08:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0bae328-2528-4562-850b-14fa108923c6/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:08:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0bae328-2528-4562-850b-14fa108923c6/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:08:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 18:08:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:08:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:08:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:08:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:08:28 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 18:08:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1937fab6-d892-406e-b8ff-52194021eea4/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:08:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1937fab6-d892-406e-b8ff-52194021eea4/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:08:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1937fab6-d892-406e-b8ff-52194021eea4/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:08:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1937fab6-d892-406e-b8ff-52194021eea4/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:08:28 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 18:08:29 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:08:29 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:08:29 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Hypervisor/Node resource view: name=user free_ram=7955MB free_disk=24.424354553222656GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 18:08:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:08:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:08:29 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:08:29 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance b0bae328-2528-4562-850b-14fa108923c6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:08:29 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 1937fab6-d892-406e-b8ff-52194021eea4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:08:29 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance dc8c4fa7-668a-4348-be16-9eb06420b01f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:08:29 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 4ebd9d80-365d-4334-8421-3b22a846321a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:08:29 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance aa469ab9-92c2-4e7f-ae66-bbe48b11511a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:08:29 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 18:08:29 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 18:08:29 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:08:29 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:08:29 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 18:08:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.366s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:08:30 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:08:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:08:35 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:08:36 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:08:36 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:08:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:08:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:08:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:08:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:08:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:08:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:08:37 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:08:41 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:08:41 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 18:08:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "refresh_cache-4ebd9d80-365d-4334-8421-3b22a846321a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:08:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquired lock "refresh_cache-4ebd9d80-365d-4334-8421-3b22a846321a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:08:41 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 18:08:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:08:41 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Updating instance_info_cache with network_info: [{"id": "c9011ff5-53de-43f3-be8e-ba86274b2c99", "address": "fa:16:3e:a7:f8:6b", "network": {"id": "bf1edb58-ef26-40ca-8ec9-853fa05de13d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1416469583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7bb141ef59487dbb2ce6243c5002af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9011ff5-53", "ovs_interfaceid": "c9011ff5-53de-43f3-be8e-ba86274b2c99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:08:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Releasing lock "refresh_cache-4ebd9d80-365d-4334-8421-3b22a846321a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:08:41 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 18:08:41 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:08:41 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 18:08:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:08:43 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:08:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:08:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:08:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4796687f-1767-468e-a5f7-6e07d0327fae tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Acquiring lock "b0bae328-2528-4562-850b-14fa108923c6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:08:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4796687f-1767-468e-a5f7-6e07d0327fae tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "b0bae328-2528-4562-850b-14fa108923c6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:08:52 user nova-compute[75100]: INFO nova.compute.manager [None req-4796687f-1767-468e-a5f7-6e07d0327fae tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: b0bae328-2528-4562-850b-14fa108923c6] Detaching volume 8c1a4aa0-d680-4608-b4a4-56115b4d5cbf
Nov 10 18:08:52 user nova-compute[75100]: INFO nova.virt.block_device [None req-4796687f-1767-468e-a5f7-6e07d0327fae tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: b0bae328-2528-4562-850b-14fa108923c6] Attempting to driver detach volume 8c1a4aa0-d680-4608-b4a4-56115b4d5cbf from mountpoint /dev/vdb
Nov 10 18:08:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4796687f-1767-468e-a5f7-6e07d0327fae tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Attempting to detach device vdb from instance b0bae328-2528-4562-850b-14fa108923c6 from the persistent domain config. {{(pid=75100) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 18:08:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-4796687f-1767-468e-a5f7-6e07d0327fae tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 18:08:52 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:08:52 user nova-compute[75100]:   <source dev="/dev/sdg"/>
Nov 10 18:08:52 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 18:08:52 user nova-compute[75100]:   <serial>8c1a4aa0-d680-4608-b4a4-56115b4d5cbf</serial>
Nov 10 18:08:52 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 18:08:52 user nova-compute[75100]: </disk>
Nov 10 18:08:52 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 18:08:52 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-4796687f-1767-468e-a5f7-6e07d0327fae tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Successfully detached device vdb from instance b0bae328-2528-4562-850b-14fa108923c6 from the persistent domain config.
Nov 10 18:08:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4796687f-1767-468e-a5f7-6e07d0327fae tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b0bae328-2528-4562-850b-14fa108923c6 from the live domain config. {{(pid=75100) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 18:08:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-4796687f-1767-468e-a5f7-6e07d0327fae tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 18:08:52 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:08:52 user nova-compute[75100]:   <source dev="/dev/sdg"/>
Nov 10 18:08:52 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 18:08:52 user nova-compute[75100]:   <serial>8c1a4aa0-d680-4608-b4a4-56115b4d5cbf</serial>
Nov 10 18:08:52 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 18:08:52 user nova-compute[75100]: </disk>
Nov 10 18:08:52 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 18:08:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4796687f-1767-468e-a5f7-6e07d0327fae tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b0bae328-2528-4562-850b-14fa108923c6 {{(pid=75100) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 18:08:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:08:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:08:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:08:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:08:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:08:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:09:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:09:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5650221a-c6cf-422b-bd38-380bf530c881 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Acquiring lock "1937fab6-d892-406e-b8ff-52194021eea4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:09:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5650221a-c6cf-422b-bd38-380bf530c881 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "1937fab6-d892-406e-b8ff-52194021eea4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:09:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5650221a-c6cf-422b-bd38-380bf530c881 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Acquiring lock "1937fab6-d892-406e-b8ff-52194021eea4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:09:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5650221a-c6cf-422b-bd38-380bf530c881 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "1937fab6-d892-406e-b8ff-52194021eea4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:09:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5650221a-c6cf-422b-bd38-380bf530c881 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "1937fab6-d892-406e-b8ff-52194021eea4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:09:03 user nova-compute[75100]: INFO nova.compute.manager [None req-5650221a-c6cf-422b-bd38-380bf530c881 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Terminating instance
Nov 10 18:09:03 user nova-compute[75100]: DEBUG nova.compute.manager [None req-5650221a-c6cf-422b-bd38-380bf530c881 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 18:09:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:09:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:09:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:09:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:09:04 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Instance destroyed successfully.
Nov 10 18:09:04 user nova-compute[75100]: DEBUG nova.objects.instance [None req-5650221a-c6cf-422b-bd38-380bf530c881 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lazy-loading 'resources' on Instance uuid 1937fab6-d892-406e-b8ff-52194021eea4 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:09:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-5650221a-c6cf-422b-bd38-380bf530c881 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:03:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-550712417',display_name='tempest-TestMinimumBasicScenario-server-550712417',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-550712417',id=37,image_ref='58ffe2f6-bf44-41f2-8818-788e8006c7a3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbHMZ/csSY9p+GduPtuiqFIhYNllnC3slobeatmB+uPE9c+Afr9UfpO7kdA+O9NN0RauKt1vhBXu2JQ7B4+8FD+GLdH4CQGjuZaKNVoAdd5YzFm4CKGoGlEpfA3dSUkrg==',key_name='tempest-TestMinimumBasicScenario-1493594938',keypairs=<?>,launch_index=0,launched_at=2023-11-10T18:03:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='19cfb454e59745bf9c77d7a7ede2bc0e',ramdisk_id='',reservation_id='r-8qlus30s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='58ffe2f6-bf44-41f2-8818-788e8006c7a3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-281006384',owner_user_name='tempest-TestMinimumBasicScenario-281006384-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T18:06:14Z,user_data=None,user_id='4d873ec5a11a4ccdb868fef673ffc568',uuid=1937fab6-d892-406e-b8ff-52194021eea4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c19c4cab-962c-4915-806a-9dbffdf4bfa4", "address": "fa:16:3e:ba:d7:b9", "network": {"id": "78d86418-c0e0-4cc2-8f4f-262f600f7d66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2054827063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19cfb454e59745bf9c77d7a7ede2bc0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc19c4cab-96", "ovs_interfaceid": "c19c4cab-962c-4915-806a-9dbffdf4bfa4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 18:09:04 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-5650221a-c6cf-422b-bd38-380bf530c881 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Converting VIF {"id": "c19c4cab-962c-4915-806a-9dbffdf4bfa4", "address": "fa:16:3e:ba:d7:b9", "network": {"id": "78d86418-c0e0-4cc2-8f4f-262f600f7d66", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2054827063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19cfb454e59745bf9c77d7a7ede2bc0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc19c4cab-96", "ovs_interfaceid": "c19c4cab-962c-4915-806a-9dbffdf4bfa4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:09:04 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-5650221a-c6cf-422b-bd38-380bf530c881 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ba:d7:b9,bridge_name='br-int',has_traffic_filtering=True,id=c19c4cab-962c-4915-806a-9dbffdf4bfa4,network=Network(78d86418-c0e0-4cc2-8f4f-262f600f7d66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc19c4cab-96') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:09:04 user nova-compute[75100]: DEBUG os_vif [None req-5650221a-c6cf-422b-bd38-380bf530c881 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:d7:b9,bridge_name='br-int',has_traffic_filtering=True,id=c19c4cab-962c-4915-806a-9dbffdf4bfa4,network=Network(78d86418-c0e0-4cc2-8f4f-262f600f7d66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc19c4cab-96') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 18:09:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:09:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc19c4cab-96, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:09:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:09:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:09:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:09:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a67125bc-8147-4548-b3b9-361d616f5246) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:09:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:09:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:09:04 user nova-compute[75100]: INFO os_vif [None req-5650221a-c6cf-422b-bd38-380bf530c881 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:d7:b9,bridge_name='br-int',has_traffic_filtering=True,id=c19c4cab-962c-4915-806a-9dbffdf4bfa4,network=Network(78d86418-c0e0-4cc2-8f4f-262f600f7d66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc19c4cab-96')
Nov 10 18:09:04 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-5650221a-c6cf-422b-bd38-380bf530c881 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Deleting instance files /opt/stack/data/nova/instances/1937fab6-d892-406e-b8ff-52194021eea4_del
Nov 10 18:09:04 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-5650221a-c6cf-422b-bd38-380bf530c881 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Deletion of /opt/stack/data/nova/instances/1937fab6-d892-406e-b8ff-52194021eea4_del complete
Nov 10 18:09:04 user nova-compute[75100]: INFO nova.compute.manager [None req-5650221a-c6cf-422b-bd38-380bf530c881 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 10 18:09:04 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-5650221a-c6cf-422b-bd38-380bf530c881 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 18:09:04 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 18:09:04 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 18:09:04 user nova-compute[75100]: DEBUG nova.compute.manager [req-15551624-d9d8-47b6-83f6-f60c5d18887b req-c1e5dd0b-fc06-451f-ad5f-6093eb374f2a service nova] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Received event network-vif-unplugged-c19c4cab-962c-4915-806a-9dbffdf4bfa4 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:09:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-15551624-d9d8-47b6-83f6-f60c5d18887b req-c1e5dd0b-fc06-451f-ad5f-6093eb374f2a service nova] Acquiring lock "1937fab6-d892-406e-b8ff-52194021eea4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:09:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-15551624-d9d8-47b6-83f6-f60c5d18887b req-c1e5dd0b-fc06-451f-ad5f-6093eb374f2a service nova] Lock "1937fab6-d892-406e-b8ff-52194021eea4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:09:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-15551624-d9d8-47b6-83f6-f60c5d18887b req-c1e5dd0b-fc06-451f-ad5f-6093eb374f2a service nova] Lock "1937fab6-d892-406e-b8ff-52194021eea4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:09:04 user nova-compute[75100]: DEBUG nova.compute.manager [req-15551624-d9d8-47b6-83f6-f60c5d18887b req-c1e5dd0b-fc06-451f-ad5f-6093eb374f2a service nova] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] No waiting events found dispatching network-vif-unplugged-c19c4cab-962c-4915-806a-9dbffdf4bfa4 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:09:04 user nova-compute[75100]: DEBUG nova.compute.manager [req-15551624-d9d8-47b6-83f6-f60c5d18887b req-c1e5dd0b-fc06-451f-ad5f-6093eb374f2a service nova] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Received event network-vif-unplugged-c19c4cab-962c-4915-806a-9dbffdf4bfa4 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 18:09:05 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:09:05 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Took 1.36 seconds to deallocate network for instance.
Nov 10 18:09:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5650221a-c6cf-422b-bd38-380bf530c881 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:09:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5650221a-c6cf-422b-bd38-380bf530c881 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:09:05 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-5650221a-c6cf-422b-bd38-380bf530c881 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:09:05 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-5650221a-c6cf-422b-bd38-380bf530c881 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:09:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5650221a-c6cf-422b-bd38-380bf530c881 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.288s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:09:06 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-5650221a-c6cf-422b-bd38-380bf530c881 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Deleted allocations for instance 1937fab6-d892-406e-b8ff-52194021eea4
Nov 10 18:09:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5650221a-c6cf-422b-bd38-380bf530c881 tempest-TestMinimumBasicScenario-281006384 tempest-TestMinimumBasicScenario-281006384-project-member] Lock "1937fab6-d892-406e-b8ff-52194021eea4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.776s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:09:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:09:06 user nova-compute[75100]: DEBUG nova.compute.manager [req-692bb554-e545-4552-9a06-5022a87db730 req-4d8f017a-5bb9-41ee-a79e-91d247e9161b service nova] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Received event network-vif-plugged-c19c4cab-962c-4915-806a-9dbffdf4bfa4 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:09:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-692bb554-e545-4552-9a06-5022a87db730 req-4d8f017a-5bb9-41ee-a79e-91d247e9161b service nova] Acquiring lock "1937fab6-d892-406e-b8ff-52194021eea4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:09:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-692bb554-e545-4552-9a06-5022a87db730 req-4d8f017a-5bb9-41ee-a79e-91d247e9161b service nova] Lock "1937fab6-d892-406e-b8ff-52194021eea4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:09:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-692bb554-e545-4552-9a06-5022a87db730 req-4d8f017a-5bb9-41ee-a79e-91d247e9161b service nova] Lock "1937fab6-d892-406e-b8ff-52194021eea4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:09:06 user nova-compute[75100]: DEBUG nova.compute.manager [req-692bb554-e545-4552-9a06-5022a87db730 req-4d8f017a-5bb9-41ee-a79e-91d247e9161b service nova] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] No waiting events found dispatching network-vif-plugged-c19c4cab-962c-4915-806a-9dbffdf4bfa4 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:09:06 user nova-compute[75100]: WARNING nova.compute.manager [req-692bb554-e545-4552-9a06-5022a87db730 req-4d8f017a-5bb9-41ee-a79e-91d247e9161b service nova] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Received unexpected event network-vif-plugged-c19c4cab-962c-4915-806a-9dbffdf4bfa4 for instance with vm_state deleted and task_state None.
Nov 10 18:09:06 user nova-compute[75100]: DEBUG nova.compute.manager [req-692bb554-e545-4552-9a06-5022a87db730 req-4d8f017a-5bb9-41ee-a79e-91d247e9161b service nova] [instance: 1937fab6-d892-406e-b8ff-52194021eea4] Received event network-vif-deleted-c19c4cab-962c-4915-806a-9dbffdf4bfa4 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:09:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:09:12 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-4796687f-1767-468e-a5f7-6e07d0327fae tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b0bae328-2528-4562-850b-14fa108923c6 is timed out.
Nov 10 18:09:12 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-4796687f-1767-468e-a5f7-6e07d0327fae tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Successfully detached device vdb from instance b0bae328-2528-4562-850b-14fa108923c6 from the live domain config.
Nov 10 18:09:12 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4796687f-1767-468e-a5f7-6e07d0327fae tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: b0bae328-2528-4562-850b-14fa108923c6] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 18:09:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4796687f-1767-468e-a5f7-6e07d0327fae tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, {'target_iqn': 'iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ctuDnhGv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:09:12 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-4796687f-1767-468e-a5f7-6e07d0327fae tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:09:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-4796687f-1767-468e-a5f7-6e07d0327fae tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:09:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-4796687f-1767-468e-a5f7-6e07d0327fae tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:09:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:09:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:09:12 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[598e3470-2296-4bc0-b867-938fc0c8808d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb1593e0-4a1c-4ae3-8e97-7ae6215f8143\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:09:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4796687f-1767-468e-a5f7-6e07d0327fae tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 18:09:12 user nova-compute[75100]: No targets found.
Nov 10 18:09:12 user nova-compute[75100]: iSNS:
Nov 10 18:09:12 user nova-compute[75100]: No targets found.
Nov 10 18:09:12 user nova-compute[75100]: STATIC:
Nov 10 18:09:12 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf
Nov 10 18:09:12 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:09:12 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:09:12 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:fb1593e0-4a1c-4ae3-8e97-7ae6215f8143
Nov 10 18:09:12 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:09:12 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:09:12 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005
Nov 10 18:09:12 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:09:12 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:09:12 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7
Nov 10 18:09:12 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:09:12 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:09:12 user nova-compute[75100]: FIRMWARE:
Nov 10 18:09:12 user nova-compute[75100]: No targets found.
Nov 10 18:09:12 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:09:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4796687f-1767-468e-a5f7-6e07d0327fae tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 18:09:12 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 18:09:12 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 18:09:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4796687f-1767-468e-a5f7-6e07d0327fae tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 18:09:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:09:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:09:12 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[82017745-efd9-4c91-8f27-285890380a22]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb1593e0-4a1c-4ae3-8e97-7ae6215f8143\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:09:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:09:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:09:12 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[01abe534-4c9c-47c4-898d-0aa893ee4d0b]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1593e0-4a1c-4ae3-8e97-7ae6215f8143 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:09:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4796687f-1767-468e-a5f7-6e07d0327fae tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 (non-flash)
Nov 10 18:09:12 user nova-compute[75100]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf (non-flash)
Nov 10 18:09:12 user nova-compute[75100]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)
Nov 10 18:09:12 user nova-compute[75100]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1593e0-4a1c-4ae3-8e97-7ae6215f8143 (non-flash)
Nov 10 18:09:12 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:09:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4796687f-1767-468e-a5f7-6e07d0327fae tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 (non-flash)
Nov 10 18:09:12 user nova-compute[75100]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf (non-flash)
Nov 10 18:09:12 user nova-compute[75100]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)
Nov 10 18:09:12 user nova-compute[75100]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1593e0-4a1c-4ae3-8e97-7ae6215f8143 (non-flash)
Nov 10 18:09:12 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:09:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4796687f-1767-468e-a5f7-6e07d0327fae tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3d429dea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf'): ({'sdg'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 18:09:12 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-4796687f-1767-468e-a5f7-6e07d0327fae tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Removing single pathed devices sdg {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 18:09:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:09:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:09:12 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7dff02-6b0a-4d22-ab4d-d6d8455cb08c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:09:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:09:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:09:12 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e0fe24-eb1e-4b2a-9f6b-c1ac6495be3d]: (4, ('ok\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:09:12 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-4796687f-1767-468e-a5f7-6e07d0327fae tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Flushing IO for device /dev/sdg {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 18:09:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:09:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:09:12 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2435b52-f0e9-4f73-a6c2-eb3ced3bea11]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:09:12 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-4796687f-1767-468e-a5f7-6e07d0327fae tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 18:09:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:09:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.041s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:09:12 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a87693c-8211-4fc9-b71f-d4d073b72da2]: (4, ('1', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:09:12 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-4796687f-1767-468e-a5f7-6e07d0327fae tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 18:09:12 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-4796687f-1767-468e-a5f7-6e07d0327fae tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] SCSI volumes sdg have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 18:09:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4796687f-1767-468e-a5f7-6e07d0327fae tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 18:09:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:09:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:09:12 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[737e33dd-43b1-46e2-8155-0f6b06637c87]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:09:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4796687f-1767-468e-a5f7-6e07d0327fae tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:09:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf -p 172.16.0.220:3260 --logout {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:09:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Acquiring lock "440fd7bb-5296-4f07-a2f8-0b6154baeb80" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:09:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Lock "440fd7bb-5296-4f07-a2f8-0b6154baeb80" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:09:12 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 440fd7bb-5296-4f07-a2f8-0b6154baeb80] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 18:09:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:09:12 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e721ad4e-4a73-4f77-9935-6ec45e1cb574]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:09:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4796687f-1767-468e-a5f7-6e07d0327fae tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf, portal: 172.16.0.220,3260]
Nov 10 18:09:12 user nova-compute[75100]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf, portal: 172.16.0.220,3260] successful.
Nov 10 18:09:12 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:09:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf -p 172.16.0.220:3260 --op delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:09:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c1a4aa0-d680-4608-b4a4-56115b4d5cbf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:09:12 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d35c286-f7a2-4ab8-8984-e315d3abc7b3]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:09:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4796687f-1767-468e-a5f7-6e07d0327fae tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:09:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-4796687f-1767-468e-a5f7-6e07d0327fae tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:09:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4796687f-1767-468e-a5f7-6e07d0327fae tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] <== disconnect_volume: return (359ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:09:12 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4796687f-1767-468e-a5f7-6e07d0327fae tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: b0bae328-2528-4562-850b-14fa108923c6] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 18:09:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:09:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:09:12 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 18:09:12 user nova-compute[75100]: INFO nova.compute.claims [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 440fd7bb-5296-4f07-a2f8-0b6154baeb80] Claim successful on node user
Nov 10 18:09:13 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:09:13 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:09:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.387s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:09:13 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 440fd7bb-5296-4f07-a2f8-0b6154baeb80] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 18:09:13 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 440fd7bb-5296-4f07-a2f8-0b6154baeb80] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 18:09:13 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 440fd7bb-5296-4f07-a2f8-0b6154baeb80] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 18:09:13 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 440fd7bb-5296-4f07-a2f8-0b6154baeb80] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 18:09:13 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 440fd7bb-5296-4f07-a2f8-0b6154baeb80] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 18:09:13 user nova-compute[75100]: DEBUG nova.policy [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '130a36dd61074d99855f44d5ebb20eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e369208c0a486fa4cceb6de3620b6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 18:09:13 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 440fd7bb-5296-4f07-a2f8-0b6154baeb80] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 18:09:13 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 440fd7bb-5296-4f07-a2f8-0b6154baeb80] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 18:09:13 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 440fd7bb-5296-4f07-a2f8-0b6154baeb80] Creating image(s)
Nov 10 18:09:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Acquiring lock "/opt/stack/data/nova/instances/440fd7bb-5296-4f07-a2f8-0b6154baeb80/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:09:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Lock "/opt/stack/data/nova/instances/440fd7bb-5296-4f07-a2f8-0b6154baeb80/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:09:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Lock "/opt/stack/data/nova/instances/440fd7bb-5296-4f07-a2f8-0b6154baeb80/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:09:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:09:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.219s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:09:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Acquiring lock "818b9e28e061d41a38d903968b229be2ed9ba520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:09:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:09:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:09:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.223s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:09:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/440fd7bb-5296-4f07-a2f8-0b6154baeb80/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:09:14 user nova-compute[75100]: DEBUG nova.objects.instance [None req-4796687f-1767-468e-a5f7-6e07d0327fae tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lazy-loading 'flavor' on Instance uuid b0bae328-2528-4562-850b-14fa108923c6 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:09:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/440fd7bb-5296-4f07-a2f8-0b6154baeb80/disk 1073741824" returned: 0 in 0.058s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:09:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.287s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:09:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:09:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:09:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4796687f-1767-468e-a5f7-6e07d0327fae tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "b0bae328-2528-4562-850b-14fa108923c6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.262s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:09:14 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 440fd7bb-5296-4f07-a2f8-0b6154baeb80] Successfully created port: 224431ce-4d10-45a5-a645-c513a9411d25 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 18:09:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.204s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:09:14 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Checking if we can resize image /opt/stack/data/nova/instances/440fd7bb-5296-4f07-a2f8-0b6154baeb80/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 18:09:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/440fd7bb-5296-4f07-a2f8-0b6154baeb80/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:09:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/440fd7bb-5296-4f07-a2f8-0b6154baeb80/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:09:14 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Cannot resize image /opt/stack/data/nova/instances/440fd7bb-5296-4f07-a2f8-0b6154baeb80/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 18:09:14 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 440fd7bb-5296-4f07-a2f8-0b6154baeb80] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 18:09:14 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 440fd7bb-5296-4f07-a2f8-0b6154baeb80] Ensure instance console log exists: /opt/stack/data/nova/instances/440fd7bb-5296-4f07-a2f8-0b6154baeb80/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 18:09:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:09:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:09:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:09:14 user nova-compute[75100]: DEBUG nova.compute.manager [req-c0f0ae18-b0b8-4bbd-81f1-7e5f44161849 req-747c2629-f04e-478a-a9e3-7b9438b7bd69 service nova] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Received event network-changed-c538aab4-e12a-4800-b8a5-48dcf1124862 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:09:14 user nova-compute[75100]: DEBUG nova.compute.manager [req-c0f0ae18-b0b8-4bbd-81f1-7e5f44161849 req-747c2629-f04e-478a-a9e3-7b9438b7bd69 service nova] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Refreshing instance network info cache due to event network-changed-c538aab4-e12a-4800-b8a5-48dcf1124862. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 18:09:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c0f0ae18-b0b8-4bbd-81f1-7e5f44161849 req-747c2629-f04e-478a-a9e3-7b9438b7bd69 service nova] Acquiring lock "refresh_cache-aa469ab9-92c2-4e7f-ae66-bbe48b11511a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:09:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c0f0ae18-b0b8-4bbd-81f1-7e5f44161849 req-747c2629-f04e-478a-a9e3-7b9438b7bd69 service nova] Acquired lock "refresh_cache-aa469ab9-92c2-4e7f-ae66-bbe48b11511a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:09:14 user nova-compute[75100]: DEBUG nova.network.neutron [req-c0f0ae18-b0b8-4bbd-81f1-7e5f44161849 req-747c2629-f04e-478a-a9e3-7b9438b7bd69 service nova] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Refreshing network info cache for port c538aab4-e12a-4800-b8a5-48dcf1124862 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 18:09:15 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 440fd7bb-5296-4f07-a2f8-0b6154baeb80] Successfully updated port: 224431ce-4d10-45a5-a645-c513a9411d25 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 18:09:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Acquiring lock "refresh_cache-440fd7bb-5296-4f07-a2f8-0b6154baeb80" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:09:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Acquired lock "refresh_cache-440fd7bb-5296-4f07-a2f8-0b6154baeb80" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:09:15 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 440fd7bb-5296-4f07-a2f8-0b6154baeb80] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 18:09:15 user nova-compute[75100]: DEBUG nova.compute.manager [req-3da0eb85-91b8-48b0-a3d8-643f7c19a081 req-611ba934-3612-4787-9593-0dcba4a9ad1f service nova] [instance: 440fd7bb-5296-4f07-a2f8-0b6154baeb80] Received event network-changed-224431ce-4d10-45a5-a645-c513a9411d25 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:09:15 user nova-compute[75100]: DEBUG nova.compute.manager [req-3da0eb85-91b8-48b0-a3d8-643f7c19a081 req-611ba934-3612-4787-9593-0dcba4a9ad1f service nova] [instance: 440fd7bb-5296-4f07-a2f8-0b6154baeb80] Refreshing instance network info cache due to event network-changed-224431ce-4d10-45a5-a645-c513a9411d25. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 18:09:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3da0eb85-91b8-48b0-a3d8-643f7c19a081 req-611ba934-3612-4787-9593-0dcba4a9ad1f service nova] Acquiring lock "refresh_cache-440fd7bb-5296-4f07-a2f8-0b6154baeb80" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:09:15 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 440fd7bb-5296-4f07-a2f8-0b6154baeb80] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 18:09:15 user nova-compute[75100]: DEBUG nova.network.neutron [req-c0f0ae18-b0b8-4bbd-81f1-7e5f44161849 req-747c2629-f04e-478a-a9e3-7b9438b7bd69 service nova] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Updated VIF entry in instance network info cache for port c538aab4-e12a-4800-b8a5-48dcf1124862. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 18:09:15 user nova-compute[75100]: DEBUG nova.network.neutron [req-c0f0ae18-b0b8-4bbd-81f1-7e5f44161849 req-747c2629-f04e-478a-a9e3-7b9438b7bd69 service nova] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Updating instance_info_cache with network_info: [{"id": "c538aab4-e12a-4800-b8a5-48dcf1124862", "address": "fa:16:3e:01:77:a1", "network": {"id": "2a85480b-f67d-4ef1-b967-3e93af57d7c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1717495768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9cd441a46aa4a579feff608d6ff9bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc538aab4-e1", "ovs_interfaceid": "c538aab4-e12a-4800-b8a5-48dcf1124862", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:09:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c0f0ae18-b0b8-4bbd-81f1-7e5f44161849 req-747c2629-f04e-478a-a9e3-7b9438b7bd69 service nova] Releasing lock "refresh_cache-aa469ab9-92c2-4e7f-ae66-bbe48b11511a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:09:15 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 440fd7bb-5296-4f07-a2f8-0b6154baeb80] Updating instance_info_cache with network_info: [{"id": "224431ce-4d10-45a5-a645-c513a9411d25", "address": "fa:16:3e:e3:8e:73", "network": {"id": "f22ce8bd-85d3-4596-849e-9e04d728af34", "bridge": "br-int", "label": "tempest-VolumesActionsTest-979416963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42e369208c0a486fa4cceb6de3620b6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap224431ce-4d", "ovs_interfaceid": "224431ce-4d10-45a5-a645-c513a9411d25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:09:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Releasing lock "refresh_cache-440fd7bb-5296-4f07-a2f8-0b6154baeb80" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:09:15 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 440fd7bb-5296-4f07-a2f8-0b6154baeb80] Instance network_info: |[{"id": "224431ce-4d10-45a5-a645-c513a9411d25", "address": "fa:16:3e:e3:8e:73", "network": {"id": "f22ce8bd-85d3-4596-849e-9e04d728af34", "bridge": "br-int", "label": "tempest-VolumesActionsTest-979416963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42e369208c0a486fa4cceb6de3620b6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap224431ce-4d", "ovs_interfaceid": "224431ce-4d10-45a5-a645-c513a9411d25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 18:09:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3da0eb85-91b8-48b0-a3d8-643f7c19a081 req-611ba934-3612-4787-9593-0dcba4a9ad1f service nova] Acquired lock "refresh_cache-440fd7bb-5296-4f07-a2f8-0b6154baeb80" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:09:15 user nova-compute[75100]: DEBUG nova.network.neutron [req-3da0eb85-91b8-48b0-a3d8-643f7c19a081 req-611ba934-3612-4787-9593-0dcba4a9ad1f service nova] [instance: 440fd7bb-5296-4f07-a2f8-0b6154baeb80] Refreshing network info cache for port 224431ce-4d10-45a5-a645-c513a9411d25 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 18:09:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 440fd7bb-5296-4f07-a2f8-0b6154baeb80] Start _get_guest_xml network_info=[{"id": "224431ce-4d10-45a5-a645-c513a9411d25", "address": "fa:16:3e:e3:8e:73", "network": {"id": "f22ce8bd-85d3-4596-849e-9e04d728af34", "bridge": "br-int", "label": "tempest-VolumesActionsTest-979416963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42e369208c0a486fa4cceb6de3620b6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap224431ce-4d", "ovs_interfaceid": "224431ce-4d10-45a5-a645-c513a9411d25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'e3cc5321-4d40-49ee-885c-700e14741732'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 18:09:15 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:09:15 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:09:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 18:09:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 18:09:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 18:09:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 18:09:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 18:09:15 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T17:40:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 18:09:15 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 18:09:15 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 18:09:15 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 18:09:15 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 18:09:15 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 18:09:15 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 18:09:15 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 18:09:15 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 18:09:15 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 18:09:15 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 18:09:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:09:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-809150265',display_name='tempest-VolumesActionsTest-instance-809150265',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-809150265',id=43,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42e369208c0a486fa4cceb6de3620b6a',ramdisk_id='',reservation_id='r-apvl1j7a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-275059269',owner_user_name='tempest-VolumesActionsTest-275059269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T18:09:14Z,user_data=None,user_id='130a36dd61074d99855f44d5ebb20eb3',uuid=440fd7bb-5296-4f07-a2f8-0b6154baeb80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "224431ce-4d10-45a5-a645-c513a9411d25", "address": "fa:16:3e:e3:8e:73", "network": {"id": "f22ce8bd-85d3-4596-849e-9e04d728af34", "bridge": "br-int", "label": "tempest-VolumesActionsTest-979416963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42e369208c0a486fa4cceb6de3620b6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap224431ce-4d", "ovs_interfaceid": "224431ce-4d10-45a5-a645-c513a9411d25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 18:09:15 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Converting VIF {"id": "224431ce-4d10-45a5-a645-c513a9411d25", "address": "fa:16:3e:e3:8e:73", "network": {"id": "f22ce8bd-85d3-4596-849e-9e04d728af34", "bridge": "br-int", "label": "tempest-VolumesActionsTest-979416963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42e369208c0a486fa4cceb6de3620b6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap224431ce-4d", "ovs_interfaceid": "224431ce-4d10-45a5-a645-c513a9411d25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:09:15 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:8e:73,bridge_name='br-int',has_traffic_filtering=True,id=224431ce-4d10-45a5-a645-c513a9411d25,network=Network(f22ce8bd-85d3-4596-849e-9e04d728af34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap224431ce-4d') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:09:15 user nova-compute[75100]: DEBUG nova.objects.instance [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Lazy-loading 'pci_devices' on Instance uuid 440fd7bb-5296-4f07-a2f8-0b6154baeb80 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:09:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 440fd7bb-5296-4f07-a2f8-0b6154baeb80] End _get_guest_xml xml=<domain type="kvm">
Nov 10 18:09:15 user nova-compute[75100]:   <uuid>440fd7bb-5296-4f07-a2f8-0b6154baeb80</uuid>
Nov 10 18:09:15 user nova-compute[75100]:   <name>instance-0000002b</name>
Nov 10 18:09:15 user nova-compute[75100]:   <memory>524288</memory>
Nov 10 18:09:15 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 10 18:09:15 user nova-compute[75100]:   <metadata>
Nov 10 18:09:15 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 18:09:15 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 10 18:09:15 user nova-compute[75100]:       <nova:name>tempest-VolumesActionsTest-instance-809150265</nova:name>
Nov 10 18:09:15 user nova-compute[75100]:       <nova:creationTime>2023-11-10 18:09:15</nova:creationTime>
Nov 10 18:09:15 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 10 18:09:15 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 10 18:09:15 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 10 18:09:15 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 10 18:09:15 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 18:09:15 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 10 18:09:15 user nova-compute[75100]:       </nova:flavor>
Nov 10 18:09:15 user nova-compute[75100]:       <nova:owner>
Nov 10 18:09:15 user nova-compute[75100]:         <nova:user uuid="130a36dd61074d99855f44d5ebb20eb3">tempest-VolumesActionsTest-275059269-project-member</nova:user>
Nov 10 18:09:15 user nova-compute[75100]:         <nova:project uuid="42e369208c0a486fa4cceb6de3620b6a">tempest-VolumesActionsTest-275059269</nova:project>
Nov 10 18:09:15 user nova-compute[75100]:       </nova:owner>
Nov 10 18:09:15 user nova-compute[75100]:       <nova:root type="image" uuid="e3cc5321-4d40-49ee-885c-700e14741732"/>
Nov 10 18:09:15 user nova-compute[75100]:       <nova:ports>
Nov 10 18:09:15 user nova-compute[75100]:         <nova:port uuid="224431ce-4d10-45a5-a645-c513a9411d25">
Nov 10 18:09:15 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 10 18:09:15 user nova-compute[75100]:         </nova:port>
Nov 10 18:09:15 user nova-compute[75100]:       </nova:ports>
Nov 10 18:09:15 user nova-compute[75100]:     </nova:instance>
Nov 10 18:09:15 user nova-compute[75100]:   </metadata>
Nov 10 18:09:15 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 10 18:09:15 user nova-compute[75100]:     <system>
Nov 10 18:09:15 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 18:09:15 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 10 18:09:15 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 10 18:09:15 user nova-compute[75100]:       <entry name="serial">440fd7bb-5296-4f07-a2f8-0b6154baeb80</entry>
Nov 10 18:09:15 user nova-compute[75100]:       <entry name="uuid">440fd7bb-5296-4f07-a2f8-0b6154baeb80</entry>
Nov 10 18:09:15 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 10 18:09:15 user nova-compute[75100]:     </system>
Nov 10 18:09:15 user nova-compute[75100]:   </sysinfo>
Nov 10 18:09:15 user nova-compute[75100]:   <os>
Nov 10 18:09:15 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 18:09:15 user nova-compute[75100]:     <boot dev="hd"/>
Nov 10 18:09:15 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 10 18:09:15 user nova-compute[75100]:   </os>
Nov 10 18:09:15 user nova-compute[75100]:   <features>
Nov 10 18:09:15 user nova-compute[75100]:     <acpi/>
Nov 10 18:09:15 user nova-compute[75100]:     <apic/>
Nov 10 18:09:15 user nova-compute[75100]:     <vmcoreinfo/>
Nov 10 18:09:15 user nova-compute[75100]:   </features>
Nov 10 18:09:15 user nova-compute[75100]:   <clock offset="utc">
Nov 10 18:09:15 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 18:09:15 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 18:09:15 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 10 18:09:15 user nova-compute[75100]:   </clock>
Nov 10 18:09:15 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 10 18:09:15 user nova-compute[75100]:     <model>Nehalem</model>
Nov 10 18:09:15 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 18:09:15 user nova-compute[75100]:   </cpu>
Nov 10 18:09:15 user nova-compute[75100]:   <devices>
Nov 10 18:09:15 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 10 18:09:15 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 18:09:15 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/440fd7bb-5296-4f07-a2f8-0b6154baeb80/disk"/>
Nov 10 18:09:15 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 10 18:09:15 user nova-compute[75100]:     </disk>
Nov 10 18:09:15 user nova-compute[75100]:     <interface type="ethernet">
Nov 10 18:09:15 user nova-compute[75100]:       <mac address="fa:16:3e:e3:8e:73"/>
Nov 10 18:09:15 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 18:09:15 user nova-compute[75100]:       <mtu size="1442"/>
Nov 10 18:09:15 user nova-compute[75100]:       <target dev="tap224431ce-4d"/>
Nov 10 18:09:15 user nova-compute[75100]:     </interface>
Nov 10 18:09:15 user nova-compute[75100]:     <serial type="pty">
Nov 10 18:09:15 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/440fd7bb-5296-4f07-a2f8-0b6154baeb80/console.log" append="off"/>
Nov 10 18:09:15 user nova-compute[75100]:     </serial>
Nov 10 18:09:15 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 18:09:15 user nova-compute[75100]:     <video>
Nov 10 18:09:15 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 18:09:15 user nova-compute[75100]:     </video>
Nov 10 18:09:15 user nova-compute[75100]:     <rng model="virtio">
Nov 10 18:09:15 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 10 18:09:15 user nova-compute[75100]:     </rng>
Nov 10 18:09:15 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 10 18:09:15 user nova-compute[75100]:     <memballoon model="virtio">
Nov 10 18:09:15 user nova-compute[75100]:       <stats period="10"/>
Nov 10 18:09:15 user nova-compute[75100]:     </memballoon>
Nov 10 18:09:15 user nova-compute[75100]:   </devices>
Nov 10 18:09:15 user nova-compute[75100]: </domain>
Nov 10 18:09:15 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 18:09:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:09:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-809150265',display_name='tempest-VolumesActionsTest-instance-809150265',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-809150265',id=43,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42e369208c0a486fa4cceb6de3620b6a',ramdisk_id='',reservation_id='r-apvl1j7a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-275059269',owner_user_name='tempest-VolumesActionsTest-275059269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T18:09:14Z,user_data=None,user_id='130a36dd61074d99855f44d5ebb20eb3',uuid=440fd7bb-5296-4f07-a2f8-0b6154baeb80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "224431ce-4d10-45a5-a645-c513a9411d25", "address": "fa:16:3e:e3:8e:73", "network": {"id": "f22ce8bd-85d3-4596-849e-9e04d728af34", "bridge": "br-int", "label": "tempest-VolumesActionsTest-979416963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42e369208c0a486fa4cceb6de3620b6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap224431ce-4d", "ovs_interfaceid": "224431ce-4d10-45a5-a645-c513a9411d25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 18:09:15 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Converting VIF {"id": "224431ce-4d10-45a5-a645-c513a9411d25", "address": "fa:16:3e:e3:8e:73", "network": {"id": "f22ce8bd-85d3-4596-849e-9e04d728af34", "bridge": "br-int", "label": "tempest-VolumesActionsTest-979416963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42e369208c0a486fa4cceb6de3620b6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap224431ce-4d", "ovs_interfaceid": "224431ce-4d10-45a5-a645-c513a9411d25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:09:15 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:8e:73,bridge_name='br-int',has_traffic_filtering=True,id=224431ce-4d10-45a5-a645-c513a9411d25,network=Network(f22ce8bd-85d3-4596-849e-9e04d728af34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap224431ce-4d') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:09:15 user nova-compute[75100]: DEBUG os_vif [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:8e:73,bridge_name='br-int',has_traffic_filtering=True,id=224431ce-4d10-45a5-a645-c513a9411d25,network=Network(f22ce8bd-85d3-4596-849e-9e04d728af34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap224431ce-4d') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 18:09:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:09:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:09:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 18:09:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:09:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dc6d1cc8-4c26-5b05-9d93-d207e08d3336', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:09:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:09:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:09:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:09:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap224431ce-4d, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:09:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap224431ce-4d, col_values=(('qos', UUID('ed326eef-8ef4-4ab1-9f7b-49cd987e8b8c')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:09:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap224431ce-4d, col_values=(('external_ids', {'iface-id': '224431ce-4d10-45a5-a645-c513a9411d25', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:8e:73', 'vm-uuid': '440fd7bb-5296-4f07-a2f8-0b6154baeb80'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:09:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:09:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:09:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:09:15 user nova-compute[75100]: INFO os_vif [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:8e:73,bridge_name='br-int',has_traffic_filtering=True,id=224431ce-4d10-45a5-a645-c513a9411d25,network=Network(f22ce8bd-85d3-4596-849e-9e04d728af34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap224431ce-4d')
Nov 10 18:09:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 18:09:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] No VIF found with MAC fa:16:3e:e3:8e:73, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 18:09:16 user nova-compute[75100]: DEBUG nova.network.neutron [req-3da0eb85-91b8-48b0-a3d8-643f7c19a081 req-611ba934-3612-4787-9593-0dcba4a9ad1f service nova] [instance: 440fd7bb-5296-4f07-a2f8-0b6154baeb80] Updated VIF entry in instance network info cache for port 224431ce-4d10-45a5-a645-c513a9411d25. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 18:09:16 user nova-compute[75100]: DEBUG nova.network.neutron [req-3da0eb85-91b8-48b0-a3d8-643f7c19a081 req-611ba934-3612-4787-9593-0dcba4a9ad1f service nova] [instance: 440fd7bb-5296-4f07-a2f8-0b6154baeb80] Updating instance_info_cache with network_info: [{"id": "224431ce-4d10-45a5-a645-c513a9411d25", "address": "fa:16:3e:e3:8e:73", "network": {"id": "f22ce8bd-85d3-4596-849e-9e04d728af34", "bridge": "br-int", "label": "tempest-VolumesActionsTest-979416963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42e369208c0a486fa4cceb6de3620b6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap224431ce-4d", "ovs_interfaceid": "224431ce-4d10-45a5-a645-c513a9411d25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:09:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3da0eb85-91b8-48b0-a3d8-643f7c19a081 req-611ba934-3612-4787-9593-0dcba4a9ad1f service nova] Releasing lock "refresh_cache-440fd7bb-5296-4f07-a2f8-0b6154baeb80" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:09:16 user nova-compute[75100]: DEBUG nova.compute.manager [req-c8254b9d-c119-4eb6-aefd-95ca7313802b req-c4ff5714-d2b4-4cce-a886-4299f5d2bf05 service nova] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Received event network-changed-c538aab4-e12a-4800-b8a5-48dcf1124862 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:09:16 user nova-compute[75100]: DEBUG nova.compute.manager [req-c8254b9d-c119-4eb6-aefd-95ca7313802b req-c4ff5714-d2b4-4cce-a886-4299f5d2bf05 service nova] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Refreshing instance network info cache due to event network-changed-c538aab4-e12a-4800-b8a5-48dcf1124862. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 18:09:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c8254b9d-c119-4eb6-aefd-95ca7313802b req-c4ff5714-d2b4-4cce-a886-4299f5d2bf05 service nova] Acquiring lock "refresh_cache-aa469ab9-92c2-4e7f-ae66-bbe48b11511a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:09:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c8254b9d-c119-4eb6-aefd-95ca7313802b req-c4ff5714-d2b4-4cce-a886-4299f5d2bf05 service nova] Acquired lock "refresh_cache-aa469ab9-92c2-4e7f-ae66-bbe48b11511a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:09:16 user nova-compute[75100]: DEBUG nova.network.neutron [req-c8254b9d-c119-4eb6-aefd-95ca7313802b req-c4ff5714-d2b4-4cce-a886-4299f5d2bf05 service nova] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Refreshing network info cache for port c538aab4-e12a-4800-b8a5-48dcf1124862 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 18:09:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6f2893e9-3eda-4d9b-9754-e466c76807d6 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Acquiring lock "aa469ab9-92c2-4e7f-ae66-bbe48b11511a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:09:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6f2893e9-3eda-4d9b-9754-e466c76807d6 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "aa469ab9-92c2-4e7f-ae66-bbe48b11511a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:09:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6f2893e9-3eda-4d9b-9754-e466c76807d6 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Acquiring lock "aa469ab9-92c2-4e7f-ae66-bbe48b11511a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:09:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6f2893e9-3eda-4d9b-9754-e466c76807d6 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "aa469ab9-92c2-4e7f-ae66-bbe48b11511a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:09:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6f2893e9-3eda-4d9b-9754-e466c76807d6 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "aa469ab9-92c2-4e7f-ae66-bbe48b11511a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:09:16 user nova-compute[75100]: INFO nova.compute.manager [None req-6f2893e9-3eda-4d9b-9754-e466c76807d6 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Terminating instance
Nov 10 18:09:16 user nova-compute[75100]: DEBUG nova.compute.manager [None req-6f2893e9-3eda-4d9b-9754-e466c76807d6 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 18:09:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:09:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:09:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:09:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:09:16 user nova-compute[75100]: DEBUG nova.network.neutron [req-c8254b9d-c119-4eb6-aefd-95ca7313802b req-c4ff5714-d2b4-4cce-a886-4299f5d2bf05 service nova] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Updated VIF entry in instance network info cache for port c538aab4-e12a-4800-b8a5-48dcf1124862. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 18:09:16 user nova-compute[75100]: DEBUG nova.network.neutron [req-c8254b9d-c119-4eb6-aefd-95ca7313802b req-c4ff5714-d2b4-4cce-a886-4299f5d2bf05 service nova] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Updating instance_info_cache with network_info: [{"id": "c538aab4-e12a-4800-b8a5-48dcf1124862", "address": "fa:16:3e:01:77:a1", "network": {"id": "2a85480b-f67d-4ef1-b967-3e93af57d7c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1717495768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9cd441a46aa4a579feff608d6ff9bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc538aab4-e1", "ovs_interfaceid": "c538aab4-e12a-4800-b8a5-48dcf1124862", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:09:16 user nova-compute[75100]: DEBUG nova.compute.manager [req-d169e027-59bd-4c61-b760-bec32e58256e req-f6bba6f0-d475-457f-9813-c303eea394d4 service nova] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Received event network-vif-unplugged-c538aab4-e12a-4800-b8a5-48dcf1124862 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:09:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d169e027-59bd-4c61-b760-bec32e58256e req-f6bba6f0-d475-457f-9813-c303eea394d4 service nova] Acquiring lock "aa469ab9-92c2-4e7f-ae66-bbe48b11511a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:09:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d169e027-59bd-4c61-b760-bec32e58256e req-f6bba6f0-d475-457f-9813-c303eea394d4 service nova] Lock "aa469ab9-92c2-4e7f-ae66-bbe48b11511a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:09:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d169e027-59bd-4c61-b760-bec32e58256e req-f6bba6f0-d475-457f-9813-c303eea394d4 service nova] Lock "aa469ab9-92c2-4e7f-ae66-bbe48b11511a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:09:16 user nova-compute[75100]: DEBUG nova.compute.manager [req-d169e027-59bd-4c61-b760-bec32e58256e req-f6bba6f0-d475-457f-9813-c303eea394d4 service nova] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] No waiting events found dispatching network-vif-unplugged-c538aab4-e12a-4800-b8a5-48dcf1124862 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:09:16 user nova-compute[75100]: DEBUG nova.compute.manager [req-d169e027-59bd-4c61-b760-bec32e58256e req-f6bba6f0-d475-457f-9813-c303eea394d4 service nova] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Received event network-vif-unplugged-c538aab4-e12a-4800-b8a5-48dcf1124862 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 18:09:16 user nova-compute[75100]: DEBUG nova.compute.manager [req-d169e027-59bd-4c61-b760-bec32e58256e req-f6bba6f0-d475-457f-9813-c303eea394d4 service nova] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Received event network-vif-plugged-c538aab4-e12a-4800-b8a5-48dcf1124862 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:09:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d169e027-59bd-4c61-b760-bec32e58256e req-f6bba6f0-d475-457f-9813-c303eea394d4 service nova] Acquiring lock "aa469ab9-92c2-4e7f-ae66-bbe48b11511a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:09:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d169e027-59bd-4c61-b760-bec32e58256e req-f6bba6f0-d475-457f-9813-c303eea394d4 service nova] Lock "aa469ab9-92c2-4e7f-ae66-bbe48b11511a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:09:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d169e027-59bd-4c61-b760-bec32e58256e req-f6bba6f0-d475-457f-9813-c303eea394d4 service nova] Lock "aa469ab9-92c2-4e7f-ae66-bbe48b11511a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:09:16 user nova-compute[75100]: DEBUG nova.compute.manager [req-d169e027-59bd-4c61-b760-bec32e58256e req-f6bba6f0-d475-457f-9813-c303eea394d4 service nova] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] No waiting events found dispatching network-vif-plugged-c538aab4-e12a-4800-b8a5-48dcf1124862 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:09:16 user nova-compute[75100]: WARNING nova.compute.manager [req-d169e027-59bd-4c61-b760-bec32e58256e req-f6bba6f0-d475-457f-9813-c303eea394d4 service nova] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Received unexpected event network-vif-plugged-c538aab4-e12a-4800-b8a5-48dcf1124862 for instance with vm_state active and task_state deleting.
Nov 10 18:09:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c8254b9d-c119-4eb6-aefd-95ca7313802b req-c4ff5714-d2b4-4cce-a886-4299f5d2bf05 service nova] Releasing lock "refresh_cache-aa469ab9-92c2-4e7f-ae66-bbe48b11511a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:09:17 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Instance destroyed successfully.
Nov 10 18:09:17 user nova-compute[75100]: DEBUG nova.objects.instance [None req-6f2893e9-3eda-4d9b-9754-e466c76807d6 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lazy-loading 'resources' on Instance uuid aa469ab9-92c2-4e7f-ae66-bbe48b11511a {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-6f2893e9-3eda-4d9b-9754-e466c76807d6 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:07:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1231469740',display_name='tempest-TestVolumeBootPattern-server-1231469740',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1231469740',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILrjRswgoJPqA+suzoqc8EEXkFg1B3St2cTU0CL5tiD3TI/qO87+FOfxjV/dwwN6UPPBmEGN67tPxZrctQdNsOvA6IRt0kMT8eF3nDG1qAx3cky0fCNWo1RZsce/R29pA==',key_name='tempest-TestVolumeBootPattern-1607857152',keypairs=<?>,launch_index=0,launched_at=2023-11-10T18:07:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b9cd441a46aa4a579feff608d6ff9bb4',ramdisk_id='',reservation_id='r-exhyvghc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-706331648',owner_user_name='tempest-TestVolumeBootPattern-706331648-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T18:07:55Z,user_data=None,user_id='323c5738ca424a379f666b4ca60825ac',uuid=aa469ab9-92c2-4e7f-ae66-bbe48b11511a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c538aab4-e12a-4800-b8a5-48dcf1124862", "address": "fa:16:3e:01:77:a1", "network": {"id": "2a85480b-f67d-4ef1-b967-3e93af57d7c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1717495768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9cd441a46aa4a579feff608d6ff9bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc538aab4-e1", "ovs_interfaceid": "c538aab4-e12a-4800-b8a5-48dcf1124862", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-6f2893e9-3eda-4d9b-9754-e466c76807d6 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Converting VIF {"id": "c538aab4-e12a-4800-b8a5-48dcf1124862", "address": "fa:16:3e:01:77:a1", "network": {"id": "2a85480b-f67d-4ef1-b967-3e93af57d7c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1717495768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9cd441a46aa4a579feff608d6ff9bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc538aab4-e1", "ovs_interfaceid": "c538aab4-e12a-4800-b8a5-48dcf1124862", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-6f2893e9-3eda-4d9b-9754-e466c76807d6 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:01:77:a1,bridge_name='br-int',has_traffic_filtering=True,id=c538aab4-e12a-4800-b8a5-48dcf1124862,network=Network(2a85480b-f67d-4ef1-b967-3e93af57d7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc538aab4-e1') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG os_vif [None req-6f2893e9-3eda-4d9b-9754-e466c76807d6 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:77:a1,bridge_name='br-int',has_traffic_filtering=True,id=c538aab4-e12a-4800-b8a5-48dcf1124862,network=Network(2a85480b-f67d-4ef1-b967-3e93af57d7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc538aab4-e1') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc538aab4-e1, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e56dc332-b6d9-4ed9-b8bc-c7457f3b0035) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:09:17 user nova-compute[75100]: INFO os_vif [None req-6f2893e9-3eda-4d9b-9754-e466c76807d6 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:77:a1,bridge_name='br-int',has_traffic_filtering=True,id=c538aab4-e12a-4800-b8a5-48dcf1124862,network=Network(2a85480b-f67d-4ef1-b967-3e93af57d7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc538aab4-e1')
Nov 10 18:09:17 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f2893e9-3eda-4d9b-9754-e466c76807d6 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f2893e9-3eda-4d9b-9754-e466c76807d6 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, {'target_iqn': 'iqn.2010-10.org.openstack:fb1593e0-4a1c-4ae3-8e97-7ae6215f8143', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XiClOfGc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:09:17 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-6f2893e9-3eda-4d9b-9754-e466c76807d6 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:09:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-6f2893e9-3eda-4d9b-9754-e466c76807d6 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-6f2893e9-3eda-4d9b-9754-e466c76807d6 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8edf83a2-aeb3-4803-8f9d-078194917b0d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fb1593e0-4a1c-4ae3-8e97-7ae6215f8143\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f2893e9-3eda-4d9b-9754-e466c76807d6 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 18:09:17 user nova-compute[75100]: No targets found.
Nov 10 18:09:17 user nova-compute[75100]: iSNS:
Nov 10 18:09:17 user nova-compute[75100]: No targets found.
Nov 10 18:09:17 user nova-compute[75100]: STATIC:
Nov 10 18:09:17 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:fb1593e0-4a1c-4ae3-8e97-7ae6215f8143
Nov 10 18:09:17 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:09:17 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:09:17 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005
Nov 10 18:09:17 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:09:17 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:09:17 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7
Nov 10 18:09:17 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:09:17 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:09:17 user nova-compute[75100]: FIRMWARE:
Nov 10 18:09:17 user nova-compute[75100]: No targets found.
Nov 10 18:09:17 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f2893e9-3eda-4d9b-9754-e466c76807d6 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 18:09:17 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 18:09:17 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f2893e9-3eda-4d9b-9754-e466c76807d6 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb1593e0-4a1c-4ae3-8e97-7ae6215f8143', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[052b3b63-5c3d-4805-a757-d7df2e21d85b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb1593e0-4a1c-4ae3-8e97-7ae6215f8143\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e060e9d-5f68-4da6-bb3f-6853178c0a07]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1593e0-4a1c-4ae3-8e97-7ae6215f8143 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f2893e9-3eda-4d9b-9754-e466c76807d6 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 (non-flash)
Nov 10 18:09:17 user nova-compute[75100]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)
Nov 10 18:09:17 user nova-compute[75100]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1593e0-4a1c-4ae3-8e97-7ae6215f8143 (non-flash)
Nov 10 18:09:17 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f2893e9-3eda-4d9b-9754-e466c76807d6 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 (non-flash)
Nov 10 18:09:17 user nova-compute[75100]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)
Nov 10 18:09:17 user nova-compute[75100]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1593e0-4a1c-4ae3-8e97-7ae6215f8143 (non-flash)
Nov 10 18:09:17 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f2893e9-3eda-4d9b-9754-e466c76807d6 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa398653e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb1593e0-4a1c-4ae3-8e97-7ae6215f8143'): ({'sdc'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-6f2893e9-3eda-4d9b-9754-e466c76807d6 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Removing single pathed devices sdc {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f422879-09bb-4568-94e8-75edcb5a40ba]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36d40e2-2722-4f69-a2a3-6bdb69e8fdac]: (4, ('ok\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-6f2893e9-3eda-4d9b-9754-e466c76807d6 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Flushing IO for device /dev/sdc {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e350086-73c2-4f8b-ba2a-95573b8a470c]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-6f2893e9-3eda-4d9b-9754-e466c76807d6 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e05d0b-517e-479f-a1e3-e44e62e54398]: (4, ('1', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-6f2893e9-3eda-4d9b-9754-e466c76807d6 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-6f2893e9-3eda-4d9b-9754-e466c76807d6 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] SCSI volumes sdc have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f2893e9-3eda-4d9b-9754-e466c76807d6 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb1593e0-4a1c-4ae3-8e97-7ae6215f8143')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb1593e0-4a1c-4ae3-8e97-7ae6215f8143 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb1593e0-4a1c-4ae3-8e97-7ae6215f8143 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07fcaaf-8adc-4ede-a15e-120bc3d6f143]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f2893e9-3eda-4d9b-9754-e466c76807d6 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb1593e0-4a1c-4ae3-8e97-7ae6215f8143 -p 172.16.0.220:3260 --logout {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb1593e0-4a1c-4ae3-8e97-7ae6215f8143 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ac95ae-e881-43d4-994b-ce578e9c2797]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:fb1593e0-4a1c-4ae3-8e97-7ae6215f8143, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:fb1593e0-4a1c-4ae3-8e97-7ae6215f8143, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f2893e9-3eda-4d9b-9754-e466c76807d6 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:fb1593e0-4a1c-4ae3-8e97-7ae6215f8143, portal: 172.16.0.220,3260]
Nov 10 18:09:17 user nova-compute[75100]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:fb1593e0-4a1c-4ae3-8e97-7ae6215f8143, portal: 172.16.0.220,3260] successful.
Nov 10 18:09:17 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb1593e0-4a1c-4ae3-8e97-7ae6215f8143 -p 172.16.0.220:3260 --op delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb1593e0-4a1c-4ae3-8e97-7ae6215f8143 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fdbaffa-a3af-4ae3-869b-fe17a4f1277d]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f2893e9-3eda-4d9b-9754-e466c76807d6 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-6f2893e9-3eda-4d9b-9754-e466c76807d6 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.379s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f2893e9-3eda-4d9b-9754-e466c76807d6 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] <== disconnect_volume: return (381ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:09:17 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f2893e9-3eda-4d9b-9754-e466c76807d6 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 18:09:17 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-6f2893e9-3eda-4d9b-9754-e466c76807d6 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Deleting instance files /opt/stack/data/nova/instances/aa469ab9-92c2-4e7f-ae66-bbe48b11511a_del
Nov 10 18:09:17 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-6f2893e9-3eda-4d9b-9754-e466c76807d6 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Deletion of /opt/stack/data/nova/instances/aa469ab9-92c2-4e7f-ae66-bbe48b11511a_del complete
Nov 10 18:09:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:09:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:09:18 user nova-compute[75100]: INFO nova.compute.manager [None req-6f2893e9-3eda-4d9b-9754-e466c76807d6 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Took 1.59 seconds to destroy the instance on the hypervisor.
Nov 10 18:09:18 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-6f2893e9-3eda-4d9b-9754-e466c76807d6 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 18:09:18 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 18:09:18 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 18:09:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:09:18 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:09:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:09:18 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Took 0.69 seconds to deallocate network for instance.
Nov 10 18:09:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:09:18 user nova-compute[75100]: DEBUG nova.compute.manager [req-c7387101-6daf-428a-a419-20dfc82a5b57 req-5a00d8f3-0f4e-4cfe-8d18-a0f1a2f83231 service nova] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Received event network-vif-deleted-c538aab4-e12a-4800-b8a5-48dcf1124862 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:09:19 user nova-compute[75100]: DEBUG nova.compute.manager [req-664bd8c3-e358-4e57-9537-88582c2afef3 req-d579526b-47fa-4d22-b958-4d7ac0b1c8a3 service nova] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Received event network-vif-plugged-c538aab4-e12a-4800-b8a5-48dcf1124862 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:09:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-664bd8c3-e358-4e57-9537-88582c2afef3 req-d579526b-47fa-4d22-b958-4d7ac0b1c8a3 service nova] Acquiring lock "aa469ab9-92c2-4e7f-ae66-bbe48b11511a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:09:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-664bd8c3-e358-4e57-9537-88582c2afef3 req-d579526b-47fa-4d22-b958-4d7ac0b1c8a3 service nova] Lock "aa469ab9-92c2-4e7f-ae66-bbe48b11511a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:09:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-664bd8c3-e358-4e57-9537-88582c2afef3 req-d579526b-47fa-4d22-b958-4d7ac0b1c8a3 service nova] Lock "aa469ab9-92c2-4e7f-ae66-bbe48b11511a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:09:19 user nova-compute[75100]: DEBUG nova.compute.manager [req-664bd8c3-e358-4e57-9537-88582c2afef3 req-d579526b-47fa-4d22-b958-4d7ac0b1c8a3 service nova] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] No waiting events found dispatching network-vif-plugged-c538aab4-e12a-4800-b8a5-48dcf1124862 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:09:19 user nova-compute[75100]: WARNING nova.compute.manager [req-664bd8c3-e358-4e57-9537-88582c2afef3 req-d579526b-47fa-4d22-b958-4d7ac0b1c8a3 service nova] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Received unexpected event network-vif-plugged-c538aab4-e12a-4800-b8a5-48dcf1124862 for instance with vm_state active and task_state deleting.
Nov 10 18:09:19 user nova-compute[75100]: DEBUG nova.compute.manager [req-664bd8c3-e358-4e57-9537-88582c2afef3 req-d579526b-47fa-4d22-b958-4d7ac0b1c8a3 service nova] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Received event network-vif-plugged-c538aab4-e12a-4800-b8a5-48dcf1124862 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:09:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-664bd8c3-e358-4e57-9537-88582c2afef3 req-d579526b-47fa-4d22-b958-4d7ac0b1c8a3 service nova] Acquiring lock "aa469ab9-92c2-4e7f-ae66-bbe48b11511a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:09:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-664bd8c3-e358-4e57-9537-88582c2afef3 req-d579526b-47fa-4d22-b958-4d7ac0b1c8a3 service nova] Lock "aa469ab9-92c2-4e7f-ae66-bbe48b11511a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:09:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-664bd8c3-e358-4e57-9537-88582c2afef3 req-d579526b-47fa-4d22-b958-4d7ac0b1c8a3 service nova] Lock "aa469ab9-92c2-4e7f-ae66-bbe48b11511a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:09:19 user nova-compute[75100]: DEBUG nova.compute.manager [req-664bd8c3-e358-4e57-9537-88582c2afef3 req-d579526b-47fa-4d22-b958-4d7ac0b1c8a3 service nova] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] No waiting events found dispatching network-vif-plugged-c538aab4-e12a-4800-b8a5-48dcf1124862 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:09:19 user nova-compute[75100]: WARNING nova.compute.manager [req-664bd8c3-e358-4e57-9537-88582c2afef3 req-d579526b-47fa-4d22-b958-4d7ac0b1c8a3 service nova] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Received unexpected event network-vif-plugged-c538aab4-e12a-4800-b8a5-48dcf1124862 for instance with vm_state active and task_state deleting.
Nov 10 18:09:19 user nova-compute[75100]: DEBUG nova.compute.manager [req-664bd8c3-e358-4e57-9537-88582c2afef3 req-d579526b-47fa-4d22-b958-4d7ac0b1c8a3 service nova] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Received event network-vif-unplugged-c538aab4-e12a-4800-b8a5-48dcf1124862 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:09:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-664bd8c3-e358-4e57-9537-88582c2afef3 req-d579526b-47fa-4d22-b958-4d7ac0b1c8a3 service nova] Acquiring lock "aa469ab9-92c2-4e7f-ae66-bbe48b11511a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:09:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-664bd8c3-e358-4e57-9537-88582c2afef3 req-d579526b-47fa-4d22-b958-4d7ac0b1c8a3 service nova] Lock "aa469ab9-92c2-4e7f-ae66-bbe48b11511a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:09:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-664bd8c3-e358-4e57-9537-88582c2afef3 req-d579526b-47fa-4d22-b958-4d7ac0b1c8a3 service nova] Lock "aa469ab9-92c2-4e7f-ae66-bbe48b11511a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:09:19 user nova-compute[75100]: DEBUG nova.compute.manager [req-664bd8c3-e358-4e57-9537-88582c2afef3 req-d579526b-47fa-4d22-b958-4d7ac0b1c8a3 service nova] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] No waiting events found dispatching network-vif-unplugged-c538aab4-e12a-4800-b8a5-48dcf1124862 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:09:19 user nova-compute[75100]: DEBUG nova.compute.manager [req-664bd8c3-e358-4e57-9537-88582c2afef3 req-d579526b-47fa-4d22-b958-4d7ac0b1c8a3 service nova] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Received event network-vif-unplugged-c538aab4-e12a-4800-b8a5-48dcf1124862 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 18:09:19 user nova-compute[75100]: DEBUG nova.compute.manager [req-664bd8c3-e358-4e57-9537-88582c2afef3 req-d579526b-47fa-4d22-b958-4d7ac0b1c8a3 service nova] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Received event network-vif-plugged-c538aab4-e12a-4800-b8a5-48dcf1124862 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:09:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-664bd8c3-e358-4e57-9537-88582c2afef3 req-d579526b-47fa-4d22-b958-4d7ac0b1c8a3 service nova] Acquiring lock "aa469ab9-92c2-4e7f-ae66-bbe48b11511a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:09:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-664bd8c3-e358-4e57-9537-88582c2afef3 req-d579526b-47fa-4d22-b958-4d7ac0b1c8a3 service nova] Lock "aa469ab9-92c2-4e7f-ae66-bbe48b11511a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:09:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-664bd8c3-e358-4e57-9537-88582c2afef3 req-d579526b-47fa-4d22-b958-4d7ac0b1c8a3 service nova] Lock "aa469ab9-92c2-4e7f-ae66-bbe48b11511a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:09:19 user nova-compute[75100]: DEBUG nova.compute.manager [req-664bd8c3-e358-4e57-9537-88582c2afef3 req-d579526b-47fa-4d22-b958-4d7ac0b1c8a3 service nova] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] No waiting events found dispatching network-vif-plugged-c538aab4-e12a-4800-b8a5-48dcf1124862 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:09:19 user nova-compute[75100]: WARNING nova.compute.manager [req-664bd8c3-e358-4e57-9537-88582c2afef3 req-d579526b-47fa-4d22-b958-4d7ac0b1c8a3 service nova] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Received unexpected event network-vif-plugged-c538aab4-e12a-4800-b8a5-48dcf1124862 for instance with vm_state active and task_state deleting.
Nov 10 18:09:19 user nova-compute[75100]: DEBUG nova.compute.manager [req-664bd8c3-e358-4e57-9537-88582c2afef3 req-d579526b-47fa-4d22-b958-4d7ac0b1c8a3 service nova] [instance: 440fd7bb-5296-4f07-a2f8-0b6154baeb80] Received event network-vif-plugged-224431ce-4d10-45a5-a645-c513a9411d25 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:09:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-664bd8c3-e358-4e57-9537-88582c2afef3 req-d579526b-47fa-4d22-b958-4d7ac0b1c8a3 service nova] Acquiring lock "440fd7bb-5296-4f07-a2f8-0b6154baeb80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:09:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-664bd8c3-e358-4e57-9537-88582c2afef3 req-d579526b-47fa-4d22-b958-4d7ac0b1c8a3 service nova] Lock "440fd7bb-5296-4f07-a2f8-0b6154baeb80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:09:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-664bd8c3-e358-4e57-9537-88582c2afef3 req-d579526b-47fa-4d22-b958-4d7ac0b1c8a3 service nova] Lock "440fd7bb-5296-4f07-a2f8-0b6154baeb80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:09:19 user nova-compute[75100]: DEBUG nova.compute.manager [req-664bd8c3-e358-4e57-9537-88582c2afef3 req-d579526b-47fa-4d22-b958-4d7ac0b1c8a3 service nova] [instance: 440fd7bb-5296-4f07-a2f8-0b6154baeb80] No waiting events found dispatching network-vif-plugged-224431ce-4d10-45a5-a645-c513a9411d25 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:09:19 user nova-compute[75100]: WARNING nova.compute.manager [req-664bd8c3-e358-4e57-9537-88582c2afef3 req-d579526b-47fa-4d22-b958-4d7ac0b1c8a3 service nova] [instance: 440fd7bb-5296-4f07-a2f8-0b6154baeb80] Received unexpected event network-vif-plugged-224431ce-4d10-45a5-a645-c513a9411d25 for instance with vm_state building and task_state spawning.
Nov 10 18:09:19 user nova-compute[75100]: DEBUG nova.compute.manager [req-664bd8c3-e358-4e57-9537-88582c2afef3 req-d579526b-47fa-4d22-b958-4d7ac0b1c8a3 service nova] [instance: 440fd7bb-5296-4f07-a2f8-0b6154baeb80] Received event network-vif-plugged-224431ce-4d10-45a5-a645-c513a9411d25 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:09:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-664bd8c3-e358-4e57-9537-88582c2afef3 req-d579526b-47fa-4d22-b958-4d7ac0b1c8a3 service nova] Acquiring lock "440fd7bb-5296-4f07-a2f8-0b6154baeb80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:09:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-664bd8c3-e358-4e57-9537-88582c2afef3 req-d579526b-47fa-4d22-b958-4d7ac0b1c8a3 service nova] Lock "440fd7bb-5296-4f07-a2f8-0b6154baeb80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:09:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-664bd8c3-e358-4e57-9537-88582c2afef3 req-d579526b-47fa-4d22-b958-4d7ac0b1c8a3 service nova] Lock "440fd7bb-5296-4f07-a2f8-0b6154baeb80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:09:19 user nova-compute[75100]: DEBUG nova.compute.manager [req-664bd8c3-e358-4e57-9537-88582c2afef3 req-d579526b-47fa-4d22-b958-4d7ac0b1c8a3 service nova] [instance: 440fd7bb-5296-4f07-a2f8-0b6154baeb80] No waiting events found dispatching network-vif-plugged-224431ce-4d10-45a5-a645-c513a9411d25 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:09:19 user nova-compute[75100]: WARNING nova.compute.manager [req-664bd8c3-e358-4e57-9537-88582c2afef3 req-d579526b-47fa-4d22-b958-4d7ac0b1c8a3 service nova] [instance: 440fd7bb-5296-4f07-a2f8-0b6154baeb80] Received unexpected event network-vif-plugged-224431ce-4d10-45a5-a645-c513a9411d25 for instance with vm_state building and task_state spawning.
Nov 10 18:09:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:09:19 user nova-compute[75100]: INFO nova.compute.manager [None req-6f2893e9-3eda-4d9b-9754-e466c76807d6 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: aa469ab9-92c2-4e7f-ae66-bbe48b11511a] Took 1.20 seconds to detach 1 volumes for instance.
Nov 10 18:09:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6f2893e9-3eda-4d9b-9754-e466c76807d6 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:09:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6f2893e9-3eda-4d9b-9754-e466c76807d6 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:09:20 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 440fd7bb-5296-4f07-a2f8-0b6154baeb80] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 18:09:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 440fd7bb-5296-4f07-a2f8-0b6154baeb80] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 18:09:20 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 440fd7bb-5296-4f07-a2f8-0b6154baeb80] Instance spawned successfully.
Nov 10 18:09:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 440fd7bb-5296-4f07-a2f8-0b6154baeb80] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 18:09:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 440fd7bb-5296-4f07-a2f8-0b6154baeb80] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:09:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 440fd7bb-5296-4f07-a2f8-0b6154baeb80] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:09:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 440fd7bb-5296-4f07-a2f8-0b6154baeb80] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:09:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 440fd7bb-5296-4f07-a2f8-0b6154baeb80] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:09:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 440fd7bb-5296-4f07-a2f8-0b6154baeb80] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:09:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 440fd7bb-5296-4f07-a2f8-0b6154baeb80] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:09:20 user nova-compute[75100]: INFO nova.compute.manager [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 440fd7bb-5296-4f07-a2f8-0b6154baeb80] Took 6.56 seconds to spawn the instance on the hypervisor.
Nov 10 18:09:20 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 440fd7bb-5296-4f07-a2f8-0b6154baeb80] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 18:09:20 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-6f2893e9-3eda-4d9b-9754-e466c76807d6 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:09:20 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-6f2893e9-3eda-4d9b-9754-e466c76807d6 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:09:20 user nova-compute[75100]: INFO nova.compute.manager [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 440fd7bb-5296-4f07-a2f8-0b6154baeb80] Took 7.36 seconds to build instance.
Nov 10 18:09:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6f2893e9-3eda-4d9b-9754-e466c76807d6 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.296s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:09:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebeefdc6-e571-4397-bbb4-b8509af69ef3 tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Lock "440fd7bb-5296-4f07-a2f8-0b6154baeb80" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.477s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:09:20 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-6f2893e9-3eda-4d9b-9754-e466c76807d6 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Deleted allocations for instance aa469ab9-92c2-4e7f-ae66-bbe48b11511a
Nov 10 18:09:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6f2893e9-3eda-4d9b-9754-e466c76807d6 tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "aa469ab9-92c2-4e7f-ae66-bbe48b11511a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.974s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:09:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:09:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:09:27 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:09:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:09:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:09:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:09:27 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 18:09:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0bae328-2528-4562-850b-14fa108923c6/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:09:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:09:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0bae328-2528-4562-850b-14fa108923c6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:09:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0bae328-2528-4562-850b-14fa108923c6/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:09:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0bae328-2528-4562-850b-14fa108923c6/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:09:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:09:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:09:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:09:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:09:28 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 18:09:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/440fd7bb-5296-4f07-a2f8-0b6154baeb80/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:09:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/440fd7bb-5296-4f07-a2f8-0b6154baeb80/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:09:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/440fd7bb-5296-4f07-a2f8-0b6154baeb80/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:09:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/440fd7bb-5296-4f07-a2f8-0b6154baeb80/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:09:28 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 18:09:28 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:09:28 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:09:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Hypervisor/Node resource view: name=user free_ram=8187MB free_disk=24.43975830078125GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 18:09:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:09:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:09:29 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:09:29 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance b0bae328-2528-4562-850b-14fa108923c6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:09:29 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance dc8c4fa7-668a-4348-be16-9eb06420b01f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:09:29 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 4ebd9d80-365d-4334-8421-3b22a846321a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:09:29 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 440fd7bb-5296-4f07-a2f8-0b6154baeb80 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:09:29 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 18:09:29 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 18:09:29 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:09:29 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:09:29 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 18:09:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.311s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:09:30 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:09:30 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:09:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:09:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:09:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:09:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:09:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:09:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:09:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:09:36 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:09:37 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:09:37 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:09:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:09:38 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:09:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:09:42 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:09:42 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 18:09:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f8752dd7-ed73-481d-a0d0-0200d546d384 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Acquiring lock "b0bae328-2528-4562-850b-14fa108923c6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:09:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f8752dd7-ed73-481d-a0d0-0200d546d384 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "b0bae328-2528-4562-850b-14fa108923c6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:09:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f8752dd7-ed73-481d-a0d0-0200d546d384 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Acquiring lock "b0bae328-2528-4562-850b-14fa108923c6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:09:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f8752dd7-ed73-481d-a0d0-0200d546d384 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "b0bae328-2528-4562-850b-14fa108923c6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:09:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f8752dd7-ed73-481d-a0d0-0200d546d384 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "b0bae328-2528-4562-850b-14fa108923c6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:09:42 user nova-compute[75100]: INFO nova.compute.manager [None req-f8752dd7-ed73-481d-a0d0-0200d546d384 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: b0bae328-2528-4562-850b-14fa108923c6] Terminating instance
Nov 10 18:09:42 user nova-compute[75100]: DEBUG nova.compute.manager [None req-f8752dd7-ed73-481d-a0d0-0200d546d384 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: b0bae328-2528-4562-850b-14fa108923c6] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 18:09:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:09:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:09:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:09:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:09:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:09:42 user nova-compute[75100]: DEBUG nova.compute.manager [req-f3e8ee30-e333-487f-945f-b520a4300dc7 req-2cddd3a8-4110-4c93-9e35-76e21a15a3dd service nova] [instance: b0bae328-2528-4562-850b-14fa108923c6] Received event network-vif-unplugged-6f68d50b-62e9-4068-98e8-131d624dd612 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:09:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f3e8ee30-e333-487f-945f-b520a4300dc7 req-2cddd3a8-4110-4c93-9e35-76e21a15a3dd service nova] Acquiring lock "b0bae328-2528-4562-850b-14fa108923c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:09:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f3e8ee30-e333-487f-945f-b520a4300dc7 req-2cddd3a8-4110-4c93-9e35-76e21a15a3dd service nova] Lock "b0bae328-2528-4562-850b-14fa108923c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:09:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f3e8ee30-e333-487f-945f-b520a4300dc7 req-2cddd3a8-4110-4c93-9e35-76e21a15a3dd service nova] Lock "b0bae328-2528-4562-850b-14fa108923c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:09:42 user nova-compute[75100]: DEBUG nova.compute.manager [req-f3e8ee30-e333-487f-945f-b520a4300dc7 req-2cddd3a8-4110-4c93-9e35-76e21a15a3dd service nova] [instance: b0bae328-2528-4562-850b-14fa108923c6] No waiting events found dispatching network-vif-unplugged-6f68d50b-62e9-4068-98e8-131d624dd612 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:09:42 user nova-compute[75100]: DEBUG nova.compute.manager [req-f3e8ee30-e333-487f-945f-b520a4300dc7 req-2cddd3a8-4110-4c93-9e35-76e21a15a3dd service nova] [instance: b0bae328-2528-4562-850b-14fa108923c6] Received event network-vif-unplugged-6f68d50b-62e9-4068-98e8-131d624dd612 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 18:09:42 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: b0bae328-2528-4562-850b-14fa108923c6] Instance destroyed successfully.
Nov 10 18:09:42 user nova-compute[75100]: DEBUG nova.objects.instance [None req-f8752dd7-ed73-481d-a0d0-0200d546d384 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lazy-loading 'resources' on Instance uuid b0bae328-2528-4562-850b-14fa108923c6 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:09:42 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-f8752dd7-ed73-481d-a0d0-0200d546d384 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:03:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1468565613',display_name='tempest-AttachVolumeNegativeTest-server-1468565613',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1468565613',id=36,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGfbhvGDgoDP2dxNtmL9BJEbA7dohTeOBW8+eBHKAHMLlRXpo/2O6+Hm0SDaDg7UVuVYlsPFN/ntEb+SzjlbLRihNQyRABlP0FGFjDIW9cGNyzktF0VWw6A4GOeN0sYKqw==',key_name='tempest-keypair-2070911957',keypairs=<?>,launch_index=0,launched_at=2023-11-10T18:03:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d4e5cb8bdc24a009dcb3dbee36a6bce',ramdisk_id='',reservation_id='r-hupb1hkw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1395057280',owner_user_name='tempest-AttachVolumeNegativeTest-1395057280-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T18:03:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efe92a172011414e8507cb6ddbfab0bb',uuid=b0bae328-2528-4562-850b-14fa108923c6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f68d50b-62e9-4068-98e8-131d624dd612", "address": "fa:16:3e:ae:03:fd", "network": {"id": "e906a397-504d-48d8-8726-187cfbb1f270", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2095832274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4e5cb8bdc24a009dcb3dbee36a6bce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f68d50b-62", "ovs_interfaceid": "6f68d50b-62e9-4068-98e8-131d624dd612", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 18:09:42 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-f8752dd7-ed73-481d-a0d0-0200d546d384 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Converting VIF {"id": "6f68d50b-62e9-4068-98e8-131d624dd612", "address": "fa:16:3e:ae:03:fd", "network": {"id": "e906a397-504d-48d8-8726-187cfbb1f270", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2095832274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4e5cb8bdc24a009dcb3dbee36a6bce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f68d50b-62", "ovs_interfaceid": "6f68d50b-62e9-4068-98e8-131d624dd612", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:09:42 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-f8752dd7-ed73-481d-a0d0-0200d546d384 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:03:fd,bridge_name='br-int',has_traffic_filtering=True,id=6f68d50b-62e9-4068-98e8-131d624dd612,network=Network(e906a397-504d-48d8-8726-187cfbb1f270),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f68d50b-62') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:09:42 user nova-compute[75100]: DEBUG os_vif [None req-f8752dd7-ed73-481d-a0d0-0200d546d384 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:03:fd,bridge_name='br-int',has_traffic_filtering=True,id=6f68d50b-62e9-4068-98e8-131d624dd612,network=Network(e906a397-504d-48d8-8726-187cfbb1f270),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f68d50b-62') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 18:09:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:09:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6f68d50b-62, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:09:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:09:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:09:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:09:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=09478e93-d99a-4fe3-aa8a-800c0e2aca6e) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:09:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:09:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:09:42 user nova-compute[75100]: INFO os_vif [None req-f8752dd7-ed73-481d-a0d0-0200d546d384 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:03:fd,bridge_name='br-int',has_traffic_filtering=True,id=6f68d50b-62e9-4068-98e8-131d624dd612,network=Network(e906a397-504d-48d8-8726-187cfbb1f270),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f68d50b-62')
Nov 10 18:09:42 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-f8752dd7-ed73-481d-a0d0-0200d546d384 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: b0bae328-2528-4562-850b-14fa108923c6] Deleting instance files /opt/stack/data/nova/instances/b0bae328-2528-4562-850b-14fa108923c6_del
Nov 10 18:09:42 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-f8752dd7-ed73-481d-a0d0-0200d546d384 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: b0bae328-2528-4562-850b-14fa108923c6] Deletion of /opt/stack/data/nova/instances/b0bae328-2528-4562-850b-14fa108923c6_del complete
Nov 10 18:09:43 user nova-compute[75100]: INFO nova.compute.manager [None req-f8752dd7-ed73-481d-a0d0-0200d546d384 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: b0bae328-2528-4562-850b-14fa108923c6] Took 0.69 seconds to destroy the instance on the hypervisor.
Nov 10 18:09:43 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-f8752dd7-ed73-481d-a0d0-0200d546d384 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 18:09:43 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: b0bae328-2528-4562-850b-14fa108923c6] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 18:09:43 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: b0bae328-2528-4562-850b-14fa108923c6] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 18:09:43 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:09:43 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 18:09:43 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Rebuilding the list of instances to heal {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 18:09:43 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: b0bae328-2528-4562-850b-14fa108923c6] Skipping network cache update for instance because it is being deleted. {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9939}}
Nov 10 18:09:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "refresh_cache-22c021d9-c8e4-455d-8e2a-a9cdfbb38f75" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:09:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquired lock "refresh_cache-22c021d9-c8e4-455d-8e2a-a9cdfbb38f75" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:09:43 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 18:09:43 user nova-compute[75100]: DEBUG nova.objects.instance [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lazy-loading 'info_cache' on Instance uuid 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:09:43 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Updating instance_info_cache with network_info: [{"id": "9855a14c-55c7-4a35-a4cc-7085dfbda684", "address": "fa:16:3e:02:b1:a1", "network": {"id": "bf1edb58-ef26-40ca-8ec9-853fa05de13d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1416469583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7bb141ef59487dbb2ce6243c5002af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9855a14c-55", "ovs_interfaceid": "9855a14c-55c7-4a35-a4cc-7085dfbda684", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:09:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Releasing lock "refresh_cache-22c021d9-c8e4-455d-8e2a-a9cdfbb38f75" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:09:43 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 18:09:44 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: b0bae328-2528-4562-850b-14fa108923c6] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:09:44 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: b0bae328-2528-4562-850b-14fa108923c6] Took 0.98 seconds to deallocate network for instance.
Nov 10 18:09:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f8752dd7-ed73-481d-a0d0-0200d546d384 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:09:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f8752dd7-ed73-481d-a0d0-0200d546d384 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:09:44 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-f8752dd7-ed73-481d-a0d0-0200d546d384 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:09:44 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-f8752dd7-ed73-481d-a0d0-0200d546d384 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:09:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f8752dd7-ed73-481d-a0d0-0200d546d384 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.244s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:09:44 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-f8752dd7-ed73-481d-a0d0-0200d546d384 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Deleted allocations for instance b0bae328-2528-4562-850b-14fa108923c6
Nov 10 18:09:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f8752dd7-ed73-481d-a0d0-0200d546d384 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "b0bae328-2528-4562-850b-14fa108923c6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.120s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:09:44 user nova-compute[75100]: DEBUG nova.compute.manager [req-6a3e546d-f4cd-481c-a6b9-20fccc8587f1 req-f5e3eced-74f2-48bc-ac30-069580b902f2 service nova] [instance: b0bae328-2528-4562-850b-14fa108923c6] Received event network-vif-plugged-6f68d50b-62e9-4068-98e8-131d624dd612 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:09:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6a3e546d-f4cd-481c-a6b9-20fccc8587f1 req-f5e3eced-74f2-48bc-ac30-069580b902f2 service nova] Acquiring lock "b0bae328-2528-4562-850b-14fa108923c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:09:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6a3e546d-f4cd-481c-a6b9-20fccc8587f1 req-f5e3eced-74f2-48bc-ac30-069580b902f2 service nova] Lock "b0bae328-2528-4562-850b-14fa108923c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:09:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6a3e546d-f4cd-481c-a6b9-20fccc8587f1 req-f5e3eced-74f2-48bc-ac30-069580b902f2 service nova] Lock "b0bae328-2528-4562-850b-14fa108923c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:09:44 user nova-compute[75100]: DEBUG nova.compute.manager [req-6a3e546d-f4cd-481c-a6b9-20fccc8587f1 req-f5e3eced-74f2-48bc-ac30-069580b902f2 service nova] [instance: b0bae328-2528-4562-850b-14fa108923c6] No waiting events found dispatching network-vif-plugged-6f68d50b-62e9-4068-98e8-131d624dd612 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:09:44 user nova-compute[75100]: WARNING nova.compute.manager [req-6a3e546d-f4cd-481c-a6b9-20fccc8587f1 req-f5e3eced-74f2-48bc-ac30-069580b902f2 service nova] [instance: b0bae328-2528-4562-850b-14fa108923c6] Received unexpected event network-vif-plugged-6f68d50b-62e9-4068-98e8-131d624dd612 for instance with vm_state deleted and task_state None.
Nov 10 18:09:44 user nova-compute[75100]: DEBUG nova.compute.manager [req-6a3e546d-f4cd-481c-a6b9-20fccc8587f1 req-f5e3eced-74f2-48bc-ac30-069580b902f2 service nova] [instance: b0bae328-2528-4562-850b-14fa108923c6] Received event network-vif-deleted-6f68d50b-62e9-4068-98e8-131d624dd612 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:09:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:09:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:09:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:09:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:09:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:09:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:09:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:10:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:10:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:10:03 user nova-compute[75100]: INFO nova.compute.manager [None req-1081ad05-bee8-44e2-93f3-58e16d8c1716 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Get console output
Nov 10 18:10:03 user nova-compute[75100]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 10 18:10:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:10:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:10:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:10:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:10:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:10:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:10:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:10:27 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:10:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:10:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:10:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:10:27 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 18:10:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:10:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:10:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:10:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:10:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:10:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:10:28 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 18:10:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/440fd7bb-5296-4f07-a2f8-0b6154baeb80/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:10:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/440fd7bb-5296-4f07-a2f8-0b6154baeb80/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:10:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/440fd7bb-5296-4f07-a2f8-0b6154baeb80/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:10:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/440fd7bb-5296-4f07-a2f8-0b6154baeb80/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:10:28 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 18:10:28 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:10:28 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:10:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Hypervisor/Node resource view: name=user free_ram=8371MB free_disk=24.468467712402344GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 18:10:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:10:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:10:29 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:10:29 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance dc8c4fa7-668a-4348-be16-9eb06420b01f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:10:29 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 4ebd9d80-365d-4334-8421-3b22a846321a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:10:29 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 440fd7bb-5296-4f07-a2f8-0b6154baeb80 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:10:29 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 18:10:29 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 18:10:29 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:10:29 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:10:29 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 18:10:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.365s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:10:29 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:10:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:10:30 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:10:30 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:10:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:10:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:10:34 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:10:34 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75100) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 18:10:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:10:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f3231036-6cc7-445b-9693-4f5c79890fed tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Acquiring lock "dc8c4fa7-668a-4348-be16-9eb06420b01f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:10:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f3231036-6cc7-445b-9693-4f5c79890fed tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "dc8c4fa7-668a-4348-be16-9eb06420b01f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:10:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f3231036-6cc7-445b-9693-4f5c79890fed tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Acquiring lock "dc8c4fa7-668a-4348-be16-9eb06420b01f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:10:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f3231036-6cc7-445b-9693-4f5c79890fed tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "dc8c4fa7-668a-4348-be16-9eb06420b01f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:10:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f3231036-6cc7-445b-9693-4f5c79890fed tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "dc8c4fa7-668a-4348-be16-9eb06420b01f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:10:34 user nova-compute[75100]: INFO nova.compute.manager [None req-f3231036-6cc7-445b-9693-4f5c79890fed tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Terminating instance
Nov 10 18:10:34 user nova-compute[75100]: DEBUG nova.compute.manager [None req-f3231036-6cc7-445b-9693-4f5c79890fed tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 18:10:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:10:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:10:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:10:34 user nova-compute[75100]: DEBUG nova.compute.manager [req-e94b538f-2361-4281-8b1b-0161315ad78d req-73598587-c2a0-422a-9d1d-adf77e7c519f service nova] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Received event network-changed-d65a39e5-d2df-4de4-943c-fb71b88fc381 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:10:34 user nova-compute[75100]: DEBUG nova.compute.manager [req-e94b538f-2361-4281-8b1b-0161315ad78d req-73598587-c2a0-422a-9d1d-adf77e7c519f service nova] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Refreshing instance network info cache due to event network-changed-d65a39e5-d2df-4de4-943c-fb71b88fc381. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 18:10:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-e94b538f-2361-4281-8b1b-0161315ad78d req-73598587-c2a0-422a-9d1d-adf77e7c519f service nova] Acquiring lock "refresh_cache-dc8c4fa7-668a-4348-be16-9eb06420b01f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:10:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-e94b538f-2361-4281-8b1b-0161315ad78d req-73598587-c2a0-422a-9d1d-adf77e7c519f service nova] Acquired lock "refresh_cache-dc8c4fa7-668a-4348-be16-9eb06420b01f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:10:34 user nova-compute[75100]: DEBUG nova.network.neutron [req-e94b538f-2361-4281-8b1b-0161315ad78d req-73598587-c2a0-422a-9d1d-adf77e7c519f service nova] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Refreshing network info cache for port d65a39e5-d2df-4de4-943c-fb71b88fc381 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 18:10:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:10:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:10:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:10:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:10:35 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Instance destroyed successfully.
Nov 10 18:10:35 user nova-compute[75100]: DEBUG nova.objects.instance [None req-f3231036-6cc7-445b-9693-4f5c79890fed tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lazy-loading 'resources' on Instance uuid dc8c4fa7-668a-4348-be16-9eb06420b01f {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:10:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-f3231036-6cc7-445b-9693-4f5c79890fed tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:05:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1987059142',display_name='tempest-TestVolumeBootPattern-server-1987059142',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1987059142',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILrjRswgoJPqA+suzoqc8EEXkFg1B3St2cTU0CL5tiD3TI/qO87+FOfxjV/dwwN6UPPBmEGN67tPxZrctQdNsOvA6IRt0kMT8eF3nDG1qAx3cky0fCNWo1RZsce/R29pA==',key_name='tempest-TestVolumeBootPattern-1607857152',keypairs=<?>,launch_index=0,launched_at=2023-11-10T18:05:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b9cd441a46aa4a579feff608d6ff9bb4',ramdisk_id='',reservation_id='r-c37qv8k5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-706331648',owner_user_name='tempest-TestVolumeBootPattern-706331648-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T18:05:42Z,user_data=None,user_id='323c5738ca424a379f666b4ca60825ac',uuid=dc8c4fa7-668a-4348-be16-9eb06420b01f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d65a39e5-d2df-4de4-943c-fb71b88fc381", "address": "fa:16:3e:01:98:2f", "network": {"id": "2a85480b-f67d-4ef1-b967-3e93af57d7c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1717495768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9cd441a46aa4a579feff608d6ff9bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd65a39e5-d2", "ovs_interfaceid": "d65a39e5-d2df-4de4-943c-fb71b88fc381", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 18:10:35 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-f3231036-6cc7-445b-9693-4f5c79890fed tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Converting VIF {"id": "d65a39e5-d2df-4de4-943c-fb71b88fc381", "address": "fa:16:3e:01:98:2f", "network": {"id": "2a85480b-f67d-4ef1-b967-3e93af57d7c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1717495768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9cd441a46aa4a579feff608d6ff9bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd65a39e5-d2", "ovs_interfaceid": "d65a39e5-d2df-4de4-943c-fb71b88fc381", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:10:35 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-f3231036-6cc7-445b-9693-4f5c79890fed tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:01:98:2f,bridge_name='br-int',has_traffic_filtering=True,id=d65a39e5-d2df-4de4-943c-fb71b88fc381,network=Network(2a85480b-f67d-4ef1-b967-3e93af57d7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd65a39e5-d2') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:10:35 user nova-compute[75100]: DEBUG os_vif [None req-f3231036-6cc7-445b-9693-4f5c79890fed tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:98:2f,bridge_name='br-int',has_traffic_filtering=True,id=d65a39e5-d2df-4de4-943c-fb71b88fc381,network=Network(2a85480b-f67d-4ef1-b967-3e93af57d7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd65a39e5-d2') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 18:10:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:10:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd65a39e5-d2, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:10:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:10:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:10:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=408e0486-bb87-4c79-a098-9ecd6e269b3a) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:10:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:10:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:10:35 user nova-compute[75100]: INFO os_vif [None req-f3231036-6cc7-445b-9693-4f5c79890fed tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:98:2f,bridge_name='br-int',has_traffic_filtering=True,id=d65a39e5-d2df-4de4-943c-fb71b88fc381,network=Network(2a85480b-f67d-4ef1-b967-3e93af57d7c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd65a39e5-d2')
Nov 10 18:10:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3231036-6cc7-445b-9693-4f5c79890fed tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 18:10:35 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3231036-6cc7-445b-9693-4f5c79890fed tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, {'target_iqn': 'iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JEPndhyG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:10:35 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-f3231036-6cc7-445b-9693-4f5c79890fed tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:10:35 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-f3231036-6cc7-445b-9693-4f5c79890fed tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:10:35 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-f3231036-6cc7-445b-9693-4f5c79890fed tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:10:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:10:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:10:35 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d62a363-e308-4a96-9679-601ed380e73e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:10:35 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3231036-6cc7-445b-9693-4f5c79890fed tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 18:10:35 user nova-compute[75100]: No targets found.
Nov 10 18:10:35 user nova-compute[75100]: iSNS:
Nov 10 18:10:35 user nova-compute[75100]: No targets found.
Nov 10 18:10:35 user nova-compute[75100]: STATIC:
Nov 10 18:10:35 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005
Nov 10 18:10:35 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:10:35 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:10:35 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7
Nov 10 18:10:35 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:10:35 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:10:35 user nova-compute[75100]: FIRMWARE:
Nov 10 18:10:35 user nova-compute[75100]: No targets found.
Nov 10 18:10:35 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:10:35 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3231036-6cc7-445b-9693-4f5c79890fed tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 18:10:35 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 18:10:35 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 18:10:35 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3231036-6cc7-445b-9693-4f5c79890fed tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 18:10:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:10:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:10:35 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[80787ca1-dc9f-4786-ae0b-5fe3fdec649d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:10:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:10:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:10:35 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db2bbd4-c3b0-4026-ab40-de6c80def957]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:10:35 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3231036-6cc7-445b-9693-4f5c79890fed tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 (non-flash)
Nov 10 18:10:35 user nova-compute[75100]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)
Nov 10 18:10:35 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:10:35 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3231036-6cc7-445b-9693-4f5c79890fed tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 (non-flash)
Nov 10 18:10:35 user nova-compute[75100]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)
Nov 10 18:10:35 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:10:35 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3231036-6cc7-445b-9693-4f5c79890fed tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3986b25f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005'): ({'sdf'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 18:10:35 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-f3231036-6cc7-445b-9693-4f5c79890fed tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Removing single pathed devices sdf {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 18:10:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:10:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:10:35 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[199bdb0e-de8e-42a1-a149-16b4c2288ac1]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:10:35 user nova-compute[75100]: DEBUG nova.network.neutron [req-e94b538f-2361-4281-8b1b-0161315ad78d req-73598587-c2a0-422a-9d1d-adf77e7c519f service nova] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Updated VIF entry in instance network info cache for port d65a39e5-d2df-4de4-943c-fb71b88fc381. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 18:10:35 user nova-compute[75100]: DEBUG nova.network.neutron [req-e94b538f-2361-4281-8b1b-0161315ad78d req-73598587-c2a0-422a-9d1d-adf77e7c519f service nova] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Updating instance_info_cache with network_info: [{"id": "d65a39e5-d2df-4de4-943c-fb71b88fc381", "address": "fa:16:3e:01:98:2f", "network": {"id": "2a85480b-f67d-4ef1-b967-3e93af57d7c7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1717495768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9cd441a46aa4a579feff608d6ff9bb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd65a39e5-d2", "ovs_interfaceid": "d65a39e5-d2df-4de4-943c-fb71b88fc381", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:10:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:10:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-e94b538f-2361-4281-8b1b-0161315ad78d req-73598587-c2a0-422a-9d1d-adf77e7c519f service nova] Releasing lock "refresh_cache-dc8c4fa7-668a-4348-be16-9eb06420b01f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:10:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:10:35 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a884532e-97e1-4476-9a16-edb635c4b186]: (4, ('ok\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:10:35 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-f3231036-6cc7-445b-9693-4f5c79890fed tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Flushing IO for device /dev/sdf {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 18:10:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:10:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:10:35 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f23623a-6e9d-4bc3-8d31-8260b5e05637]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:10:35 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-f3231036-6cc7-445b-9693-4f5c79890fed tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 18:10:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:10:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.042s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:10:35 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b0fa2a-94cc-4944-8de7-698b7a461020]: (4, ('1', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:10:35 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-f3231036-6cc7-445b-9693-4f5c79890fed tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 18:10:35 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-f3231036-6cc7-445b-9693-4f5c79890fed tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] SCSI volumes sdf have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 18:10:35 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3231036-6cc7-445b-9693-4f5c79890fed tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 18:10:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:10:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:10:36 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcbb6935-762a-4479-a952-0491c350c4b3]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:10:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3231036-6cc7-445b-9693-4f5c79890fed tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:10:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 -p 172.16.0.220:3260 --logout {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:10:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:10:36 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5620fd8-5f2f-4cb4-bdf8-a350d296ff13]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:10:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3231036-6cc7-445b-9693-4f5c79890fed tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005, portal: 172.16.0.220,3260]
Nov 10 18:10:36 user nova-compute[75100]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005, portal: 172.16.0.220,3260] successful.
Nov 10 18:10:36 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:10:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 -p 172.16.0.220:3260 --op delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:10:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a54f8ddb-2769-4cf8-9e3e-e199b57b3005 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:10:36 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[942f6554-e3d2-47c9-a551-13db02133014]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:10:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3231036-6cc7-445b-9693-4f5c79890fed tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:10:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-f3231036-6cc7-445b-9693-4f5c79890fed tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:10:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3231036-6cc7-445b-9693-4f5c79890fed tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] <== disconnect_volume: return (368ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:10:36 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3231036-6cc7-445b-9693-4f5c79890fed tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 18:10:36 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-f3231036-6cc7-445b-9693-4f5c79890fed tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Deleting instance files /opt/stack/data/nova/instances/dc8c4fa7-668a-4348-be16-9eb06420b01f_del
Nov 10 18:10:36 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-f3231036-6cc7-445b-9693-4f5c79890fed tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Deletion of /opt/stack/data/nova/instances/dc8c4fa7-668a-4348-be16-9eb06420b01f_del complete
Nov 10 18:10:36 user nova-compute[75100]: INFO nova.compute.manager [None req-f3231036-6cc7-445b-9693-4f5c79890fed tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Took 1.48 seconds to destroy the instance on the hypervisor.
Nov 10 18:10:36 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-f3231036-6cc7-445b-9693-4f5c79890fed tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 18:10:36 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 18:10:36 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 18:10:36 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:10:36 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Took 0.66 seconds to deallocate network for instance.
Nov 10 18:10:36 user nova-compute[75100]: DEBUG nova.compute.manager [req-809378af-42f4-4c31-80cd-95b23789acbc req-95731e8a-6c41-483c-93ef-6f9c991fd187 service nova] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Received event network-vif-unplugged-d65a39e5-d2df-4de4-943c-fb71b88fc381 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:10:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-809378af-42f4-4c31-80cd-95b23789acbc req-95731e8a-6c41-483c-93ef-6f9c991fd187 service nova] Acquiring lock "dc8c4fa7-668a-4348-be16-9eb06420b01f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:10:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-809378af-42f4-4c31-80cd-95b23789acbc req-95731e8a-6c41-483c-93ef-6f9c991fd187 service nova] Lock "dc8c4fa7-668a-4348-be16-9eb06420b01f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:10:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-809378af-42f4-4c31-80cd-95b23789acbc req-95731e8a-6c41-483c-93ef-6f9c991fd187 service nova] Lock "dc8c4fa7-668a-4348-be16-9eb06420b01f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:10:36 user nova-compute[75100]: DEBUG nova.compute.manager [req-809378af-42f4-4c31-80cd-95b23789acbc req-95731e8a-6c41-483c-93ef-6f9c991fd187 service nova] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] No waiting events found dispatching network-vif-unplugged-d65a39e5-d2df-4de4-943c-fb71b88fc381 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:10:36 user nova-compute[75100]: DEBUG nova.compute.manager [req-809378af-42f4-4c31-80cd-95b23789acbc req-95731e8a-6c41-483c-93ef-6f9c991fd187 service nova] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Received event network-vif-unplugged-d65a39e5-d2df-4de4-943c-fb71b88fc381 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 18:10:36 user nova-compute[75100]: DEBUG nova.compute.manager [req-809378af-42f4-4c31-80cd-95b23789acbc req-95731e8a-6c41-483c-93ef-6f9c991fd187 service nova] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Received event network-vif-plugged-d65a39e5-d2df-4de4-943c-fb71b88fc381 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:10:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-809378af-42f4-4c31-80cd-95b23789acbc req-95731e8a-6c41-483c-93ef-6f9c991fd187 service nova] Acquiring lock "dc8c4fa7-668a-4348-be16-9eb06420b01f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:10:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-809378af-42f4-4c31-80cd-95b23789acbc req-95731e8a-6c41-483c-93ef-6f9c991fd187 service nova] Lock "dc8c4fa7-668a-4348-be16-9eb06420b01f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:10:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-809378af-42f4-4c31-80cd-95b23789acbc req-95731e8a-6c41-483c-93ef-6f9c991fd187 service nova] Lock "dc8c4fa7-668a-4348-be16-9eb06420b01f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:10:36 user nova-compute[75100]: DEBUG nova.compute.manager [req-809378af-42f4-4c31-80cd-95b23789acbc req-95731e8a-6c41-483c-93ef-6f9c991fd187 service nova] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] No waiting events found dispatching network-vif-plugged-d65a39e5-d2df-4de4-943c-fb71b88fc381 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:10:36 user nova-compute[75100]: WARNING nova.compute.manager [req-809378af-42f4-4c31-80cd-95b23789acbc req-95731e8a-6c41-483c-93ef-6f9c991fd187 service nova] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Received unexpected event network-vif-plugged-d65a39e5-d2df-4de4-943c-fb71b88fc381 for instance with vm_state active and task_state deleting.
Nov 10 18:10:36 user nova-compute[75100]: DEBUG nova.compute.manager [req-809378af-42f4-4c31-80cd-95b23789acbc req-95731e8a-6c41-483c-93ef-6f9c991fd187 service nova] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Received event network-vif-deleted-d65a39e5-d2df-4de4-943c-fb71b88fc381 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:10:38 user nova-compute[75100]: INFO nova.compute.manager [None req-f3231036-6cc7-445b-9693-4f5c79890fed tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] [instance: dc8c4fa7-668a-4348-be16-9eb06420b01f] Took 1.19 seconds to detach 1 volumes for instance.
Nov 10 18:10:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f3231036-6cc7-445b-9693-4f5c79890fed tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:10:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f3231036-6cc7-445b-9693-4f5c79890fed tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:10:38 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:10:38 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:10:38 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:10:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Acquiring lock "7003b97b-edf1-4972-a0be-dcb41c329ec8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:10:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "7003b97b-edf1-4972-a0be-dcb41c329ec8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:10:38 user nova-compute[75100]: DEBUG nova.compute.manager [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 18:10:38 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-f3231036-6cc7-445b-9693-4f5c79890fed tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:10:38 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-f3231036-6cc7-445b-9693-4f5c79890fed tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:10:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:10:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f3231036-6cc7-445b-9693-4f5c79890fed tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.393s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:10:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.027s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:10:38 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 18:10:38 user nova-compute[75100]: INFO nova.compute.claims [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Claim successful on node user
Nov 10 18:10:38 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-f3231036-6cc7-445b-9693-4f5c79890fed tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Deleted allocations for instance dc8c4fa7-668a-4348-be16-9eb06420b01f
Nov 10 18:10:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f3231036-6cc7-445b-9693-4f5c79890fed tempest-TestVolumeBootPattern-706331648 tempest-TestVolumeBootPattern-706331648-project-member] Lock "dc8c4fa7-668a-4348-be16-9eb06420b01f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.947s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:10:38 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:10:38 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:10:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.361s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:10:38 user nova-compute[75100]: DEBUG nova.compute.manager [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 18:10:38 user nova-compute[75100]: DEBUG nova.compute.manager [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 18:10:38 user nova-compute[75100]: DEBUG nova.network.neutron [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 18:10:38 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 18:10:38 user nova-compute[75100]: DEBUG nova.compute.manager [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 18:10:38 user nova-compute[75100]: DEBUG nova.policy [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'efe92a172011414e8507cb6ddbfab0bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4e5cb8bdc24a009dcb3dbee36a6bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 18:10:39 user nova-compute[75100]: DEBUG nova.compute.manager [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 18:10:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 18:10:39 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Creating image(s)
Nov 10 18:10:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Acquiring lock "/opt/stack/data/nova/instances/7003b97b-edf1-4972-a0be-dcb41c329ec8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:10:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "/opt/stack/data/nova/instances/7003b97b-edf1-4972-a0be-dcb41c329ec8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:10:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "/opt/stack/data/nova/instances/7003b97b-edf1-4972-a0be-dcb41c329ec8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:10:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:10:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Acquiring lock "f0b2a902-2358-4bed-a474-21170a45577d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:10:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Lock "f0b2a902-2358-4bed-a474-21170a45577d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:10:39 user nova-compute[75100]: DEBUG nova.compute.manager [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 18:10:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.203s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:10:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Acquiring lock "818b9e28e061d41a38d903968b229be2ed9ba520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:10:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:10:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:10:39 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:10:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:10:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:10:39 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 18:10:39 user nova-compute[75100]: INFO nova.compute.claims [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Claim successful on node user
Nov 10 18:10:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.182s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:10:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/7003b97b-edf1-4972-a0be-dcb41c329ec8/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:10:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/7003b97b-edf1-4972-a0be-dcb41c329ec8/disk 1073741824" returned: 0 in 0.054s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:10:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:10:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:10:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.193s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:10:39 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7003b97b-edf1-4972-a0be-dcb41c329ec8/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 18:10:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7003b97b-edf1-4972-a0be-dcb41c329ec8/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:10:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:10:39 user nova-compute[75100]: DEBUG nova.network.neutron [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Successfully created port: 06c73859-cc53-487c-8bd8-9c4f5961e3cd {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 18:10:39 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:10:39 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:10:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7003b97b-edf1-4972-a0be-dcb41c329ec8/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:10:39 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Cannot resize image /opt/stack/data/nova/instances/7003b97b-edf1-4972-a0be-dcb41c329ec8/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 18:10:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 18:10:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Ensure instance console log exists: /opt/stack/data/nova/instances/7003b97b-edf1-4972-a0be-dcb41c329ec8/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 18:10:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:10:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:10:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:10:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.533s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:10:39 user nova-compute[75100]: DEBUG nova.compute.manager [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 18:10:40 user nova-compute[75100]: DEBUG nova.compute.manager [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 18:10:40 user nova-compute[75100]: DEBUG nova.network.neutron [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] [instance: f0b2a902-2358-4bed-a474-21170a45577d] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 18:10:40 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 18:10:40 user nova-compute[75100]: DEBUG nova.compute.manager [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 18:10:40 user nova-compute[75100]: DEBUG nova.policy [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '01dec08989fe49f781636aec26e41900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b6a6cf82404999aa9e2d5f99b5b9df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 18:10:40 user nova-compute[75100]: DEBUG nova.compute.manager [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 18:10:40 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 18:10:40 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Creating image(s)
Nov 10 18:10:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Acquiring lock "/opt/stack/data/nova/instances/f0b2a902-2358-4bed-a474-21170a45577d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:10:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Lock "/opt/stack/data/nova/instances/f0b2a902-2358-4bed-a474-21170a45577d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:10:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Lock "/opt/stack/data/nova/instances/f0b2a902-2358-4bed-a474-21170a45577d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:10:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:10:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.177s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:10:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Acquiring lock "818b9e28e061d41a38d903968b229be2ed9ba520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:10:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:10:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:10:40 user nova-compute[75100]: DEBUG nova.network.neutron [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Successfully updated port: 06c73859-cc53-487c-8bd8-9c4f5961e3cd {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 18:10:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Acquiring lock "refresh_cache-7003b97b-edf1-4972-a0be-dcb41c329ec8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:10:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Acquired lock "refresh_cache-7003b97b-edf1-4972-a0be-dcb41c329ec8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:10:40 user nova-compute[75100]: DEBUG nova.network.neutron [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 18:10:40 user nova-compute[75100]: DEBUG nova.compute.manager [req-bba610ef-e1f7-49d1-8567-8ecfd0e7a07d req-59818d2c-091c-47f1-b16c-b9dad15abd34 service nova] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Received event network-changed-06c73859-cc53-487c-8bd8-9c4f5961e3cd {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:10:40 user nova-compute[75100]: DEBUG nova.compute.manager [req-bba610ef-e1f7-49d1-8567-8ecfd0e7a07d req-59818d2c-091c-47f1-b16c-b9dad15abd34 service nova] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Refreshing instance network info cache due to event network-changed-06c73859-cc53-487c-8bd8-9c4f5961e3cd. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 18:10:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-bba610ef-e1f7-49d1-8567-8ecfd0e7a07d req-59818d2c-091c-47f1-b16c-b9dad15abd34 service nova] Acquiring lock "refresh_cache-7003b97b-edf1-4972-a0be-dcb41c329ec8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:10:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.188s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:10:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/f0b2a902-2358-4bed-a474-21170a45577d/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:10:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:10:40 user nova-compute[75100]: DEBUG nova.network.neutron [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 18:10:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/f0b2a902-2358-4bed-a474-21170a45577d/disk 1073741824" returned: 0 in 0.058s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:10:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:10:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:10:40 user nova-compute[75100]: DEBUG nova.network.neutron [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Successfully created port: 6a80628d-e450-4d72-86c9-08d8578d9f17 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 18:10:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.191s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:10:40 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f0b2a902-2358-4bed-a474-21170a45577d/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 18:10:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0b2a902-2358-4bed-a474-21170a45577d/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG nova.network.neutron [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Updating instance_info_cache with network_info: [{"id": "06c73859-cc53-487c-8bd8-9c4f5961e3cd", "address": "fa:16:3e:4b:06:cf", "network": {"id": "e906a397-504d-48d8-8726-187cfbb1f270", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2095832274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4e5cb8bdc24a009dcb3dbee36a6bce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06c73859-cc", "ovs_interfaceid": "06c73859-cc53-487c-8bd8-9c4f5961e3cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Releasing lock "refresh_cache-7003b97b-edf1-4972-a0be-dcb41c329ec8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG nova.compute.manager [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Instance network_info: |[{"id": "06c73859-cc53-487c-8bd8-9c4f5961e3cd", "address": "fa:16:3e:4b:06:cf", "network": {"id": "e906a397-504d-48d8-8726-187cfbb1f270", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2095832274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4e5cb8bdc24a009dcb3dbee36a6bce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06c73859-cc", "ovs_interfaceid": "06c73859-cc53-487c-8bd8-9c4f5961e3cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-bba610ef-e1f7-49d1-8567-8ecfd0e7a07d req-59818d2c-091c-47f1-b16c-b9dad15abd34 service nova] Acquired lock "refresh_cache-7003b97b-edf1-4972-a0be-dcb41c329ec8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG nova.network.neutron [req-bba610ef-e1f7-49d1-8567-8ecfd0e7a07d req-59818d2c-091c-47f1-b16c-b9dad15abd34 service nova] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Refreshing network info cache for port 06c73859-cc53-487c-8bd8-9c4f5961e3cd {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Start _get_guest_xml network_info=[{"id": "06c73859-cc53-487c-8bd8-9c4f5961e3cd", "address": "fa:16:3e:4b:06:cf", "network": {"id": "e906a397-504d-48d8-8726-187cfbb1f270", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2095832274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4e5cb8bdc24a009dcb3dbee36a6bce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06c73859-cc", "ovs_interfaceid": "06c73859-cc53-487c-8bd8-9c4f5961e3cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'e3cc5321-4d40-49ee-885c-700e14741732'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 18:10:41 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:10:41 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:10:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T17:40:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:10:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-149784190',display_name='tempest-AttachVolumeNegativeTest-server-149784190',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-149784190',id=44,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG+dnNz+Nse8iAXzN+U2goYcybHM2a5LO2IBlmotfjKbfAvA2Rg3L9qGFUYcK/DFySgZVl29zl7CYYPwJ07z+gjQcOh14ezfqqHLjgbspWem6A94L4Rq8l1ZI/E1Oz7/aw==',key_name='tempest-keypair-2055020147',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d4e5cb8bdc24a009dcb3dbee36a6bce',ramdisk_id='',reservation_id='r-omfq5km6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1395057280',owner_user_name='tempest-AttachVolumeNegativeTest-1395057280-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T18:10:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efe92a172011414e8507cb6ddbfab0bb',uuid=7003b97b-edf1-4972-a0be-dcb41c329ec8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06c73859-cc53-487c-8bd8-9c4f5961e3cd", "address": "fa:16:3e:4b:06:cf", "network": {"id": "e906a397-504d-48d8-8726-187cfbb1f270", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2095832274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4e5cb8bdc24a009dcb3dbee36a6bce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06c73859-cc", "ovs_interfaceid": "06c73859-cc53-487c-8bd8-9c4f5961e3cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Converting VIF {"id": "06c73859-cc53-487c-8bd8-9c4f5961e3cd", "address": "fa:16:3e:4b:06:cf", "network": {"id": "e906a397-504d-48d8-8726-187cfbb1f270", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2095832274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4e5cb8bdc24a009dcb3dbee36a6bce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06c73859-cc", "ovs_interfaceid": "06c73859-cc53-487c-8bd8-9c4f5961e3cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:06:cf,bridge_name='br-int',has_traffic_filtering=True,id=06c73859-cc53-487c-8bd8-9c4f5961e3cd,network=Network(e906a397-504d-48d8-8726-187cfbb1f270),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06c73859-cc') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG nova.objects.instance [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lazy-loading 'pci_devices' on Instance uuid 7003b97b-edf1-4972-a0be-dcb41c329ec8 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0b2a902-2358-4bed-a474-21170a45577d/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Cannot resize image /opt/stack/data/nova/instances/f0b2a902-2358-4bed-a474-21170a45577d/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Ensure instance console log exists: /opt/stack/data/nova/instances/f0b2a902-2358-4bed-a474-21170a45577d/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] End _get_guest_xml xml=<domain type="kvm">
Nov 10 18:10:41 user nova-compute[75100]:   <uuid>7003b97b-edf1-4972-a0be-dcb41c329ec8</uuid>
Nov 10 18:10:41 user nova-compute[75100]:   <name>instance-0000002c</name>
Nov 10 18:10:41 user nova-compute[75100]:   <memory>524288</memory>
Nov 10 18:10:41 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 10 18:10:41 user nova-compute[75100]:   <metadata>
Nov 10 18:10:41 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 18:10:41 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 10 18:10:41 user nova-compute[75100]:       <nova:name>tempest-AttachVolumeNegativeTest-server-149784190</nova:name>
Nov 10 18:10:41 user nova-compute[75100]:       <nova:creationTime>2023-11-10 18:10:41</nova:creationTime>
Nov 10 18:10:41 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 10 18:10:41 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 10 18:10:41 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 10 18:10:41 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 10 18:10:41 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 18:10:41 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 10 18:10:41 user nova-compute[75100]:       </nova:flavor>
Nov 10 18:10:41 user nova-compute[75100]:       <nova:owner>
Nov 10 18:10:41 user nova-compute[75100]:         <nova:user uuid="efe92a172011414e8507cb6ddbfab0bb">tempest-AttachVolumeNegativeTest-1395057280-project-member</nova:user>
Nov 10 18:10:41 user nova-compute[75100]:         <nova:project uuid="9d4e5cb8bdc24a009dcb3dbee36a6bce">tempest-AttachVolumeNegativeTest-1395057280</nova:project>
Nov 10 18:10:41 user nova-compute[75100]:       </nova:owner>
Nov 10 18:10:41 user nova-compute[75100]:       <nova:root type="image" uuid="e3cc5321-4d40-49ee-885c-700e14741732"/>
Nov 10 18:10:41 user nova-compute[75100]:       <nova:ports>
Nov 10 18:10:41 user nova-compute[75100]:         <nova:port uuid="06c73859-cc53-487c-8bd8-9c4f5961e3cd">
Nov 10 18:10:41 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 10 18:10:41 user nova-compute[75100]:         </nova:port>
Nov 10 18:10:41 user nova-compute[75100]:       </nova:ports>
Nov 10 18:10:41 user nova-compute[75100]:     </nova:instance>
Nov 10 18:10:41 user nova-compute[75100]:   </metadata>
Nov 10 18:10:41 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 10 18:10:41 user nova-compute[75100]:     <system>
Nov 10 18:10:41 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 18:10:41 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 10 18:10:41 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 10 18:10:41 user nova-compute[75100]:       <entry name="serial">7003b97b-edf1-4972-a0be-dcb41c329ec8</entry>
Nov 10 18:10:41 user nova-compute[75100]:       <entry name="uuid">7003b97b-edf1-4972-a0be-dcb41c329ec8</entry>
Nov 10 18:10:41 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 10 18:10:41 user nova-compute[75100]:     </system>
Nov 10 18:10:41 user nova-compute[75100]:   </sysinfo>
Nov 10 18:10:41 user nova-compute[75100]:   <os>
Nov 10 18:10:41 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 18:10:41 user nova-compute[75100]:     <boot dev="hd"/>
Nov 10 18:10:41 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 10 18:10:41 user nova-compute[75100]:   </os>
Nov 10 18:10:41 user nova-compute[75100]:   <features>
Nov 10 18:10:41 user nova-compute[75100]:     <acpi/>
Nov 10 18:10:41 user nova-compute[75100]:     <apic/>
Nov 10 18:10:41 user nova-compute[75100]:     <vmcoreinfo/>
Nov 10 18:10:41 user nova-compute[75100]:   </features>
Nov 10 18:10:41 user nova-compute[75100]:   <clock offset="utc">
Nov 10 18:10:41 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 18:10:41 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 18:10:41 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 10 18:10:41 user nova-compute[75100]:   </clock>
Nov 10 18:10:41 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 10 18:10:41 user nova-compute[75100]:     <model>Nehalem</model>
Nov 10 18:10:41 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 18:10:41 user nova-compute[75100]:   </cpu>
Nov 10 18:10:41 user nova-compute[75100]:   <devices>
Nov 10 18:10:41 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 10 18:10:41 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 18:10:41 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/7003b97b-edf1-4972-a0be-dcb41c329ec8/disk"/>
Nov 10 18:10:41 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 10 18:10:41 user nova-compute[75100]:     </disk>
Nov 10 18:10:41 user nova-compute[75100]:     <interface type="ethernet">
Nov 10 18:10:41 user nova-compute[75100]:       <mac address="fa:16:3e:4b:06:cf"/>
Nov 10 18:10:41 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 18:10:41 user nova-compute[75100]:       <mtu size="1442"/>
Nov 10 18:10:41 user nova-compute[75100]:       <target dev="tap06c73859-cc"/>
Nov 10 18:10:41 user nova-compute[75100]:     </interface>
Nov 10 18:10:41 user nova-compute[75100]:     <serial type="pty">
Nov 10 18:10:41 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/7003b97b-edf1-4972-a0be-dcb41c329ec8/console.log" append="off"/>
Nov 10 18:10:41 user nova-compute[75100]:     </serial>
Nov 10 18:10:41 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 18:10:41 user nova-compute[75100]:     <video>
Nov 10 18:10:41 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 18:10:41 user nova-compute[75100]:     </video>
Nov 10 18:10:41 user nova-compute[75100]:     <rng model="virtio">
Nov 10 18:10:41 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 10 18:10:41 user nova-compute[75100]:     </rng>
Nov 10 18:10:41 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 10 18:10:41 user nova-compute[75100]:     <memballoon model="virtio">
Nov 10 18:10:41 user nova-compute[75100]:       <stats period="10"/>
Nov 10 18:10:41 user nova-compute[75100]:     </memballoon>
Nov 10 18:10:41 user nova-compute[75100]:   </devices>
Nov 10 18:10:41 user nova-compute[75100]: </domain>
Nov 10 18:10:41 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:10:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-149784190',display_name='tempest-AttachVolumeNegativeTest-server-149784190',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-149784190',id=44,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG+dnNz+Nse8iAXzN+U2goYcybHM2a5LO2IBlmotfjKbfAvA2Rg3L9qGFUYcK/DFySgZVl29zl7CYYPwJ07z+gjQcOh14ezfqqHLjgbspWem6A94L4Rq8l1ZI/E1Oz7/aw==',key_name='tempest-keypair-2055020147',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d4e5cb8bdc24a009dcb3dbee36a6bce',ramdisk_id='',reservation_id='r-omfq5km6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1395057280',owner_user_name='tempest-AttachVolumeNegativeTest-1395057280-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T18:10:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efe92a172011414e8507cb6ddbfab0bb',uuid=7003b97b-edf1-4972-a0be-dcb41c329ec8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06c73859-cc53-487c-8bd8-9c4f5961e3cd", "address": "fa:16:3e:4b:06:cf", "network": {"id": "e906a397-504d-48d8-8726-187cfbb1f270", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2095832274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4e5cb8bdc24a009dcb3dbee36a6bce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06c73859-cc", "ovs_interfaceid": "06c73859-cc53-487c-8bd8-9c4f5961e3cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Converting VIF {"id": "06c73859-cc53-487c-8bd8-9c4f5961e3cd", "address": "fa:16:3e:4b:06:cf", "network": {"id": "e906a397-504d-48d8-8726-187cfbb1f270", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2095832274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4e5cb8bdc24a009dcb3dbee36a6bce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06c73859-cc", "ovs_interfaceid": "06c73859-cc53-487c-8bd8-9c4f5961e3cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:06:cf,bridge_name='br-int',has_traffic_filtering=True,id=06c73859-cc53-487c-8bd8-9c4f5961e3cd,network=Network(e906a397-504d-48d8-8726-187cfbb1f270),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06c73859-cc') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG os_vif [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:06:cf,bridge_name='br-int',has_traffic_filtering=True,id=06c73859-cc53-487c-8bd8-9c4f5961e3cd,network=Network(e906a397-504d-48d8-8726-187cfbb1f270),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06c73859-cc') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3548a3c4-7543-5b68-9ab7-02cd54a218a5', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap06c73859-cc, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap06c73859-cc, col_values=(('qos', UUID('18193846-ac26-458b-95b7-b360c9540a3f')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap06c73859-cc, col_values=(('external_ids', {'iface-id': '06c73859-cc53-487c-8bd8-9c4f5961e3cd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:06:cf', 'vm-uuid': '7003b97b-edf1-4972-a0be-dcb41c329ec8'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:10:41 user nova-compute[75100]: INFO os_vif [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:06:cf,bridge_name='br-int',has_traffic_filtering=True,id=06c73859-cc53-487c-8bd8-9c4f5961e3cd,network=Network(e906a397-504d-48d8-8726-187cfbb1f270),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06c73859-cc')
Nov 10 18:10:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] No VIF found with MAC fa:16:3e:4b:06:cf, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG nova.network.neutron [req-bba610ef-e1f7-49d1-8567-8ecfd0e7a07d req-59818d2c-091c-47f1-b16c-b9dad15abd34 service nova] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Updated VIF entry in instance network info cache for port 06c73859-cc53-487c-8bd8-9c4f5961e3cd. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG nova.network.neutron [req-bba610ef-e1f7-49d1-8567-8ecfd0e7a07d req-59818d2c-091c-47f1-b16c-b9dad15abd34 service nova] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Updating instance_info_cache with network_info: [{"id": "06c73859-cc53-487c-8bd8-9c4f5961e3cd", "address": "fa:16:3e:4b:06:cf", "network": {"id": "e906a397-504d-48d8-8726-187cfbb1f270", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2095832274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4e5cb8bdc24a009dcb3dbee36a6bce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06c73859-cc", "ovs_interfaceid": "06c73859-cc53-487c-8bd8-9c4f5961e3cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-bba610ef-e1f7-49d1-8567-8ecfd0e7a07d req-59818d2c-091c-47f1-b16c-b9dad15abd34 service nova] Releasing lock "refresh_cache-7003b97b-edf1-4972-a0be-dcb41c329ec8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG nova.network.neutron [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Successfully updated port: 6a80628d-e450-4d72-86c9-08d8578d9f17 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Acquiring lock "refresh_cache-f0b2a902-2358-4bed-a474-21170a45577d" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Acquired lock "refresh_cache-f0b2a902-2358-4bed-a474-21170a45577d" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG nova.network.neutron [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG nova.compute.manager [req-fd34244a-57d4-4aa9-aea3-bf12f6a63b2f req-07cbeb64-26e4-4636-bd71-a298e9fa833b service nova] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Received event network-changed-6a80628d-e450-4d72-86c9-08d8578d9f17 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG nova.compute.manager [req-fd34244a-57d4-4aa9-aea3-bf12f6a63b2f req-07cbeb64-26e4-4636-bd71-a298e9fa833b service nova] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Refreshing instance network info cache due to event network-changed-6a80628d-e450-4d72-86c9-08d8578d9f17. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-fd34244a-57d4-4aa9-aea3-bf12f6a63b2f req-07cbeb64-26e4-4636-bd71-a298e9fa833b service nova] Acquiring lock "refresh_cache-f0b2a902-2358-4bed-a474-21170a45577d" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG nova.network.neutron [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG nova.network.neutron [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Updating instance_info_cache with network_info: [{"id": "6a80628d-e450-4d72-86c9-08d8578d9f17", "address": "fa:16:3e:01:34:07", "network": {"id": "5e6c66a5-a7bb-4157-aed0-8f8f7cfa846c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-209207359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1b6a6cf82404999aa9e2d5f99b5b9df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a80628d-e4", "ovs_interfaceid": "6a80628d-e450-4d72-86c9-08d8578d9f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Releasing lock "refresh_cache-f0b2a902-2358-4bed-a474-21170a45577d" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG nova.compute.manager [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Instance network_info: |[{"id": "6a80628d-e450-4d72-86c9-08d8578d9f17", "address": "fa:16:3e:01:34:07", "network": {"id": "5e6c66a5-a7bb-4157-aed0-8f8f7cfa846c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-209207359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1b6a6cf82404999aa9e2d5f99b5b9df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a80628d-e4", "ovs_interfaceid": "6a80628d-e450-4d72-86c9-08d8578d9f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-fd34244a-57d4-4aa9-aea3-bf12f6a63b2f req-07cbeb64-26e4-4636-bd71-a298e9fa833b service nova] Acquired lock "refresh_cache-f0b2a902-2358-4bed-a474-21170a45577d" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG nova.network.neutron [req-fd34244a-57d4-4aa9-aea3-bf12f6a63b2f req-07cbeb64-26e4-4636-bd71-a298e9fa833b service nova] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Refreshing network info cache for port 6a80628d-e450-4d72-86c9-08d8578d9f17 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Start _get_guest_xml network_info=[{"id": "6a80628d-e450-4d72-86c9-08d8578d9f17", "address": "fa:16:3e:01:34:07", "network": {"id": "5e6c66a5-a7bb-4157-aed0-8f8f7cfa846c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-209207359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1b6a6cf82404999aa9e2d5f99b5b9df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a80628d-e4", "ovs_interfaceid": "6a80628d-e450-4d72-86c9-08d8578d9f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'e3cc5321-4d40-49ee-885c-700e14741732'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 18:10:41 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:10:41 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:10:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T17:40:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 18:10:41 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 18:10:42 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:10:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1171196664',display_name='tempest-TestServerVolumeAttachmentScenario-server-1171196664',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1171196664',id=45,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAuW+kCJia8KV27/A+k6o3SR678YpqbdO9leaTozOnoVey1Aq212cTr1XgJimDRIKt8S71baUVitkBRpZ1r9a2LKWAzFPdWzhdIbv3iaHEBTMkEm7SWt8A8QqO/GnIiOg==',key_name='tempest-keypair-2024642438',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1b6a6cf82404999aa9e2d5f99b5b9df',ramdisk_id='',reservation_id='r-q8ykhnnn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-360864520',owner_user_name='tempest-TestServerVolumeAttachmentScenario-360864520-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T18:10:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01dec08989fe49f781636aec26e41900',uuid=f0b2a902-2358-4bed-a474-21170a45577d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a80628d-e450-4d72-86c9-08d8578d9f17", "address": "fa:16:3e:01:34:07", "network": {"id": "5e6c66a5-a7bb-4157-aed0-8f8f7cfa846c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-209207359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1b6a6cf82404999aa9e2d5f99b5b9df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a80628d-e4", "ovs_interfaceid": "6a80628d-e450-4d72-86c9-08d8578d9f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 18:10:42 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Converting VIF {"id": "6a80628d-e450-4d72-86c9-08d8578d9f17", "address": "fa:16:3e:01:34:07", "network": {"id": "5e6c66a5-a7bb-4157-aed0-8f8f7cfa846c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-209207359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1b6a6cf82404999aa9e2d5f99b5b9df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a80628d-e4", "ovs_interfaceid": "6a80628d-e450-4d72-86c9-08d8578d9f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:10:42 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:34:07,bridge_name='br-int',has_traffic_filtering=True,id=6a80628d-e450-4d72-86c9-08d8578d9f17,network=Network(5e6c66a5-a7bb-4157-aed0-8f8f7cfa846c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a80628d-e4') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:10:42 user nova-compute[75100]: DEBUG nova.objects.instance [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Lazy-loading 'pci_devices' on Instance uuid f0b2a902-2358-4bed-a474-21170a45577d {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:10:42 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] [instance: f0b2a902-2358-4bed-a474-21170a45577d] End _get_guest_xml xml=<domain type="kvm">
Nov 10 18:10:42 user nova-compute[75100]:   <uuid>f0b2a902-2358-4bed-a474-21170a45577d</uuid>
Nov 10 18:10:42 user nova-compute[75100]:   <name>instance-0000002d</name>
Nov 10 18:10:42 user nova-compute[75100]:   <memory>524288</memory>
Nov 10 18:10:42 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 10 18:10:42 user nova-compute[75100]:   <metadata>
Nov 10 18:10:42 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 18:10:42 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 10 18:10:42 user nova-compute[75100]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1171196664</nova:name>
Nov 10 18:10:42 user nova-compute[75100]:       <nova:creationTime>2023-11-10 18:10:41</nova:creationTime>
Nov 10 18:10:42 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 10 18:10:42 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 10 18:10:42 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 10 18:10:42 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 10 18:10:42 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 18:10:42 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 10 18:10:42 user nova-compute[75100]:       </nova:flavor>
Nov 10 18:10:42 user nova-compute[75100]:       <nova:owner>
Nov 10 18:10:42 user nova-compute[75100]:         <nova:user uuid="01dec08989fe49f781636aec26e41900">tempest-TestServerVolumeAttachmentScenario-360864520-project-member</nova:user>
Nov 10 18:10:42 user nova-compute[75100]:         <nova:project uuid="f1b6a6cf82404999aa9e2d5f99b5b9df">tempest-TestServerVolumeAttachmentScenario-360864520</nova:project>
Nov 10 18:10:42 user nova-compute[75100]:       </nova:owner>
Nov 10 18:10:42 user nova-compute[75100]:       <nova:root type="image" uuid="e3cc5321-4d40-49ee-885c-700e14741732"/>
Nov 10 18:10:42 user nova-compute[75100]:       <nova:ports>
Nov 10 18:10:42 user nova-compute[75100]:         <nova:port uuid="6a80628d-e450-4d72-86c9-08d8578d9f17">
Nov 10 18:10:42 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 10 18:10:42 user nova-compute[75100]:         </nova:port>
Nov 10 18:10:42 user nova-compute[75100]:       </nova:ports>
Nov 10 18:10:42 user nova-compute[75100]:     </nova:instance>
Nov 10 18:10:42 user nova-compute[75100]:   </metadata>
Nov 10 18:10:42 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 10 18:10:42 user nova-compute[75100]:     <system>
Nov 10 18:10:42 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 18:10:42 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 10 18:10:42 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 10 18:10:42 user nova-compute[75100]:       <entry name="serial">f0b2a902-2358-4bed-a474-21170a45577d</entry>
Nov 10 18:10:42 user nova-compute[75100]:       <entry name="uuid">f0b2a902-2358-4bed-a474-21170a45577d</entry>
Nov 10 18:10:42 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 10 18:10:42 user nova-compute[75100]:     </system>
Nov 10 18:10:42 user nova-compute[75100]:   </sysinfo>
Nov 10 18:10:42 user nova-compute[75100]:   <os>
Nov 10 18:10:42 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 18:10:42 user nova-compute[75100]:     <boot dev="hd"/>
Nov 10 18:10:42 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 10 18:10:42 user nova-compute[75100]:   </os>
Nov 10 18:10:42 user nova-compute[75100]:   <features>
Nov 10 18:10:42 user nova-compute[75100]:     <acpi/>
Nov 10 18:10:42 user nova-compute[75100]:     <apic/>
Nov 10 18:10:42 user nova-compute[75100]:     <vmcoreinfo/>
Nov 10 18:10:42 user nova-compute[75100]:   </features>
Nov 10 18:10:42 user nova-compute[75100]:   <clock offset="utc">
Nov 10 18:10:42 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 18:10:42 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 18:10:42 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 10 18:10:42 user nova-compute[75100]:   </clock>
Nov 10 18:10:42 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 10 18:10:42 user nova-compute[75100]:     <model>Nehalem</model>
Nov 10 18:10:42 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 18:10:42 user nova-compute[75100]:   </cpu>
Nov 10 18:10:42 user nova-compute[75100]:   <devices>
Nov 10 18:10:42 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 10 18:10:42 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 18:10:42 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/f0b2a902-2358-4bed-a474-21170a45577d/disk"/>
Nov 10 18:10:42 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 10 18:10:42 user nova-compute[75100]:     </disk>
Nov 10 18:10:42 user nova-compute[75100]:     <interface type="ethernet">
Nov 10 18:10:42 user nova-compute[75100]:       <mac address="fa:16:3e:01:34:07"/>
Nov 10 18:10:42 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 18:10:42 user nova-compute[75100]:       <mtu size="1442"/>
Nov 10 18:10:42 user nova-compute[75100]:       <target dev="tap6a80628d-e4"/>
Nov 10 18:10:42 user nova-compute[75100]:     </interface>
Nov 10 18:10:42 user nova-compute[75100]:     <serial type="pty">
Nov 10 18:10:42 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/f0b2a902-2358-4bed-a474-21170a45577d/console.log" append="off"/>
Nov 10 18:10:42 user nova-compute[75100]:     </serial>
Nov 10 18:10:42 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 18:10:42 user nova-compute[75100]:     <video>
Nov 10 18:10:42 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 18:10:42 user nova-compute[75100]:     </video>
Nov 10 18:10:42 user nova-compute[75100]:     <rng model="virtio">
Nov 10 18:10:42 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 10 18:10:42 user nova-compute[75100]:     </rng>
Nov 10 18:10:42 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 10 18:10:42 user nova-compute[75100]:     <memballoon model="virtio">
Nov 10 18:10:42 user nova-compute[75100]:       <stats period="10"/>
Nov 10 18:10:42 user nova-compute[75100]:     </memballoon>
Nov 10 18:10:42 user nova-compute[75100]:   </devices>
Nov 10 18:10:42 user nova-compute[75100]: </domain>
Nov 10 18:10:42 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 18:10:42 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:10:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1171196664',display_name='tempest-TestServerVolumeAttachmentScenario-server-1171196664',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1171196664',id=45,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAuW+kCJia8KV27/A+k6o3SR678YpqbdO9leaTozOnoVey1Aq212cTr1XgJimDRIKt8S71baUVitkBRpZ1r9a2LKWAzFPdWzhdIbv3iaHEBTMkEm7SWt8A8QqO/GnIiOg==',key_name='tempest-keypair-2024642438',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1b6a6cf82404999aa9e2d5f99b5b9df',ramdisk_id='',reservation_id='r-q8ykhnnn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-360864520',owner_user_name='tempest-TestServerVolumeAttachmentScenario-360864520-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T18:10:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01dec08989fe49f781636aec26e41900',uuid=f0b2a902-2358-4bed-a474-21170a45577d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a80628d-e450-4d72-86c9-08d8578d9f17", "address": "fa:16:3e:01:34:07", "network": {"id": "5e6c66a5-a7bb-4157-aed0-8f8f7cfa846c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-209207359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1b6a6cf82404999aa9e2d5f99b5b9df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a80628d-e4", "ovs_interfaceid": "6a80628d-e450-4d72-86c9-08d8578d9f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 18:10:42 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Converting VIF {"id": "6a80628d-e450-4d72-86c9-08d8578d9f17", "address": "fa:16:3e:01:34:07", "network": {"id": "5e6c66a5-a7bb-4157-aed0-8f8f7cfa846c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-209207359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1b6a6cf82404999aa9e2d5f99b5b9df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a80628d-e4", "ovs_interfaceid": "6a80628d-e450-4d72-86c9-08d8578d9f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:10:42 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:34:07,bridge_name='br-int',has_traffic_filtering=True,id=6a80628d-e450-4d72-86c9-08d8578d9f17,network=Network(5e6c66a5-a7bb-4157-aed0-8f8f7cfa846c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a80628d-e4') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:10:42 user nova-compute[75100]: DEBUG os_vif [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:34:07,bridge_name='br-int',has_traffic_filtering=True,id=6a80628d-e450-4d72-86c9-08d8578d9f17,network=Network(5e6c66a5-a7bb-4157-aed0-8f8f7cfa846c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a80628d-e4') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 18:10:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:10:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:10:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 18:10:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:10:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'de154292-94b5-5928-8450-0b81f71a742b', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:10:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:10:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:10:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:10:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6a80628d-e4, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:10:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6a80628d-e4, col_values=(('qos', UUID('b9131a59-ea85-473a-a3d4-327e6c6b3181')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:10:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6a80628d-e4, col_values=(('external_ids', {'iface-id': '6a80628d-e450-4d72-86c9-08d8578d9f17', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:34:07', 'vm-uuid': 'f0b2a902-2358-4bed-a474-21170a45577d'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:10:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:10:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:10:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:10:42 user nova-compute[75100]: INFO os_vif [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:34:07,bridge_name='br-int',has_traffic_filtering=True,id=6a80628d-e450-4d72-86c9-08d8578d9f17,network=Network(5e6c66a5-a7bb-4157-aed0-8f8f7cfa846c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a80628d-e4')
Nov 10 18:10:42 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 18:10:42 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] No VIF found with MAC fa:16:3e:01:34:07, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 18:10:42 user nova-compute[75100]: DEBUG nova.network.neutron [req-fd34244a-57d4-4aa9-aea3-bf12f6a63b2f req-07cbeb64-26e4-4636-bd71-a298e9fa833b service nova] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Updated VIF entry in instance network info cache for port 6a80628d-e450-4d72-86c9-08d8578d9f17. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 18:10:42 user nova-compute[75100]: DEBUG nova.network.neutron [req-fd34244a-57d4-4aa9-aea3-bf12f6a63b2f req-07cbeb64-26e4-4636-bd71-a298e9fa833b service nova] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Updating instance_info_cache with network_info: [{"id": "6a80628d-e450-4d72-86c9-08d8578d9f17", "address": "fa:16:3e:01:34:07", "network": {"id": "5e6c66a5-a7bb-4157-aed0-8f8f7cfa846c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-209207359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1b6a6cf82404999aa9e2d5f99b5b9df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a80628d-e4", "ovs_interfaceid": "6a80628d-e450-4d72-86c9-08d8578d9f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:10:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-fd34244a-57d4-4aa9-aea3-bf12f6a63b2f req-07cbeb64-26e4-4636-bd71-a298e9fa833b service nova] Releasing lock "refresh_cache-f0b2a902-2358-4bed-a474-21170a45577d" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:10:42 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:10:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:10:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:10:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:10:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:10:43 user nova-compute[75100]: DEBUG nova.compute.manager [req-eae9201f-ed1c-45ff-98e1-41eac5ce12ff req-b49d12b9-0109-4a41-b553-47a317b379fe service nova] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Received event network-vif-plugged-06c73859-cc53-487c-8bd8-9c4f5961e3cd {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:10:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-eae9201f-ed1c-45ff-98e1-41eac5ce12ff req-b49d12b9-0109-4a41-b553-47a317b379fe service nova] Acquiring lock "7003b97b-edf1-4972-a0be-dcb41c329ec8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:10:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-eae9201f-ed1c-45ff-98e1-41eac5ce12ff req-b49d12b9-0109-4a41-b553-47a317b379fe service nova] Lock "7003b97b-edf1-4972-a0be-dcb41c329ec8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:10:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-eae9201f-ed1c-45ff-98e1-41eac5ce12ff req-b49d12b9-0109-4a41-b553-47a317b379fe service nova] Lock "7003b97b-edf1-4972-a0be-dcb41c329ec8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:10:43 user nova-compute[75100]: DEBUG nova.compute.manager [req-eae9201f-ed1c-45ff-98e1-41eac5ce12ff req-b49d12b9-0109-4a41-b553-47a317b379fe service nova] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] No waiting events found dispatching network-vif-plugged-06c73859-cc53-487c-8bd8-9c4f5961e3cd {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:10:43 user nova-compute[75100]: WARNING nova.compute.manager [req-eae9201f-ed1c-45ff-98e1-41eac5ce12ff req-b49d12b9-0109-4a41-b553-47a317b379fe service nova] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Received unexpected event network-vif-plugged-06c73859-cc53-487c-8bd8-9c4f5961e3cd for instance with vm_state building and task_state spawning.
Nov 10 18:10:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:10:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:10:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:10:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:10:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:10:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:10:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:10:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:10:44 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Triggering sync for uuid 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75 {{(pid=75100) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 18:10:44 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Triggering sync for uuid 4ebd9d80-365d-4334-8421-3b22a846321a {{(pid=75100) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 18:10:44 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Triggering sync for uuid 440fd7bb-5296-4f07-a2f8-0b6154baeb80 {{(pid=75100) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 18:10:44 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Triggering sync for uuid 7003b97b-edf1-4972-a0be-dcb41c329ec8 {{(pid=75100) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 18:10:44 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Triggering sync for uuid f0b2a902-2358-4bed-a474-21170a45577d {{(pid=75100) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 18:10:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "22c021d9-c8e4-455d-8e2a-a9cdfbb38f75" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:10:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "22c021d9-c8e4-455d-8e2a-a9cdfbb38f75" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:10:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "4ebd9d80-365d-4334-8421-3b22a846321a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:10:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "4ebd9d80-365d-4334-8421-3b22a846321a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:10:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "440fd7bb-5296-4f07-a2f8-0b6154baeb80" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:10:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "440fd7bb-5296-4f07-a2f8-0b6154baeb80" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:10:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "7003b97b-edf1-4972-a0be-dcb41c329ec8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:10:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "f0b2a902-2358-4bed-a474-21170a45577d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:10:44 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:10:44 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 18:10:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "4ebd9d80-365d-4334-8421-3b22a846321a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:10:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "22c021d9-c8e4-455d-8e2a-a9cdfbb38f75" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:10:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "440fd7bb-5296-4f07-a2f8-0b6154baeb80" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:10:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:10:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:10:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:10:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:10:45 user nova-compute[75100]: DEBUG nova.compute.manager [req-f3fb99e0-8c9c-4844-acf3-842e105e6e71 req-4d408972-400c-45f9-a274-77fc452013e6 service nova] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Received event network-vif-plugged-06c73859-cc53-487c-8bd8-9c4f5961e3cd {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:10:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f3fb99e0-8c9c-4844-acf3-842e105e6e71 req-4d408972-400c-45f9-a274-77fc452013e6 service nova] Acquiring lock "7003b97b-edf1-4972-a0be-dcb41c329ec8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:10:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f3fb99e0-8c9c-4844-acf3-842e105e6e71 req-4d408972-400c-45f9-a274-77fc452013e6 service nova] Lock "7003b97b-edf1-4972-a0be-dcb41c329ec8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:10:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f3fb99e0-8c9c-4844-acf3-842e105e6e71 req-4d408972-400c-45f9-a274-77fc452013e6 service nova] Lock "7003b97b-edf1-4972-a0be-dcb41c329ec8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:10:45 user nova-compute[75100]: DEBUG nova.compute.manager [req-f3fb99e0-8c9c-4844-acf3-842e105e6e71 req-4d408972-400c-45f9-a274-77fc452013e6 service nova] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] No waiting events found dispatching network-vif-plugged-06c73859-cc53-487c-8bd8-9c4f5961e3cd {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:10:45 user nova-compute[75100]: WARNING nova.compute.manager [req-f3fb99e0-8c9c-4844-acf3-842e105e6e71 req-4d408972-400c-45f9-a274-77fc452013e6 service nova] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Received unexpected event network-vif-plugged-06c73859-cc53-487c-8bd8-9c4f5961e3cd for instance with vm_state building and task_state spawning.
Nov 10 18:10:45 user nova-compute[75100]: DEBUG nova.compute.manager [req-f3fb99e0-8c9c-4844-acf3-842e105e6e71 req-4d408972-400c-45f9-a274-77fc452013e6 service nova] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Received event network-vif-plugged-6a80628d-e450-4d72-86c9-08d8578d9f17 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:10:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f3fb99e0-8c9c-4844-acf3-842e105e6e71 req-4d408972-400c-45f9-a274-77fc452013e6 service nova] Acquiring lock "f0b2a902-2358-4bed-a474-21170a45577d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:10:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f3fb99e0-8c9c-4844-acf3-842e105e6e71 req-4d408972-400c-45f9-a274-77fc452013e6 service nova] Lock "f0b2a902-2358-4bed-a474-21170a45577d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:10:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f3fb99e0-8c9c-4844-acf3-842e105e6e71 req-4d408972-400c-45f9-a274-77fc452013e6 service nova] Lock "f0b2a902-2358-4bed-a474-21170a45577d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:10:45 user nova-compute[75100]: DEBUG nova.compute.manager [req-f3fb99e0-8c9c-4844-acf3-842e105e6e71 req-4d408972-400c-45f9-a274-77fc452013e6 service nova] [instance: f0b2a902-2358-4bed-a474-21170a45577d] No waiting events found dispatching network-vif-plugged-6a80628d-e450-4d72-86c9-08d8578d9f17 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:10:45 user nova-compute[75100]: WARNING nova.compute.manager [req-f3fb99e0-8c9c-4844-acf3-842e105e6e71 req-4d408972-400c-45f9-a274-77fc452013e6 service nova] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Received unexpected event network-vif-plugged-6a80628d-e450-4d72-86c9-08d8578d9f17 for instance with vm_state building and task_state spawning.
Nov 10 18:10:45 user nova-compute[75100]: DEBUG nova.compute.manager [req-f3fb99e0-8c9c-4844-acf3-842e105e6e71 req-4d408972-400c-45f9-a274-77fc452013e6 service nova] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Received event network-vif-plugged-6a80628d-e450-4d72-86c9-08d8578d9f17 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:10:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f3fb99e0-8c9c-4844-acf3-842e105e6e71 req-4d408972-400c-45f9-a274-77fc452013e6 service nova] Acquiring lock "f0b2a902-2358-4bed-a474-21170a45577d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:10:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f3fb99e0-8c9c-4844-acf3-842e105e6e71 req-4d408972-400c-45f9-a274-77fc452013e6 service nova] Lock "f0b2a902-2358-4bed-a474-21170a45577d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:10:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f3fb99e0-8c9c-4844-acf3-842e105e6e71 req-4d408972-400c-45f9-a274-77fc452013e6 service nova] Lock "f0b2a902-2358-4bed-a474-21170a45577d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:10:45 user nova-compute[75100]: DEBUG nova.compute.manager [req-f3fb99e0-8c9c-4844-acf3-842e105e6e71 req-4d408972-400c-45f9-a274-77fc452013e6 service nova] [instance: f0b2a902-2358-4bed-a474-21170a45577d] No waiting events found dispatching network-vif-plugged-6a80628d-e450-4d72-86c9-08d8578d9f17 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:10:45 user nova-compute[75100]: WARNING nova.compute.manager [req-f3fb99e0-8c9c-4844-acf3-842e105e6e71 req-4d408972-400c-45f9-a274-77fc452013e6 service nova] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Received unexpected event network-vif-plugged-6a80628d-e450-4d72-86c9-08d8578d9f17 for instance with vm_state building and task_state spawning.
Nov 10 18:10:45 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:10:45 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:10:45 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 18:10:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "refresh_cache-4ebd9d80-365d-4334-8421-3b22a846321a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:10:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquired lock "refresh_cache-4ebd9d80-365d-4334-8421-3b22a846321a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:10:45 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 18:10:46 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Updating instance_info_cache with network_info: [{"id": "c9011ff5-53de-43f3-be8e-ba86274b2c99", "address": "fa:16:3e:a7:f8:6b", "network": {"id": "bf1edb58-ef26-40ca-8ec9-853fa05de13d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1416469583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7bb141ef59487dbb2ce6243c5002af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9011ff5-53", "ovs_interfaceid": "c9011ff5-53de-43f3-be8e-ba86274b2c99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:10:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Releasing lock "refresh_cache-4ebd9d80-365d-4334-8421-3b22a846321a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:10:46 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 18:10:46 user nova-compute[75100]: DEBUG nova.compute.manager [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 18:10:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 18:10:46 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Instance spawned successfully.
Nov 10 18:10:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 18:10:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:10:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:10:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:10:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:10:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:10:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:10:46 user nova-compute[75100]: INFO nova.compute.manager [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Took 7.37 seconds to spawn the instance on the hypervisor.
Nov 10 18:10:46 user nova-compute[75100]: DEBUG nova.compute.manager [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 18:10:46 user nova-compute[75100]: DEBUG nova.compute.manager [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 18:10:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 18:10:46 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Instance spawned successfully.
Nov 10 18:10:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 18:10:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:10:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:10:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:10:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:10:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:10:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:10:46 user nova-compute[75100]: INFO nova.compute.manager [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Took 8.12 seconds to build instance.
Nov 10 18:10:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2d666126-4f79-4ca3-ab60-23da9e471924 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "7003b97b-edf1-4972-a0be-dcb41c329ec8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.235s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:10:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "7003b97b-edf1-4972-a0be-dcb41c329ec8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.980s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:10:46 user nova-compute[75100]: INFO nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] During sync_power_state the instance has a pending task (spawning). Skip.
Nov 10 18:10:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "7003b97b-edf1-4972-a0be-dcb41c329ec8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:10:46 user nova-compute[75100]: INFO nova.compute.manager [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Took 6.25 seconds to spawn the instance on the hypervisor.
Nov 10 18:10:46 user nova-compute[75100]: DEBUG nova.compute.manager [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 18:10:46 user nova-compute[75100]: INFO nova.compute.manager [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Took 7.30 seconds to build instance.
Nov 10 18:10:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-be294db9-e010-4085-8635-ed81be5a4ba4 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Lock "f0b2a902-2358-4bed-a474-21170a45577d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.433s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:10:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "f0b2a902-2358-4bed-a474-21170a45577d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 2.106s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:10:46 user nova-compute[75100]: INFO nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: f0b2a902-2358-4bed-a474-21170a45577d] During sync_power_state the instance has a pending task (spawning). Skip.
Nov 10 18:10:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "f0b2a902-2358-4bed-a474-21170a45577d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:10:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:10:47 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:10:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:10:50 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:10:50 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Cleaning up deleted instances {{(pid=75100) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 18:10:50 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] There are 0 instances to clean {{(pid=75100) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 18:10:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:10:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:10:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:11:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:11:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7e2c7715-621e-410f-9177-191bea9835fa tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Acquiring lock "440fd7bb-5296-4f07-a2f8-0b6154baeb80" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:11:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7e2c7715-621e-410f-9177-191bea9835fa tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Lock "440fd7bb-5296-4f07-a2f8-0b6154baeb80" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:11:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7e2c7715-621e-410f-9177-191bea9835fa tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Acquiring lock "440fd7bb-5296-4f07-a2f8-0b6154baeb80-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:11:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7e2c7715-621e-410f-9177-191bea9835fa tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Lock "440fd7bb-5296-4f07-a2f8-0b6154baeb80-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:11:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7e2c7715-621e-410f-9177-191bea9835fa tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Lock "440fd7bb-5296-4f07-a2f8-0b6154baeb80-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:11:04 user nova-compute[75100]: INFO nova.compute.manager [None req-7e2c7715-621e-410f-9177-191bea9835fa tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 440fd7bb-5296-4f07-a2f8-0b6154baeb80] Terminating instance
Nov 10 18:11:04 user nova-compute[75100]: DEBUG nova.compute.manager [None req-7e2c7715-621e-410f-9177-191bea9835fa tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 440fd7bb-5296-4f07-a2f8-0b6154baeb80] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 18:11:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:11:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:11:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:11:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:11:04 user nova-compute[75100]: DEBUG nova.compute.manager [req-beae1417-e41a-4201-aa15-8a04a7bbd126 req-69d4b2e8-1cb8-435b-ac76-5c2687b77fe4 service nova] [instance: 440fd7bb-5296-4f07-a2f8-0b6154baeb80] Received event network-vif-unplugged-224431ce-4d10-45a5-a645-c513a9411d25 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:11:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-beae1417-e41a-4201-aa15-8a04a7bbd126 req-69d4b2e8-1cb8-435b-ac76-5c2687b77fe4 service nova] Acquiring lock "440fd7bb-5296-4f07-a2f8-0b6154baeb80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:11:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-beae1417-e41a-4201-aa15-8a04a7bbd126 req-69d4b2e8-1cb8-435b-ac76-5c2687b77fe4 service nova] Lock "440fd7bb-5296-4f07-a2f8-0b6154baeb80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:11:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-beae1417-e41a-4201-aa15-8a04a7bbd126 req-69d4b2e8-1cb8-435b-ac76-5c2687b77fe4 service nova] Lock "440fd7bb-5296-4f07-a2f8-0b6154baeb80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:11:04 user nova-compute[75100]: DEBUG nova.compute.manager [req-beae1417-e41a-4201-aa15-8a04a7bbd126 req-69d4b2e8-1cb8-435b-ac76-5c2687b77fe4 service nova] [instance: 440fd7bb-5296-4f07-a2f8-0b6154baeb80] No waiting events found dispatching network-vif-unplugged-224431ce-4d10-45a5-a645-c513a9411d25 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:11:04 user nova-compute[75100]: DEBUG nova.compute.manager [req-beae1417-e41a-4201-aa15-8a04a7bbd126 req-69d4b2e8-1cb8-435b-ac76-5c2687b77fe4 service nova] [instance: 440fd7bb-5296-4f07-a2f8-0b6154baeb80] Received event network-vif-unplugged-224431ce-4d10-45a5-a645-c513a9411d25 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 18:11:04 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 440fd7bb-5296-4f07-a2f8-0b6154baeb80] Instance destroyed successfully.
Nov 10 18:11:04 user nova-compute[75100]: DEBUG nova.objects.instance [None req-7e2c7715-621e-410f-9177-191bea9835fa tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Lazy-loading 'resources' on Instance uuid 440fd7bb-5296-4f07-a2f8-0b6154baeb80 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:11:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-7e2c7715-621e-410f-9177-191bea9835fa tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:09:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-809150265',display_name='tempest-VolumesActionsTest-instance-809150265',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-809150265',id=43,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T18:09:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='42e369208c0a486fa4cceb6de3620b6a',ramdisk_id='',reservation_id='r-apvl1j7a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-275059269',owner_user_name='tempest-VolumesActionsTest-275059269-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T18:09:20Z,user_data=None,user_id='130a36dd61074d99855f44d5ebb20eb3',uuid=440fd7bb-5296-4f07-a2f8-0b6154baeb80,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "224431ce-4d10-45a5-a645-c513a9411d25", "address": "fa:16:3e:e3:8e:73", "network": {"id": "f22ce8bd-85d3-4596-849e-9e04d728af34", "bridge": "br-int", "label": "tempest-VolumesActionsTest-979416963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42e369208c0a486fa4cceb6de3620b6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap224431ce-4d", "ovs_interfaceid": "224431ce-4d10-45a5-a645-c513a9411d25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 18:11:04 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-7e2c7715-621e-410f-9177-191bea9835fa tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Converting VIF {"id": "224431ce-4d10-45a5-a645-c513a9411d25", "address": "fa:16:3e:e3:8e:73", "network": {"id": "f22ce8bd-85d3-4596-849e-9e04d728af34", "bridge": "br-int", "label": "tempest-VolumesActionsTest-979416963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42e369208c0a486fa4cceb6de3620b6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap224431ce-4d", "ovs_interfaceid": "224431ce-4d10-45a5-a645-c513a9411d25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:11:04 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-7e2c7715-621e-410f-9177-191bea9835fa tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:8e:73,bridge_name='br-int',has_traffic_filtering=True,id=224431ce-4d10-45a5-a645-c513a9411d25,network=Network(f22ce8bd-85d3-4596-849e-9e04d728af34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap224431ce-4d') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:11:04 user nova-compute[75100]: DEBUG os_vif [None req-7e2c7715-621e-410f-9177-191bea9835fa tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:8e:73,bridge_name='br-int',has_traffic_filtering=True,id=224431ce-4d10-45a5-a645-c513a9411d25,network=Network(f22ce8bd-85d3-4596-849e-9e04d728af34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap224431ce-4d') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 18:11:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:11:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap224431ce-4d, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:11:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:11:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-40a2cf72-5f14-484d-94c7-ba6dabc936c0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Acquiring lock "4ebd9d80-365d-4334-8421-3b22a846321a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:11:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-40a2cf72-5f14-484d-94c7-ba6dabc936c0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "4ebd9d80-365d-4334-8421-3b22a846321a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:11:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-40a2cf72-5f14-484d-94c7-ba6dabc936c0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Acquiring lock "4ebd9d80-365d-4334-8421-3b22a846321a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:11:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-40a2cf72-5f14-484d-94c7-ba6dabc936c0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "4ebd9d80-365d-4334-8421-3b22a846321a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:11:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-40a2cf72-5f14-484d-94c7-ba6dabc936c0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "4ebd9d80-365d-4334-8421-3b22a846321a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:11:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:11:04 user nova-compute[75100]: INFO nova.compute.manager [None req-40a2cf72-5f14-484d-94c7-ba6dabc936c0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Terminating instance
Nov 10 18:11:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:11:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ed326eef-8ef4-4ab1-9f7b-49cd987e8b8c) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:11:04 user nova-compute[75100]: DEBUG nova.compute.manager [None req-40a2cf72-5f14-484d-94c7-ba6dabc936c0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 18:11:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:11:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:11:04 user nova-compute[75100]: INFO os_vif [None req-7e2c7715-621e-410f-9177-191bea9835fa tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:8e:73,bridge_name='br-int',has_traffic_filtering=True,id=224431ce-4d10-45a5-a645-c513a9411d25,network=Network(f22ce8bd-85d3-4596-849e-9e04d728af34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap224431ce-4d')
Nov 10 18:11:04 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-7e2c7715-621e-410f-9177-191bea9835fa tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 440fd7bb-5296-4f07-a2f8-0b6154baeb80] Deleting instance files /opt/stack/data/nova/instances/440fd7bb-5296-4f07-a2f8-0b6154baeb80_del
Nov 10 18:11:04 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-7e2c7715-621e-410f-9177-191bea9835fa tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 440fd7bb-5296-4f07-a2f8-0b6154baeb80] Deletion of /opt/stack/data/nova/instances/440fd7bb-5296-4f07-a2f8-0b6154baeb80_del complete
Nov 10 18:11:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:11:04 user nova-compute[75100]: INFO nova.compute.manager [None req-7e2c7715-621e-410f-9177-191bea9835fa tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] [instance: 440fd7bb-5296-4f07-a2f8-0b6154baeb80] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 10 18:11:04 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-7e2c7715-621e-410f-9177-191bea9835fa tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 18:11:04 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: 440fd7bb-5296-4f07-a2f8-0b6154baeb80] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 18:11:04 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 440fd7bb-5296-4f07-a2f8-0b6154baeb80] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 18:11:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:11:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:11:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:11:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:11:05 user nova-compute[75100]: DEBUG nova.compute.manager [req-ac9e44f0-3947-46c1-8c3e-36a010294518 req-95a296d8-d664-40ea-a942-b40317472ee7 service nova] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Received event network-vif-unplugged-c9011ff5-53de-43f3-be8e-ba86274b2c99 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:11:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ac9e44f0-3947-46c1-8c3e-36a010294518 req-95a296d8-d664-40ea-a942-b40317472ee7 service nova] Acquiring lock "4ebd9d80-365d-4334-8421-3b22a846321a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:11:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ac9e44f0-3947-46c1-8c3e-36a010294518 req-95a296d8-d664-40ea-a942-b40317472ee7 service nova] Lock "4ebd9d80-365d-4334-8421-3b22a846321a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:11:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ac9e44f0-3947-46c1-8c3e-36a010294518 req-95a296d8-d664-40ea-a942-b40317472ee7 service nova] Lock "4ebd9d80-365d-4334-8421-3b22a846321a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:11:05 user nova-compute[75100]: DEBUG nova.compute.manager [req-ac9e44f0-3947-46c1-8c3e-36a010294518 req-95a296d8-d664-40ea-a942-b40317472ee7 service nova] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] No waiting events found dispatching network-vif-unplugged-c9011ff5-53de-43f3-be8e-ba86274b2c99 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:11:05 user nova-compute[75100]: DEBUG nova.compute.manager [req-ac9e44f0-3947-46c1-8c3e-36a010294518 req-95a296d8-d664-40ea-a942-b40317472ee7 service nova] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Received event network-vif-unplugged-c9011ff5-53de-43f3-be8e-ba86274b2c99 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 18:11:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:11:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:11:05 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Instance destroyed successfully.
Nov 10 18:11:05 user nova-compute[75100]: DEBUG nova.objects.instance [None req-40a2cf72-5f14-484d-94c7-ba6dabc936c0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lazy-loading 'resources' on Instance uuid 4ebd9d80-365d-4334-8421-3b22a846321a {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:11:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-40a2cf72-5f14-484d-94c7-ba6dabc936c0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:03:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-541372061',display_name='tempest-ServerActionsTestOtherA-server-541372061',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-541372061',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJad9dm/VlgxkcoctzSOteh4UYTuKPNeJ9f0qso9IjuH6DpxTyWo1Jqw77DQ9s/VWyRmakd0roi/G14M/XBa/3VT72t8942zFgmm3ckvSnycGMTUzmFZ+zGnWexds7KMSQ==',key_name='tempest-keypair-1062541421',keypairs=<?>,launch_index=0,launched_at=2023-11-10T18:07:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ce7bb141ef59487dbb2ce6243c5002af',ramdisk_id='',reservation_id='r-bes8zsqu',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1364670684',owner_user_name='tempest-ServerActionsTestOtherA-1364670684-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T18:08:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f4df424af2343a2a27e869502651216',uuid=4ebd9d80-365d-4334-8421-3b22a846321a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c9011ff5-53de-43f3-be8e-ba86274b2c99", "address": "fa:16:3e:a7:f8:6b", "network": {"id": "bf1edb58-ef26-40ca-8ec9-853fa05de13d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1416469583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7bb141ef59487dbb2ce6243c5002af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9011ff5-53", "ovs_interfaceid": "c9011ff5-53de-43f3-be8e-ba86274b2c99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 18:11:05 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-40a2cf72-5f14-484d-94c7-ba6dabc936c0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Converting VIF {"id": "c9011ff5-53de-43f3-be8e-ba86274b2c99", "address": "fa:16:3e:a7:f8:6b", "network": {"id": "bf1edb58-ef26-40ca-8ec9-853fa05de13d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1416469583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7bb141ef59487dbb2ce6243c5002af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9011ff5-53", "ovs_interfaceid": "c9011ff5-53de-43f3-be8e-ba86274b2c99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:11:05 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-40a2cf72-5f14-484d-94c7-ba6dabc936c0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:f8:6b,bridge_name='br-int',has_traffic_filtering=True,id=c9011ff5-53de-43f3-be8e-ba86274b2c99,network=Network(bf1edb58-ef26-40ca-8ec9-853fa05de13d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9011ff5-53') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:11:05 user nova-compute[75100]: DEBUG os_vif [None req-40a2cf72-5f14-484d-94c7-ba6dabc936c0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:f8:6b,bridge_name='br-int',has_traffic_filtering=True,id=c9011ff5-53de-43f3-be8e-ba86274b2c99,network=Network(bf1edb58-ef26-40ca-8ec9-853fa05de13d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9011ff5-53') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 18:11:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:11:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc9011ff5-53, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:11:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:11:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:11:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:11:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=29e29206-55f2-4828-bc89-e5e515a6d16b) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:11:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:11:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:11:05 user nova-compute[75100]: INFO os_vif [None req-40a2cf72-5f14-484d-94c7-ba6dabc936c0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:f8:6b,bridge_name='br-int',has_traffic_filtering=True,id=c9011ff5-53de-43f3-be8e-ba86274b2c99,network=Network(bf1edb58-ef26-40ca-8ec9-853fa05de13d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9011ff5-53')
Nov 10 18:11:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40a2cf72-5f14-484d-94c7-ba6dabc936c0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 18:11:05 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a2cf72-5f14-484d-94c7-ba6dabc936c0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, {'target_iqn': 'iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'esQJvHgS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:11:05 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-40a2cf72-5f14-484d-94c7-ba6dabc936c0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:11:05 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-40a2cf72-5f14-484d-94c7-ba6dabc936c0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:11:05 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-40a2cf72-5f14-484d-94c7-ba6dabc936c0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:11:05 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:11:05 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:11:05 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7612a888-cb19-4632-898d-e7ad28a997c7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:11:05 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a2cf72-5f14-484d-94c7-ba6dabc936c0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 18:11:05 user nova-compute[75100]: No targets found.
Nov 10 18:11:05 user nova-compute[75100]: iSNS:
Nov 10 18:11:05 user nova-compute[75100]: No targets found.
Nov 10 18:11:05 user nova-compute[75100]: STATIC:
Nov 10 18:11:05 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7
Nov 10 18:11:05 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:11:05 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:11:05 user nova-compute[75100]: FIRMWARE:
Nov 10 18:11:05 user nova-compute[75100]: No targets found.
Nov 10 18:11:05 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:11:05 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a2cf72-5f14-484d-94c7-ba6dabc936c0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 18:11:05 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 18:11:05 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 18:11:05 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a2cf72-5f14-484d-94c7-ba6dabc936c0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 18:11:05 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:11:05 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:11:05 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d606085b-92da-4005-904e-2ea14eeaa92c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:11:05 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:11:05 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:11:05 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a4604a-dde8-42a5-a71f-611d0c952040]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:11:05 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a2cf72-5f14-484d-94c7-ba6dabc936c0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)
Nov 10 18:11:05 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:11:05 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a2cf72-5f14-484d-94c7-ba6dabc936c0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 (non-flash)
Nov 10 18:11:05 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:11:05 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a2cf72-5f14-484d-94c7-ba6dabc936c0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa39873b250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7'): ({'sdb'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 18:11:05 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-40a2cf72-5f14-484d-94c7-ba6dabc936c0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Removing single pathed devices sdb {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 18:11:05 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:11:05 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.032s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:11:05 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ee4236-0e70-4dc6-bce4-4e8bf6dadb4d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:11:05 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:11:05 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 440fd7bb-5296-4f07-a2f8-0b6154baeb80] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:11:05 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.027s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:11:05 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[25905b34-4655-49de-8848-7d86a8b2aeb9]: (4, ('ok\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:11:05 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-40a2cf72-5f14-484d-94c7-ba6dabc936c0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Flushing IO for device /dev/sdb {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 18:11:05 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:11:05 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:11:05 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ee0382-b2fd-498d-a08d-dec71b231aed]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:11:05 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-40a2cf72-5f14-484d-94c7-ba6dabc936c0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 18:11:05 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: 440fd7bb-5296-4f07-a2f8-0b6154baeb80] Took 0.99 seconds to deallocate network for instance.
Nov 10 18:11:05 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:11:05 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:11:05 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[29890a69-61aa-4d3c-a8ae-d113677f224a]: (4, ('1', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:11:05 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-40a2cf72-5f14-484d-94c7-ba6dabc936c0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 18:11:05 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-40a2cf72-5f14-484d-94c7-ba6dabc936c0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 18:11:05 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a2cf72-5f14-484d-94c7-ba6dabc936c0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 18:11:05 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:11:05 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:11:05 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[28efaf27-94e4-44c2-aafd-72303c127d95]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:11:05 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a2cf72-5f14-484d-94c7-ba6dabc936c0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:11:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7e2c7715-621e-410f-9177-191bea9835fa tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:11:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7e2c7715-621e-410f-9177-191bea9835fa tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:11:05 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 -p 172.16.0.220:3260 --logout {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:11:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:11:06 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b58e38e-d459-425e-93f5-7bdf5671c537]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:11:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a2cf72-5f14-484d-94c7-ba6dabc936c0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7, portal: 172.16.0.220,3260]
Nov 10 18:11:06 user nova-compute[75100]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7, portal: 172.16.0.220,3260] successful.
Nov 10 18:11:06 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:11:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 -p 172.16.0.220:3260 --op delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:11:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:11:06 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77a695a-8151-4570-a20e-57b25c8e5450]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:11:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a2cf72-5f14-484d-94c7-ba6dabc936c0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:11:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-40a2cf72-5f14-484d-94c7-ba6dabc936c0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.401s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:11:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a2cf72-5f14-484d-94c7-ba6dabc936c0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] <== disconnect_volume: return (404ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:11:06 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40a2cf72-5f14-484d-94c7-ba6dabc936c0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 18:11:06 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-40a2cf72-5f14-484d-94c7-ba6dabc936c0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Deleting instance files /opt/stack/data/nova/instances/4ebd9d80-365d-4334-8421-3b22a846321a_del
Nov 10 18:11:06 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-40a2cf72-5f14-484d-94c7-ba6dabc936c0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Deletion of /opt/stack/data/nova/instances/4ebd9d80-365d-4334-8421-3b22a846321a_del complete
Nov 10 18:11:06 user nova-compute[75100]: INFO nova.compute.manager [None req-40a2cf72-5f14-484d-94c7-ba6dabc936c0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Took 1.38 seconds to destroy the instance on the hypervisor.
Nov 10 18:11:06 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-40a2cf72-5f14-484d-94c7-ba6dabc936c0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 18:11:06 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 18:11:06 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 18:11:06 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-7e2c7715-621e-410f-9177-191bea9835fa tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:11:06 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-7e2c7715-621e-410f-9177-191bea9835fa tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:11:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7e2c7715-621e-410f-9177-191bea9835fa tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.274s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:11:06 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-7e2c7715-621e-410f-9177-191bea9835fa tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Deleted allocations for instance 440fd7bb-5296-4f07-a2f8-0b6154baeb80
Nov 10 18:11:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7e2c7715-621e-410f-9177-191bea9835fa tempest-VolumesActionsTest-275059269 tempest-VolumesActionsTest-275059269-project-member] Lock "440fd7bb-5296-4f07-a2f8-0b6154baeb80" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.349s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:11:06 user nova-compute[75100]: DEBUG nova.compute.manager [req-0fbc2d97-5d9b-4ffa-9633-d15d64bb5e35 req-a5c509c3-9e98-4812-8dd3-4e2dbfb94581 service nova] [instance: 440fd7bb-5296-4f07-a2f8-0b6154baeb80] Received event network-vif-plugged-224431ce-4d10-45a5-a645-c513a9411d25 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:11:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0fbc2d97-5d9b-4ffa-9633-d15d64bb5e35 req-a5c509c3-9e98-4812-8dd3-4e2dbfb94581 service nova] Acquiring lock "440fd7bb-5296-4f07-a2f8-0b6154baeb80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:11:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0fbc2d97-5d9b-4ffa-9633-d15d64bb5e35 req-a5c509c3-9e98-4812-8dd3-4e2dbfb94581 service nova] Lock "440fd7bb-5296-4f07-a2f8-0b6154baeb80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:11:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0fbc2d97-5d9b-4ffa-9633-d15d64bb5e35 req-a5c509c3-9e98-4812-8dd3-4e2dbfb94581 service nova] Lock "440fd7bb-5296-4f07-a2f8-0b6154baeb80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:11:06 user nova-compute[75100]: DEBUG nova.compute.manager [req-0fbc2d97-5d9b-4ffa-9633-d15d64bb5e35 req-a5c509c3-9e98-4812-8dd3-4e2dbfb94581 service nova] [instance: 440fd7bb-5296-4f07-a2f8-0b6154baeb80] No waiting events found dispatching network-vif-plugged-224431ce-4d10-45a5-a645-c513a9411d25 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:11:06 user nova-compute[75100]: WARNING nova.compute.manager [req-0fbc2d97-5d9b-4ffa-9633-d15d64bb5e35 req-a5c509c3-9e98-4812-8dd3-4e2dbfb94581 service nova] [instance: 440fd7bb-5296-4f07-a2f8-0b6154baeb80] Received unexpected event network-vif-plugged-224431ce-4d10-45a5-a645-c513a9411d25 for instance with vm_state deleted and task_state None.
Nov 10 18:11:06 user nova-compute[75100]: DEBUG nova.compute.manager [req-0fbc2d97-5d9b-4ffa-9633-d15d64bb5e35 req-a5c509c3-9e98-4812-8dd3-4e2dbfb94581 service nova] [instance: 440fd7bb-5296-4f07-a2f8-0b6154baeb80] Received event network-vif-deleted-224431ce-4d10-45a5-a645-c513a9411d25 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:11:07 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:11:07 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Took 0.94 seconds to deallocate network for instance.
Nov 10 18:11:07 user nova-compute[75100]: DEBUG nova.compute.manager [req-2642b954-dcc1-4499-a9a4-c0e4ccb0d046 req-7df96706-3ffd-4042-961f-ed97993d7775 service nova] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Received event network-vif-plugged-c9011ff5-53de-43f3-be8e-ba86274b2c99 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:11:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2642b954-dcc1-4499-a9a4-c0e4ccb0d046 req-7df96706-3ffd-4042-961f-ed97993d7775 service nova] Acquiring lock "4ebd9d80-365d-4334-8421-3b22a846321a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:11:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2642b954-dcc1-4499-a9a4-c0e4ccb0d046 req-7df96706-3ffd-4042-961f-ed97993d7775 service nova] Lock "4ebd9d80-365d-4334-8421-3b22a846321a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:11:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2642b954-dcc1-4499-a9a4-c0e4ccb0d046 req-7df96706-3ffd-4042-961f-ed97993d7775 service nova] Lock "4ebd9d80-365d-4334-8421-3b22a846321a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:11:07 user nova-compute[75100]: DEBUG nova.compute.manager [req-2642b954-dcc1-4499-a9a4-c0e4ccb0d046 req-7df96706-3ffd-4042-961f-ed97993d7775 service nova] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] No waiting events found dispatching network-vif-plugged-c9011ff5-53de-43f3-be8e-ba86274b2c99 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:11:07 user nova-compute[75100]: WARNING nova.compute.manager [req-2642b954-dcc1-4499-a9a4-c0e4ccb0d046 req-7df96706-3ffd-4042-961f-ed97993d7775 service nova] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Received unexpected event network-vif-plugged-c9011ff5-53de-43f3-be8e-ba86274b2c99 for instance with vm_state active and task_state deleting.
Nov 10 18:11:08 user nova-compute[75100]: INFO nova.compute.manager [None req-40a2cf72-5f14-484d-94c7-ba6dabc936c0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Took 1.02 seconds to detach 1 volumes for instance.
Nov 10 18:11:08 user nova-compute[75100]: DEBUG nova.compute.manager [None req-40a2cf72-5f14-484d-94c7-ba6dabc936c0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Deleting volume: 9942ef0e-de84-4e1e-b62b-34ab4d72d5d7 {{(pid=75100) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 10 18:11:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-40a2cf72-5f14-484d-94c7-ba6dabc936c0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:11:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-40a2cf72-5f14-484d-94c7-ba6dabc936c0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:11:08 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-40a2cf72-5f14-484d-94c7-ba6dabc936c0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:11:08 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-40a2cf72-5f14-484d-94c7-ba6dabc936c0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:11:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-40a2cf72-5f14-484d-94c7-ba6dabc936c0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.246s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:11:08 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-40a2cf72-5f14-484d-94c7-ba6dabc936c0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Deleted allocations for instance 4ebd9d80-365d-4334-8421-3b22a846321a
Nov 10 18:11:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-40a2cf72-5f14-484d-94c7-ba6dabc936c0 tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "4ebd9d80-365d-4334-8421-3b22a846321a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.936s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:11:08 user nova-compute[75100]: DEBUG nova.compute.manager [req-98b22c32-8482-44ce-8ac7-120f6e3de7ac req-7970f705-f2b1-4752-be9a-43caee0870b4 service nova] [instance: 4ebd9d80-365d-4334-8421-3b22a846321a] Received event network-vif-deleted-c9011ff5-53de-43f3-be8e-ba86274b2c99 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:11:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:11:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:11:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:11:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:11:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:11:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:11:28 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:11:28 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:11:29 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:11:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:11:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:11:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:11:29 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 18:11:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0b2a902-2358-4bed-a474-21170a45577d/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:11:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0b2a902-2358-4bed-a474-21170a45577d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:11:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0b2a902-2358-4bed-a474-21170a45577d/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:11:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0b2a902-2358-4bed-a474-21170a45577d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:11:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7003b97b-edf1-4972-a0be-dcb41c329ec8/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:11:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7003b97b-edf1-4972-a0be-dcb41c329ec8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:11:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7003b97b-edf1-4972-a0be-dcb41c329ec8/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:11:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7003b97b-edf1-4972-a0be-dcb41c329ec8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:11:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:11:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:11:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:11:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:11:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:11:30 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:11:30 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:11:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Hypervisor/Node resource view: name=user free_ram=8391MB free_disk=24.43499755859375GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 18:11:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:11:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:11:31 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:11:31 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 7003b97b-edf1-4972-a0be-dcb41c329ec8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:11:31 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance f0b2a902-2358-4bed-a474-21170a45577d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:11:31 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 18:11:31 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 18:11:31 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Refreshing inventories for resource provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 18:11:31 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Updating ProviderTree inventory for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 18:11:31 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Updating inventory in ProviderTree for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 18:11:31 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Refreshing aggregate associations for resource provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64, aggregates: None {{(pid=75100) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 18:11:31 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Refreshing trait associations for resource provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2 {{(pid=75100) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 18:11:31 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:11:31 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:11:31 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 18:11:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.385s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:11:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:11:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:11:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:11:41 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:11:41 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:11:41 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:11:41 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:11:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:11:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:11:44 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:11:44 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 18:11:44 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Didn't find any instances for network info cache update. {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 18:11:45 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:11:45 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 18:11:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:11:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:11:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:12:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:12:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:12:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d28dbe40-eca7-4cb6-b8f1-1163a81d8d6d tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Acquiring lock "22c021d9-c8e4-455d-8e2a-a9cdfbb38f75" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:12:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d28dbe40-eca7-4cb6-b8f1-1163a81d8d6d tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "22c021d9-c8e4-455d-8e2a-a9cdfbb38f75" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:12:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d28dbe40-eca7-4cb6-b8f1-1163a81d8d6d tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Acquiring lock "22c021d9-c8e4-455d-8e2a-a9cdfbb38f75-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:12:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d28dbe40-eca7-4cb6-b8f1-1163a81d8d6d tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "22c021d9-c8e4-455d-8e2a-a9cdfbb38f75-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:12:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d28dbe40-eca7-4cb6-b8f1-1163a81d8d6d tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "22c021d9-c8e4-455d-8e2a-a9cdfbb38f75-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:12:10 user nova-compute[75100]: INFO nova.compute.manager [None req-d28dbe40-eca7-4cb6-b8f1-1163a81d8d6d tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Terminating instance
Nov 10 18:12:10 user nova-compute[75100]: DEBUG nova.compute.manager [None req-d28dbe40-eca7-4cb6-b8f1-1163a81d8d6d tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 18:12:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:12:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:12:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:12:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:12:10 user nova-compute[75100]: DEBUG nova.compute.manager [req-a2e86686-8268-48d0-8efb-d98ee4fa778c req-d9fc8ad1-8532-4fc3-b29c-eef89ed479ac service nova] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Received event network-vif-unplugged-9855a14c-55c7-4a35-a4cc-7085dfbda684 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:12:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a2e86686-8268-48d0-8efb-d98ee4fa778c req-d9fc8ad1-8532-4fc3-b29c-eef89ed479ac service nova] Acquiring lock "22c021d9-c8e4-455d-8e2a-a9cdfbb38f75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:12:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a2e86686-8268-48d0-8efb-d98ee4fa778c req-d9fc8ad1-8532-4fc3-b29c-eef89ed479ac service nova] Lock "22c021d9-c8e4-455d-8e2a-a9cdfbb38f75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:12:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a2e86686-8268-48d0-8efb-d98ee4fa778c req-d9fc8ad1-8532-4fc3-b29c-eef89ed479ac service nova] Lock "22c021d9-c8e4-455d-8e2a-a9cdfbb38f75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:12:10 user nova-compute[75100]: DEBUG nova.compute.manager [req-a2e86686-8268-48d0-8efb-d98ee4fa778c req-d9fc8ad1-8532-4fc3-b29c-eef89ed479ac service nova] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] No waiting events found dispatching network-vif-unplugged-9855a14c-55c7-4a35-a4cc-7085dfbda684 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:12:10 user nova-compute[75100]: DEBUG nova.compute.manager [req-a2e86686-8268-48d0-8efb-d98ee4fa778c req-d9fc8ad1-8532-4fc3-b29c-eef89ed479ac service nova] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Received event network-vif-unplugged-9855a14c-55c7-4a35-a4cc-7085dfbda684 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 18:12:10 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Instance destroyed successfully.
Nov 10 18:12:10 user nova-compute[75100]: DEBUG nova.objects.instance [None req-d28dbe40-eca7-4cb6-b8f1-1163a81d8d6d tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lazy-loading 'resources' on Instance uuid 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:12:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-d28dbe40-eca7-4cb6-b8f1-1163a81d8d6d tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T17:49:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-221928721',display_name='tempest-ServerActionsTestOtherA-server-221928721',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-221928721',id=18,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJad9dm/VlgxkcoctzSOteh4UYTuKPNeJ9f0qso9IjuH6DpxTyWo1Jqw77DQ9s/VWyRmakd0roi/G14M/XBa/3VT72t8942zFgmm3ckvSnycGMTUzmFZ+zGnWexds7KMSQ==',key_name='tempest-keypair-1062541421',keypairs=<?>,launch_index=0,launched_at=2023-11-10T17:50:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ce7bb141ef59487dbb2ce6243c5002af',ramdisk_id='',reservation_id='r-smju6rlp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1364670684',owner_user_name='tempest-ServerActionsTestOtherA-1364670684-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T17:50:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f4df424af2343a2a27e869502651216',uuid=22c021d9-c8e4-455d-8e2a-a9cdfbb38f75,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9855a14c-55c7-4a35-a4cc-7085dfbda684", "address": "fa:16:3e:02:b1:a1", "network": {"id": "bf1edb58-ef26-40ca-8ec9-853fa05de13d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1416469583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7bb141ef59487dbb2ce6243c5002af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9855a14c-55", "ovs_interfaceid": "9855a14c-55c7-4a35-a4cc-7085dfbda684", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 18:12:10 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-d28dbe40-eca7-4cb6-b8f1-1163a81d8d6d tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Converting VIF {"id": "9855a14c-55c7-4a35-a4cc-7085dfbda684", "address": "fa:16:3e:02:b1:a1", "network": {"id": "bf1edb58-ef26-40ca-8ec9-853fa05de13d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1416469583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce7bb141ef59487dbb2ce6243c5002af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9855a14c-55", "ovs_interfaceid": "9855a14c-55c7-4a35-a4cc-7085dfbda684", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:12:10 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-d28dbe40-eca7-4cb6-b8f1-1163a81d8d6d tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:02:b1:a1,bridge_name='br-int',has_traffic_filtering=True,id=9855a14c-55c7-4a35-a4cc-7085dfbda684,network=Network(bf1edb58-ef26-40ca-8ec9-853fa05de13d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9855a14c-55') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:12:10 user nova-compute[75100]: DEBUG os_vif [None req-d28dbe40-eca7-4cb6-b8f1-1163a81d8d6d tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:b1:a1,bridge_name='br-int',has_traffic_filtering=True,id=9855a14c-55c7-4a35-a4cc-7085dfbda684,network=Network(bf1edb58-ef26-40ca-8ec9-853fa05de13d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9855a14c-55') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 18:12:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:12:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9855a14c-55, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:12:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:12:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:12:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:12:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f8c5a397-81bb-4c2c-b22f-74abaa2dd1be) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:12:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:12:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:12:10 user nova-compute[75100]: INFO os_vif [None req-d28dbe40-eca7-4cb6-b8f1-1163a81d8d6d tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:b1:a1,bridge_name='br-int',has_traffic_filtering=True,id=9855a14c-55c7-4a35-a4cc-7085dfbda684,network=Network(bf1edb58-ef26-40ca-8ec9-853fa05de13d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9855a14c-55')
Nov 10 18:12:10 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-d28dbe40-eca7-4cb6-b8f1-1163a81d8d6d tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Deleting instance files /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75_del
Nov 10 18:12:10 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-d28dbe40-eca7-4cb6-b8f1-1163a81d8d6d tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Deletion of /opt/stack/data/nova/instances/22c021d9-c8e4-455d-8e2a-a9cdfbb38f75_del complete
Nov 10 18:12:10 user nova-compute[75100]: INFO nova.compute.manager [None req-d28dbe40-eca7-4cb6-b8f1-1163a81d8d6d tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Took 0.76 seconds to destroy the instance on the hypervisor.
Nov 10 18:12:10 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-d28dbe40-eca7-4cb6-b8f1-1163a81d8d6d tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 18:12:10 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 18:12:10 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 18:12:11 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:12:11 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Took 0.47 seconds to deallocate network for instance.
Nov 10 18:12:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d28dbe40-eca7-4cb6-b8f1-1163a81d8d6d tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:12:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d28dbe40-eca7-4cb6-b8f1-1163a81d8d6d tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:12:11 user nova-compute[75100]: DEBUG nova.compute.manager [req-f6cc5255-3393-4e14-88df-e9d1b8c5ff9e req-ed8bffe1-b682-40df-b609-ba2fed71abb9 service nova] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Received event network-vif-deleted-9855a14c-55c7-4a35-a4cc-7085dfbda684 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:12:11 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-d28dbe40-eca7-4cb6-b8f1-1163a81d8d6d tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:12:11 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-d28dbe40-eca7-4cb6-b8f1-1163a81d8d6d tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:12:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d28dbe40-eca7-4cb6-b8f1-1163a81d8d6d tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.182s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:12:11 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-d28dbe40-eca7-4cb6-b8f1-1163a81d8d6d tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Deleted allocations for instance 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75
Nov 10 18:12:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d28dbe40-eca7-4cb6-b8f1-1163a81d8d6d tempest-ServerActionsTestOtherA-1364670684 tempest-ServerActionsTestOtherA-1364670684-project-member] Lock "22c021d9-c8e4-455d-8e2a-a9cdfbb38f75" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.633s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:12:12 user nova-compute[75100]: DEBUG nova.compute.manager [req-7ecf3962-cd9b-4b74-96d3-9e899f1a9f40 req-becde2ab-a86a-441d-baef-62af0c206728 service nova] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Received event network-vif-plugged-9855a14c-55c7-4a35-a4cc-7085dfbda684 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:12:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7ecf3962-cd9b-4b74-96d3-9e899f1a9f40 req-becde2ab-a86a-441d-baef-62af0c206728 service nova] Acquiring lock "22c021d9-c8e4-455d-8e2a-a9cdfbb38f75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:12:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7ecf3962-cd9b-4b74-96d3-9e899f1a9f40 req-becde2ab-a86a-441d-baef-62af0c206728 service nova] Lock "22c021d9-c8e4-455d-8e2a-a9cdfbb38f75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:12:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7ecf3962-cd9b-4b74-96d3-9e899f1a9f40 req-becde2ab-a86a-441d-baef-62af0c206728 service nova] Lock "22c021d9-c8e4-455d-8e2a-a9cdfbb38f75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:12:12 user nova-compute[75100]: DEBUG nova.compute.manager [req-7ecf3962-cd9b-4b74-96d3-9e899f1a9f40 req-becde2ab-a86a-441d-baef-62af0c206728 service nova] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] No waiting events found dispatching network-vif-plugged-9855a14c-55c7-4a35-a4cc-7085dfbda684 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:12:12 user nova-compute[75100]: WARNING nova.compute.manager [req-7ecf3962-cd9b-4b74-96d3-9e899f1a9f40 req-becde2ab-a86a-441d-baef-62af0c206728 service nova] [instance: 22c021d9-c8e4-455d-8e2a-a9cdfbb38f75] Received unexpected event network-vif-plugged-9855a14c-55c7-4a35-a4cc-7085dfbda684 for instance with vm_state deleted and task_state None.
Nov 10 18:12:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:12:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:12:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:12:28 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:12:28 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:12:29 user nova-compute[75100]: DEBUG nova.compute.manager [req-fefbd4a4-61da-4470-b471-679191170b01 req-0c8a6dc0-700d-4dc4-ad5c-db4649280bd3 service nova] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Received event network-changed-06c73859-cc53-487c-8bd8-9c4f5961e3cd {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:12:29 user nova-compute[75100]: DEBUG nova.compute.manager [req-fefbd4a4-61da-4470-b471-679191170b01 req-0c8a6dc0-700d-4dc4-ad5c-db4649280bd3 service nova] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Refreshing instance network info cache due to event network-changed-06c73859-cc53-487c-8bd8-9c4f5961e3cd. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 18:12:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-fefbd4a4-61da-4470-b471-679191170b01 req-0c8a6dc0-700d-4dc4-ad5c-db4649280bd3 service nova] Acquiring lock "refresh_cache-7003b97b-edf1-4972-a0be-dcb41c329ec8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:12:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-fefbd4a4-61da-4470-b471-679191170b01 req-0c8a6dc0-700d-4dc4-ad5c-db4649280bd3 service nova] Acquired lock "refresh_cache-7003b97b-edf1-4972-a0be-dcb41c329ec8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:12:29 user nova-compute[75100]: DEBUG nova.network.neutron [req-fefbd4a4-61da-4470-b471-679191170b01 req-0c8a6dc0-700d-4dc4-ad5c-db4649280bd3 service nova] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Refreshing network info cache for port 06c73859-cc53-487c-8bd8-9c4f5961e3cd {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 18:12:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:12:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:12:30 user nova-compute[75100]: DEBUG nova.network.neutron [req-fefbd4a4-61da-4470-b471-679191170b01 req-0c8a6dc0-700d-4dc4-ad5c-db4649280bd3 service nova] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Updated VIF entry in instance network info cache for port 06c73859-cc53-487c-8bd8-9c4f5961e3cd. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 18:12:30 user nova-compute[75100]: DEBUG nova.network.neutron [req-fefbd4a4-61da-4470-b471-679191170b01 req-0c8a6dc0-700d-4dc4-ad5c-db4649280bd3 service nova] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Updating instance_info_cache with network_info: [{"id": "06c73859-cc53-487c-8bd8-9c4f5961e3cd", "address": "fa:16:3e:4b:06:cf", "network": {"id": "e906a397-504d-48d8-8726-187cfbb1f270", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2095832274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4e5cb8bdc24a009dcb3dbee36a6bce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06c73859-cc", "ovs_interfaceid": "06c73859-cc53-487c-8bd8-9c4f5961e3cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:12:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-fefbd4a4-61da-4470-b471-679191170b01 req-0c8a6dc0-700d-4dc4-ad5c-db4649280bd3 service nova] Releasing lock "refresh_cache-7003b97b-edf1-4972-a0be-dcb41c329ec8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:12:31 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:12:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:12:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:12:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:12:31 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 18:12:31 user nova-compute[75100]: DEBUG nova.compute.manager [req-0941c9e4-58f4-4876-b795-7f87ba395ddb req-bac4ae48-75b8-4d83-9c2c-f87795704de3 service nova] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Received event network-changed-6a80628d-e450-4d72-86c9-08d8578d9f17 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:12:31 user nova-compute[75100]: DEBUG nova.compute.manager [req-0941c9e4-58f4-4876-b795-7f87ba395ddb req-bac4ae48-75b8-4d83-9c2c-f87795704de3 service nova] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Refreshing instance network info cache due to event network-changed-6a80628d-e450-4d72-86c9-08d8578d9f17. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 18:12:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0941c9e4-58f4-4876-b795-7f87ba395ddb req-bac4ae48-75b8-4d83-9c2c-f87795704de3 service nova] Acquiring lock "refresh_cache-f0b2a902-2358-4bed-a474-21170a45577d" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:12:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0941c9e4-58f4-4876-b795-7f87ba395ddb req-bac4ae48-75b8-4d83-9c2c-f87795704de3 service nova] Acquired lock "refresh_cache-f0b2a902-2358-4bed-a474-21170a45577d" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:12:31 user nova-compute[75100]: DEBUG nova.network.neutron [req-0941c9e4-58f4-4876-b795-7f87ba395ddb req-bac4ae48-75b8-4d83-9c2c-f87795704de3 service nova] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Refreshing network info cache for port 6a80628d-e450-4d72-86c9-08d8578d9f17 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 18:12:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0b2a902-2358-4bed-a474-21170a45577d/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:12:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0b2a902-2358-4bed-a474-21170a45577d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:12:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0b2a902-2358-4bed-a474-21170a45577d/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:12:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0b2a902-2358-4bed-a474-21170a45577d/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:12:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7003b97b-edf1-4972-a0be-dcb41c329ec8/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:12:32 user nova-compute[75100]: DEBUG nova.network.neutron [req-0941c9e4-58f4-4876-b795-7f87ba395ddb req-bac4ae48-75b8-4d83-9c2c-f87795704de3 service nova] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Updated VIF entry in instance network info cache for port 6a80628d-e450-4d72-86c9-08d8578d9f17. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 18:12:32 user nova-compute[75100]: DEBUG nova.network.neutron [req-0941c9e4-58f4-4876-b795-7f87ba395ddb req-bac4ae48-75b8-4d83-9c2c-f87795704de3 service nova] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Updating instance_info_cache with network_info: [{"id": "6a80628d-e450-4d72-86c9-08d8578d9f17", "address": "fa:16:3e:01:34:07", "network": {"id": "5e6c66a5-a7bb-4157-aed0-8f8f7cfa846c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-209207359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1b6a6cf82404999aa9e2d5f99b5b9df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a80628d-e4", "ovs_interfaceid": "6a80628d-e450-4d72-86c9-08d8578d9f17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:12:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0941c9e4-58f4-4876-b795-7f87ba395ddb req-bac4ae48-75b8-4d83-9c2c-f87795704de3 service nova] Releasing lock "refresh_cache-f0b2a902-2358-4bed-a474-21170a45577d" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:12:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7003b97b-edf1-4972-a0be-dcb41c329ec8/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:12:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7003b97b-edf1-4972-a0be-dcb41c329ec8/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:12:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7003b97b-edf1-4972-a0be-dcb41c329ec8/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:12:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-288ac374-33e9-4f79-a915-da7afd7ae183 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Acquiring lock "f0b2a902-2358-4bed-a474-21170a45577d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:12:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-288ac374-33e9-4f79-a915-da7afd7ae183 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Lock "f0b2a902-2358-4bed-a474-21170a45577d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:12:32 user nova-compute[75100]: DEBUG nova.objects.instance [None req-288ac374-33e9-4f79-a915-da7afd7ae183 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Lazy-loading 'flavor' on Instance uuid f0b2a902-2358-4bed-a474-21170a45577d {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:12:33 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:12:33 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:12:33 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Hypervisor/Node resource view: name=user free_ram=8598MB free_disk=24.12366485595703GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 18:12:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:12:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:12:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-288ac374-33e9-4f79-a915-da7afd7ae183 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Lock "f0b2a902-2358-4bed-a474-21170a45577d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.447s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:12:33 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 7003b97b-edf1-4972-a0be-dcb41c329ec8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:12:33 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance f0b2a902-2358-4bed-a474-21170a45577d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:12:33 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 18:12:33 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 18:12:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-288ac374-33e9-4f79-a915-da7afd7ae183 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Acquiring lock "f0b2a902-2358-4bed-a474-21170a45577d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:12:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-288ac374-33e9-4f79-a915-da7afd7ae183 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Lock "f0b2a902-2358-4bed-a474-21170a45577d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:12:33 user nova-compute[75100]: INFO nova.compute.manager [None req-288ac374-33e9-4f79-a915-da7afd7ae183 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Attaching volume 9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4 to /dev/vdb
Nov 10 18:12:33 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:12:33 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:12:33 user nova-compute[75100]: DEBUG os_brick.utils [None req-288ac374-33e9-4f79-a915-da7afd7ae183 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:12:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:12:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:12:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d5bdc0-62cb-445e-979f-3ef8e7ad2064]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90b1a229568f\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:12:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:12:33 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 18:12:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.341s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:12:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:12:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d523b3-5e2f-4060-8429-85c62108a8ec]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:12:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:12:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:12:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2397eb8-e5c8-4daf-80b1-8b59d1705551]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:12:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d7825b-e357-487b-a41c-197118e76dbe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:12:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-288ac374-33e9-4f79-a915-da7afd7ae183 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:12:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-288ac374-33e9-4f79-a915-da7afd7ae183 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 18:12:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-288ac374-33e9-4f79-a915-da7afd7ae183 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 18:12:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:12:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 18:12:33 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 18:12:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7fda3b-b941-4846-8ae6-b0875692a96a]: (4, '') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:12:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-288ac374-33e9-4f79-a915-da7afd7ae183 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 18:12:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-288ac374-33e9-4f79-a915-da7afd7ae183 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 18:12:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-288ac374-33e9-4f79-a915-da7afd7ae183 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 18:12:33 user nova-compute[75100]: DEBUG os_brick.utils [None req-288ac374-33e9-4f79-a915-da7afd7ae183 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90b1a229568f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:12:33 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-288ac374-33e9-4f79-a915-da7afd7ae183 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Updating existing volume attachment record: 8c3c7fbb-ee33-4a02-97aa-e9998532abed {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 18:12:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:12:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:12:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-36a3f3b3-6850-4bcc-97b6-d3d4e255fba2 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Acquiring lock "7003b97b-edf1-4972-a0be-dcb41c329ec8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:12:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-36a3f3b3-6850-4bcc-97b6-d3d4e255fba2 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "7003b97b-edf1-4972-a0be-dcb41c329ec8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:12:37 user nova-compute[75100]: DEBUG nova.objects.instance [None req-36a3f3b3-6850-4bcc-97b6-d3d4e255fba2 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lazy-loading 'flavor' on Instance uuid 7003b97b-edf1-4972-a0be-dcb41c329ec8 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:12:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-36a3f3b3-6850-4bcc-97b6-d3d4e255fba2 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "7003b97b-edf1-4972-a0be-dcb41c329ec8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:12:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-36a3f3b3-6850-4bcc-97b6-d3d4e255fba2 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Acquiring lock "7003b97b-edf1-4972-a0be-dcb41c329ec8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:12:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-36a3f3b3-6850-4bcc-97b6-d3d4e255fba2 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "7003b97b-edf1-4972-a0be-dcb41c329ec8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:12:38 user nova-compute[75100]: INFO nova.compute.manager [None req-36a3f3b3-6850-4bcc-97b6-d3d4e255fba2 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Attaching volume 8a771f9f-caa1-4b13-95af-f8338f664f09 to /dev/vdb
Nov 10 18:12:38 user nova-compute[75100]: DEBUG os_brick.utils [None req-36a3f3b3-6850-4bcc-97b6-d3d4e255fba2 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:12:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:12:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:12:38 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce50ebae-1a0e-4d26-98c4-0d261c1a9705]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90b1a229568f\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:12:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:12:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:12:38 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce74811-5cdc-40d4-a354-3587d51581d1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:12:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:12:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:12:38 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a26e0e-43f5-4ced-9646-447d8f1a568a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:12:38 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76fed33-c9dd-4bd7-ba0d-fbcffc42931e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:12:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-36a3f3b3-6850-4bcc-97b6-d3d4e255fba2 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:12:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-36a3f3b3-6850-4bcc-97b6-d3d4e255fba2 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 18:12:38 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-36a3f3b3-6850-4bcc-97b6-d3d4e255fba2 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 18:12:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:12:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 18:12:38 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 18:12:38 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5f7013-f2e0-4cc6-af31-163641a41e84]: (4, '') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:12:38 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-36a3f3b3-6850-4bcc-97b6-d3d4e255fba2 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 18:12:38 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-36a3f3b3-6850-4bcc-97b6-d3d4e255fba2 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 18:12:38 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-36a3f3b3-6850-4bcc-97b6-d3d4e255fba2 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 18:12:38 user nova-compute[75100]: DEBUG os_brick.utils [None req-36a3f3b3-6850-4bcc-97b6-d3d4e255fba2 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90b1a229568f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:12:38 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-36a3f3b3-6850-4bcc-97b6-d3d4e255fba2 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Updating existing volume attachment record: 5dbb808c-2f22-454c-a654-482cc084c5c0 {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 18:12:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:12:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:12:42 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:12:42 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:12:42 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:12:42 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:12:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:12:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:12:46 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:12:46 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 18:12:46 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Rebuilding the list of instances to heal {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 18:12:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "refresh_cache-7003b97b-edf1-4972-a0be-dcb41c329ec8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:12:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquired lock "refresh_cache-7003b97b-edf1-4972-a0be-dcb41c329ec8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:12:46 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 18:12:46 user nova-compute[75100]: DEBUG nova.objects.instance [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lazy-loading 'info_cache' on Instance uuid 7003b97b-edf1-4972-a0be-dcb41c329ec8 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:12:46 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Updating instance_info_cache with network_info: [{"id": "06c73859-cc53-487c-8bd8-9c4f5961e3cd", "address": "fa:16:3e:4b:06:cf", "network": {"id": "e906a397-504d-48d8-8726-187cfbb1f270", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2095832274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4e5cb8bdc24a009dcb3dbee36a6bce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06c73859-cc", "ovs_interfaceid": "06c73859-cc53-487c-8bd8-9c4f5961e3cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:12:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Releasing lock "refresh_cache-7003b97b-edf1-4972-a0be-dcb41c329ec8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:12:46 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 18:12:46 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:12:46 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 18:12:48 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:12:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:12:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:12:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:13:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-288ac374-33e9-4f79-a915-da7afd7ae183 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 18:13:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-288ac374-33e9-4f79-a915-da7afd7ae183 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OThDmpAs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:13:00 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-288ac374-33e9-4f79-a915-da7afd7ae183 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:13:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-288ac374-33e9-4f79-a915-da7afd7ae183 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:13:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-288ac374-33e9-4f79-a915-da7afd7ae183 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:13:00 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-288ac374-33e9-4f79-a915-da7afd7ae183 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:13:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-288ac374-33e9-4f79-a915-da7afd7ae183 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:13:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-288ac374-33e9-4f79-a915-da7afd7ae183 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:13:00 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-288ac374-33e9-4f79-a915-da7afd7ae183 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 18:13:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4 -p 172.16.0.220:3260 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:13:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:13:00 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0404be3-72be-49e6-aae8-d080ecfab35e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:13:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-288ac374-33e9-4f79-a915-da7afd7ae183 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 18:13:00 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:13:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:13:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:13:00 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[026ad71c-615a-4a4a-a10c-e0c8946bad79]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4] added\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:13:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-288ac374-33e9-4f79-a915-da7afd7ae183 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4] added
Nov 10 18:13:00 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:13:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:13:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:13:00 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef02f5bf-ad84-4c0d-a8ea-625e5b7411b2]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:13:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-288ac374-33e9-4f79-a915-da7afd7ae183 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:13:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:13:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:13:00 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2d2544-1e7c-42da-8d9f-2180f0aabe66]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:13:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-288ac374-33e9-4f79-a915-da7afd7ae183 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:13:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OThDmpAs {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:13:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OThDmpAs" returned: 0 in 0.026s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:13:00 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd998171-e9cd-4c7a-9958-9d8de8851085]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:13:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-288ac374-33e9-4f79-a915-da7afd7ae183 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OThDmpAs'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:13:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:13:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:13:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:13:00 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a4c91d-e4c0-4312-8d98-4382e4c169b3]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:13:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-288ac374-33e9-4f79-a915-da7afd7ae183 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:13:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:13:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:13:00 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e669522c-741c-4386-9740-3180d1157308]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3fda7ff-107c-4ae8-8d90-2883c69df026 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:13:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-288ac374-33e9-4f79-a915-da7afd7ae183 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3fda7ff-107c-4ae8-8d90-2883c69df026 (non-flash)
Nov 10 18:13:00 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:13:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-288ac374-33e9-4f79-a915-da7afd7ae183 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3fda7ff-107c-4ae8-8d90-2883c69df026 (non-flash)
Nov 10 18:13:00 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:13:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4 -p 172.16.0.220:3260 --login {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:13:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:13:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:13:00 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[de40ee0d-6336-4038-ad6a-b5c978564a0d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:13:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-288ac374-33e9-4f79-a915-da7afd7ae183 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4, portal: 172.16.0.220,3260]
Nov 10 18:13:00 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4, portal: 172.16.0.220,3260] successful.
Nov 10 18:13:00 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:13:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:13:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:13:00 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd035c70-a852-47b6-aa86-6adc3a4814f9]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:13:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-288ac374-33e9-4f79-a915-da7afd7ae183 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:13:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:13:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:13:00 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d353eb39-e19c-4876-ae61-8d3a4ffaa85d]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3fda7ff-107c-4ae8-8d90-2883c69df026 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:13:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-288ac374-33e9-4f79-a915-da7afd7ae183 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3fda7ff-107c-4ae8-8d90-2883c69df026 (non-flash)
Nov 10 18:13:00 user nova-compute[75100]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4 (non-flash)
Nov 10 18:13:00 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:13:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-288ac374-33e9-4f79-a915-da7afd7ae183 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3fda7ff-107c-4ae8-8d90-2883c69df026 (non-flash)
Nov 10 18:13:00 user nova-compute[75100]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4 (non-flash)
Nov 10 18:13:00 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:13:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-288ac374-33e9-4f79-a915-da7afd7ae183 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:13:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-288ac374-33e9-4f79-a915-da7afd7ae183 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 18:13:00 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-288ac374-33e9-4f79-a915-da7afd7ae183 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] HCTL ('34', '-', '-', 0) found on session 36 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 18:13:00 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-288ac374-33e9-4f79-a915-da7afd7ae183 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 18:13:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:13:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:13:00 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a56839f-901e-470b-89e4-1705b317d8de]: (4, ('- - 0', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:13:00 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-288ac374-33e9-4f79-a915-da7afd7ae183 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: None {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 18:13:01 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-288ac374-33e9-4f79-a915-da7afd7ae183 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 18:13:01 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-288ac374-33e9-4f79-a915-da7afd7ae183 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OThDmpAs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 18:13:01 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-288ac374-33e9-4f79-a915-da7afd7ae183 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:13:01 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-288ac374-33e9-4f79-a915-da7afd7ae183 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '26537313034343364', 'path': '/dev/sdc'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:13:01 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-288ac374-33e9-4f79-a915-da7afd7ae183 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537313034343364', 'path': '/dev/sdc'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 18:13:01 user nova-compute[75100]: DEBUG nova.objects.instance [None req-288ac374-33e9-4f79-a915-da7afd7ae183 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Lazy-loading 'flavor' on Instance uuid f0b2a902-2358-4bed-a474-21170a45577d {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:13:01 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-288ac374-33e9-4f79-a915-da7afd7ae183 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 18:13:01 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:13:01 user nova-compute[75100]:   <source dev="/dev/sdc"/>
Nov 10 18:13:01 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 18:13:01 user nova-compute[75100]:   <serial>9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4</serial>
Nov 10 18:13:01 user nova-compute[75100]: </disk>
Nov 10 18:13:01 user nova-compute[75100]:  {{(pid=75100) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 18:13:02 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-288ac374-33e9-4f79-a915-da7afd7ae183 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 18:13:02 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-288ac374-33e9-4f79-a915-da7afd7ae183 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 18:13:02 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-288ac374-33e9-4f79-a915-da7afd7ae183 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] No VIF found with MAC fa:16:3e:01:34:07, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 18:13:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-288ac374-33e9-4f79-a915-da7afd7ae183 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Lock "f0b2a902-2358-4bed-a474-21170a45577d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 29.062s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:13:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:13:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:13:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36a3f3b3-6850-4bcc-97b6-d3d4e255fba2 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 18:13:04 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a3f3b3-6850-4bcc-97b6-d3d4e255fba2 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8a771f9f-caa1-4b13-95af-f8338f664f09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ChgUIRSf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:13:04 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-36a3f3b3-6850-4bcc-97b6-d3d4e255fba2 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:13:04 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-36a3f3b3-6850-4bcc-97b6-d3d4e255fba2 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:13:04 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-36a3f3b3-6850-4bcc-97b6-d3d4e255fba2 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:13:04 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-36a3f3b3-6850-4bcc-97b6-d3d4e255fba2 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:13:04 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-36a3f3b3-6850-4bcc-97b6-d3d4e255fba2 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a771f9f-caa1-4b13-95af-f8338f664f09" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:13:04 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-36a3f3b3-6850-4bcc-97b6-d3d4e255fba2 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a771f9f-caa1-4b13-95af-f8338f664f09" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:13:04 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-36a3f3b3-6850-4bcc-97b6-d3d4e255fba2 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 18:13:04 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a771f9f-caa1-4b13-95af-f8338f664f09 -p 172.16.0.220:3260 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:13:05 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a771f9f-caa1-4b13-95af-f8338f664f09 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:13:05 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a94c72-2c4f-42e4-bdbb-62eb3a60da17]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:13:05 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a3f3b3-6850-4bcc-97b6-d3d4e255fba2 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 18:13:05 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:13:05 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a771f9f-caa1-4b13-95af-f8338f664f09 -p 172.16.0.220:3260 --interface default --op new {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:13:05 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a771f9f-caa1-4b13-95af-f8338f664f09 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:13:05 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bed1dc1-ef99-4b95-bae1-a57691d74896]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a771f9f-caa1-4b13-95af-f8338f664f09] added\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:13:05 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a3f3b3-6850-4bcc-97b6-d3d4e255fba2 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a771f9f-caa1-4b13-95af-f8338f664f09] added
Nov 10 18:13:05 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:13:05 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a771f9f-caa1-4b13-95af-f8338f664f09 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:13:05 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a771f9f-caa1-4b13-95af-f8338f664f09 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:13:05 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[890e83ba-56bf-4d13-b20a-c258f156180b]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:13:05 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a3f3b3-6850-4bcc-97b6-d3d4e255fba2 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:13:05 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a771f9f-caa1-4b13-95af-f8338f664f09 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:13:05 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a771f9f-caa1-4b13-95af-f8338f664f09 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:13:05 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d74bbc-ae35-471a-a7fd-da4fd74aa8c8]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:13:05 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a3f3b3-6850-4bcc-97b6-d3d4e255fba2 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:13:05 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a771f9f-caa1-4b13-95af-f8338f664f09 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ChgUIRSf {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:13:05 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a771f9f-caa1-4b13-95af-f8338f664f09 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ChgUIRSf" returned: 0 in 0.218s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:13:05 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23526f9-3fd8-4ecf-82dd-a6ee29b5fd02]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:13:05 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a3f3b3-6850-4bcc-97b6-d3d4e255fba2 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ChgUIRSf'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:13:05 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a771f9f-caa1-4b13-95af-f8338f664f09 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:13:05 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a771f9f-caa1-4b13-95af-f8338f664f09 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.096s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:13:05 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[04add6b0-0ed3-4921-b808-90dca73e3dc1]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:13:05 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a3f3b3-6850-4bcc-97b6-d3d4e255fba2 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:13:05 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:13:05 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:13:05 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0295c7f-8f0a-4f2f-a962-e8829dc23e6e]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3fda7ff-107c-4ae8-8d90-2883c69df026 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:13:05 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a3f3b3-6850-4bcc-97b6-d3d4e255fba2 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3fda7ff-107c-4ae8-8d90-2883c69df026 (non-flash)
Nov 10 18:13:05 user nova-compute[75100]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4 (non-flash)
Nov 10 18:13:05 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:13:05 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a3f3b3-6850-4bcc-97b6-d3d4e255fba2 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3fda7ff-107c-4ae8-8d90-2883c69df026 (non-flash)
Nov 10 18:13:05 user nova-compute[75100]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4 (non-flash)
Nov 10 18:13:05 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:13:05 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a771f9f-caa1-4b13-95af-f8338f664f09 -p 172.16.0.220:3260 --login {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:13:05 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a771f9f-caa1-4b13-95af-f8338f664f09 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:13:05 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba50acd-29fc-45a0-acb7-22227a4b5476]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a771f9f-caa1-4b13-95af-f8338f664f09, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8a771f9f-caa1-4b13-95af-f8338f664f09, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:13:05 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a3f3b3-6850-4bcc-97b6-d3d4e255fba2 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a771f9f-caa1-4b13-95af-f8338f664f09, portal: 172.16.0.220,3260]
Nov 10 18:13:05 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:8a771f9f-caa1-4b13-95af-f8338f664f09, portal: 172.16.0.220,3260] successful.
Nov 10 18:13:05 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:13:05 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a771f9f-caa1-4b13-95af-f8338f664f09 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:13:05 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a771f9f-caa1-4b13-95af-f8338f664f09 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:13:05 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[814940cc-137b-4f18-99fb-8637c8e45e4c]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:13:05 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a3f3b3-6850-4bcc-97b6-d3d4e255fba2 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:13:05 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:13:05 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:13:05 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdda4587-a3f3-4617-b4aa-6448a2f405fa]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3fda7ff-107c-4ae8-8d90-2883c69df026 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a771f9f-caa1-4b13-95af-f8338f664f09 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:13:05 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a3f3b3-6850-4bcc-97b6-d3d4e255fba2 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3fda7ff-107c-4ae8-8d90-2883c69df026 (non-flash)
Nov 10 18:13:05 user nova-compute[75100]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4 (non-flash)
Nov 10 18:13:05 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a771f9f-caa1-4b13-95af-f8338f664f09 (non-flash)
Nov 10 18:13:05 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:13:05 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a3f3b3-6850-4bcc-97b6-d3d4e255fba2 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3fda7ff-107c-4ae8-8d90-2883c69df026 (non-flash)
Nov 10 18:13:05 user nova-compute[75100]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4 (non-flash)
Nov 10 18:13:05 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a771f9f-caa1-4b13-95af-f8338f664f09 (non-flash)
Nov 10 18:13:05 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:13:05 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-36a3f3b3-6850-4bcc-97b6-d3d4e255fba2 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a771f9f-caa1-4b13-95af-f8338f664f09" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.616s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:13:05 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a3f3b3-6850-4bcc-97b6-d3d4e255fba2 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 18:13:05 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-36a3f3b3-6850-4bcc-97b6-d3d4e255fba2 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] HCTL ('35', '-', '-', 0) found on session 37 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 18:13:05 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-36a3f3b3-6850-4bcc-97b6-d3d4e255fba2 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 18:13:05 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:13:05 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:13:05 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23d9a56-8f05-4335-a6b8-2000a96f7663]: (4, ('- - 0', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:13:05 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-36a3f3b3-6850-4bcc-97b6-d3d4e255fba2 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: None {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 18:13:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:13:06 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-36a3f3b3-6850-4bcc-97b6-d3d4e255fba2 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 18:13:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a3f3b3-6850-4bcc-97b6-d3d4e255fba2 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:8a771f9f-caa1-4b13-95af-f8338f664f09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ChgUIRSf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 18:13:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-36a3f3b3-6850-4bcc-97b6-d3d4e255fba2 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.651s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:13:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a3f3b3-6850-4bcc-97b6-d3d4e255fba2 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] <== connect_volume: return (1653ms) {'type': 'block', 'scsi_wwn': '23665303035626234', 'path': '/dev/sdd'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:13:06 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36a3f3b3-6850-4bcc-97b6-d3d4e255fba2 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665303035626234', 'path': '/dev/sdd'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 18:13:06 user nova-compute[75100]: DEBUG nova.objects.instance [None req-36a3f3b3-6850-4bcc-97b6-d3d4e255fba2 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lazy-loading 'flavor' on Instance uuid 7003b97b-edf1-4972-a0be-dcb41c329ec8 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:13:06 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-36a3f3b3-6850-4bcc-97b6-d3d4e255fba2 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 18:13:06 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:13:06 user nova-compute[75100]:   <source dev="/dev/sdd"/>
Nov 10 18:13:06 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 18:13:06 user nova-compute[75100]:   <serial>8a771f9f-caa1-4b13-95af-f8338f664f09</serial>
Nov 10 18:13:06 user nova-compute[75100]: </disk>
Nov 10 18:13:06 user nova-compute[75100]:  {{(pid=75100) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 18:13:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-36a3f3b3-6850-4bcc-97b6-d3d4e255fba2 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 18:13:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-36a3f3b3-6850-4bcc-97b6-d3d4e255fba2 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 18:13:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-36a3f3b3-6850-4bcc-97b6-d3d4e255fba2 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] No VIF found with MAC fa:16:3e:4b:06:cf, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 18:13:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-36a3f3b3-6850-4bcc-97b6-d3d4e255fba2 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "7003b97b-edf1-4972-a0be-dcb41c329ec8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 29.159s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:13:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0894af31-c849-4974-9c4f-463d34487919 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Acquiring lock "f0b2a902-2358-4bed-a474-21170a45577d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:13:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0894af31-c849-4974-9c4f-463d34487919 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Lock "f0b2a902-2358-4bed-a474-21170a45577d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:13:07 user nova-compute[75100]: DEBUG nova.objects.instance [None req-0894af31-c849-4974-9c4f-463d34487919 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Lazy-loading 'flavor' on Instance uuid f0b2a902-2358-4bed-a474-21170a45577d {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:13:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0894af31-c849-4974-9c4f-463d34487919 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Lock "f0b2a902-2358-4bed-a474-21170a45577d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:13:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0894af31-c849-4974-9c4f-463d34487919 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Acquiring lock "f0b2a902-2358-4bed-a474-21170a45577d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:13:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0894af31-c849-4974-9c4f-463d34487919 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Lock "f0b2a902-2358-4bed-a474-21170a45577d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:13:07 user nova-compute[75100]: INFO nova.compute.manager [None req-0894af31-c849-4974-9c4f-463d34487919 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Attaching volume 493746e9-d5a7-44d0-9abe-b001f3dbf369 to /dev/vdc
Nov 10 18:13:07 user nova-compute[75100]: DEBUG os_brick.utils [None req-0894af31-c849-4974-9c4f-463d34487919 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:13:07 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:13:07 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:13:07 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[14dcfa68-0340-4be9-896e-ce97eb6d4f18]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90b1a229568f\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:13:07 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:13:07 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:13:07 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4171e0c-aeac-4601-bcac-23fe9ca87f6e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:13:07 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:13:07 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:13:07 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a13d444-58af-444e-9ac4-fce5635c710d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:13:07 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16d27d0-98c0-4787-9ff4-e363a7a40a0d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:13:07 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-0894af31-c849-4974-9c4f-463d34487919 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:13:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-0894af31-c849-4974-9c4f-463d34487919 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 18:13:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0894af31-c849-4974-9c4f-463d34487919 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 18:13:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:13:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 18:13:08 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 18:13:08 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[070fe20a-1aab-4e95-a128-72264d79687e]: (4, '') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:13:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-0894af31-c849-4974-9c4f-463d34487919 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 18:13:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-0894af31-c849-4974-9c4f-463d34487919 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 18:13:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-0894af31-c849-4974-9c4f-463d34487919 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 18:13:08 user nova-compute[75100]: DEBUG os_brick.utils [None req-0894af31-c849-4974-9c4f-463d34487919 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90b1a229568f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:13:08 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-0894af31-c849-4974-9c4f-463d34487919 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Updating existing volume attachment record: 276c6db4-b391-4c02-adf6-d3e780b5c1e7 {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 18:13:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-263cf2ed-4b6c-418c-aa67-05aa110d0567 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Acquiring lock "7003b97b-edf1-4972-a0be-dcb41c329ec8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:13:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-263cf2ed-4b6c-418c-aa67-05aa110d0567 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "7003b97b-edf1-4972-a0be-dcb41c329ec8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:13:08 user nova-compute[75100]: INFO nova.compute.manager [None req-263cf2ed-4b6c-418c-aa67-05aa110d0567 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Detaching volume 8a771f9f-caa1-4b13-95af-f8338f664f09
Nov 10 18:13:08 user nova-compute[75100]: INFO nova.virt.block_device [None req-263cf2ed-4b6c-418c-aa67-05aa110d0567 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Attempting to driver detach volume 8a771f9f-caa1-4b13-95af-f8338f664f09 from mountpoint /dev/vdb
Nov 10 18:13:08 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-263cf2ed-4b6c-418c-aa67-05aa110d0567 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Attempting to detach device vdb from instance 7003b97b-edf1-4972-a0be-dcb41c329ec8 from the persistent domain config. {{(pid=75100) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 18:13:08 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-263cf2ed-4b6c-418c-aa67-05aa110d0567 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 18:13:08 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:13:08 user nova-compute[75100]:   <source dev="/dev/sdd"/>
Nov 10 18:13:08 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 18:13:08 user nova-compute[75100]:   <serial>8a771f9f-caa1-4b13-95af-f8338f664f09</serial>
Nov 10 18:13:08 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 18:13:08 user nova-compute[75100]: </disk>
Nov 10 18:13:08 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 18:13:08 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-263cf2ed-4b6c-418c-aa67-05aa110d0567 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Successfully detached device vdb from instance 7003b97b-edf1-4972-a0be-dcb41c329ec8 from the persistent domain config.
Nov 10 18:13:08 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-263cf2ed-4b6c-418c-aa67-05aa110d0567 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7003b97b-edf1-4972-a0be-dcb41c329ec8 from the live domain config. {{(pid=75100) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 18:13:08 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-263cf2ed-4b6c-418c-aa67-05aa110d0567 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 18:13:08 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:13:08 user nova-compute[75100]:   <source dev="/dev/sdd"/>
Nov 10 18:13:08 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 18:13:08 user nova-compute[75100]:   <serial>8a771f9f-caa1-4b13-95af-f8338f664f09</serial>
Nov 10 18:13:08 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 18:13:08 user nova-compute[75100]: </disk>
Nov 10 18:13:08 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 18:13:09 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-263cf2ed-4b6c-418c-aa67-05aa110d0567 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7003b97b-edf1-4972-a0be-dcb41c329ec8 {{(pid=75100) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 18:13:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:13:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:13:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:13:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:13:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:13:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:13:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Acquiring lock "fb6b4d45-7c2b-4211-9939-9989a6a3c913" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:13:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "fb6b4d45-7c2b-4211-9939-9989a6a3c913" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:13:18 user nova-compute[75100]: DEBUG nova.compute.manager [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 18:13:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:13:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:13:18 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 18:13:18 user nova-compute[75100]: INFO nova.compute.claims [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Claim successful on node user
Nov 10 18:13:18 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:13:18 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:13:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.243s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:13:18 user nova-compute[75100]: DEBUG nova.compute.manager [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 18:13:18 user nova-compute[75100]: DEBUG nova.compute.manager [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 18:13:18 user nova-compute[75100]: DEBUG nova.network.neutron [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 18:13:18 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 18:13:19 user nova-compute[75100]: DEBUG nova.compute.manager [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 18:13:19 user nova-compute[75100]: DEBUG nova.policy [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '20c5bb15b9174fbc9df8ba12de10cea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cc6fc8310f44f3788e13aa4f1eb8c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 18:13:19 user nova-compute[75100]: DEBUG nova.compute.manager [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 18:13:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 18:13:19 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Creating image(s)
Nov 10 18:13:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Acquiring lock "/opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:13:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "/opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:13:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "/opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:13:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:13:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.200s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:13:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Acquiring lock "818b9e28e061d41a38d903968b229be2ed9ba520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:13:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:13:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:13:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.206s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:13:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:13:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk 1073741824" returned: 0 in 0.055s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:13:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:13:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:13:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.217s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:13:19 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 18:13:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:13:19 user nova-compute[75100]: DEBUG nova.network.neutron [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Successfully created port: 64ffd205-85a8-4c33-8ec4-40f8519b0bd5 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 18:13:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:13:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:13:20 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Cannot resize image /opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 18:13:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 18:13:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Ensure instance console log exists: /opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 18:13:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:13:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:13:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:13:20 user nova-compute[75100]: DEBUG nova.network.neutron [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Successfully updated port: 64ffd205-85a8-4c33-8ec4-40f8519b0bd5 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 18:13:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Acquiring lock "refresh_cache-fb6b4d45-7c2b-4211-9939-9989a6a3c913" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:13:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Acquired lock "refresh_cache-fb6b4d45-7c2b-4211-9939-9989a6a3c913" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:13:20 user nova-compute[75100]: DEBUG nova.network.neutron [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 18:13:20 user nova-compute[75100]: DEBUG nova.compute.manager [req-a93bebfe-0cfe-4230-a836-dc8cc2544151 req-344056b9-81da-4096-850b-a0ec384b35e2 service nova] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Received event network-changed-64ffd205-85a8-4c33-8ec4-40f8519b0bd5 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:13:20 user nova-compute[75100]: DEBUG nova.compute.manager [req-a93bebfe-0cfe-4230-a836-dc8cc2544151 req-344056b9-81da-4096-850b-a0ec384b35e2 service nova] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Refreshing instance network info cache due to event network-changed-64ffd205-85a8-4c33-8ec4-40f8519b0bd5. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 18:13:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a93bebfe-0cfe-4230-a836-dc8cc2544151 req-344056b9-81da-4096-850b-a0ec384b35e2 service nova] Acquiring lock "refresh_cache-fb6b4d45-7c2b-4211-9939-9989a6a3c913" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:13:20 user nova-compute[75100]: DEBUG nova.network.neutron [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 18:13:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:13:20 user nova-compute[75100]: DEBUG nova.network.neutron [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Updating instance_info_cache with network_info: [{"id": "64ffd205-85a8-4c33-8ec4-40f8519b0bd5", "address": "fa:16:3e:d6:d0:ff", "network": {"id": "0c411791-eb03-4e00-9d7f-d032e2c16d46", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1808141765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc6fc8310f44f3788e13aa4f1eb8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ffd205-85", "ovs_interfaceid": "64ffd205-85a8-4c33-8ec4-40f8519b0bd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:13:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Releasing lock "refresh_cache-fb6b4d45-7c2b-4211-9939-9989a6a3c913" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:13:21 user nova-compute[75100]: DEBUG nova.compute.manager [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Instance network_info: |[{"id": "64ffd205-85a8-4c33-8ec4-40f8519b0bd5", "address": "fa:16:3e:d6:d0:ff", "network": {"id": "0c411791-eb03-4e00-9d7f-d032e2c16d46", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1808141765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc6fc8310f44f3788e13aa4f1eb8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ffd205-85", "ovs_interfaceid": "64ffd205-85a8-4c33-8ec4-40f8519b0bd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 18:13:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a93bebfe-0cfe-4230-a836-dc8cc2544151 req-344056b9-81da-4096-850b-a0ec384b35e2 service nova] Acquired lock "refresh_cache-fb6b4d45-7c2b-4211-9939-9989a6a3c913" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:13:21 user nova-compute[75100]: DEBUG nova.network.neutron [req-a93bebfe-0cfe-4230-a836-dc8cc2544151 req-344056b9-81da-4096-850b-a0ec384b35e2 service nova] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Refreshing network info cache for port 64ffd205-85a8-4c33-8ec4-40f8519b0bd5 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 18:13:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Start _get_guest_xml network_info=[{"id": "64ffd205-85a8-4c33-8ec4-40f8519b0bd5", "address": "fa:16:3e:d6:d0:ff", "network": {"id": "0c411791-eb03-4e00-9d7f-d032e2c16d46", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1808141765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc6fc8310f44f3788e13aa4f1eb8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ffd205-85", "ovs_interfaceid": "64ffd205-85a8-4c33-8ec4-40f8519b0bd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'e3cc5321-4d40-49ee-885c-700e14741732'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 18:13:21 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:13:21 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:13:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 18:13:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 18:13:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 18:13:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 18:13:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 18:13:21 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T17:40:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 18:13:21 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 18:13:21 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 18:13:21 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 18:13:21 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 18:13:21 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 18:13:21 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 18:13:21 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 18:13:21 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 18:13:21 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 18:13:21 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 18:13:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:13:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1135440047',display_name='tempest-AttachVolumeTestJSON-server-1135440047',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1135440047',id=46,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcNRutHNHeVY/scgmxR9G4KJoQs59QhgQZEw5FvsqZrAjpQ/2uGeVsJVaEeZoz53+Lx9VAPkikUDH6vDzggddQ9KuRG+0ma+NlYbiZWBP5qgm948UdG/c0syluE8zjWJA==',key_name='tempest-keypair-1049460111',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8cc6fc8310f44f3788e13aa4f1eb8c96',ramdisk_id='',reservation_id='r-nozvlwff',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-375321786',owner_user_name='tempest-AttachVolumeTestJSON-375321786-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T18:13:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='20c5bb15b9174fbc9df8ba12de10cea6',uuid=fb6b4d45-7c2b-4211-9939-9989a6a3c913,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64ffd205-85a8-4c33-8ec4-40f8519b0bd5", "address": "fa:16:3e:d6:d0:ff", "network": {"id": "0c411791-eb03-4e00-9d7f-d032e2c16d46", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1808141765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc6fc8310f44f3788e13aa4f1eb8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ffd205-85", "ovs_interfaceid": "64ffd205-85a8-4c33-8ec4-40f8519b0bd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 18:13:21 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Converting VIF {"id": "64ffd205-85a8-4c33-8ec4-40f8519b0bd5", "address": "fa:16:3e:d6:d0:ff", "network": {"id": "0c411791-eb03-4e00-9d7f-d032e2c16d46", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1808141765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc6fc8310f44f3788e13aa4f1eb8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ffd205-85", "ovs_interfaceid": "64ffd205-85a8-4c33-8ec4-40f8519b0bd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:13:21 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:d0:ff,bridge_name='br-int',has_traffic_filtering=True,id=64ffd205-85a8-4c33-8ec4-40f8519b0bd5,network=Network(0c411791-eb03-4e00-9d7f-d032e2c16d46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64ffd205-85') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:13:21 user nova-compute[75100]: DEBUG nova.objects.instance [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lazy-loading 'pci_devices' on Instance uuid fb6b4d45-7c2b-4211-9939-9989a6a3c913 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:13:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] End _get_guest_xml xml=<domain type="kvm">
Nov 10 18:13:21 user nova-compute[75100]:   <uuid>fb6b4d45-7c2b-4211-9939-9989a6a3c913</uuid>
Nov 10 18:13:21 user nova-compute[75100]:   <name>instance-0000002e</name>
Nov 10 18:13:21 user nova-compute[75100]:   <memory>524288</memory>
Nov 10 18:13:21 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 10 18:13:21 user nova-compute[75100]:   <metadata>
Nov 10 18:13:21 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 18:13:21 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 10 18:13:21 user nova-compute[75100]:       <nova:name>tempest-AttachVolumeTestJSON-server-1135440047</nova:name>
Nov 10 18:13:21 user nova-compute[75100]:       <nova:creationTime>2023-11-10 18:13:21</nova:creationTime>
Nov 10 18:13:21 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 10 18:13:21 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 10 18:13:21 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 10 18:13:21 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 10 18:13:21 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 18:13:21 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 10 18:13:21 user nova-compute[75100]:       </nova:flavor>
Nov 10 18:13:21 user nova-compute[75100]:       <nova:owner>
Nov 10 18:13:21 user nova-compute[75100]:         <nova:user uuid="20c5bb15b9174fbc9df8ba12de10cea6">tempest-AttachVolumeTestJSON-375321786-project-member</nova:user>
Nov 10 18:13:21 user nova-compute[75100]:         <nova:project uuid="8cc6fc8310f44f3788e13aa4f1eb8c96">tempest-AttachVolumeTestJSON-375321786</nova:project>
Nov 10 18:13:21 user nova-compute[75100]:       </nova:owner>
Nov 10 18:13:21 user nova-compute[75100]:       <nova:root type="image" uuid="e3cc5321-4d40-49ee-885c-700e14741732"/>
Nov 10 18:13:21 user nova-compute[75100]:       <nova:ports>
Nov 10 18:13:21 user nova-compute[75100]:         <nova:port uuid="64ffd205-85a8-4c33-8ec4-40f8519b0bd5">
Nov 10 18:13:21 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 10 18:13:21 user nova-compute[75100]:         </nova:port>
Nov 10 18:13:21 user nova-compute[75100]:       </nova:ports>
Nov 10 18:13:21 user nova-compute[75100]:     </nova:instance>
Nov 10 18:13:21 user nova-compute[75100]:   </metadata>
Nov 10 18:13:21 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 10 18:13:21 user nova-compute[75100]:     <system>
Nov 10 18:13:21 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 18:13:21 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 10 18:13:21 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 10 18:13:21 user nova-compute[75100]:       <entry name="serial">fb6b4d45-7c2b-4211-9939-9989a6a3c913</entry>
Nov 10 18:13:21 user nova-compute[75100]:       <entry name="uuid">fb6b4d45-7c2b-4211-9939-9989a6a3c913</entry>
Nov 10 18:13:21 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 10 18:13:21 user nova-compute[75100]:     </system>
Nov 10 18:13:21 user nova-compute[75100]:   </sysinfo>
Nov 10 18:13:21 user nova-compute[75100]:   <os>
Nov 10 18:13:21 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 18:13:21 user nova-compute[75100]:     <boot dev="hd"/>
Nov 10 18:13:21 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 10 18:13:21 user nova-compute[75100]:   </os>
Nov 10 18:13:21 user nova-compute[75100]:   <features>
Nov 10 18:13:21 user nova-compute[75100]:     <acpi/>
Nov 10 18:13:21 user nova-compute[75100]:     <apic/>
Nov 10 18:13:21 user nova-compute[75100]:     <vmcoreinfo/>
Nov 10 18:13:21 user nova-compute[75100]:   </features>
Nov 10 18:13:21 user nova-compute[75100]:   <clock offset="utc">
Nov 10 18:13:21 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 18:13:21 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 18:13:21 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 10 18:13:21 user nova-compute[75100]:   </clock>
Nov 10 18:13:21 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 10 18:13:21 user nova-compute[75100]:     <model>Nehalem</model>
Nov 10 18:13:21 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 18:13:21 user nova-compute[75100]:   </cpu>
Nov 10 18:13:21 user nova-compute[75100]:   <devices>
Nov 10 18:13:21 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 10 18:13:21 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 18:13:21 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk"/>
Nov 10 18:13:21 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 10 18:13:21 user nova-compute[75100]:     </disk>
Nov 10 18:13:21 user nova-compute[75100]:     <interface type="ethernet">
Nov 10 18:13:21 user nova-compute[75100]:       <mac address="fa:16:3e:d6:d0:ff"/>
Nov 10 18:13:21 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 18:13:21 user nova-compute[75100]:       <mtu size="1442"/>
Nov 10 18:13:21 user nova-compute[75100]:       <target dev="tap64ffd205-85"/>
Nov 10 18:13:21 user nova-compute[75100]:     </interface>
Nov 10 18:13:21 user nova-compute[75100]:     <serial type="pty">
Nov 10 18:13:21 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/console.log" append="off"/>
Nov 10 18:13:21 user nova-compute[75100]:     </serial>
Nov 10 18:13:21 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 18:13:21 user nova-compute[75100]:     <video>
Nov 10 18:13:21 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 18:13:21 user nova-compute[75100]:     </video>
Nov 10 18:13:21 user nova-compute[75100]:     <rng model="virtio">
Nov 10 18:13:21 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 10 18:13:21 user nova-compute[75100]:     </rng>
Nov 10 18:13:21 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 10 18:13:21 user nova-compute[75100]:     <memballoon model="virtio">
Nov 10 18:13:21 user nova-compute[75100]:       <stats period="10"/>
Nov 10 18:13:21 user nova-compute[75100]:     </memballoon>
Nov 10 18:13:21 user nova-compute[75100]:   </devices>
Nov 10 18:13:21 user nova-compute[75100]: </domain>
Nov 10 18:13:21 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 18:13:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:13:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1135440047',display_name='tempest-AttachVolumeTestJSON-server-1135440047',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1135440047',id=46,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcNRutHNHeVY/scgmxR9G4KJoQs59QhgQZEw5FvsqZrAjpQ/2uGeVsJVaEeZoz53+Lx9VAPkikUDH6vDzggddQ9KuRG+0ma+NlYbiZWBP5qgm948UdG/c0syluE8zjWJA==',key_name='tempest-keypair-1049460111',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8cc6fc8310f44f3788e13aa4f1eb8c96',ramdisk_id='',reservation_id='r-nozvlwff',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-375321786',owner_user_name='tempest-AttachVolumeTestJSON-375321786-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T18:13:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='20c5bb15b9174fbc9df8ba12de10cea6',uuid=fb6b4d45-7c2b-4211-9939-9989a6a3c913,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64ffd205-85a8-4c33-8ec4-40f8519b0bd5", "address": "fa:16:3e:d6:d0:ff", "network": {"id": "0c411791-eb03-4e00-9d7f-d032e2c16d46", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1808141765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc6fc8310f44f3788e13aa4f1eb8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ffd205-85", "ovs_interfaceid": "64ffd205-85a8-4c33-8ec4-40f8519b0bd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 18:13:21 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Converting VIF {"id": "64ffd205-85a8-4c33-8ec4-40f8519b0bd5", "address": "fa:16:3e:d6:d0:ff", "network": {"id": "0c411791-eb03-4e00-9d7f-d032e2c16d46", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1808141765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc6fc8310f44f3788e13aa4f1eb8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ffd205-85", "ovs_interfaceid": "64ffd205-85a8-4c33-8ec4-40f8519b0bd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:13:21 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:d0:ff,bridge_name='br-int',has_traffic_filtering=True,id=64ffd205-85a8-4c33-8ec4-40f8519b0bd5,network=Network(0c411791-eb03-4e00-9d7f-d032e2c16d46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64ffd205-85') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:13:21 user nova-compute[75100]: DEBUG os_vif [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:d0:ff,bridge_name='br-int',has_traffic_filtering=True,id=64ffd205-85a8-4c33-8ec4-40f8519b0bd5,network=Network(0c411791-eb03-4e00-9d7f-d032e2c16d46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64ffd205-85') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 18:13:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:13:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:13:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 18:13:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:13:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bec451fb-2b1e-530e-9419-4051e35f1110', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:13:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:13:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:13:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:13:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap64ffd205-85, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:13:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap64ffd205-85, col_values=(('qos', UUID('7b5279c0-cc43-4eee-8611-dae499589245')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:13:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap64ffd205-85, col_values=(('external_ids', {'iface-id': '64ffd205-85a8-4c33-8ec4-40f8519b0bd5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:d0:ff', 'vm-uuid': 'fb6b4d45-7c2b-4211-9939-9989a6a3c913'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:13:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:13:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:13:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:13:21 user nova-compute[75100]: INFO os_vif [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:d0:ff,bridge_name='br-int',has_traffic_filtering=True,id=64ffd205-85a8-4c33-8ec4-40f8519b0bd5,network=Network(0c411791-eb03-4e00-9d7f-d032e2c16d46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64ffd205-85')
Nov 10 18:13:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 18:13:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] No VIF found with MAC fa:16:3e:d6:d0:ff, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 18:13:21 user nova-compute[75100]: DEBUG nova.network.neutron [req-a93bebfe-0cfe-4230-a836-dc8cc2544151 req-344056b9-81da-4096-850b-a0ec384b35e2 service nova] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Updated VIF entry in instance network info cache for port 64ffd205-85a8-4c33-8ec4-40f8519b0bd5. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 18:13:21 user nova-compute[75100]: DEBUG nova.network.neutron [req-a93bebfe-0cfe-4230-a836-dc8cc2544151 req-344056b9-81da-4096-850b-a0ec384b35e2 service nova] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Updating instance_info_cache with network_info: [{"id": "64ffd205-85a8-4c33-8ec4-40f8519b0bd5", "address": "fa:16:3e:d6:d0:ff", "network": {"id": "0c411791-eb03-4e00-9d7f-d032e2c16d46", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1808141765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc6fc8310f44f3788e13aa4f1eb8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ffd205-85", "ovs_interfaceid": "64ffd205-85a8-4c33-8ec4-40f8519b0bd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:13:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a93bebfe-0cfe-4230-a836-dc8cc2544151 req-344056b9-81da-4096-850b-a0ec384b35e2 service nova] Releasing lock "refresh_cache-fb6b4d45-7c2b-4211-9939-9989a6a3c913" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:13:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:13:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:13:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:13:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:13:23 user nova-compute[75100]: DEBUG nova.compute.manager [req-5af7026a-ccc1-43da-9e98-06e2055226a0 req-ed64dfef-dfba-43b4-b117-736bc7f146ef service nova] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Received event network-vif-plugged-64ffd205-85a8-4c33-8ec4-40f8519b0bd5 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:13:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5af7026a-ccc1-43da-9e98-06e2055226a0 req-ed64dfef-dfba-43b4-b117-736bc7f146ef service nova] Acquiring lock "fb6b4d45-7c2b-4211-9939-9989a6a3c913-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:13:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5af7026a-ccc1-43da-9e98-06e2055226a0 req-ed64dfef-dfba-43b4-b117-736bc7f146ef service nova] Lock "fb6b4d45-7c2b-4211-9939-9989a6a3c913-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:13:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5af7026a-ccc1-43da-9e98-06e2055226a0 req-ed64dfef-dfba-43b4-b117-736bc7f146ef service nova] Lock "fb6b4d45-7c2b-4211-9939-9989a6a3c913-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:13:23 user nova-compute[75100]: DEBUG nova.compute.manager [req-5af7026a-ccc1-43da-9e98-06e2055226a0 req-ed64dfef-dfba-43b4-b117-736bc7f146ef service nova] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] No waiting events found dispatching network-vif-plugged-64ffd205-85a8-4c33-8ec4-40f8519b0bd5 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:13:23 user nova-compute[75100]: WARNING nova.compute.manager [req-5af7026a-ccc1-43da-9e98-06e2055226a0 req-ed64dfef-dfba-43b4-b117-736bc7f146ef service nova] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Received unexpected event network-vif-plugged-64ffd205-85a8-4c33-8ec4-40f8519b0bd5 for instance with vm_state building and task_state spawning.
Nov 10 18:13:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:13:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:13:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:13:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:13:25 user nova-compute[75100]: DEBUG nova.compute.manager [req-7c168e57-154a-4e22-a1e3-3bf8bd033b60 req-478b910f-b086-4260-ab7e-eeef9a56a1e4 service nova] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Received event network-vif-plugged-64ffd205-85a8-4c33-8ec4-40f8519b0bd5 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:13:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7c168e57-154a-4e22-a1e3-3bf8bd033b60 req-478b910f-b086-4260-ab7e-eeef9a56a1e4 service nova] Acquiring lock "fb6b4d45-7c2b-4211-9939-9989a6a3c913-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:13:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7c168e57-154a-4e22-a1e3-3bf8bd033b60 req-478b910f-b086-4260-ab7e-eeef9a56a1e4 service nova] Lock "fb6b4d45-7c2b-4211-9939-9989a6a3c913-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:13:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7c168e57-154a-4e22-a1e3-3bf8bd033b60 req-478b910f-b086-4260-ab7e-eeef9a56a1e4 service nova] Lock "fb6b4d45-7c2b-4211-9939-9989a6a3c913-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:13:25 user nova-compute[75100]: DEBUG nova.compute.manager [req-7c168e57-154a-4e22-a1e3-3bf8bd033b60 req-478b910f-b086-4260-ab7e-eeef9a56a1e4 service nova] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] No waiting events found dispatching network-vif-plugged-64ffd205-85a8-4c33-8ec4-40f8519b0bd5 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:13:25 user nova-compute[75100]: WARNING nova.compute.manager [req-7c168e57-154a-4e22-a1e3-3bf8bd033b60 req-478b910f-b086-4260-ab7e-eeef9a56a1e4 service nova] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Received unexpected event network-vif-plugged-64ffd205-85a8-4c33-8ec4-40f8519b0bd5 for instance with vm_state building and task_state spawning.
Nov 10 18:13:25 user nova-compute[75100]: DEBUG nova.compute.manager [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 18:13:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 18:13:25 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Instance spawned successfully.
Nov 10 18:13:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 18:13:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:13:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:13:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:13:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:13:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:13:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:13:25 user nova-compute[75100]: INFO nova.compute.manager [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Took 6.41 seconds to spawn the instance on the hypervisor.
Nov 10 18:13:25 user nova-compute[75100]: DEBUG nova.compute.manager [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 18:13:25 user nova-compute[75100]: INFO nova.compute.manager [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Took 7.03 seconds to build instance.
Nov 10 18:13:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7a6ba13e-755d-4d0a-9bc7-cc9daa650eaa tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "fb6b4d45-7c2b-4211-9939-9989a6a3c913" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.281s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:13:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:13:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:13:28 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:13:28 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:13:29 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-263cf2ed-4b6c-418c-aa67-05aa110d0567 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7003b97b-edf1-4972-a0be-dcb41c329ec8 is timed out.
Nov 10 18:13:29 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-263cf2ed-4b6c-418c-aa67-05aa110d0567 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Successfully detached device vdb from instance 7003b97b-edf1-4972-a0be-dcb41c329ec8 from the live domain config.
Nov 10 18:13:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-263cf2ed-4b6c-418c-aa67-05aa110d0567 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 18:13:29 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-263cf2ed-4b6c-418c-aa67-05aa110d0567 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, {'target_iqn': 'iqn.2010-10.org.openstack:8a771f9f-caa1-4b13-95af-f8338f664f09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ChgUIRSf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:13:29 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-263cf2ed-4b6c-418c-aa67-05aa110d0567 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:13:29 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-263cf2ed-4b6c-418c-aa67-05aa110d0567 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:13:29 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-263cf2ed-4b6c-418c-aa67-05aa110d0567 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:13:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:13:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:13:29 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab3fcfae-96da-4bf3-a62c-eb5b1b58255c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8a771f9f-caa1-4b13-95af-f8338f664f09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f902357f-a802-4b00-b07a-9edcf090157a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3fda7ff-107c-4ae8-8d90-2883c69df026\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:13:29 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-263cf2ed-4b6c-418c-aa67-05aa110d0567 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 18:13:29 user nova-compute[75100]: No targets found.
Nov 10 18:13:29 user nova-compute[75100]: iSNS:
Nov 10 18:13:29 user nova-compute[75100]: No targets found.
Nov 10 18:13:29 user nova-compute[75100]: STATIC:
Nov 10 18:13:29 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:8a771f9f-caa1-4b13-95af-f8338f664f09
Nov 10 18:13:29 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:13:29 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:13:29 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:f902357f-a802-4b00-b07a-9edcf090157a
Nov 10 18:13:29 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:13:29 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:13:29 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:e3fda7ff-107c-4ae8-8d90-2883c69df026
Nov 10 18:13:29 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:13:29 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:13:29 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4
Nov 10 18:13:29 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:13:29 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:13:29 user nova-compute[75100]: FIRMWARE:
Nov 10 18:13:29 user nova-compute[75100]: No targets found.
Nov 10 18:13:29 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:13:29 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-263cf2ed-4b6c-418c-aa67-05aa110d0567 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 18:13:29 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 18:13:29 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 18:13:29 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-263cf2ed-4b6c-418c-aa67-05aa110d0567 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a771f9f-caa1-4b13-95af-f8338f664f09', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 18:13:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:13:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:13:29 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f678c15c-5ddb-4114-9ddd-32054f527f99]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a771f9f-caa1-4b13-95af-f8338f664f09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3fda7ff-107c-4ae8-8d90-2883c69df026\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f902357f-a802-4b00-b07a-9edcf090157a\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:13:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:13:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:13:29 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[00480b95-4195-44b6-93c6-e0df69f79f75]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3fda7ff-107c-4ae8-8d90-2883c69df026 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a771f9f-caa1-4b13-95af-f8338f664f09 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f902357f-a802-4b00-b07a-9edcf090157a (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:13:29 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-263cf2ed-4b6c-418c-aa67-05aa110d0567 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3fda7ff-107c-4ae8-8d90-2883c69df026 (non-flash)
Nov 10 18:13:29 user nova-compute[75100]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4 (non-flash)
Nov 10 18:13:29 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a771f9f-caa1-4b13-95af-f8338f664f09 (non-flash)
Nov 10 18:13:29 user nova-compute[75100]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f902357f-a802-4b00-b07a-9edcf090157a (non-flash)
Nov 10 18:13:29 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:13:29 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-263cf2ed-4b6c-418c-aa67-05aa110d0567 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3fda7ff-107c-4ae8-8d90-2883c69df026 (non-flash)
Nov 10 18:13:29 user nova-compute[75100]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4 (non-flash)
Nov 10 18:13:29 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a771f9f-caa1-4b13-95af-f8338f664f09 (non-flash)
Nov 10 18:13:29 user nova-compute[75100]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f902357f-a802-4b00-b07a-9edcf090157a (non-flash)
Nov 10 18:13:29 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:13:29 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-263cf2ed-4b6c-418c-aa67-05aa110d0567 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3bc1077f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a771f9f-caa1-4b13-95af-f8338f664f09'): ({'sdd'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 18:13:29 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-263cf2ed-4b6c-418c-aa67-05aa110d0567 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Removing single pathed devices sdd {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 18:13:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:13:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.038s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:13:29 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d17fe88-fa1d-4ccb-9eaa-0a436205c4a8]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:13:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:13:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.035s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:13:29 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[93abf232-42e9-477b-a430-4a261bcfeec3]: (4, ('ok\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:13:29 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-263cf2ed-4b6c-418c-aa67-05aa110d0567 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Flushing IO for device /dev/sdd {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 18:13:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:13:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.029s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:13:29 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecfb3925-b135-490f-9fb1-b7a4f55da53f]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:13:29 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-263cf2ed-4b6c-418c-aa67-05aa110d0567 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 18:13:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:13:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.065s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:13:29 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71241c4-c751-40b1-b928-78fe46b8c764]: (4, ('1', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:13:29 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-263cf2ed-4b6c-418c-aa67-05aa110d0567 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 18:13:29 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-263cf2ed-4b6c-418c-aa67-05aa110d0567 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] SCSI volumes sdd have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 18:13:29 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-263cf2ed-4b6c-418c-aa67-05aa110d0567 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a771f9f-caa1-4b13-95af-f8338f664f09')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 18:13:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a771f9f-caa1-4b13-95af-f8338f664f09 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:13:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a771f9f-caa1-4b13-95af-f8338f664f09 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:13:29 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[846f64bc-c5a5-46ac-aacf-f5561216f7f4]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:13:29 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-263cf2ed-4b6c-418c-aa67-05aa110d0567 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:13:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a771f9f-caa1-4b13-95af-f8338f664f09 -p 172.16.0.220:3260 --logout {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:13:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a771f9f-caa1-4b13-95af-f8338f664f09 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:13:29 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fea1286-d95d-4a96-8dce-356ec2945e8e]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:8a771f9f-caa1-4b13-95af-f8338f664f09, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:8a771f9f-caa1-4b13-95af-f8338f664f09, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:13:29 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-263cf2ed-4b6c-418c-aa67-05aa110d0567 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:8a771f9f-caa1-4b13-95af-f8338f664f09, portal: 172.16.0.220,3260]
Nov 10 18:13:29 user nova-compute[75100]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:8a771f9f-caa1-4b13-95af-f8338f664f09, portal: 172.16.0.220,3260] successful.
Nov 10 18:13:29 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:13:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a771f9f-caa1-4b13-95af-f8338f664f09 -p 172.16.0.220:3260 --op delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:13:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a771f9f-caa1-4b13-95af-f8338f664f09 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:13:29 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e06a431-5564-468b-9091-695ac1b331b6]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:13:29 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-263cf2ed-4b6c-418c-aa67-05aa110d0567 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:13:29 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-263cf2ed-4b6c-418c-aa67-05aa110d0567 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.451s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:13:29 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-263cf2ed-4b6c-418c-aa67-05aa110d0567 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] <== disconnect_volume: return (455ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:13:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-263cf2ed-4b6c-418c-aa67-05aa110d0567 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 18:13:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:13:30 user nova-compute[75100]: DEBUG nova.objects.instance [None req-263cf2ed-4b6c-418c-aa67-05aa110d0567 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lazy-loading 'flavor' on Instance uuid 7003b97b-edf1-4972-a0be-dcb41c329ec8 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:13:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-263cf2ed-4b6c-418c-aa67-05aa110d0567 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "7003b97b-edf1-4972-a0be-dcb41c329ec8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.359s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:13:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:13:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:13:33 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:13:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:13:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:13:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:13:33 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 18:13:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0b2a902-2358-4bed-a474-21170a45577d/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:13:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0b2a902-2358-4bed-a474-21170a45577d/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:13:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0b2a902-2358-4bed-a474-21170a45577d/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:13:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0b2a902-2358-4bed-a474-21170a45577d/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:13:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 18:13:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:13:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:13:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:13:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:13:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:13:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7003b97b-edf1-4972-a0be-dcb41c329ec8/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:13:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7003b97b-edf1-4972-a0be-dcb41c329ec8/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:13:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7003b97b-edf1-4972-a0be-dcb41c329ec8/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:13:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7003b97b-edf1-4972-a0be-dcb41c329ec8/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:13:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:13:35 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:13:35 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:13:35 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Hypervisor/Node resource view: name=user free_ram=8425MB free_disk=24.43679428100586GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 18:13:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:13:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:13:35 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 7003b97b-edf1-4972-a0be-dcb41c329ec8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:13:35 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance f0b2a902-2358-4bed-a474-21170a45577d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:13:35 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance fb6b4d45-7c2b-4211-9939-9989a6a3c913 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:13:35 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 18:13:35 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 18:13:35 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:13:35 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:13:35 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 18:13:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.375s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:13:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:13:36 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0894af31-c849-4974-9c4f-463d34487919 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 18:13:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0894af31-c849-4974-9c4f-463d34487919 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:493746e9-d5a7-44d0-9abe-b001f3dbf369', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SIfBTrNH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:13:36 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-0894af31-c849-4974-9c4f-463d34487919 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:13:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-0894af31-c849-4974-9c4f-463d34487919 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:13:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-0894af31-c849-4974-9c4f-463d34487919 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:13:36 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-0894af31-c849-4974-9c4f-463d34487919 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:13:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-0894af31-c849-4974-9c4f-463d34487919 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:493746e9-d5a7-44d0-9abe-b001f3dbf369" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:13:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-0894af31-c849-4974-9c4f-463d34487919 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:493746e9-d5a7-44d0-9abe-b001f3dbf369" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:13:36 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-0894af31-c849-4974-9c4f-463d34487919 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 18:13:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:493746e9-d5a7-44d0-9abe-b001f3dbf369 -p 172.16.0.220:3260 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:13:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:493746e9-d5a7-44d0-9abe-b001f3dbf369 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:13:36 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7ada65-6291-473b-b39a-e595ee1b903f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:13:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0894af31-c849-4974-9c4f-463d34487919 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 18:13:36 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:13:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:493746e9-d5a7-44d0-9abe-b001f3dbf369 -p 172.16.0.220:3260 --interface default --op new {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:13:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:493746e9-d5a7-44d0-9abe-b001f3dbf369 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:13:36 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[619dc4d3-26f2-4f18-b6e0-0a25ff415d3f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:493746e9-d5a7-44d0-9abe-b001f3dbf369] added\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:13:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0894af31-c849-4974-9c4f-463d34487919 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:493746e9-d5a7-44d0-9abe-b001f3dbf369] added
Nov 10 18:13:36 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:13:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:493746e9-d5a7-44d0-9abe-b001f3dbf369 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:13:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:493746e9-d5a7-44d0-9abe-b001f3dbf369 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:13:36 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1ca1a4-3335-4db7-8eb6-1a5b2adffda1]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:13:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0894af31-c849-4974-9c4f-463d34487919 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:13:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:493746e9-d5a7-44d0-9abe-b001f3dbf369 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:13:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:493746e9-d5a7-44d0-9abe-b001f3dbf369 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:13:36 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d62d7e5-29bf-4273-9af7-9014f8a88528]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:13:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0894af31-c849-4974-9c4f-463d34487919 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:13:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:493746e9-d5a7-44d0-9abe-b001f3dbf369 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SIfBTrNH {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:13:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:493746e9-d5a7-44d0-9abe-b001f3dbf369 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SIfBTrNH" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:13:36 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5562a144-b917-48d5-a87c-c7285a2429ea]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:13:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0894af31-c849-4974-9c4f-463d34487919 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SIfBTrNH'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:13:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:493746e9-d5a7-44d0-9abe-b001f3dbf369 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:13:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:493746e9-d5a7-44d0-9abe-b001f3dbf369 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:13:36 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d7d8c90-6d2b-4535-9b67-985281113a5f]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:13:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0894af31-c849-4974-9c4f-463d34487919 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:13:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:13:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:13:36 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[419af221-f5ef-453c-9e34-83d3468b941f]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:13:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0894af31-c849-4974-9c4f-463d34487919 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4 (non-flash)
Nov 10 18:13:36 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:13:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0894af31-c849-4974-9c4f-463d34487919 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4 (non-flash)
Nov 10 18:13:36 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:13:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:493746e9-d5a7-44d0-9abe-b001f3dbf369 -p 172.16.0.220:3260 --login {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:13:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:493746e9-d5a7-44d0-9abe-b001f3dbf369 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:13:36 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f518a178-2dc8-44b2-a87f-8ac000b175dc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:493746e9-d5a7-44d0-9abe-b001f3dbf369, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:493746e9-d5a7-44d0-9abe-b001f3dbf369, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:13:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0894af31-c849-4974-9c4f-463d34487919 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:493746e9-d5a7-44d0-9abe-b001f3dbf369, portal: 172.16.0.220,3260]
Nov 10 18:13:36 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:493746e9-d5a7-44d0-9abe-b001f3dbf369, portal: 172.16.0.220,3260] successful.
Nov 10 18:13:36 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:13:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:493746e9-d5a7-44d0-9abe-b001f3dbf369 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:13:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:493746e9-d5a7-44d0-9abe-b001f3dbf369 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:13:36 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad2a81d-96c4-4af4-b32d-16206f823a16]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:13:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0894af31-c849-4974-9c4f-463d34487919 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:13:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:13:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:13:36 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37cefae-6ced-4875-80a8-4cf84af5a8f7]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:493746e9-d5a7-44d0-9abe-b001f3dbf369 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:13:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0894af31-c849-4974-9c4f-463d34487919 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4 (non-flash)
Nov 10 18:13:36 user nova-compute[75100]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:493746e9-d5a7-44d0-9abe-b001f3dbf369 (non-flash)
Nov 10 18:13:36 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:13:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0894af31-c849-4974-9c4f-463d34487919 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4 (non-flash)
Nov 10 18:13:36 user nova-compute[75100]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:493746e9-d5a7-44d0-9abe-b001f3dbf369 (non-flash)
Nov 10 18:13:36 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:13:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-0894af31-c849-4974-9c4f-463d34487919 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:493746e9-d5a7-44d0-9abe-b001f3dbf369" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:13:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0894af31-c849-4974-9c4f-463d34487919 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 18:13:36 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-0894af31-c849-4974-9c4f-463d34487919 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] HCTL ('33', '-', '-', 0) found on session 39 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 18:13:36 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-0894af31-c849-4974-9c4f-463d34487919 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 18:13:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:13:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:13:36 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[73105836-95b9-4018-9097-39ab1556175e]: (4, ('- - 0', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:13:36 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-0894af31-c849-4974-9c4f-463d34487919 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: None {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 18:13:37 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-0894af31-c849-4974-9c4f-463d34487919 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 18:13:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0894af31-c849-4974-9c4f-463d34487919 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:493746e9-d5a7-44d0-9abe-b001f3dbf369', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SIfBTrNH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 18:13:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-0894af31-c849-4974-9c4f-463d34487919 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:13:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0894af31-c849-4974-9c4f-463d34487919 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '26231646234313132', 'path': '/dev/sdb'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:13:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0894af31-c849-4974-9c4f-463d34487919 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26231646234313132', 'path': '/dev/sdb'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 18:13:37 user nova-compute[75100]: DEBUG nova.objects.instance [None req-0894af31-c849-4974-9c4f-463d34487919 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Lazy-loading 'flavor' on Instance uuid f0b2a902-2358-4bed-a474-21170a45577d {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:13:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-0894af31-c849-4974-9c4f-463d34487919 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 18:13:37 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:13:37 user nova-compute[75100]:   <source dev="/dev/sdb"/>
Nov 10 18:13:37 user nova-compute[75100]:   <target dev="vdc" bus="virtio"/>
Nov 10 18:13:37 user nova-compute[75100]:   <serial>493746e9-d5a7-44d0-9abe-b001f3dbf369</serial>
Nov 10 18:13:37 user nova-compute[75100]: </disk>
Nov 10 18:13:37 user nova-compute[75100]:  {{(pid=75100) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 18:13:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0894af31-c849-4974-9c4f-463d34487919 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 18:13:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0894af31-c849-4974-9c4f-463d34487919 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 18:13:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0894af31-c849-4974-9c4f-463d34487919 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 18:13:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0894af31-c849-4974-9c4f-463d34487919 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] No VIF found with MAC fa:16:3e:01:34:07, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 18:13:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0894af31-c849-4974-9c4f-463d34487919 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Lock "f0b2a902-2358-4bed-a474-21170a45577d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 30.530s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:13:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4521d82c-0e29-49eb-abd3-95f80e3f5a60 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Acquiring lock "f0b2a902-2358-4bed-a474-21170a45577d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:13:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4521d82c-0e29-49eb-abd3-95f80e3f5a60 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Lock "f0b2a902-2358-4bed-a474-21170a45577d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:13:39 user nova-compute[75100]: INFO nova.compute.manager [None req-4521d82c-0e29-49eb-abd3-95f80e3f5a60 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Detaching volume 493746e9-d5a7-44d0-9abe-b001f3dbf369
Nov 10 18:13:39 user nova-compute[75100]: INFO nova.virt.block_device [None req-4521d82c-0e29-49eb-abd3-95f80e3f5a60 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Attempting to driver detach volume 493746e9-d5a7-44d0-9abe-b001f3dbf369 from mountpoint /dev/vdc
Nov 10 18:13:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4521d82c-0e29-49eb-abd3-95f80e3f5a60 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Attempting to detach device vdc from instance f0b2a902-2358-4bed-a474-21170a45577d from the persistent domain config. {{(pid=75100) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 18:13:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-4521d82c-0e29-49eb-abd3-95f80e3f5a60 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 18:13:39 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:13:39 user nova-compute[75100]:   <source dev="/dev/sdb"/>
Nov 10 18:13:39 user nova-compute[75100]:   <target dev="vdc" bus="virtio"/>
Nov 10 18:13:39 user nova-compute[75100]:   <serial>493746e9-d5a7-44d0-9abe-b001f3dbf369</serial>
Nov 10 18:13:39 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 10 18:13:39 user nova-compute[75100]: </disk>
Nov 10 18:13:39 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 18:13:39 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-4521d82c-0e29-49eb-abd3-95f80e3f5a60 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Successfully detached device vdc from instance f0b2a902-2358-4bed-a474-21170a45577d from the persistent domain config.
Nov 10 18:13:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4521d82c-0e29-49eb-abd3-95f80e3f5a60 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance f0b2a902-2358-4bed-a474-21170a45577d from the live domain config. {{(pid=75100) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 18:13:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-4521d82c-0e29-49eb-abd3-95f80e3f5a60 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 18:13:39 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:13:39 user nova-compute[75100]:   <source dev="/dev/sdb"/>
Nov 10 18:13:39 user nova-compute[75100]:   <target dev="vdc" bus="virtio"/>
Nov 10 18:13:39 user nova-compute[75100]:   <serial>493746e9-d5a7-44d0-9abe-b001f3dbf369</serial>
Nov 10 18:13:39 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 10 18:13:39 user nova-compute[75100]: </disk>
Nov 10 18:13:39 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 18:13:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4521d82c-0e29-49eb-abd3-95f80e3f5a60 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance f0b2a902-2358-4bed-a474-21170a45577d {{(pid=75100) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 18:13:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:13:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:13:42 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:13:42 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:13:42 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:13:44 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:13:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:13:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:13:47 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:13:47 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 18:13:48 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:13:48 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 18:13:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "refresh_cache-f0b2a902-2358-4bed-a474-21170a45577d" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:13:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquired lock "refresh_cache-f0b2a902-2358-4bed-a474-21170a45577d" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:13:48 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 18:13:48 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Updating instance_info_cache with network_info: [{"id": "6a80628d-e450-4d72-86c9-08d8578d9f17", "address": "fa:16:3e:01:34:07", "network": {"id": "5e6c66a5-a7bb-4157-aed0-8f8f7cfa846c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-209207359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1b6a6cf82404999aa9e2d5f99b5b9df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a80628d-e4", "ovs_interfaceid": "6a80628d-e450-4d72-86c9-08d8578d9f17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:13:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Releasing lock "refresh_cache-f0b2a902-2358-4bed-a474-21170a45577d" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:13:48 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 18:13:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:13:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:13:54 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:13:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:13:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Acquiring lock "8f04a49b-8124-4319-a4b2-b40786984c00" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:13:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Lock "8f04a49b-8124-4319-a4b2-b40786984c00" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:13:56 user nova-compute[75100]: DEBUG nova.compute.manager [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 18:13:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:13:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:13:56 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 18:13:56 user nova-compute[75100]: INFO nova.compute.claims [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Claim successful on node user
Nov 10 18:13:56 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:13:56 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:13:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.326s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:13:56 user nova-compute[75100]: DEBUG nova.compute.manager [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 18:13:56 user nova-compute[75100]: DEBUG nova.compute.manager [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 18:13:56 user nova-compute[75100]: DEBUG nova.network.neutron [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 18:13:56 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 18:13:56 user nova-compute[75100]: DEBUG nova.compute.manager [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 18:13:57 user nova-compute[75100]: DEBUG nova.policy [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '899e3a2f60b24a52b71f73e7ca965699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88550719c2fd46d6a4e4dd8038fdad78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 18:13:57 user nova-compute[75100]: INFO nova.virt.block_device [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Booting with volume e235bb5d-0f3a-4380-a53a-224a47d6584e at /dev/vda
Nov 10 18:13:57 user nova-compute[75100]: DEBUG os_brick.utils [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:13:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:13:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:13:57 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[03854500-efc3-4580-8f88-b2c879a092d5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90b1a229568f\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:13:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:13:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:13:57 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee2b1ac-0c84-497e-9d8d-99506823e0ba]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:13:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:13:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:13:57 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d720eb08-4711-4e28-8ffa-ef8514f5697d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:13:57 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[32fa2ac6-8636-4fc4-b61a-bd6eae94804c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:13:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:13:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 18:13:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 18:13:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:13:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 18:13:57 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 18:13:57 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b949cad-cc13-41da-9363-eb68d563ad88]: (4, '') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:13:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 18:13:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 18:13:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 18:13:57 user nova-compute[75100]: DEBUG os_brick.utils [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90b1a229568f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:13:57 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Updating existing volume attachment record: ecab671d-a060-412a-8d30-5a9e23497d09 {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 18:13:57 user nova-compute[75100]: DEBUG nova.network.neutron [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Successfully created port: c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 18:13:58 user nova-compute[75100]: DEBUG nova.network.neutron [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Successfully updated port: c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 18:13:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Acquiring lock "refresh_cache-8f04a49b-8124-4319-a4b2-b40786984c00" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:13:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Acquired lock "refresh_cache-8f04a49b-8124-4319-a4b2-b40786984c00" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:13:58 user nova-compute[75100]: DEBUG nova.network.neutron [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 18:13:58 user nova-compute[75100]: DEBUG nova.compute.manager [req-b5f46878-1680-43c2-ab55-2bbb8fd6f6c5 req-98661cc5-9f5d-4a21-95b2-005679ec9270 service nova] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Received event network-changed-c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:13:58 user nova-compute[75100]: DEBUG nova.compute.manager [req-b5f46878-1680-43c2-ab55-2bbb8fd6f6c5 req-98661cc5-9f5d-4a21-95b2-005679ec9270 service nova] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Refreshing instance network info cache due to event network-changed-c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 18:13:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b5f46878-1680-43c2-ab55-2bbb8fd6f6c5 req-98661cc5-9f5d-4a21-95b2-005679ec9270 service nova] Acquiring lock "refresh_cache-8f04a49b-8124-4319-a4b2-b40786984c00" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:13:58 user nova-compute[75100]: DEBUG nova.network.neutron [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 18:13:58 user nova-compute[75100]: DEBUG nova.network.neutron [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Updating instance_info_cache with network_info: [{"id": "c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a", "address": "fa:16:3e:16:4f:0b", "network": {"id": "17352d7d-ab4a-4f2a-b647-e9fa7d9c355d", "bridge": "br-int", "label": "tempest-TestShelveInstance-756457394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88550719c2fd46d6a4e4dd8038fdad78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63ac7d6-ae", "ovs_interfaceid": "c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:13:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Releasing lock "refresh_cache-8f04a49b-8124-4319-a4b2-b40786984c00" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:13:58 user nova-compute[75100]: DEBUG nova.compute.manager [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Instance network_info: |[{"id": "c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a", "address": "fa:16:3e:16:4f:0b", "network": {"id": "17352d7d-ab4a-4f2a-b647-e9fa7d9c355d", "bridge": "br-int", "label": "tempest-TestShelveInstance-756457394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88550719c2fd46d6a4e4dd8038fdad78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63ac7d6-ae", "ovs_interfaceid": "c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 18:13:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b5f46878-1680-43c2-ab55-2bbb8fd6f6c5 req-98661cc5-9f5d-4a21-95b2-005679ec9270 service nova] Acquired lock "refresh_cache-8f04a49b-8124-4319-a4b2-b40786984c00" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:13:58 user nova-compute[75100]: DEBUG nova.network.neutron [req-b5f46878-1680-43c2-ab55-2bbb8fd6f6c5 req-98661cc5-9f5d-4a21-95b2-005679ec9270 service nova] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Refreshing network info cache for port c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 18:13:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5d90e6ee-fcd8-41f6-9bd1-ca1283ef46b3 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Acquiring lock "7003b97b-edf1-4972-a0be-dcb41c329ec8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:13:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5d90e6ee-fcd8-41f6-9bd1-ca1283ef46b3 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "7003b97b-edf1-4972-a0be-dcb41c329ec8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:13:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5d90e6ee-fcd8-41f6-9bd1-ca1283ef46b3 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Acquiring lock "7003b97b-edf1-4972-a0be-dcb41c329ec8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:13:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5d90e6ee-fcd8-41f6-9bd1-ca1283ef46b3 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "7003b97b-edf1-4972-a0be-dcb41c329ec8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:13:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5d90e6ee-fcd8-41f6-9bd1-ca1283ef46b3 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "7003b97b-edf1-4972-a0be-dcb41c329ec8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:13:59 user nova-compute[75100]: INFO nova.compute.manager [None req-5d90e6ee-fcd8-41f6-9bd1-ca1283ef46b3 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Terminating instance
Nov 10 18:13:59 user nova-compute[75100]: DEBUG nova.compute.manager [None req-5d90e6ee-fcd8-41f6-9bd1-ca1283ef46b3 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 18:13:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:13:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:13:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:13:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:13:59 user nova-compute[75100]: DEBUG nova.compute.manager [req-6036f0d3-b886-4af5-b43a-6fe5d6f49385 req-62ae2baf-ce2e-4f76-8721-2753ecf9660e service nova] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Received event network-vif-unplugged-06c73859-cc53-487c-8bd8-9c4f5961e3cd {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:13:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6036f0d3-b886-4af5-b43a-6fe5d6f49385 req-62ae2baf-ce2e-4f76-8721-2753ecf9660e service nova] Acquiring lock "7003b97b-edf1-4972-a0be-dcb41c329ec8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:13:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6036f0d3-b886-4af5-b43a-6fe5d6f49385 req-62ae2baf-ce2e-4f76-8721-2753ecf9660e service nova] Lock "7003b97b-edf1-4972-a0be-dcb41c329ec8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:13:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6036f0d3-b886-4af5-b43a-6fe5d6f49385 req-62ae2baf-ce2e-4f76-8721-2753ecf9660e service nova] Lock "7003b97b-edf1-4972-a0be-dcb41c329ec8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:13:59 user nova-compute[75100]: DEBUG nova.compute.manager [req-6036f0d3-b886-4af5-b43a-6fe5d6f49385 req-62ae2baf-ce2e-4f76-8721-2753ecf9660e service nova] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] No waiting events found dispatching network-vif-unplugged-06c73859-cc53-487c-8bd8-9c4f5961e3cd {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:13:59 user nova-compute[75100]: DEBUG nova.compute.manager [req-6036f0d3-b886-4af5-b43a-6fe5d6f49385 req-62ae2baf-ce2e-4f76-8721-2753ecf9660e service nova] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Received event network-vif-unplugged-06c73859-cc53-487c-8bd8-9c4f5961e3cd for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 18:13:59 user nova-compute[75100]: DEBUG nova.network.neutron [req-b5f46878-1680-43c2-ab55-2bbb8fd6f6c5 req-98661cc5-9f5d-4a21-95b2-005679ec9270 service nova] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Updated VIF entry in instance network info cache for port c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 18:13:59 user nova-compute[75100]: DEBUG nova.network.neutron [req-b5f46878-1680-43c2-ab55-2bbb8fd6f6c5 req-98661cc5-9f5d-4a21-95b2-005679ec9270 service nova] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Updating instance_info_cache with network_info: [{"id": "c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a", "address": "fa:16:3e:16:4f:0b", "network": {"id": "17352d7d-ab4a-4f2a-b647-e9fa7d9c355d", "bridge": "br-int", "label": "tempest-TestShelveInstance-756457394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88550719c2fd46d6a4e4dd8038fdad78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63ac7d6-ae", "ovs_interfaceid": "c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:13:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b5f46878-1680-43c2-ab55-2bbb8fd6f6c5 req-98661cc5-9f5d-4a21-95b2-005679ec9270 service nova] Releasing lock "refresh_cache-8f04a49b-8124-4319-a4b2-b40786984c00" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:13:59 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Instance destroyed successfully.
Nov 10 18:13:59 user nova-compute[75100]: DEBUG nova.objects.instance [None req-5d90e6ee-fcd8-41f6-9bd1-ca1283ef46b3 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lazy-loading 'resources' on Instance uuid 7003b97b-edf1-4972-a0be-dcb41c329ec8 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:13:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-5d90e6ee-fcd8-41f6-9bd1-ca1283ef46b3 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:10:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-149784190',display_name='tempest-AttachVolumeNegativeTest-server-149784190',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-149784190',id=44,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG+dnNz+Nse8iAXzN+U2goYcybHM2a5LO2IBlmotfjKbfAvA2Rg3L9qGFUYcK/DFySgZVl29zl7CYYPwJ07z+gjQcOh14ezfqqHLjgbspWem6A94L4Rq8l1ZI/E1Oz7/aw==',key_name='tempest-keypair-2055020147',keypairs=<?>,launch_index=0,launched_at=2023-11-10T18:10:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d4e5cb8bdc24a009dcb3dbee36a6bce',ramdisk_id='',reservation_id='r-omfq5km6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1395057280',owner_user_name='tempest-AttachVolumeNegativeTest-1395057280-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T18:10:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efe92a172011414e8507cb6ddbfab0bb',uuid=7003b97b-edf1-4972-a0be-dcb41c329ec8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "06c73859-cc53-487c-8bd8-9c4f5961e3cd", "address": "fa:16:3e:4b:06:cf", "network": {"id": "e906a397-504d-48d8-8726-187cfbb1f270", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2095832274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4e5cb8bdc24a009dcb3dbee36a6bce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06c73859-cc", "ovs_interfaceid": "06c73859-cc53-487c-8bd8-9c4f5961e3cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 18:13:59 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-5d90e6ee-fcd8-41f6-9bd1-ca1283ef46b3 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Converting VIF {"id": "06c73859-cc53-487c-8bd8-9c4f5961e3cd", "address": "fa:16:3e:4b:06:cf", "network": {"id": "e906a397-504d-48d8-8726-187cfbb1f270", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2095832274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4e5cb8bdc24a009dcb3dbee36a6bce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06c73859-cc", "ovs_interfaceid": "06c73859-cc53-487c-8bd8-9c4f5961e3cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:13:59 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-5d90e6ee-fcd8-41f6-9bd1-ca1283ef46b3 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4b:06:cf,bridge_name='br-int',has_traffic_filtering=True,id=06c73859-cc53-487c-8bd8-9c4f5961e3cd,network=Network(e906a397-504d-48d8-8726-187cfbb1f270),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06c73859-cc') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:13:59 user nova-compute[75100]: DEBUG os_vif [None req-5d90e6ee-fcd8-41f6-9bd1-ca1283ef46b3 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:06:cf,bridge_name='br-int',has_traffic_filtering=True,id=06c73859-cc53-487c-8bd8-9c4f5961e3cd,network=Network(e906a397-504d-48d8-8726-187cfbb1f270),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06c73859-cc') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 18:13:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:13:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap06c73859-cc, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:13:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:13:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:13:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:13:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=18193846-ac26-458b-95b7-b360c9540a3f) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:13:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:13:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:13:59 user nova-compute[75100]: INFO os_vif [None req-5d90e6ee-fcd8-41f6-9bd1-ca1283ef46b3 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:06:cf,bridge_name='br-int',has_traffic_filtering=True,id=06c73859-cc53-487c-8bd8-9c4f5961e3cd,network=Network(e906a397-504d-48d8-8726-187cfbb1f270),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06c73859-cc')
Nov 10 18:13:59 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-5d90e6ee-fcd8-41f6-9bd1-ca1283ef46b3 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Deleting instance files /opt/stack/data/nova/instances/7003b97b-edf1-4972-a0be-dcb41c329ec8_del
Nov 10 18:13:59 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-5d90e6ee-fcd8-41f6-9bd1-ca1283ef46b3 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Deletion of /opt/stack/data/nova/instances/7003b97b-edf1-4972-a0be-dcb41c329ec8_del complete
Nov 10 18:13:59 user nova-compute[75100]: INFO nova.compute.manager [None req-5d90e6ee-fcd8-41f6-9bd1-ca1283ef46b3 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 10 18:13:59 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-5d90e6ee-fcd8-41f6-9bd1-ca1283ef46b3 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 18:13:59 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 18:13:59 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 18:13:59 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-4521d82c-0e29-49eb-abd3-95f80e3f5a60 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance f0b2a902-2358-4bed-a474-21170a45577d is timed out.
Nov 10 18:13:59 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-4521d82c-0e29-49eb-abd3-95f80e3f5a60 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Successfully detached device vdc from instance f0b2a902-2358-4bed-a474-21170a45577d from the live domain config.
Nov 10 18:13:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4521d82c-0e29-49eb-abd3-95f80e3f5a60 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] [instance: f0b2a902-2358-4bed-a474-21170a45577d] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 18:13:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4521d82c-0e29-49eb-abd3-95f80e3f5a60 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, {'target_iqn': 'iqn.2010-10.org.openstack:493746e9-d5a7-44d0-9abe-b001f3dbf369', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SIfBTrNH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:13:59 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-4521d82c-0e29-49eb-abd3-95f80e3f5a60 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:13:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-4521d82c-0e29-49eb-abd3-95f80e3f5a60 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:13:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-4521d82c-0e29-49eb-abd3-95f80e3f5a60 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:13:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:13:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:13:59 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[af5014c7-4a38-4f2b-a9b5-b62077d8e899]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:493746e9-d5a7-44d0-9abe-b001f3dbf369\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:13:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4521d82c-0e29-49eb-abd3-95f80e3f5a60 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 18:13:59 user nova-compute[75100]: No targets found.
Nov 10 18:13:59 user nova-compute[75100]: iSNS:
Nov 10 18:13:59 user nova-compute[75100]: No targets found.
Nov 10 18:13:59 user nova-compute[75100]: STATIC:
Nov 10 18:13:59 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:493746e9-d5a7-44d0-9abe-b001f3dbf369
Nov 10 18:13:59 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:13:59 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:13:59 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4
Nov 10 18:13:59 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:13:59 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:13:59 user nova-compute[75100]: FIRMWARE:
Nov 10 18:13:59 user nova-compute[75100]: No targets found.
Nov 10 18:13:59 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:13:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4521d82c-0e29-49eb-abd3-95f80e3f5a60 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 18:13:59 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 18:13:59 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 18:13:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4521d82c-0e29-49eb-abd3-95f80e3f5a60 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:493746e9-d5a7-44d0-9abe-b001f3dbf369', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 18:13:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:13:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:13:59 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[583ef9e0-b2a3-4ab6-9409-b601d09f880a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:493746e9-d5a7-44d0-9abe-b001f3dbf369\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:13:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:14:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:14:00 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2047df3-2c6f-49c9-b131-4249a74cc291]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:493746e9-d5a7-44d0-9abe-b001f3dbf369 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:14:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4521d82c-0e29-49eb-abd3-95f80e3f5a60 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4 (non-flash)
Nov 10 18:14:00 user nova-compute[75100]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:493746e9-d5a7-44d0-9abe-b001f3dbf369 (non-flash)
Nov 10 18:14:00 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:14:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4521d82c-0e29-49eb-abd3-95f80e3f5a60 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4 (non-flash)
Nov 10 18:14:00 user nova-compute[75100]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:493746e9-d5a7-44d0-9abe-b001f3dbf369 (non-flash)
Nov 10 18:14:00 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:14:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4521d82c-0e29-49eb-abd3-95f80e3f5a60 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3dd3269e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:493746e9-d5a7-44d0-9abe-b001f3dbf369'): ({'sdb'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 18:14:00 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-4521d82c-0e29-49eb-abd3-95f80e3f5a60 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Removing single pathed devices sdb {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 18:14:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:14:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:14:00 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb2e31f-33cc-48aa-a443-6dd3de20c037]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:14:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:14:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:14:00 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c66e08bc-8c50-45ad-b1f3-c0c99c66eca0]: (4, ('ok\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:14:00 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-4521d82c-0e29-49eb-abd3-95f80e3f5a60 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Flushing IO for device /dev/sdb {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 18:14:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:14:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:14:00 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0a8123-aa7b-4f01-bae0-2528981c2839]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:14:00 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-4521d82c-0e29-49eb-abd3-95f80e3f5a60 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 18:14:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:14:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:14:00 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c116cf6-c3f8-40cf-8eef-19a38cf33d1d]: (4, ('1', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:14:00 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-4521d82c-0e29-49eb-abd3-95f80e3f5a60 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 18:14:00 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-4521d82c-0e29-49eb-abd3-95f80e3f5a60 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 18:14:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4521d82c-0e29-49eb-abd3-95f80e3f5a60 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:493746e9-d5a7-44d0-9abe-b001f3dbf369')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 18:14:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:493746e9-d5a7-44d0-9abe-b001f3dbf369 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:14:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:493746e9-d5a7-44d0-9abe-b001f3dbf369 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:14:00 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f51bede-33ba-4cfb-a9d7-c5f387aaa27b]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:14:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4521d82c-0e29-49eb-abd3-95f80e3f5a60 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:14:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:493746e9-d5a7-44d0-9abe-b001f3dbf369 -p 172.16.0.220:3260 --logout {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:14:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:493746e9-d5a7-44d0-9abe-b001f3dbf369 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:14:00 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fdc6c5a-78a1-4361-9b47-29e5aec8550b]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:493746e9-d5a7-44d0-9abe-b001f3dbf369, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:493746e9-d5a7-44d0-9abe-b001f3dbf369, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:14:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4521d82c-0e29-49eb-abd3-95f80e3f5a60 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:493746e9-d5a7-44d0-9abe-b001f3dbf369, portal: 172.16.0.220,3260]
Nov 10 18:14:00 user nova-compute[75100]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:493746e9-d5a7-44d0-9abe-b001f3dbf369, portal: 172.16.0.220,3260] successful.
Nov 10 18:14:00 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:14:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:493746e9-d5a7-44d0-9abe-b001f3dbf369 -p 172.16.0.220:3260 --op delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:14:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:493746e9-d5a7-44d0-9abe-b001f3dbf369 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:14:00 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c6334b-da83-488e-8cc7-09d2c29a3cdb]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:14:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4521d82c-0e29-49eb-abd3-95f80e3f5a60 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:14:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-4521d82c-0e29-49eb-abd3-95f80e3f5a60 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:14:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4521d82c-0e29-49eb-abd3-95f80e3f5a60 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] <== disconnect_volume: return (308ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:14:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4521d82c-0e29-49eb-abd3-95f80e3f5a60 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 18:14:00 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:14:00 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Took 0.85 seconds to deallocate network for instance.
Nov 10 18:14:00 user nova-compute[75100]: DEBUG nova.compute.manager [req-f136410c-a284-45bd-a6e8-3c39bc297037 req-1e524e3e-a752-4416-a1d1-44900e87ef4c service nova] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Received event network-vif-deleted-06c73859-cc53-487c-8bd8-9c4f5961e3cd {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:14:00 user nova-compute[75100]: INFO nova.compute.manager [req-f136410c-a284-45bd-a6e8-3c39bc297037 req-1e524e3e-a752-4416-a1d1-44900e87ef4c service nova] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Neutron deleted interface 06c73859-cc53-487c-8bd8-9c4f5961e3cd; detaching it from the instance and deleting it from the info cache
Nov 10 18:14:00 user nova-compute[75100]: DEBUG nova.network.neutron [req-f136410c-a284-45bd-a6e8-3c39bc297037 req-1e524e3e-a752-4416-a1d1-44900e87ef4c service nova] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:14:00 user nova-compute[75100]: DEBUG nova.compute.manager [req-f136410c-a284-45bd-a6e8-3c39bc297037 req-1e524e3e-a752-4416-a1d1-44900e87ef4c service nova] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Detach interface failed, port_id=06c73859-cc53-487c-8bd8-9c4f5961e3cd, reason: Instance 7003b97b-edf1-4972-a0be-dcb41c329ec8 could not be found. {{(pid=75100) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 18:14:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5d90e6ee-fcd8-41f6-9bd1-ca1283ef46b3 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:14:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5d90e6ee-fcd8-41f6-9bd1-ca1283ef46b3 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:14:00 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-5d90e6ee-fcd8-41f6-9bd1-ca1283ef46b3 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:14:00 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-5d90e6ee-fcd8-41f6-9bd1-ca1283ef46b3 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:14:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5d90e6ee-fcd8-41f6-9bd1-ca1283ef46b3 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.191s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:14:01 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-5d90e6ee-fcd8-41f6-9bd1-ca1283ef46b3 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Deleted allocations for instance 7003b97b-edf1-4972-a0be-dcb41c329ec8
Nov 10 18:14:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5d90e6ee-fcd8-41f6-9bd1-ca1283ef46b3 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "7003b97b-edf1-4972-a0be-dcb41c329ec8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.086s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:14:01 user nova-compute[75100]: DEBUG nova.objects.instance [None req-4521d82c-0e29-49eb-abd3-95f80e3f5a60 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Lazy-loading 'flavor' on Instance uuid f0b2a902-2358-4bed-a474-21170a45577d {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:14:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4521d82c-0e29-49eb-abd3-95f80e3f5a60 tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Lock "f0b2a902-2358-4bed-a474-21170a45577d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.963s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:14:01 user nova-compute[75100]: DEBUG nova.compute.manager [req-eebf533f-22fc-46ba-b371-aab8e579083e req-3427df96-f2a7-488b-926d-c9b2f3ca649d service nova] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Received event network-vif-plugged-06c73859-cc53-487c-8bd8-9c4f5961e3cd {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:14:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-eebf533f-22fc-46ba-b371-aab8e579083e req-3427df96-f2a7-488b-926d-c9b2f3ca649d service nova] Acquiring lock "7003b97b-edf1-4972-a0be-dcb41c329ec8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:14:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-eebf533f-22fc-46ba-b371-aab8e579083e req-3427df96-f2a7-488b-926d-c9b2f3ca649d service nova] Lock "7003b97b-edf1-4972-a0be-dcb41c329ec8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:14:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-eebf533f-22fc-46ba-b371-aab8e579083e req-3427df96-f2a7-488b-926d-c9b2f3ca649d service nova] Lock "7003b97b-edf1-4972-a0be-dcb41c329ec8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:14:01 user nova-compute[75100]: DEBUG nova.compute.manager [req-eebf533f-22fc-46ba-b371-aab8e579083e req-3427df96-f2a7-488b-926d-c9b2f3ca649d service nova] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] No waiting events found dispatching network-vif-plugged-06c73859-cc53-487c-8bd8-9c4f5961e3cd {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:14:01 user nova-compute[75100]: WARNING nova.compute.manager [req-eebf533f-22fc-46ba-b371-aab8e579083e req-3427df96-f2a7-488b-926d-c9b2f3ca649d service nova] [instance: 7003b97b-edf1-4972-a0be-dcb41c329ec8] Received unexpected event network-vif-plugged-06c73859-cc53-487c-8bd8-9c4f5961e3cd for instance with vm_state deleted and task_state None.
Nov 10 18:14:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:14:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:14:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:14:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:14:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:14:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:14:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:14:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:14:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:14:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:14:21 user nova-compute[75100]: DEBUG nova.compute.manager [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 18:14:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 18:14:21 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Creating image(s)
Nov 10 18:14:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Did not create local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 18:14:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Ensure instance console log exists: /opt/stack/data/nova/instances/8f04a49b-8124-4319-a4b2-b40786984c00/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 18:14:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:14:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:14:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:14:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Start _get_guest_xml network_info=[{"id": "c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a", "address": "fa:16:3e:16:4f:0b", "network": {"id": "17352d7d-ab4a-4f2a-b647-e9fa7d9c355d", "bridge": "br-int", "label": "tempest-TestShelveInstance-756457394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88550719c2fd46d6a4e4dd8038fdad78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63ac7d6-ae", "ovs_interfaceid": "c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NaXenRKr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8f04a49b-8124-4319-a4b2-b40786984c00', 'attached_at': '', 'detached_at': '', 'volume_id': 'e235bb5d-0f3a-4380-a53a-224a47d6584e', 'serial': 'e235bb5d-0f3a-4380-a53a-224a47d6584e'}, 'mount_device': '/dev/vda', 'attachment_id': 'ecab671d-a060-412a-8d30-5a9e23497d09', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 18:14:21 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:14:22 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:14:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 18:14:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 18:14:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 18:14:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 18:14:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 18:14:22 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T17:40:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 18:14:22 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 18:14:22 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 18:14:22 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 18:14:22 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 18:14:22 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 18:14:22 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 18:14:22 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 18:14:22 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 18:14:22 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 18:14:22 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 18:14:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 18:14:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NaXenRKr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:14:22 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:14:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:14:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:14:22 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:14:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:14:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:14:22 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 18:14:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e -p 172.16.0.220:3260 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:14:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:14:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13c6a7f-9cda-42cf-907b-4c9779640aa2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:14:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 18:14:22 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:14:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e -p 172.16.0.220:3260 --interface default --op new {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:14:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:14:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[887e22df-fe0b-44d8-bc54-a95755d03d49]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e] added\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:14:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e] added
Nov 10 18:14:22 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:14:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:14:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:14:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e10bbd-accc-4707-a7d1-35a6e5f3b77b]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:14:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:14:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:14:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:14:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b6d04d-7d17-4f8d-a070-83182abfa082]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:14:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:14:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NaXenRKr {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:14:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NaXenRKr" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:14:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d57d041-5a30-492a-88c1-9c76e3b4f940]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:14:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NaXenRKr'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:14:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:14:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:14:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[93fff4af-21fe-46f9-9064-2e50772205e9]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:14:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:14:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:14:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:14:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2eee06-73b0-4c1f-8de6-70b973e48fe1]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:14:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4 (non-flash)
Nov 10 18:14:22 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:14:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4 (non-flash)
Nov 10 18:14:22 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:14:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e -p 172.16.0.220:3260 --login {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:14:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:14:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[09743aa1-aa69-4764-9237-12b5a2ff5591]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:14:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e, portal: 172.16.0.220,3260]
Nov 10 18:14:22 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e, portal: 172.16.0.220,3260] successful.
Nov 10 18:14:22 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:14:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:14:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:14:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e7bf13-a398-42f9-a36f-faebe7b7cb39]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:14:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:14:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:14:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:14:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba0d9ba-85b1-4d7d-b2ad-ccbc1d2200ff]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:14:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4 (non-flash)
Nov 10 18:14:22 user nova-compute[75100]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e (non-flash)
Nov 10 18:14:22 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:14:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4 (non-flash)
Nov 10 18:14:22 user nova-compute[75100]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e (non-flash)
Nov 10 18:14:22 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:14:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:14:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 18:14:22 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] HCTL ('33', '-', '-', 0) found on session 40 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 18:14:22 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 18:14:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:14:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:14:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd09cd5a-1815-42a0-a256-c24b109827d2]: (4, ('- - 0', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:14:22 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: None {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 18:14:23 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 18:14:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NaXenRKr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 18:14:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:14:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '26265663436613536', 'path': '/dev/sdb'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:14:23 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26265663436613536', 'path': '/dev/sdb'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 18:14:23 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:13:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2027830495',display_name='tempest-TestShelveInstance-server-2027830495',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2027830495',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB9qEHEmYdMuWxE5gf70kraK1OXUOB4Q8BESIygRL+qQHvsdRICR3ppT56RlX1dWZbh86Resa7Vt9qrVDWMYfSY79L/T72hFPuMCGqoZUD9uGRGvYY4StURcY0jI+vYwBw==',key_name='tempest-TestShelveInstance-1902062708',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88550719c2fd46d6a4e4dd8038fdad78',ramdisk_id='',reservation_id='r-z7a0122o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-691216050',owner_user_name='tempest-TestShelveInstance-691216050-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T18:13:57Z,user_data=None,user_id='899e3a2f60b24a52b71f73e7ca965699',uuid=8f04a49b-8124-4319-a4b2-b40786984c00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a", "address": "fa:16:3e:16:4f:0b", "network": {"id": "17352d7d-ab4a-4f2a-b647-e9fa7d9c355d", "bridge": "br-int", "label": "tempest-TestShelveInstance-756457394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88550719c2fd46d6a4e4dd8038fdad78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63ac7d6-ae", "ovs_interfaceid": "c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 18:14:23 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Converting VIF {"id": "c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a", "address": "fa:16:3e:16:4f:0b", "network": {"id": "17352d7d-ab4a-4f2a-b647-e9fa7d9c355d", "bridge": "br-int", "label": "tempest-TestShelveInstance-756457394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88550719c2fd46d6a4e4dd8038fdad78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63ac7d6-ae", "ovs_interfaceid": "c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:14:23 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:4f:0b,bridge_name='br-int',has_traffic_filtering=True,id=c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a,network=Network(17352d7d-ab4a-4f2a-b647-e9fa7d9c355d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63ac7d6-ae') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:14:23 user nova-compute[75100]: DEBUG nova.objects.instance [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Lazy-loading 'pci_devices' on Instance uuid 8f04a49b-8124-4319-a4b2-b40786984c00 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:14:23 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] End _get_guest_xml xml=<domain type="kvm">
Nov 10 18:14:23 user nova-compute[75100]:   <uuid>8f04a49b-8124-4319-a4b2-b40786984c00</uuid>
Nov 10 18:14:23 user nova-compute[75100]:   <name>instance-0000002f</name>
Nov 10 18:14:23 user nova-compute[75100]:   <memory>524288</memory>
Nov 10 18:14:23 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 10 18:14:23 user nova-compute[75100]:   <metadata>
Nov 10 18:14:23 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 18:14:23 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 10 18:14:23 user nova-compute[75100]:       <nova:name>tempest-TestShelveInstance-server-2027830495</nova:name>
Nov 10 18:14:23 user nova-compute[75100]:       <nova:creationTime>2023-11-10 18:14:22</nova:creationTime>
Nov 10 18:14:23 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 10 18:14:23 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 10 18:14:23 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 10 18:14:23 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 10 18:14:23 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 18:14:23 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 10 18:14:23 user nova-compute[75100]:       </nova:flavor>
Nov 10 18:14:23 user nova-compute[75100]:       <nova:owner>
Nov 10 18:14:23 user nova-compute[75100]:         <nova:user uuid="899e3a2f60b24a52b71f73e7ca965699">tempest-TestShelveInstance-691216050-project-member</nova:user>
Nov 10 18:14:23 user nova-compute[75100]:         <nova:project uuid="88550719c2fd46d6a4e4dd8038fdad78">tempest-TestShelveInstance-691216050</nova:project>
Nov 10 18:14:23 user nova-compute[75100]:       </nova:owner>
Nov 10 18:14:23 user nova-compute[75100]:       <nova:ports>
Nov 10 18:14:23 user nova-compute[75100]:         <nova:port uuid="c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a">
Nov 10 18:14:23 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 10 18:14:23 user nova-compute[75100]:         </nova:port>
Nov 10 18:14:23 user nova-compute[75100]:       </nova:ports>
Nov 10 18:14:23 user nova-compute[75100]:     </nova:instance>
Nov 10 18:14:23 user nova-compute[75100]:   </metadata>
Nov 10 18:14:23 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 10 18:14:23 user nova-compute[75100]:     <system>
Nov 10 18:14:23 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 18:14:23 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 10 18:14:23 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 10 18:14:23 user nova-compute[75100]:       <entry name="serial">8f04a49b-8124-4319-a4b2-b40786984c00</entry>
Nov 10 18:14:23 user nova-compute[75100]:       <entry name="uuid">8f04a49b-8124-4319-a4b2-b40786984c00</entry>
Nov 10 18:14:23 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 10 18:14:23 user nova-compute[75100]:     </system>
Nov 10 18:14:23 user nova-compute[75100]:   </sysinfo>
Nov 10 18:14:23 user nova-compute[75100]:   <os>
Nov 10 18:14:23 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 18:14:23 user nova-compute[75100]:     <boot dev="hd"/>
Nov 10 18:14:23 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 10 18:14:23 user nova-compute[75100]:   </os>
Nov 10 18:14:23 user nova-compute[75100]:   <features>
Nov 10 18:14:23 user nova-compute[75100]:     <acpi/>
Nov 10 18:14:23 user nova-compute[75100]:     <apic/>
Nov 10 18:14:23 user nova-compute[75100]:     <vmcoreinfo/>
Nov 10 18:14:23 user nova-compute[75100]:   </features>
Nov 10 18:14:23 user nova-compute[75100]:   <clock offset="utc">
Nov 10 18:14:23 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 18:14:23 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 18:14:23 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 10 18:14:23 user nova-compute[75100]:   </clock>
Nov 10 18:14:23 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 10 18:14:23 user nova-compute[75100]:     <model>Nehalem</model>
Nov 10 18:14:23 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 18:14:23 user nova-compute[75100]:   </cpu>
Nov 10 18:14:23 user nova-compute[75100]:   <devices>
Nov 10 18:14:23 user nova-compute[75100]:     <disk type="block" device="disk">
Nov 10 18:14:23 user nova-compute[75100]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:14:23 user nova-compute[75100]:       <source dev="/dev/sdb"/>
Nov 10 18:14:23 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 10 18:14:23 user nova-compute[75100]:       <serial>e235bb5d-0f3a-4380-a53a-224a47d6584e</serial>
Nov 10 18:14:23 user nova-compute[75100]:     </disk>
Nov 10 18:14:23 user nova-compute[75100]:     <interface type="ethernet">
Nov 10 18:14:23 user nova-compute[75100]:       <mac address="fa:16:3e:16:4f:0b"/>
Nov 10 18:14:23 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 18:14:23 user nova-compute[75100]:       <mtu size="1442"/>
Nov 10 18:14:23 user nova-compute[75100]:       <target dev="tapc63ac7d6-ae"/>
Nov 10 18:14:23 user nova-compute[75100]:     </interface>
Nov 10 18:14:23 user nova-compute[75100]:     <serial type="pty">
Nov 10 18:14:23 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/8f04a49b-8124-4319-a4b2-b40786984c00/console.log" append="off"/>
Nov 10 18:14:23 user nova-compute[75100]:     </serial>
Nov 10 18:14:23 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 18:14:23 user nova-compute[75100]:     <video>
Nov 10 18:14:23 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 18:14:23 user nova-compute[75100]:     </video>
Nov 10 18:14:23 user nova-compute[75100]:     <rng model="virtio">
Nov 10 18:14:23 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 10 18:14:23 user nova-compute[75100]:     </rng>
Nov 10 18:14:23 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 10 18:14:23 user nova-compute[75100]:     <memballoon model="virtio">
Nov 10 18:14:23 user nova-compute[75100]:       <stats period="10"/>
Nov 10 18:14:23 user nova-compute[75100]:     </memballoon>
Nov 10 18:14:23 user nova-compute[75100]:   </devices>
Nov 10 18:14:23 user nova-compute[75100]: </domain>
Nov 10 18:14:23 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 18:14:23 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:13:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2027830495',display_name='tempest-TestShelveInstance-server-2027830495',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2027830495',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB9qEHEmYdMuWxE5gf70kraK1OXUOB4Q8BESIygRL+qQHvsdRICR3ppT56RlX1dWZbh86Resa7Vt9qrVDWMYfSY79L/T72hFPuMCGqoZUD9uGRGvYY4StURcY0jI+vYwBw==',key_name='tempest-TestShelveInstance-1902062708',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88550719c2fd46d6a4e4dd8038fdad78',ramdisk_id='',reservation_id='r-z7a0122o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-691216050',owner_user_name='tempest-TestShelveInstance-691216050-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T18:13:57Z,user_data=None,user_id='899e3a2f60b24a52b71f73e7ca965699',uuid=8f04a49b-8124-4319-a4b2-b40786984c00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a", "address": "fa:16:3e:16:4f:0b", "network": {"id": "17352d7d-ab4a-4f2a-b647-e9fa7d9c355d", "bridge": "br-int", "label": "tempest-TestShelveInstance-756457394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88550719c2fd46d6a4e4dd8038fdad78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63ac7d6-ae", "ovs_interfaceid": "c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 18:14:23 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Converting VIF {"id": "c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a", "address": "fa:16:3e:16:4f:0b", "network": {"id": "17352d7d-ab4a-4f2a-b647-e9fa7d9c355d", "bridge": "br-int", "label": "tempest-TestShelveInstance-756457394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88550719c2fd46d6a4e4dd8038fdad78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63ac7d6-ae", "ovs_interfaceid": "c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:14:23 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:4f:0b,bridge_name='br-int',has_traffic_filtering=True,id=c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a,network=Network(17352d7d-ab4a-4f2a-b647-e9fa7d9c355d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63ac7d6-ae') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:14:23 user nova-compute[75100]: DEBUG os_vif [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:4f:0b,bridge_name='br-int',has_traffic_filtering=True,id=c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a,network=Network(17352d7d-ab4a-4f2a-b647-e9fa7d9c355d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63ac7d6-ae') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 18:14:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:14:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:14:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 18:14:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:14:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ea7343f2-3fa3-5bcf-ab08-9fb1dd06aca0', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:14:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:14:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:14:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:14:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc63ac7d6-ae, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:14:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc63ac7d6-ae, col_values=(('qos', UUID('92e014a3-fbbb-48d6-a4a6-182f2b9b18c9')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:14:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc63ac7d6-ae, col_values=(('external_ids', {'iface-id': 'c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:4f:0b', 'vm-uuid': '8f04a49b-8124-4319-a4b2-b40786984c00'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:14:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:14:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:14:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:14:23 user nova-compute[75100]: INFO os_vif [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:4f:0b,bridge_name='br-int',has_traffic_filtering=True,id=c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a,network=Network(17352d7d-ab4a-4f2a-b647-e9fa7d9c355d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63ac7d6-ae')
Nov 10 18:14:23 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 18:14:23 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] No VIF found with MAC fa:16:3e:16:4f:0b, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 18:14:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:14:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:14:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:14:24 user nova-compute[75100]: DEBUG nova.compute.manager [req-14759dc4-3cf7-4e5e-a89a-cdd05f195831 req-2f5b9587-b767-4719-a87e-c9894bdbb48d service nova] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Received event network-vif-plugged-c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:14:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-14759dc4-3cf7-4e5e-a89a-cdd05f195831 req-2f5b9587-b767-4719-a87e-c9894bdbb48d service nova] Acquiring lock "8f04a49b-8124-4319-a4b2-b40786984c00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:14:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-14759dc4-3cf7-4e5e-a89a-cdd05f195831 req-2f5b9587-b767-4719-a87e-c9894bdbb48d service nova] Lock "8f04a49b-8124-4319-a4b2-b40786984c00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:14:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-14759dc4-3cf7-4e5e-a89a-cdd05f195831 req-2f5b9587-b767-4719-a87e-c9894bdbb48d service nova] Lock "8f04a49b-8124-4319-a4b2-b40786984c00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:14:24 user nova-compute[75100]: DEBUG nova.compute.manager [req-14759dc4-3cf7-4e5e-a89a-cdd05f195831 req-2f5b9587-b767-4719-a87e-c9894bdbb48d service nova] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] No waiting events found dispatching network-vif-plugged-c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:14:24 user nova-compute[75100]: WARNING nova.compute.manager [req-14759dc4-3cf7-4e5e-a89a-cdd05f195831 req-2f5b9587-b767-4719-a87e-c9894bdbb48d service nova] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Received unexpected event network-vif-plugged-c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a for instance with vm_state building and task_state spawning.
Nov 10 18:14:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:14:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:14:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:14:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:14:26 user nova-compute[75100]: DEBUG nova.compute.manager [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 18:14:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 18:14:26 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Instance spawned successfully.
Nov 10 18:14:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 18:14:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:14:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:14:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:14:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:14:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:14:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:14:26 user nova-compute[75100]: INFO nova.compute.manager [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Took 4.91 seconds to spawn the instance on the hypervisor.
Nov 10 18:14:26 user nova-compute[75100]: DEBUG nova.compute.manager [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 18:14:26 user nova-compute[75100]: INFO nova.compute.manager [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Took 30.46 seconds to build instance.
Nov 10 18:14:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6d9b2150-aac8-4e47-87f5-6125366c36fe tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Lock "8f04a49b-8124-4319-a4b2-b40786984c00" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.572s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:14:27 user nova-compute[75100]: DEBUG nova.compute.manager [req-5e967131-0bbf-4d28-bb0b-5a62b3836821 req-9da2d3e8-66ba-4bbf-9f93-78c4880e3735 service nova] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Received event network-vif-plugged-c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:14:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5e967131-0bbf-4d28-bb0b-5a62b3836821 req-9da2d3e8-66ba-4bbf-9f93-78c4880e3735 service nova] Acquiring lock "8f04a49b-8124-4319-a4b2-b40786984c00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:14:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5e967131-0bbf-4d28-bb0b-5a62b3836821 req-9da2d3e8-66ba-4bbf-9f93-78c4880e3735 service nova] Lock "8f04a49b-8124-4319-a4b2-b40786984c00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:14:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5e967131-0bbf-4d28-bb0b-5a62b3836821 req-9da2d3e8-66ba-4bbf-9f93-78c4880e3735 service nova] Lock "8f04a49b-8124-4319-a4b2-b40786984c00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:14:27 user nova-compute[75100]: DEBUG nova.compute.manager [req-5e967131-0bbf-4d28-bb0b-5a62b3836821 req-9da2d3e8-66ba-4bbf-9f93-78c4880e3735 service nova] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] No waiting events found dispatching network-vif-plugged-c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:14:27 user nova-compute[75100]: WARNING nova.compute.manager [req-5e967131-0bbf-4d28-bb0b-5a62b3836821 req-9da2d3e8-66ba-4bbf-9f93-78c4880e3735 service nova] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Received unexpected event network-vif-plugged-c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a for instance with vm_state active and task_state None.
Nov 10 18:14:28 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:14:28 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:14:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:14:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-448bb415-2ac6-4ebe-bd5f-b77b5f800fda tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Acquiring lock "f0b2a902-2358-4bed-a474-21170a45577d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:14:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-448bb415-2ac6-4ebe-bd5f-b77b5f800fda tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Lock "f0b2a902-2358-4bed-a474-21170a45577d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:14:29 user nova-compute[75100]: INFO nova.compute.manager [None req-448bb415-2ac6-4ebe-bd5f-b77b5f800fda tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Detaching volume 9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4
Nov 10 18:14:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:14:30 user nova-compute[75100]: INFO nova.virt.block_device [None req-448bb415-2ac6-4ebe-bd5f-b77b5f800fda tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Attempting to driver detach volume 9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4 from mountpoint /dev/vdb
Nov 10 18:14:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-448bb415-2ac6-4ebe-bd5f-b77b5f800fda tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Attempting to detach device vdb from instance f0b2a902-2358-4bed-a474-21170a45577d from the persistent domain config. {{(pid=75100) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 18:14:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-448bb415-2ac6-4ebe-bd5f-b77b5f800fda tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 18:14:30 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:14:30 user nova-compute[75100]:   <source dev="/dev/sdc"/>
Nov 10 18:14:30 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 18:14:30 user nova-compute[75100]:   <serial>9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4</serial>
Nov 10 18:14:30 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 18:14:30 user nova-compute[75100]: </disk>
Nov 10 18:14:30 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 18:14:30 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-448bb415-2ac6-4ebe-bd5f-b77b5f800fda tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Successfully detached device vdb from instance f0b2a902-2358-4bed-a474-21170a45577d from the persistent domain config.
Nov 10 18:14:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-448bb415-2ac6-4ebe-bd5f-b77b5f800fda tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f0b2a902-2358-4bed-a474-21170a45577d from the live domain config. {{(pid=75100) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 18:14:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-448bb415-2ac6-4ebe-bd5f-b77b5f800fda tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 18:14:30 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:14:30 user nova-compute[75100]:   <source dev="/dev/sdc"/>
Nov 10 18:14:30 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 18:14:30 user nova-compute[75100]:   <serial>9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4</serial>
Nov 10 18:14:30 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 18:14:30 user nova-compute[75100]: </disk>
Nov 10 18:14:30 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 18:14:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-448bb415-2ac6-4ebe-bd5f-b77b5f800fda tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f0b2a902-2358-4bed-a474-21170a45577d {{(pid=75100) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 18:14:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:14:35 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:14:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:14:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:14:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:14:35 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 18:14:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0b2a902-2358-4bed-a474-21170a45577d/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:14:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0b2a902-2358-4bed-a474-21170a45577d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:14:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0b2a902-2358-4bed-a474-21170a45577d/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:14:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0b2a902-2358-4bed-a474-21170a45577d/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:14:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:14:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:14:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:14:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:14:36 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 18:14:36 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:14:37 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:14:37 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Hypervisor/Node resource view: name=user free_ram=8488MB free_disk=24.42530059814453GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 18:14:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:14:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:14:37 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance f0b2a902-2358-4bed-a474-21170a45577d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:14:37 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance fb6b4d45-7c2b-4211-9939-9989a6a3c913 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:14:37 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 8f04a49b-8124-4319-a4b2-b40786984c00 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:14:37 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 18:14:37 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 18:14:37 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:14:37 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:14:37 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 18:14:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.282s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:14:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:14:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:14:43 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:14:43 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:14:43 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:14:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:14:44 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:14:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:14:48 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:14:48 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:14:48 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 18:14:48 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Rebuilding the list of instances to heal {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 18:14:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:14:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "refresh_cache-f0b2a902-2358-4bed-a474-21170a45577d" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:14:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquired lock "refresh_cache-f0b2a902-2358-4bed-a474-21170a45577d" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:14:48 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 18:14:48 user nova-compute[75100]: DEBUG nova.objects.instance [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lazy-loading 'info_cache' on Instance uuid f0b2a902-2358-4bed-a474-21170a45577d {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:14:48 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Updating instance_info_cache with network_info: [{"id": "6a80628d-e450-4d72-86c9-08d8578d9f17", "address": "fa:16:3e:01:34:07", "network": {"id": "5e6c66a5-a7bb-4157-aed0-8f8f7cfa846c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-209207359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1b6a6cf82404999aa9e2d5f99b5b9df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a80628d-e4", "ovs_interfaceid": "6a80628d-e450-4d72-86c9-08d8578d9f17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:14:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Releasing lock "refresh_cache-f0b2a902-2358-4bed-a474-21170a45577d" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:14:48 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 18:14:49 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:14:49 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 18:14:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:14:50 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-448bb415-2ac6-4ebe-bd5f-b77b5f800fda tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f0b2a902-2358-4bed-a474-21170a45577d is timed out.
Nov 10 18:14:50 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-448bb415-2ac6-4ebe-bd5f-b77b5f800fda tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Successfully detached device vdb from instance f0b2a902-2358-4bed-a474-21170a45577d from the live domain config.
Nov 10 18:14:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-448bb415-2ac6-4ebe-bd5f-b77b5f800fda tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] [instance: f0b2a902-2358-4bed-a474-21170a45577d] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 18:14:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-448bb415-2ac6-4ebe-bd5f-b77b5f800fda tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, {'target_iqn': 'iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OThDmpAs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:14:50 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-448bb415-2ac6-4ebe-bd5f-b77b5f800fda tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:14:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-448bb415-2ac6-4ebe-bd5f-b77b5f800fda tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:14:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-448bb415-2ac6-4ebe-bd5f-b77b5f800fda tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:14:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:14:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:14:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec65e5a-2df9-4e94-83f1-54f559839dfa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:14:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-448bb415-2ac6-4ebe-bd5f-b77b5f800fda tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 18:14:50 user nova-compute[75100]: No targets found.
Nov 10 18:14:50 user nova-compute[75100]: iSNS:
Nov 10 18:14:50 user nova-compute[75100]: No targets found.
Nov 10 18:14:50 user nova-compute[75100]: STATIC:
Nov 10 18:14:50 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e
Nov 10 18:14:50 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:14:50 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:14:50 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4
Nov 10 18:14:50 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:14:50 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:14:50 user nova-compute[75100]: FIRMWARE:
Nov 10 18:14:50 user nova-compute[75100]: No targets found.
Nov 10 18:14:50 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:14:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-448bb415-2ac6-4ebe-bd5f-b77b5f800fda tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 18:14:50 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 18:14:50 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 18:14:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-448bb415-2ac6-4ebe-bd5f-b77b5f800fda tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 18:14:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:14:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:14:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c87b010-cdec-405e-8e3d-c4fc577c6013]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:14:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:14:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:14:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b3de81-bcdf-4243-973b-e20c2e59ef37]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:14:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-448bb415-2ac6-4ebe-bd5f-b77b5f800fda tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4 (non-flash)
Nov 10 18:14:50 user nova-compute[75100]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e (non-flash)
Nov 10 18:14:50 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:14:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-448bb415-2ac6-4ebe-bd5f-b77b5f800fda tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4 (non-flash)
Nov 10 18:14:50 user nova-compute[75100]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e (non-flash)
Nov 10 18:14:50 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:14:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-448bb415-2ac6-4ebe-bd5f-b77b5f800fda tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3d42c03a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4'): ({'sdc'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 18:14:50 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-448bb415-2ac6-4ebe-bd5f-b77b5f800fda tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Removing single pathed devices sdc {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 18:14:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:14:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:14:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0342771-0cee-4973-a4d4-18d10946c833]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:14:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:14:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:14:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef2c18b-5806-477a-8153-06d4907baef5]: (4, ('ok\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:14:50 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-448bb415-2ac6-4ebe-bd5f-b77b5f800fda tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Flushing IO for device /dev/sdc {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 18:14:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:14:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:14:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f75022-e1be-4dee-b38f-aa978e456a40]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:14:50 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-448bb415-2ac6-4ebe-bd5f-b77b5f800fda tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 18:14:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:14:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:14:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07f39c3-5621-4284-b680-c94df8e4f58d]: (4, ('1', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:14:50 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-448bb415-2ac6-4ebe-bd5f-b77b5f800fda tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 18:14:50 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-448bb415-2ac6-4ebe-bd5f-b77b5f800fda tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] SCSI volumes sdc have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 18:14:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-448bb415-2ac6-4ebe-bd5f-b77b5f800fda tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 18:14:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:14:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:14:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[986513a8-314f-4012-8306-c21845fbabad]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:14:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-448bb415-2ac6-4ebe-bd5f-b77b5f800fda tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:14:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4 -p 172.16.0.220:3260 --logout {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:14:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:14:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[137518f6-55ca-4eab-9c9f-a2f8e803bd67]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:14:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-448bb415-2ac6-4ebe-bd5f-b77b5f800fda tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4, portal: 172.16.0.220,3260]
Nov 10 18:14:50 user nova-compute[75100]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4, portal: 172.16.0.220,3260] successful.
Nov 10 18:14:50 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:14:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4 -p 172.16.0.220:3260 --op delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:14:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a6e4ee9-2cfb-42a7-9c69-ba34d23c35c4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:14:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[46530809-fac1-4a3d-a919-dcd37e277258]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:14:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-448bb415-2ac6-4ebe-bd5f-b77b5f800fda tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:14:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-448bb415-2ac6-4ebe-bd5f-b77b5f800fda tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:14:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-448bb415-2ac6-4ebe-bd5f-b77b5f800fda tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] <== disconnect_volume: return (278ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:14:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-448bb415-2ac6-4ebe-bd5f-b77b5f800fda tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 18:14:51 user nova-compute[75100]: DEBUG nova.objects.instance [None req-448bb415-2ac6-4ebe-bd5f-b77b5f800fda tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Lazy-loading 'flavor' on Instance uuid f0b2a902-2358-4bed-a474-21170a45577d {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:14:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-448bb415-2ac6-4ebe-bd5f-b77b5f800fda tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Lock "f0b2a902-2358-4bed-a474-21170a45577d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.896s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:14:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Acquiring lock "1220ad0e-3f5e-4d47-be01-4652e2390e87" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:14:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "1220ad0e-3f5e-4d47-be01-4652e2390e87" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:14:53 user nova-compute[75100]: DEBUG nova.compute.manager [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 18:14:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:14:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:14:53 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 18:14:53 user nova-compute[75100]: INFO nova.compute.claims [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] Claim successful on node user
Nov 10 18:14:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:14:53 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:14:53 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:14:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.245s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:14:53 user nova-compute[75100]: DEBUG nova.compute.manager [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 18:14:53 user nova-compute[75100]: DEBUG nova.compute.manager [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 18:14:53 user nova-compute[75100]: DEBUG nova.network.neutron [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 18:14:53 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 18:14:53 user nova-compute[75100]: DEBUG nova.compute.manager [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 18:14:53 user nova-compute[75100]: DEBUG nova.policy [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'efe92a172011414e8507cb6ddbfab0bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4e5cb8bdc24a009dcb3dbee36a6bce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 18:14:53 user nova-compute[75100]: DEBUG nova.compute.manager [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 18:14:53 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 18:14:53 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] Creating image(s)
Nov 10 18:14:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Acquiring lock "/opt/stack/data/nova/instances/1220ad0e-3f5e-4d47-be01-4652e2390e87/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:14:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "/opt/stack/data/nova/instances/1220ad0e-3f5e-4d47-be01-4652e2390e87/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:14:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "/opt/stack/data/nova/instances/1220ad0e-3f5e-4d47-be01-4652e2390e87/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:14:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:14:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.181s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:14:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Acquiring lock "818b9e28e061d41a38d903968b229be2ed9ba520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:14:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:14:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:14:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.166s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:14:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/1220ad0e-3f5e-4d47-be01-4652e2390e87/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:14:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/1220ad0e-3f5e-4d47-be01-4652e2390e87/disk 1073741824" returned: 0 in 0.049s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:14:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:14:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:14:54 user nova-compute[75100]: DEBUG nova.network.neutron [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] Successfully created port: b40ca80d-b78e-4bcc-ac31-203a76ebf3b7 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 18:14:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.196s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:14:54 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1220ad0e-3f5e-4d47-be01-4652e2390e87/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 18:14:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1220ad0e-3f5e-4d47-be01-4652e2390e87/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:14:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1220ad0e-3f5e-4d47-be01-4652e2390e87/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:14:54 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Cannot resize image /opt/stack/data/nova/instances/1220ad0e-3f5e-4d47-be01-4652e2390e87/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 18:14:54 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 18:14:54 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] Ensure instance console log exists: /opt/stack/data/nova/instances/1220ad0e-3f5e-4d47-be01-4652e2390e87/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 18:14:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:14:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:14:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:14:54 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:14:55 user nova-compute[75100]: DEBUG nova.network.neutron [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] Successfully updated port: b40ca80d-b78e-4bcc-ac31-203a76ebf3b7 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 18:14:55 user nova-compute[75100]: DEBUG nova.compute.manager [req-825ec00a-b31a-413b-8545-0bdd119a5c9c req-30fb2182-90fa-4bc9-a93f-a60394129e86 service nova] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] Received event network-changed-b40ca80d-b78e-4bcc-ac31-203a76ebf3b7 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:14:55 user nova-compute[75100]: DEBUG nova.compute.manager [req-825ec00a-b31a-413b-8545-0bdd119a5c9c req-30fb2182-90fa-4bc9-a93f-a60394129e86 service nova] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] Refreshing instance network info cache due to event network-changed-b40ca80d-b78e-4bcc-ac31-203a76ebf3b7. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 18:14:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-825ec00a-b31a-413b-8545-0bdd119a5c9c req-30fb2182-90fa-4bc9-a93f-a60394129e86 service nova] Acquiring lock "refresh_cache-1220ad0e-3f5e-4d47-be01-4652e2390e87" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:14:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-825ec00a-b31a-413b-8545-0bdd119a5c9c req-30fb2182-90fa-4bc9-a93f-a60394129e86 service nova] Acquired lock "refresh_cache-1220ad0e-3f5e-4d47-be01-4652e2390e87" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:14:55 user nova-compute[75100]: DEBUG nova.network.neutron [req-825ec00a-b31a-413b-8545-0bdd119a5c9c req-30fb2182-90fa-4bc9-a93f-a60394129e86 service nova] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] Refreshing network info cache for port b40ca80d-b78e-4bcc-ac31-203a76ebf3b7 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 18:14:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Acquiring lock "refresh_cache-1220ad0e-3f5e-4d47-be01-4652e2390e87" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:14:55 user nova-compute[75100]: DEBUG nova.network.neutron [req-825ec00a-b31a-413b-8545-0bdd119a5c9c req-30fb2182-90fa-4bc9-a93f-a60394129e86 service nova] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 18:14:55 user nova-compute[75100]: DEBUG nova.network.neutron [req-825ec00a-b31a-413b-8545-0bdd119a5c9c req-30fb2182-90fa-4bc9-a93f-a60394129e86 service nova] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:14:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-825ec00a-b31a-413b-8545-0bdd119a5c9c req-30fb2182-90fa-4bc9-a93f-a60394129e86 service nova] Releasing lock "refresh_cache-1220ad0e-3f5e-4d47-be01-4652e2390e87" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:14:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Acquired lock "refresh_cache-1220ad0e-3f5e-4d47-be01-4652e2390e87" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:14:55 user nova-compute[75100]: DEBUG nova.network.neutron [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 18:14:55 user nova-compute[75100]: DEBUG nova.network.neutron [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 18:14:55 user nova-compute[75100]: DEBUG nova.network.neutron [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] Updating instance_info_cache with network_info: [{"id": "b40ca80d-b78e-4bcc-ac31-203a76ebf3b7", "address": "fa:16:3e:6d:45:a1", "network": {"id": "e906a397-504d-48d8-8726-187cfbb1f270", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2095832274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4e5cb8bdc24a009dcb3dbee36a6bce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb40ca80d-b7", "ovs_interfaceid": "b40ca80d-b78e-4bcc-ac31-203a76ebf3b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:14:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Releasing lock "refresh_cache-1220ad0e-3f5e-4d47-be01-4652e2390e87" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:14:55 user nova-compute[75100]: DEBUG nova.compute.manager [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] Instance network_info: |[{"id": "b40ca80d-b78e-4bcc-ac31-203a76ebf3b7", "address": "fa:16:3e:6d:45:a1", "network": {"id": "e906a397-504d-48d8-8726-187cfbb1f270", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2095832274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4e5cb8bdc24a009dcb3dbee36a6bce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb40ca80d-b7", "ovs_interfaceid": "b40ca80d-b78e-4bcc-ac31-203a76ebf3b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 18:14:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] Start _get_guest_xml network_info=[{"id": "b40ca80d-b78e-4bcc-ac31-203a76ebf3b7", "address": "fa:16:3e:6d:45:a1", "network": {"id": "e906a397-504d-48d8-8726-187cfbb1f270", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2095832274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4e5cb8bdc24a009dcb3dbee36a6bce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb40ca80d-b7", "ovs_interfaceid": "b40ca80d-b78e-4bcc-ac31-203a76ebf3b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'e3cc5321-4d40-49ee-885c-700e14741732'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 18:14:55 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:14:55 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:14:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 18:14:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 18:14:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 18:14:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 18:14:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 18:14:55 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T17:40:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 18:14:55 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 18:14:55 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 18:14:55 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 18:14:55 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 18:14:55 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 18:14:55 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 18:14:55 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 18:14:55 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 18:14:55 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 18:14:55 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 18:14:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:14:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-523445808',display_name='tempest-AttachVolumeNegativeTest-server-523445808',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-523445808',id=48,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8eN2+ejV81w/zdOYTtf0JylCt8udcOs4J6RXjn86uKIHjViiGxD/QsKNhxQZVuLfU7qVQUveiHeAceYMTjjsJYa+Bb6BTLjGbSe/cvA8r5AWqkQ9e+km8jzG7d3EdSSg==',key_name='tempest-keypair-1428224260',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d4e5cb8bdc24a009dcb3dbee36a6bce',ramdisk_id='',reservation_id='r-m0jjy27z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1395057280',owner_user_name='tempest-AttachVolumeNegativeTest-1395057280-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T18:14:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efe92a172011414e8507cb6ddbfab0bb',uuid=1220ad0e-3f5e-4d47-be01-4652e2390e87,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b40ca80d-b78e-4bcc-ac31-203a76ebf3b7", "address": "fa:16:3e:6d:45:a1", "network": {"id": "e906a397-504d-48d8-8726-187cfbb1f270", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2095832274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4e5cb8bdc24a009dcb3dbee36a6bce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb40ca80d-b7", "ovs_interfaceid": "b40ca80d-b78e-4bcc-ac31-203a76ebf3b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 18:14:55 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Converting VIF {"id": "b40ca80d-b78e-4bcc-ac31-203a76ebf3b7", "address": "fa:16:3e:6d:45:a1", "network": {"id": "e906a397-504d-48d8-8726-187cfbb1f270", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2095832274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4e5cb8bdc24a009dcb3dbee36a6bce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb40ca80d-b7", "ovs_interfaceid": "b40ca80d-b78e-4bcc-ac31-203a76ebf3b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:14:55 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:45:a1,bridge_name='br-int',has_traffic_filtering=True,id=b40ca80d-b78e-4bcc-ac31-203a76ebf3b7,network=Network(e906a397-504d-48d8-8726-187cfbb1f270),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb40ca80d-b7') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:14:55 user nova-compute[75100]: DEBUG nova.objects.instance [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lazy-loading 'pci_devices' on Instance uuid 1220ad0e-3f5e-4d47-be01-4652e2390e87 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:14:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] End _get_guest_xml xml=<domain type="kvm">
Nov 10 18:14:55 user nova-compute[75100]:   <uuid>1220ad0e-3f5e-4d47-be01-4652e2390e87</uuid>
Nov 10 18:14:55 user nova-compute[75100]:   <name>instance-00000030</name>
Nov 10 18:14:55 user nova-compute[75100]:   <memory>524288</memory>
Nov 10 18:14:55 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 10 18:14:55 user nova-compute[75100]:   <metadata>
Nov 10 18:14:55 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 18:14:55 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 10 18:14:55 user nova-compute[75100]:       <nova:name>tempest-AttachVolumeNegativeTest-server-523445808</nova:name>
Nov 10 18:14:55 user nova-compute[75100]:       <nova:creationTime>2023-11-10 18:14:55</nova:creationTime>
Nov 10 18:14:55 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 10 18:14:55 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 10 18:14:55 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 10 18:14:55 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 10 18:14:55 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 18:14:55 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 10 18:14:55 user nova-compute[75100]:       </nova:flavor>
Nov 10 18:14:55 user nova-compute[75100]:       <nova:owner>
Nov 10 18:14:55 user nova-compute[75100]:         <nova:user uuid="efe92a172011414e8507cb6ddbfab0bb">tempest-AttachVolumeNegativeTest-1395057280-project-member</nova:user>
Nov 10 18:14:55 user nova-compute[75100]:         <nova:project uuid="9d4e5cb8bdc24a009dcb3dbee36a6bce">tempest-AttachVolumeNegativeTest-1395057280</nova:project>
Nov 10 18:14:55 user nova-compute[75100]:       </nova:owner>
Nov 10 18:14:55 user nova-compute[75100]:       <nova:root type="image" uuid="e3cc5321-4d40-49ee-885c-700e14741732"/>
Nov 10 18:14:55 user nova-compute[75100]:       <nova:ports>
Nov 10 18:14:55 user nova-compute[75100]:         <nova:port uuid="b40ca80d-b78e-4bcc-ac31-203a76ebf3b7">
Nov 10 18:14:55 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 10 18:14:55 user nova-compute[75100]:         </nova:port>
Nov 10 18:14:55 user nova-compute[75100]:       </nova:ports>
Nov 10 18:14:55 user nova-compute[75100]:     </nova:instance>
Nov 10 18:14:55 user nova-compute[75100]:   </metadata>
Nov 10 18:14:55 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 10 18:14:55 user nova-compute[75100]:     <system>
Nov 10 18:14:55 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 18:14:55 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 10 18:14:55 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 10 18:14:55 user nova-compute[75100]:       <entry name="serial">1220ad0e-3f5e-4d47-be01-4652e2390e87</entry>
Nov 10 18:14:55 user nova-compute[75100]:       <entry name="uuid">1220ad0e-3f5e-4d47-be01-4652e2390e87</entry>
Nov 10 18:14:55 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 10 18:14:55 user nova-compute[75100]:     </system>
Nov 10 18:14:55 user nova-compute[75100]:   </sysinfo>
Nov 10 18:14:55 user nova-compute[75100]:   <os>
Nov 10 18:14:55 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 18:14:55 user nova-compute[75100]:     <boot dev="hd"/>
Nov 10 18:14:55 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 10 18:14:55 user nova-compute[75100]:   </os>
Nov 10 18:14:55 user nova-compute[75100]:   <features>
Nov 10 18:14:55 user nova-compute[75100]:     <acpi/>
Nov 10 18:14:55 user nova-compute[75100]:     <apic/>
Nov 10 18:14:55 user nova-compute[75100]:     <vmcoreinfo/>
Nov 10 18:14:55 user nova-compute[75100]:   </features>
Nov 10 18:14:55 user nova-compute[75100]:   <clock offset="utc">
Nov 10 18:14:55 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 18:14:55 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 18:14:55 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 10 18:14:55 user nova-compute[75100]:   </clock>
Nov 10 18:14:55 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 10 18:14:55 user nova-compute[75100]:     <model>Nehalem</model>
Nov 10 18:14:55 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 18:14:55 user nova-compute[75100]:   </cpu>
Nov 10 18:14:55 user nova-compute[75100]:   <devices>
Nov 10 18:14:55 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 10 18:14:55 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 18:14:55 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/1220ad0e-3f5e-4d47-be01-4652e2390e87/disk"/>
Nov 10 18:14:55 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 10 18:14:55 user nova-compute[75100]:     </disk>
Nov 10 18:14:55 user nova-compute[75100]:     <interface type="ethernet">
Nov 10 18:14:55 user nova-compute[75100]:       <mac address="fa:16:3e:6d:45:a1"/>
Nov 10 18:14:55 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 18:14:55 user nova-compute[75100]:       <mtu size="1442"/>
Nov 10 18:14:55 user nova-compute[75100]:       <target dev="tapb40ca80d-b7"/>
Nov 10 18:14:55 user nova-compute[75100]:     </interface>
Nov 10 18:14:55 user nova-compute[75100]:     <serial type="pty">
Nov 10 18:14:55 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/1220ad0e-3f5e-4d47-be01-4652e2390e87/console.log" append="off"/>
Nov 10 18:14:55 user nova-compute[75100]:     </serial>
Nov 10 18:14:55 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 18:14:55 user nova-compute[75100]:     <video>
Nov 10 18:14:55 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 18:14:55 user nova-compute[75100]:     </video>
Nov 10 18:14:55 user nova-compute[75100]:     <rng model="virtio">
Nov 10 18:14:55 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 10 18:14:55 user nova-compute[75100]:     </rng>
Nov 10 18:14:55 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 10 18:14:55 user nova-compute[75100]:     <memballoon model="virtio">
Nov 10 18:14:55 user nova-compute[75100]:       <stats period="10"/>
Nov 10 18:14:55 user nova-compute[75100]:     </memballoon>
Nov 10 18:14:55 user nova-compute[75100]:   </devices>
Nov 10 18:14:55 user nova-compute[75100]: </domain>
Nov 10 18:14:55 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 18:14:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:14:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-523445808',display_name='tempest-AttachVolumeNegativeTest-server-523445808',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-523445808',id=48,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8eN2+ejV81w/zdOYTtf0JylCt8udcOs4J6RXjn86uKIHjViiGxD/QsKNhxQZVuLfU7qVQUveiHeAceYMTjjsJYa+Bb6BTLjGbSe/cvA8r5AWqkQ9e+km8jzG7d3EdSSg==',key_name='tempest-keypair-1428224260',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d4e5cb8bdc24a009dcb3dbee36a6bce',ramdisk_id='',reservation_id='r-m0jjy27z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1395057280',owner_user_name='tempest-AttachVolumeNegativeTest-1395057280-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T18:14:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efe92a172011414e8507cb6ddbfab0bb',uuid=1220ad0e-3f5e-4d47-be01-4652e2390e87,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b40ca80d-b78e-4bcc-ac31-203a76ebf3b7", "address": "fa:16:3e:6d:45:a1", "network": {"id": "e906a397-504d-48d8-8726-187cfbb1f270", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2095832274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4e5cb8bdc24a009dcb3dbee36a6bce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb40ca80d-b7", "ovs_interfaceid": "b40ca80d-b78e-4bcc-ac31-203a76ebf3b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 18:14:55 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Converting VIF {"id": "b40ca80d-b78e-4bcc-ac31-203a76ebf3b7", "address": "fa:16:3e:6d:45:a1", "network": {"id": "e906a397-504d-48d8-8726-187cfbb1f270", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2095832274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4e5cb8bdc24a009dcb3dbee36a6bce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb40ca80d-b7", "ovs_interfaceid": "b40ca80d-b78e-4bcc-ac31-203a76ebf3b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:14:55 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:45:a1,bridge_name='br-int',has_traffic_filtering=True,id=b40ca80d-b78e-4bcc-ac31-203a76ebf3b7,network=Network(e906a397-504d-48d8-8726-187cfbb1f270),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb40ca80d-b7') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:14:55 user nova-compute[75100]: DEBUG os_vif [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:45:a1,bridge_name='br-int',has_traffic_filtering=True,id=b40ca80d-b78e-4bcc-ac31-203a76ebf3b7,network=Network(e906a397-504d-48d8-8726-187cfbb1f270),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb40ca80d-b7') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 18:14:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:14:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:14:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 18:14:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:14:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fc7692ce-abb5-57bb-980f-0c5a98a82537', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:14:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:14:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:14:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:14:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb40ca80d-b7, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:14:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb40ca80d-b7, col_values=(('qos', UUID('e935eeb0-c730-4250-9b01-3d20d6bd6169')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:14:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb40ca80d-b7, col_values=(('external_ids', {'iface-id': 'b40ca80d-b78e-4bcc-ac31-203a76ebf3b7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:45:a1', 'vm-uuid': '1220ad0e-3f5e-4d47-be01-4652e2390e87'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:14:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:14:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:14:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:14:55 user nova-compute[75100]: INFO os_vif [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:45:a1,bridge_name='br-int',has_traffic_filtering=True,id=b40ca80d-b78e-4bcc-ac31-203a76ebf3b7,network=Network(e906a397-504d-48d8-8726-187cfbb1f270),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb40ca80d-b7')
Nov 10 18:14:56 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 18:14:56 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] No VIF found with MAC fa:16:3e:6d:45:a1, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 18:14:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:14:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:14:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:14:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:14:57 user nova-compute[75100]: DEBUG nova.compute.manager [req-d74bd730-c0da-4036-80cd-383209f290da req-3a3f4acd-9da2-40e1-a394-4f1c1a9dd10b service nova] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] Received event network-vif-plugged-b40ca80d-b78e-4bcc-ac31-203a76ebf3b7 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:14:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d74bd730-c0da-4036-80cd-383209f290da req-3a3f4acd-9da2-40e1-a394-4f1c1a9dd10b service nova] Acquiring lock "1220ad0e-3f5e-4d47-be01-4652e2390e87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:14:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d74bd730-c0da-4036-80cd-383209f290da req-3a3f4acd-9da2-40e1-a394-4f1c1a9dd10b service nova] Lock "1220ad0e-3f5e-4d47-be01-4652e2390e87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:14:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d74bd730-c0da-4036-80cd-383209f290da req-3a3f4acd-9da2-40e1-a394-4f1c1a9dd10b service nova] Lock "1220ad0e-3f5e-4d47-be01-4652e2390e87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:14:57 user nova-compute[75100]: DEBUG nova.compute.manager [req-d74bd730-c0da-4036-80cd-383209f290da req-3a3f4acd-9da2-40e1-a394-4f1c1a9dd10b service nova] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] No waiting events found dispatching network-vif-plugged-b40ca80d-b78e-4bcc-ac31-203a76ebf3b7 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:14:57 user nova-compute[75100]: WARNING nova.compute.manager [req-d74bd730-c0da-4036-80cd-383209f290da req-3a3f4acd-9da2-40e1-a394-4f1c1a9dd10b service nova] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] Received unexpected event network-vif-plugged-b40ca80d-b78e-4bcc-ac31-203a76ebf3b7 for instance with vm_state building and task_state spawning.
Nov 10 18:14:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:14:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:14:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:14:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:14:59 user nova-compute[75100]: DEBUG nova.compute.manager [req-eb7641d3-f1c6-48d8-90c4-a3b826e25328 req-828a6f21-e26b-46b4-a6a1-88e5f485574e service nova] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] Received event network-vif-plugged-b40ca80d-b78e-4bcc-ac31-203a76ebf3b7 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:14:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-eb7641d3-f1c6-48d8-90c4-a3b826e25328 req-828a6f21-e26b-46b4-a6a1-88e5f485574e service nova] Acquiring lock "1220ad0e-3f5e-4d47-be01-4652e2390e87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:14:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-eb7641d3-f1c6-48d8-90c4-a3b826e25328 req-828a6f21-e26b-46b4-a6a1-88e5f485574e service nova] Lock "1220ad0e-3f5e-4d47-be01-4652e2390e87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:14:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-eb7641d3-f1c6-48d8-90c4-a3b826e25328 req-828a6f21-e26b-46b4-a6a1-88e5f485574e service nova] Lock "1220ad0e-3f5e-4d47-be01-4652e2390e87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:14:59 user nova-compute[75100]: DEBUG nova.compute.manager [req-eb7641d3-f1c6-48d8-90c4-a3b826e25328 req-828a6f21-e26b-46b4-a6a1-88e5f485574e service nova] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] No waiting events found dispatching network-vif-plugged-b40ca80d-b78e-4bcc-ac31-203a76ebf3b7 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:14:59 user nova-compute[75100]: WARNING nova.compute.manager [req-eb7641d3-f1c6-48d8-90c4-a3b826e25328 req-828a6f21-e26b-46b4-a6a1-88e5f485574e service nova] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] Received unexpected event network-vif-plugged-b40ca80d-b78e-4bcc-ac31-203a76ebf3b7 for instance with vm_state building and task_state spawning.
Nov 10 18:14:59 user nova-compute[75100]: DEBUG nova.compute.manager [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 18:14:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 18:14:59 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] Instance spawned successfully.
Nov 10 18:14:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 18:14:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:14:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:14:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:14:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:14:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:14:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:14:59 user nova-compute[75100]: INFO nova.compute.manager [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] Took 6.06 seconds to spawn the instance on the hypervisor.
Nov 10 18:14:59 user nova-compute[75100]: DEBUG nova.compute.manager [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 18:14:59 user nova-compute[75100]: INFO nova.compute.manager [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] Took 6.61 seconds to build instance.
Nov 10 18:14:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e5dd0b0e-5a8f-454b-947f-712eaaf67d7a tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "1220ad0e-3f5e-4d47-be01-4652e2390e87" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.809s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:14:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:15:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:15:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:15:09 user nova-compute[75100]: DEBUG nova.compute.manager [req-729e978f-0485-43ab-862e-6169d6b6bdc0 req-0db5a8af-1d7b-47eb-aedb-ee31c2d1825f service nova] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Received event network-changed-64ffd205-85a8-4c33-8ec4-40f8519b0bd5 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:15:09 user nova-compute[75100]: DEBUG nova.compute.manager [req-729e978f-0485-43ab-862e-6169d6b6bdc0 req-0db5a8af-1d7b-47eb-aedb-ee31c2d1825f service nova] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Refreshing instance network info cache due to event network-changed-64ffd205-85a8-4c33-8ec4-40f8519b0bd5. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 18:15:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-729e978f-0485-43ab-862e-6169d6b6bdc0 req-0db5a8af-1d7b-47eb-aedb-ee31c2d1825f service nova] Acquiring lock "refresh_cache-fb6b4d45-7c2b-4211-9939-9989a6a3c913" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:15:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-729e978f-0485-43ab-862e-6169d6b6bdc0 req-0db5a8af-1d7b-47eb-aedb-ee31c2d1825f service nova] Acquired lock "refresh_cache-fb6b4d45-7c2b-4211-9939-9989a6a3c913" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:15:09 user nova-compute[75100]: DEBUG nova.network.neutron [req-729e978f-0485-43ab-862e-6169d6b6bdc0 req-0db5a8af-1d7b-47eb-aedb-ee31c2d1825f service nova] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Refreshing network info cache for port 64ffd205-85a8-4c33-8ec4-40f8519b0bd5 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 18:15:09 user nova-compute[75100]: DEBUG nova.network.neutron [req-729e978f-0485-43ab-862e-6169d6b6bdc0 req-0db5a8af-1d7b-47eb-aedb-ee31c2d1825f service nova] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Updated VIF entry in instance network info cache for port 64ffd205-85a8-4c33-8ec4-40f8519b0bd5. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 18:15:09 user nova-compute[75100]: DEBUG nova.network.neutron [req-729e978f-0485-43ab-862e-6169d6b6bdc0 req-0db5a8af-1d7b-47eb-aedb-ee31c2d1825f service nova] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Updating instance_info_cache with network_info: [{"id": "64ffd205-85a8-4c33-8ec4-40f8519b0bd5", "address": "fa:16:3e:d6:d0:ff", "network": {"id": "0c411791-eb03-4e00-9d7f-d032e2c16d46", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1808141765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc6fc8310f44f3788e13aa4f1eb8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ffd205-85", "ovs_interfaceid": "64ffd205-85a8-4c33-8ec4-40f8519b0bd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:15:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-729e978f-0485-43ab-862e-6169d6b6bdc0 req-0db5a8af-1d7b-47eb-aedb-ee31c2d1825f service nova] Releasing lock "refresh_cache-fb6b4d45-7c2b-4211-9939-9989a6a3c913" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:15:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:15:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:15:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:15:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-56c13ff6-30bf-4a5a-95d7-64aeed34c348 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Acquiring lock "fb6b4d45-7c2b-4211-9939-9989a6a3c913" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:15:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-56c13ff6-30bf-4a5a-95d7-64aeed34c348 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "fb6b4d45-7c2b-4211-9939-9989a6a3c913" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:15:15 user nova-compute[75100]: DEBUG nova.objects.instance [None req-56c13ff6-30bf-4a5a-95d7-64aeed34c348 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lazy-loading 'flavor' on Instance uuid fb6b4d45-7c2b-4211-9939-9989a6a3c913 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:15:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-56c13ff6-30bf-4a5a-95d7-64aeed34c348 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "fb6b4d45-7c2b-4211-9939-9989a6a3c913" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:15:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:15:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-56c13ff6-30bf-4a5a-95d7-64aeed34c348 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Acquiring lock "fb6b4d45-7c2b-4211-9939-9989a6a3c913" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:15:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-56c13ff6-30bf-4a5a-95d7-64aeed34c348 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "fb6b4d45-7c2b-4211-9939-9989a6a3c913" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:15:16 user nova-compute[75100]: INFO nova.compute.manager [None req-56c13ff6-30bf-4a5a-95d7-64aeed34c348 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Attaching volume fc0ab4ad-3373-400c-a672-07ef9b16555e to /dev/vdb
Nov 10 18:15:16 user nova-compute[75100]: DEBUG os_brick.utils [None req-56c13ff6-30bf-4a5a-95d7-64aeed34c348 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:15:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:15:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:15:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9512fa6-32b2-4e5e-850a-50bc929f4b3b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90b1a229568f\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:15:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:15:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:15:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[990e037d-e525-4073-a77c-96c3b596bab6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:15:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:15:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:15:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f90813-c070-4db6-b1ed-59843c8670de]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:15:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe8d051-c5f4-475d-8b19-a170f3686b02]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:15:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-56c13ff6-30bf-4a5a-95d7-64aeed34c348 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:15:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-56c13ff6-30bf-4a5a-95d7-64aeed34c348 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 18:15:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-56c13ff6-30bf-4a5a-95d7-64aeed34c348 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 18:15:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:15:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 18:15:16 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 18:15:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ea8939-cb76-4ee3-8084-7af48ff1ad08]: (4, '') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:15:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-56c13ff6-30bf-4a5a-95d7-64aeed34c348 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 18:15:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-56c13ff6-30bf-4a5a-95d7-64aeed34c348 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 18:15:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-56c13ff6-30bf-4a5a-95d7-64aeed34c348 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 18:15:16 user nova-compute[75100]: DEBUG os_brick.utils [None req-56c13ff6-30bf-4a5a-95d7-64aeed34c348 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90b1a229568f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:15:16 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-56c13ff6-30bf-4a5a-95d7-64aeed34c348 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Updating existing volume attachment record: c42fbfb5-9d8d-4c5f-953b-a78eb784e70c {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 18:15:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:15:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8d46de71-4b88-4e7a-9e6f-0cf0145a24cf tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Acquiring lock "f0b2a902-2358-4bed-a474-21170a45577d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:15:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8d46de71-4b88-4e7a-9e6f-0cf0145a24cf tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Lock "f0b2a902-2358-4bed-a474-21170a45577d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:15:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8d46de71-4b88-4e7a-9e6f-0cf0145a24cf tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Acquiring lock "f0b2a902-2358-4bed-a474-21170a45577d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:15:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8d46de71-4b88-4e7a-9e6f-0cf0145a24cf tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Lock "f0b2a902-2358-4bed-a474-21170a45577d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:15:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8d46de71-4b88-4e7a-9e6f-0cf0145a24cf tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Lock "f0b2a902-2358-4bed-a474-21170a45577d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:15:20 user nova-compute[75100]: INFO nova.compute.manager [None req-8d46de71-4b88-4e7a-9e6f-0cf0145a24cf tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Terminating instance
Nov 10 18:15:20 user nova-compute[75100]: DEBUG nova.compute.manager [None req-8d46de71-4b88-4e7a-9e6f-0cf0145a24cf tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 18:15:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:15:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:15:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:15:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:15:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:15:20 user nova-compute[75100]: DEBUG nova.compute.manager [req-e77e5747-e7f2-4f68-a05e-72b943fdef13 req-7a92c33f-c51d-4d94-9db5-e0c5b868180d service nova] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Received event network-vif-unplugged-6a80628d-e450-4d72-86c9-08d8578d9f17 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:15:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-e77e5747-e7f2-4f68-a05e-72b943fdef13 req-7a92c33f-c51d-4d94-9db5-e0c5b868180d service nova] Acquiring lock "f0b2a902-2358-4bed-a474-21170a45577d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:15:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-e77e5747-e7f2-4f68-a05e-72b943fdef13 req-7a92c33f-c51d-4d94-9db5-e0c5b868180d service nova] Lock "f0b2a902-2358-4bed-a474-21170a45577d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:15:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-e77e5747-e7f2-4f68-a05e-72b943fdef13 req-7a92c33f-c51d-4d94-9db5-e0c5b868180d service nova] Lock "f0b2a902-2358-4bed-a474-21170a45577d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:15:20 user nova-compute[75100]: DEBUG nova.compute.manager [req-e77e5747-e7f2-4f68-a05e-72b943fdef13 req-7a92c33f-c51d-4d94-9db5-e0c5b868180d service nova] [instance: f0b2a902-2358-4bed-a474-21170a45577d] No waiting events found dispatching network-vif-unplugged-6a80628d-e450-4d72-86c9-08d8578d9f17 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:15:20 user nova-compute[75100]: DEBUG nova.compute.manager [req-e77e5747-e7f2-4f68-a05e-72b943fdef13 req-7a92c33f-c51d-4d94-9db5-e0c5b868180d service nova] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Received event network-vif-unplugged-6a80628d-e450-4d72-86c9-08d8578d9f17 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 18:15:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:15:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:15:21 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Instance destroyed successfully.
Nov 10 18:15:21 user nova-compute[75100]: DEBUG nova.objects.instance [None req-8d46de71-4b88-4e7a-9e6f-0cf0145a24cf tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Lazy-loading 'resources' on Instance uuid f0b2a902-2358-4bed-a474-21170a45577d {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:15:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-8d46de71-4b88-4e7a-9e6f-0cf0145a24cf tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:10:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1171196664',display_name='tempest-TestServerVolumeAttachmentScenario-server-1171196664',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1171196664',id=45,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAuW+kCJia8KV27/A+k6o3SR678YpqbdO9leaTozOnoVey1Aq212cTr1XgJimDRIKt8S71baUVitkBRpZ1r9a2LKWAzFPdWzhdIbv3iaHEBTMkEm7SWt8A8QqO/GnIiOg==',key_name='tempest-keypair-2024642438',keypairs=<?>,launch_index=0,launched_at=2023-11-10T18:10:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f1b6a6cf82404999aa9e2d5f99b5b9df',ramdisk_id='',reservation_id='r-q8ykhnnn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-360864520',owner_user_name='tempest-TestServerVolumeAttachmentScenario-360864520-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T18:10:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01dec08989fe49f781636aec26e41900',uuid=f0b2a902-2358-4bed-a474-21170a45577d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6a80628d-e450-4d72-86c9-08d8578d9f17", "address": "fa:16:3e:01:34:07", "network": {"id": "5e6c66a5-a7bb-4157-aed0-8f8f7cfa846c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-209207359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1b6a6cf82404999aa9e2d5f99b5b9df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a80628d-e4", "ovs_interfaceid": "6a80628d-e450-4d72-86c9-08d8578d9f17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 18:15:21 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-8d46de71-4b88-4e7a-9e6f-0cf0145a24cf tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Converting VIF {"id": "6a80628d-e450-4d72-86c9-08d8578d9f17", "address": "fa:16:3e:01:34:07", "network": {"id": "5e6c66a5-a7bb-4157-aed0-8f8f7cfa846c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-209207359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1b6a6cf82404999aa9e2d5f99b5b9df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a80628d-e4", "ovs_interfaceid": "6a80628d-e450-4d72-86c9-08d8578d9f17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:15:21 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-8d46de71-4b88-4e7a-9e6f-0cf0145a24cf tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:01:34:07,bridge_name='br-int',has_traffic_filtering=True,id=6a80628d-e450-4d72-86c9-08d8578d9f17,network=Network(5e6c66a5-a7bb-4157-aed0-8f8f7cfa846c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a80628d-e4') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:15:21 user nova-compute[75100]: DEBUG os_vif [None req-8d46de71-4b88-4e7a-9e6f-0cf0145a24cf tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:34:07,bridge_name='br-int',has_traffic_filtering=True,id=6a80628d-e450-4d72-86c9-08d8578d9f17,network=Network(5e6c66a5-a7bb-4157-aed0-8f8f7cfa846c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a80628d-e4') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 18:15:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:15:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6a80628d-e4, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:15:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:15:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:15:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:15:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b9131a59-ea85-473a-a3d4-327e6c6b3181) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:15:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:15:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:15:21 user nova-compute[75100]: INFO os_vif [None req-8d46de71-4b88-4e7a-9e6f-0cf0145a24cf tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:34:07,bridge_name='br-int',has_traffic_filtering=True,id=6a80628d-e450-4d72-86c9-08d8578d9f17,network=Network(5e6c66a5-a7bb-4157-aed0-8f8f7cfa846c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a80628d-e4')
Nov 10 18:15:21 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-8d46de71-4b88-4e7a-9e6f-0cf0145a24cf tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Deleting instance files /opt/stack/data/nova/instances/f0b2a902-2358-4bed-a474-21170a45577d_del
Nov 10 18:15:21 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-8d46de71-4b88-4e7a-9e6f-0cf0145a24cf tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Deletion of /opt/stack/data/nova/instances/f0b2a902-2358-4bed-a474-21170a45577d_del complete
Nov 10 18:15:21 user nova-compute[75100]: INFO nova.compute.manager [None req-8d46de71-4b88-4e7a-9e6f-0cf0145a24cf tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 10 18:15:21 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-8d46de71-4b88-4e7a-9e6f-0cf0145a24cf tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 18:15:21 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 18:15:21 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: f0b2a902-2358-4bed-a474-21170a45577d] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 18:15:21 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:15:21 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Took 0.66 seconds to deallocate network for instance.
Nov 10 18:15:21 user nova-compute[75100]: DEBUG nova.compute.manager [req-510feb8e-1f22-44ab-9219-8c045b731ea0 req-d49c58a1-a365-4c4b-a1af-d5442d83ece1 service nova] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Received event network-vif-deleted-6a80628d-e450-4d72-86c9-08d8578d9f17 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:15:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8d46de71-4b88-4e7a-9e6f-0cf0145a24cf tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:15:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8d46de71-4b88-4e7a-9e6f-0cf0145a24cf tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:15:21 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-8d46de71-4b88-4e7a-9e6f-0cf0145a24cf tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:15:21 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-8d46de71-4b88-4e7a-9e6f-0cf0145a24cf tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:15:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8d46de71-4b88-4e7a-9e6f-0cf0145a24cf tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.174s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:15:22 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-8d46de71-4b88-4e7a-9e6f-0cf0145a24cf tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Deleted allocations for instance f0b2a902-2358-4bed-a474-21170a45577d
Nov 10 18:15:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8d46de71-4b88-4e7a-9e6f-0cf0145a24cf tempest-TestServerVolumeAttachmentScenario-360864520 tempest-TestServerVolumeAttachmentScenario-360864520-project-member] Lock "f0b2a902-2358-4bed-a474-21170a45577d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.887s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:15:22 user nova-compute[75100]: DEBUG nova.compute.manager [req-ef1aaa36-2db9-476a-8536-46be711bf674 req-b66ccb4d-55b2-4b9b-b92d-c16e857d3670 service nova] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Received event network-vif-plugged-6a80628d-e450-4d72-86c9-08d8578d9f17 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:15:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ef1aaa36-2db9-476a-8536-46be711bf674 req-b66ccb4d-55b2-4b9b-b92d-c16e857d3670 service nova] Acquiring lock "f0b2a902-2358-4bed-a474-21170a45577d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:15:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ef1aaa36-2db9-476a-8536-46be711bf674 req-b66ccb4d-55b2-4b9b-b92d-c16e857d3670 service nova] Lock "f0b2a902-2358-4bed-a474-21170a45577d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:15:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ef1aaa36-2db9-476a-8536-46be711bf674 req-b66ccb4d-55b2-4b9b-b92d-c16e857d3670 service nova] Lock "f0b2a902-2358-4bed-a474-21170a45577d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:15:22 user nova-compute[75100]: DEBUG nova.compute.manager [req-ef1aaa36-2db9-476a-8536-46be711bf674 req-b66ccb4d-55b2-4b9b-b92d-c16e857d3670 service nova] [instance: f0b2a902-2358-4bed-a474-21170a45577d] No waiting events found dispatching network-vif-plugged-6a80628d-e450-4d72-86c9-08d8578d9f17 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:15:22 user nova-compute[75100]: WARNING nova.compute.manager [req-ef1aaa36-2db9-476a-8536-46be711bf674 req-b66ccb4d-55b2-4b9b-b92d-c16e857d3670 service nova] [instance: f0b2a902-2358-4bed-a474-21170a45577d] Received unexpected event network-vif-plugged-6a80628d-e450-4d72-86c9-08d8578d9f17 for instance with vm_state deleted and task_state None.
Nov 10 18:15:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:15:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:15:29 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:15:30 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:15:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:15:34 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:15:34 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75100) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 18:15:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:15:37 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:15:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:15:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:15:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:15:37 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 18:15:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:15:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:15:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:15:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:15:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 18:15:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1220ad0e-3f5e-4d47-be01-4652e2390e87/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:15:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1220ad0e-3f5e-4d47-be01-4652e2390e87/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:15:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1220ad0e-3f5e-4d47-be01-4652e2390e87/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:15:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1220ad0e-3f5e-4d47-be01-4652e2390e87/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:15:38 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:15:38 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:15:38 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Hypervisor/Node resource view: name=user free_ram=8591MB free_disk=24.422725677490234GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 18:15:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:15:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:15:38 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance fb6b4d45-7c2b-4211-9939-9989a6a3c913 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:15:38 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 8f04a49b-8124-4319-a4b2-b40786984c00 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:15:38 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 1220ad0e-3f5e-4d47-be01-4652e2390e87 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:15:38 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 18:15:38 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 18:15:39 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:15:39 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:15:39 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 18:15:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.472s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:15:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56c13ff6-30bf-4a5a-95d7-64aeed34c348 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 18:15:39 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c13ff6-30bf-4a5a-95d7-64aeed34c348 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oYSOkxne', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:15:39 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-56c13ff6-30bf-4a5a-95d7-64aeed34c348 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:15:39 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-56c13ff6-30bf-4a5a-95d7-64aeed34c348 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:15:39 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-56c13ff6-30bf-4a5a-95d7-64aeed34c348 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:15:39 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-56c13ff6-30bf-4a5a-95d7-64aeed34c348 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:15:39 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-56c13ff6-30bf-4a5a-95d7-64aeed34c348 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:15:39 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-56c13ff6-30bf-4a5a-95d7-64aeed34c348 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:15:39 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-56c13ff6-30bf-4a5a-95d7-64aeed34c348 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 18:15:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e -p 172.16.0.220:3260 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:15:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:15:39 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a16b4e-e4c9-462a-a949-ce363a274b8c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:15:39 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c13ff6-30bf-4a5a-95d7-64aeed34c348 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 18:15:39 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:15:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e -p 172.16.0.220:3260 --interface default --op new {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:15:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:15:39 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c39761-244b-4ac0-a353-01cb629443d6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e] added\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:15:39 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c13ff6-30bf-4a5a-95d7-64aeed34c348 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e] added
Nov 10 18:15:39 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:15:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:15:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:15:39 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67f470f-defd-414f-a996-2340a3f14d0f]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:15:39 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c13ff6-30bf-4a5a-95d7-64aeed34c348 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:15:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:15:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:15:39 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccad7a12-24ef-4a30-b067-bc985f7afd9b]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:15:39 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c13ff6-30bf-4a5a-95d7-64aeed34c348 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:15:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oYSOkxne {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:15:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oYSOkxne" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:15:39 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[839e8315-2b9c-4824-9a1d-76f6e6cd8ee5]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:15:39 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c13ff6-30bf-4a5a-95d7-64aeed34c348 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oYSOkxne'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:15:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:15:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:15:39 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4887a91b-45ef-4cc8-a966-238b3d50fe7a]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:15:39 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c13ff6-30bf-4a5a-95d7-64aeed34c348 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:15:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:15:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:15:39 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ebe609d-44c7-4f2b-9cb3-4504bd79ca47]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:15:39 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c13ff6-30bf-4a5a-95d7-64aeed34c348 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e (non-flash)
Nov 10 18:15:39 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:15:39 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c13ff6-30bf-4a5a-95d7-64aeed34c348 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e (non-flash)
Nov 10 18:15:39 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:15:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e -p 172.16.0.220:3260 --login {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:15:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:15:39 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d96556e-a60a-41e0-8b98-15b4f37a1f04]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:15:39 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c13ff6-30bf-4a5a-95d7-64aeed34c348 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e, portal: 172.16.0.220,3260]
Nov 10 18:15:39 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e, portal: 172.16.0.220,3260] successful.
Nov 10 18:15:39 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:15:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:15:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:15:39 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[695011e7-d9bc-41fa-9fa8-a9a882c27fb9]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:15:39 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c13ff6-30bf-4a5a-95d7-64aeed34c348 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:15:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:15:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:15:39 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[651b2da4-fe0b-45d5-9e9e-53bd2e9db491]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:15:39 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c13ff6-30bf-4a5a-95d7-64aeed34c348 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e (non-flash)
Nov 10 18:15:39 user nova-compute[75100]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e (non-flash)
Nov 10 18:15:39 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:15:39 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c13ff6-30bf-4a5a-95d7-64aeed34c348 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e (non-flash)
Nov 10 18:15:39 user nova-compute[75100]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e (non-flash)
Nov 10 18:15:39 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:15:39 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-56c13ff6-30bf-4a5a-95d7-64aeed34c348 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:15:39 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c13ff6-30bf-4a5a-95d7-64aeed34c348 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 18:15:39 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-56c13ff6-30bf-4a5a-95d7-64aeed34c348 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] HCTL ('34', '-', '-', 0) found on session 41 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 18:15:39 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-56c13ff6-30bf-4a5a-95d7-64aeed34c348 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 18:15:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:15:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:15:40 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6582ec43-41e7-4985-bcc6-b8a6940f13da]: (4, ('- - 0', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:15:40 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-56c13ff6-30bf-4a5a-95d7-64aeed34c348 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: None {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 18:15:41 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-56c13ff6-30bf-4a5a-95d7-64aeed34c348 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 18:15:41 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c13ff6-30bf-4a5a-95d7-64aeed34c348 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oYSOkxne', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 18:15:41 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-56c13ff6-30bf-4a5a-95d7-64aeed34c348 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:15:41 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c13ff6-30bf-4a5a-95d7-64aeed34c348 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '26663323262643462', 'path': '/dev/sdc'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:15:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56c13ff6-30bf-4a5a-95d7-64aeed34c348 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26663323262643462', 'path': '/dev/sdc'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 18:15:41 user nova-compute[75100]: DEBUG nova.objects.instance [None req-56c13ff6-30bf-4a5a-95d7-64aeed34c348 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lazy-loading 'flavor' on Instance uuid fb6b4d45-7c2b-4211-9939-9989a6a3c913 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:15:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-56c13ff6-30bf-4a5a-95d7-64aeed34c348 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 18:15:41 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:15:41 user nova-compute[75100]:   <source dev="/dev/sdc"/>
Nov 10 18:15:41 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 18:15:41 user nova-compute[75100]:   <serial>fc0ab4ad-3373-400c-a672-07ef9b16555e</serial>
Nov 10 18:15:41 user nova-compute[75100]: </disk>
Nov 10 18:15:41 user nova-compute[75100]:  {{(pid=75100) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 18:15:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:15:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-56c13ff6-30bf-4a5a-95d7-64aeed34c348 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 18:15:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-56c13ff6-30bf-4a5a-95d7-64aeed34c348 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 18:15:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-56c13ff6-30bf-4a5a-95d7-64aeed34c348 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] No VIF found with MAC fa:16:3e:d6:d0:ff, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 18:15:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-56c13ff6-30bf-4a5a-95d7-64aeed34c348 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "fb6b4d45-7c2b-4211-9939-9989a6a3c913" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.443s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:15:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-24f45465-1562-48a5-b2d3-7128ee7487f0 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Acquiring lock "fb6b4d45-7c2b-4211-9939-9989a6a3c913" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:15:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-24f45465-1562-48a5-b2d3-7128ee7487f0 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "fb6b4d45-7c2b-4211-9939-9989a6a3c913" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:15:41 user nova-compute[75100]: DEBUG nova.compute.manager [None req-24f45465-1562-48a5-b2d3-7128ee7487f0 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 18:15:41 user nova-compute[75100]: DEBUG nova.compute.manager [None req-24f45465-1562-48a5-b2d3-7128ee7487f0 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75100) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 10 18:15:41 user nova-compute[75100]: DEBUG nova.objects.instance [None req-24f45465-1562-48a5-b2d3-7128ee7487f0 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lazy-loading 'flavor' on Instance uuid fb6b4d45-7c2b-4211-9939-9989a6a3c913 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:15:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:15:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:15:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:15:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:15:42 user nova-compute[75100]: DEBUG nova.compute.manager [req-429d5535-9e14-43e2-aa0d-95e97cf13aec req-724b188f-c917-4af2-94f7-082d2392418a service nova] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Received event network-vif-unplugged-64ffd205-85a8-4c33-8ec4-40f8519b0bd5 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:15:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-429d5535-9e14-43e2-aa0d-95e97cf13aec req-724b188f-c917-4af2-94f7-082d2392418a service nova] Acquiring lock "fb6b4d45-7c2b-4211-9939-9989a6a3c913-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:15:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-429d5535-9e14-43e2-aa0d-95e97cf13aec req-724b188f-c917-4af2-94f7-082d2392418a service nova] Lock "fb6b4d45-7c2b-4211-9939-9989a6a3c913-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:15:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-429d5535-9e14-43e2-aa0d-95e97cf13aec req-724b188f-c917-4af2-94f7-082d2392418a service nova] Lock "fb6b4d45-7c2b-4211-9939-9989a6a3c913-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:15:42 user nova-compute[75100]: DEBUG nova.compute.manager [req-429d5535-9e14-43e2-aa0d-95e97cf13aec req-724b188f-c917-4af2-94f7-082d2392418a service nova] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] No waiting events found dispatching network-vif-unplugged-64ffd205-85a8-4c33-8ec4-40f8519b0bd5 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:15:42 user nova-compute[75100]: WARNING nova.compute.manager [req-429d5535-9e14-43e2-aa0d-95e97cf13aec req-724b188f-c917-4af2-94f7-082d2392418a service nova] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Received unexpected event network-vif-unplugged-64ffd205-85a8-4c33-8ec4-40f8519b0bd5 for instance with vm_state active and task_state powering-off.
Nov 10 18:15:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:15:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:15:42 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Instance destroyed successfully.
Nov 10 18:15:42 user nova-compute[75100]: DEBUG nova.compute.manager [None req-24f45465-1562-48a5-b2d3-7128ee7487f0 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 18:15:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-24f45465-1562-48a5-b2d3-7128ee7487f0 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "fb6b4d45-7c2b-4211-9939-9989a6a3c913" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.929s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:15:44 user nova-compute[75100]: DEBUG nova.compute.manager [req-559ad13b-a3d3-4308-97a6-da9bea8658cb req-f675667d-2332-4cc8-a52c-bb35fad7432e service nova] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Received event network-vif-plugged-64ffd205-85a8-4c33-8ec4-40f8519b0bd5 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:15:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-559ad13b-a3d3-4308-97a6-da9bea8658cb req-f675667d-2332-4cc8-a52c-bb35fad7432e service nova] Acquiring lock "fb6b4d45-7c2b-4211-9939-9989a6a3c913-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:15:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-559ad13b-a3d3-4308-97a6-da9bea8658cb req-f675667d-2332-4cc8-a52c-bb35fad7432e service nova] Lock "fb6b4d45-7c2b-4211-9939-9989a6a3c913-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:15:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-559ad13b-a3d3-4308-97a6-da9bea8658cb req-f675667d-2332-4cc8-a52c-bb35fad7432e service nova] Lock "fb6b4d45-7c2b-4211-9939-9989a6a3c913-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:15:44 user nova-compute[75100]: DEBUG nova.compute.manager [req-559ad13b-a3d3-4308-97a6-da9bea8658cb req-f675667d-2332-4cc8-a52c-bb35fad7432e service nova] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] No waiting events found dispatching network-vif-plugged-64ffd205-85a8-4c33-8ec4-40f8519b0bd5 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:15:44 user nova-compute[75100]: WARNING nova.compute.manager [req-559ad13b-a3d3-4308-97a6-da9bea8658cb req-f675667d-2332-4cc8-a52c-bb35fad7432e service nova] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Received unexpected event network-vif-plugged-64ffd205-85a8-4c33-8ec4-40f8519b0bd5 for instance with vm_state stopped and task_state None.
Nov 10 18:15:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:15:45 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:15:45 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:15:45 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:15:45 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:15:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:15:47 user nova-compute[75100]: DEBUG nova.compute.manager [req-4905a3a2-8293-4ea8-8a78-a239df84fdb0 req-d107027a-565b-486c-be99-9b0a5cf46d40 service nova] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Received event network-changed-c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:15:47 user nova-compute[75100]: DEBUG nova.compute.manager [req-4905a3a2-8293-4ea8-8a78-a239df84fdb0 req-d107027a-565b-486c-be99-9b0a5cf46d40 service nova] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Refreshing instance network info cache due to event network-changed-c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 18:15:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4905a3a2-8293-4ea8-8a78-a239df84fdb0 req-d107027a-565b-486c-be99-9b0a5cf46d40 service nova] Acquiring lock "refresh_cache-8f04a49b-8124-4319-a4b2-b40786984c00" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:15:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4905a3a2-8293-4ea8-8a78-a239df84fdb0 req-d107027a-565b-486c-be99-9b0a5cf46d40 service nova] Acquired lock "refresh_cache-8f04a49b-8124-4319-a4b2-b40786984c00" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:15:48 user nova-compute[75100]: DEBUG nova.network.neutron [req-4905a3a2-8293-4ea8-8a78-a239df84fdb0 req-d107027a-565b-486c-be99-9b0a5cf46d40 service nova] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Refreshing network info cache for port c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 18:15:48 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:15:48 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 18:15:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "refresh_cache-fb6b4d45-7c2b-4211-9939-9989a6a3c913" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:15:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquired lock "refresh_cache-fb6b4d45-7c2b-4211-9939-9989a6a3c913" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:15:48 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 18:15:48 user nova-compute[75100]: DEBUG nova.network.neutron [req-4905a3a2-8293-4ea8-8a78-a239df84fdb0 req-d107027a-565b-486c-be99-9b0a5cf46d40 service nova] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Updated VIF entry in instance network info cache for port c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 18:15:48 user nova-compute[75100]: DEBUG nova.network.neutron [req-4905a3a2-8293-4ea8-8a78-a239df84fdb0 req-d107027a-565b-486c-be99-9b0a5cf46d40 service nova] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Updating instance_info_cache with network_info: [{"id": "c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a", "address": "fa:16:3e:16:4f:0b", "network": {"id": "17352d7d-ab4a-4f2a-b647-e9fa7d9c355d", "bridge": "br-int", "label": "tempest-TestShelveInstance-756457394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88550719c2fd46d6a4e4dd8038fdad78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63ac7d6-ae", "ovs_interfaceid": "c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:15:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4905a3a2-8293-4ea8-8a78-a239df84fdb0 req-d107027a-565b-486c-be99-9b0a5cf46d40 service nova] Releasing lock "refresh_cache-8f04a49b-8124-4319-a4b2-b40786984c00" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:15:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-92537e72-e557-461b-b895-ae1f74402459 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Acquiring lock "8f04a49b-8124-4319-a4b2-b40786984c00" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:15:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-92537e72-e557-461b-b895-ae1f74402459 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Lock "8f04a49b-8124-4319-a4b2-b40786984c00" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:15:48 user nova-compute[75100]: INFO nova.compute.manager [None req-92537e72-e557-461b-b895-ae1f74402459 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Shelve offloading
Nov 10 18:15:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:15:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:15:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:15:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:15:48 user nova-compute[75100]: DEBUG nova.compute.manager [req-3729b4dd-403e-4763-82fc-3e2504a35729 req-09fc8d7d-a883-41af-b789-54fec4f7efeb service nova] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Received event network-vif-unplugged-c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:15:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3729b4dd-403e-4763-82fc-3e2504a35729 req-09fc8d7d-a883-41af-b789-54fec4f7efeb service nova] Acquiring lock "8f04a49b-8124-4319-a4b2-b40786984c00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:15:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3729b4dd-403e-4763-82fc-3e2504a35729 req-09fc8d7d-a883-41af-b789-54fec4f7efeb service nova] Lock "8f04a49b-8124-4319-a4b2-b40786984c00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:15:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3729b4dd-403e-4763-82fc-3e2504a35729 req-09fc8d7d-a883-41af-b789-54fec4f7efeb service nova] Lock "8f04a49b-8124-4319-a4b2-b40786984c00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:15:48 user nova-compute[75100]: DEBUG nova.compute.manager [req-3729b4dd-403e-4763-82fc-3e2504a35729 req-09fc8d7d-a883-41af-b789-54fec4f7efeb service nova] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] No waiting events found dispatching network-vif-unplugged-c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:15:48 user nova-compute[75100]: WARNING nova.compute.manager [req-3729b4dd-403e-4763-82fc-3e2504a35729 req-09fc8d7d-a883-41af-b789-54fec4f7efeb service nova] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Received unexpected event network-vif-unplugged-c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a for instance with vm_state active and task_state shelving.
Nov 10 18:15:49 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Updating instance_info_cache with network_info: [{"id": "64ffd205-85a8-4c33-8ec4-40f8519b0bd5", "address": "fa:16:3e:d6:d0:ff", "network": {"id": "0c411791-eb03-4e00-9d7f-d032e2c16d46", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1808141765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc6fc8310f44f3788e13aa4f1eb8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ffd205-85", "ovs_interfaceid": "64ffd205-85a8-4c33-8ec4-40f8519b0bd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:15:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Releasing lock "refresh_cache-fb6b4d45-7c2b-4211-9939-9989a6a3c913" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:15:49 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 18:15:49 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:15:49 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Instance destroyed successfully.
Nov 10 18:15:49 user nova-compute[75100]: DEBUG nova.compute.manager [None req-92537e72-e557-461b-b895-ae1f74402459 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 18:15:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-92537e72-e557-461b-b895-ae1f74402459 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Acquiring lock "refresh_cache-8f04a49b-8124-4319-a4b2-b40786984c00" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:15:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-92537e72-e557-461b-b895-ae1f74402459 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Acquired lock "refresh_cache-8f04a49b-8124-4319-a4b2-b40786984c00" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:15:49 user nova-compute[75100]: DEBUG nova.network.neutron [None req-92537e72-e557-461b-b895-ae1f74402459 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 18:15:49 user nova-compute[75100]: DEBUG nova.network.neutron [None req-92537e72-e557-461b-b895-ae1f74402459 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Updating instance_info_cache with network_info: [{"id": "c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a", "address": "fa:16:3e:16:4f:0b", "network": {"id": "17352d7d-ab4a-4f2a-b647-e9fa7d9c355d", "bridge": "br-int", "label": "tempest-TestShelveInstance-756457394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88550719c2fd46d6a4e4dd8038fdad78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63ac7d6-ae", "ovs_interfaceid": "c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:15:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-92537e72-e557-461b-b895-ae1f74402459 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Releasing lock "refresh_cache-8f04a49b-8124-4319-a4b2-b40786984c00" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:15:50 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Instance destroyed successfully.
Nov 10 18:15:50 user nova-compute[75100]: DEBUG nova.objects.instance [None req-92537e72-e557-461b-b895-ae1f74402459 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Lazy-loading 'resources' on Instance uuid 8f04a49b-8124-4319-a4b2-b40786984c00 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-92537e72-e557-461b-b895-ae1f74402459 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:13:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2027830495',display_name='tempest-TestShelveInstance-server-2027830495',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2027830495',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB9qEHEmYdMuWxE5gf70kraK1OXUOB4Q8BESIygRL+qQHvsdRICR3ppT56RlX1dWZbh86Resa7Vt9qrVDWMYfSY79L/T72hFPuMCGqoZUD9uGRGvYY4StURcY0jI+vYwBw==',key_name='tempest-TestShelveInstance-1902062708',keypairs=<?>,launch_index=0,launched_at=2023-11-10T18:14:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88550719c2fd46d6a4e4dd8038fdad78',ramdisk_id='',reservation_id='r-z7a0122o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-691216050',owner_user_name='tempest-TestShelveInstance-691216050-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T18:14:27Z,user_data=None,user_id='899e3a2f60b24a52b71f73e7ca965699',uuid=8f04a49b-8124-4319-a4b2-b40786984c00,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a", "address": "fa:16:3e:16:4f:0b", "network": {"id": "17352d7d-ab4a-4f2a-b647-e9fa7d9c355d", "bridge": "br-int", "label": "tempest-TestShelveInstance-756457394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88550719c2fd46d6a4e4dd8038fdad78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63ac7d6-ae", "ovs_interfaceid": "c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-92537e72-e557-461b-b895-ae1f74402459 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Converting VIF {"id": "c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a", "address": "fa:16:3e:16:4f:0b", "network": {"id": "17352d7d-ab4a-4f2a-b647-e9fa7d9c355d", "bridge": "br-int", "label": "tempest-TestShelveInstance-756457394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88550719c2fd46d6a4e4dd8038fdad78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63ac7d6-ae", "ovs_interfaceid": "c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-92537e72-e557-461b-b895-ae1f74402459 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:4f:0b,bridge_name='br-int',has_traffic_filtering=True,id=c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a,network=Network(17352d7d-ab4a-4f2a-b647-e9fa7d9c355d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63ac7d6-ae') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG os_vif [None req-92537e72-e557-461b-b895-ae1f74402459 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:4f:0b,bridge_name='br-int',has_traffic_filtering=True,id=c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a,network=Network(17352d7d-ab4a-4f2a-b647-e9fa7d9c355d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63ac7d6-ae') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc63ac7d6-ae, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=92e014a3-fbbb-48d6-a4a6-182f2b9b18c9) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:15:50 user nova-compute[75100]: INFO os_vif [None req-92537e72-e557-461b-b895-ae1f74402459 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:4f:0b,bridge_name='br-int',has_traffic_filtering=True,id=c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a,network=Network(17352d7d-ab4a-4f2a-b647-e9fa7d9c355d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63ac7d6-ae')
Nov 10 18:15:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92537e72-e557-461b-b895-ae1f74402459 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-92537e72-e557-461b-b895-ae1f74402459 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, {'target_iqn': 'iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NaXenRKr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:15:50 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-92537e72-e557-461b-b895-ae1f74402459 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:15:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-92537e72-e557-461b-b895-ae1f74402459 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-92537e72-e557-461b-b895-ae1f74402459 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG nova.compute.manager [req-089d759a-6722-4d26-96db-d32a96c03ab4 req-e0c2ee9a-b24f-4f4a-8aa0-4e50b23fa54e service nova] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Received event network-changed-c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG nova.compute.manager [req-089d759a-6722-4d26-96db-d32a96c03ab4 req-e0c2ee9a-b24f-4f4a-8aa0-4e50b23fa54e service nova] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Refreshing instance network info cache due to event network-changed-c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-089d759a-6722-4d26-96db-d32a96c03ab4 req-e0c2ee9a-b24f-4f4a-8aa0-4e50b23fa54e service nova] Acquiring lock "refresh_cache-8f04a49b-8124-4319-a4b2-b40786984c00" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-089d759a-6722-4d26-96db-d32a96c03ab4 req-e0c2ee9a-b24f-4f4a-8aa0-4e50b23fa54e service nova] Acquired lock "refresh_cache-8f04a49b-8124-4319-a4b2-b40786984c00" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG nova.network.neutron [req-089d759a-6722-4d26-96db-d32a96c03ab4 req-e0c2ee9a-b24f-4f4a-8aa0-4e50b23fa54e service nova] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Refreshing network info cache for port c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[737bac3f-11d1-4e5c-8ed5-56ecd5bc0978]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-92537e72-e557-461b-b895-ae1f74402459 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 18:15:50 user nova-compute[75100]: No targets found.
Nov 10 18:15:50 user nova-compute[75100]: iSNS:
Nov 10 18:15:50 user nova-compute[75100]: No targets found.
Nov 10 18:15:50 user nova-compute[75100]: STATIC:
Nov 10 18:15:50 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e
Nov 10 18:15:50 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:15:50 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:15:50 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e
Nov 10 18:15:50 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:15:50 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:15:50 user nova-compute[75100]: FIRMWARE:
Nov 10 18:15:50 user nova-compute[75100]: No targets found.
Nov 10 18:15:50 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-92537e72-e557-461b-b895-ae1f74402459 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 18:15:50 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 18:15:50 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-92537e72-e557-461b-b895-ae1f74402459 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[68017ca2-cba2-4524-be2f-38a41f6145dc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9c4f90-8955-4659-bac2-0722c964cfe4]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-92537e72-e557-461b-b895-ae1f74402459 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e (non-flash)
Nov 10 18:15:50 user nova-compute[75100]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e (non-flash)
Nov 10 18:15:50 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-92537e72-e557-461b-b895-ae1f74402459 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e (non-flash)
Nov 10 18:15:50 user nova-compute[75100]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e (non-flash)
Nov 10 18:15:50 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-92537e72-e557-461b-b895-ae1f74402459 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3bc61da20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e'): ({'sdb'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-92537e72-e557-461b-b895-ae1f74402459 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Removing single pathed devices sdb {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[240cf7d8-2808-4eab-a67f-e5bc448a93c1]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a86205-92dc-4cc2-9cd8-26291176c2bb]: (4, ('ok\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-92537e72-e557-461b-b895-ae1f74402459 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Flushing IO for device /dev/sdb {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[323e2362-f2f9-4ce2-9176-cd0dbc3784c4]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-92537e72-e557-461b-b895-ae1f74402459 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf6b984-4dc4-4af2-9094-a0b2eb78a187]: (4, ('1', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-92537e72-e557-461b-b895-ae1f74402459 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-92537e72-e557-461b-b895-ae1f74402459 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-92537e72-e557-461b-b895-ae1f74402459 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[147bbd7e-722a-4b4b-b909-64ce26b4685c]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-92537e72-e557-461b-b895-ae1f74402459 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e -p 172.16.0.220:3260 --logout {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f872683-894d-49c6-83b3-f98eb84d21f2]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-92537e72-e557-461b-b895-ae1f74402459 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e, portal: 172.16.0.220,3260]
Nov 10 18:15:50 user nova-compute[75100]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e, portal: 172.16.0.220,3260] successful.
Nov 10 18:15:50 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e -p 172.16.0.220:3260 --op delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b2fe92-e726-42a0-8307-3ab5aadc3107]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-92537e72-e557-461b-b895-ae1f74402459 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-92537e72-e557-461b-b895-ae1f74402459 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-92537e72-e557-461b-b895-ae1f74402459 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] <== disconnect_volume: return (299ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92537e72-e557-461b-b895-ae1f74402459 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 18:15:50 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-92537e72-e557-461b-b895-ae1f74402459 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Deleting instance files /opt/stack/data/nova/instances/8f04a49b-8124-4319-a4b2-b40786984c00_del
Nov 10 18:15:50 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-92537e72-e557-461b-b895-ae1f74402459 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Deletion of /opt/stack/data/nova/instances/8f04a49b-8124-4319-a4b2-b40786984c00_del complete
Nov 10 18:15:50 user nova-compute[75100]: DEBUG nova.network.neutron [req-089d759a-6722-4d26-96db-d32a96c03ab4 req-e0c2ee9a-b24f-4f4a-8aa0-4e50b23fa54e service nova] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Updated VIF entry in instance network info cache for port c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG nova.network.neutron [req-089d759a-6722-4d26-96db-d32a96c03ab4 req-e0c2ee9a-b24f-4f4a-8aa0-4e50b23fa54e service nova] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Updating instance_info_cache with network_info: [{"id": "c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a", "address": "fa:16:3e:16:4f:0b", "network": {"id": "17352d7d-ab4a-4f2a-b647-e9fa7d9c355d", "bridge": null, "label": "tempest-TestShelveInstance-756457394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88550719c2fd46d6a4e4dd8038fdad78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapc63ac7d6-ae", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-089d759a-6722-4d26-96db-d32a96c03ab4 req-e0c2ee9a-b24f-4f4a-8aa0-4e50b23fa54e service nova] Releasing lock "refresh_cache-8f04a49b-8124-4319-a4b2-b40786984c00" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG nova.compute.manager [req-2194255c-068d-43b8-9b4f-7b74324825ee req-33596209-5041-4a1b-a4cf-8c7c7205f77b service nova] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Received event network-vif-plugged-c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2194255c-068d-43b8-9b4f-7b74324825ee req-33596209-5041-4a1b-a4cf-8c7c7205f77b service nova] Acquiring lock "8f04a49b-8124-4319-a4b2-b40786984c00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2194255c-068d-43b8-9b4f-7b74324825ee req-33596209-5041-4a1b-a4cf-8c7c7205f77b service nova] Lock "8f04a49b-8124-4319-a4b2-b40786984c00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2194255c-068d-43b8-9b4f-7b74324825ee req-33596209-5041-4a1b-a4cf-8c7c7205f77b service nova] Lock "8f04a49b-8124-4319-a4b2-b40786984c00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:15:50 user nova-compute[75100]: DEBUG nova.compute.manager [req-2194255c-068d-43b8-9b4f-7b74324825ee req-33596209-5041-4a1b-a4cf-8c7c7205f77b service nova] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] No waiting events found dispatching network-vif-plugged-c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:15:50 user nova-compute[75100]: WARNING nova.compute.manager [req-2194255c-068d-43b8-9b4f-7b74324825ee req-33596209-5041-4a1b-a4cf-8c7c7205f77b service nova] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Received unexpected event network-vif-plugged-c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a for instance with vm_state active and task_state shelving.
Nov 10 18:15:51 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-92537e72-e557-461b-b895-ae1f74402459 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Deleted allocations for instance 8f04a49b-8124-4319-a4b2-b40786984c00
Nov 10 18:15:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-92537e72-e557-461b-b895-ae1f74402459 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:15:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-92537e72-e557-461b-b895-ae1f74402459 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:15:51 user nova-compute[75100]: DEBUG nova.objects.instance [None req-92537e72-e557-461b-b895-ae1f74402459 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Lazy-loading 'numa_topology' on Instance uuid 8f04a49b-8124-4319-a4b2-b40786984c00 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:15:51 user nova-compute[75100]: DEBUG nova.objects.base [None req-92537e72-e557-461b-b895-ae1f74402459 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Object Instance<8f04a49b-8124-4319-a4b2-b40786984c00> lazy-loaded attributes: resources,numa_topology {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 18:15:51 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-92537e72-e557-461b-b895-ae1f74402459 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:15:51 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-92537e72-e557-461b-b895-ae1f74402459 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:15:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-92537e72-e557-461b-b895-ae1f74402459 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.154s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:15:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-92537e72-e557-461b-b895-ae1f74402459 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Lock "8f04a49b-8124-4319-a4b2-b40786984c00" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.400s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:15:54 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:15:54 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Cleaning up deleted instances {{(pid=75100) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 18:15:54 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] There are 0 instances to clean {{(pid=75100) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 18:15:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:15:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:16:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:16:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:16:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:16:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:16:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:16:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:16:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:16:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:16:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:16:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:16:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:16:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:16:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:16:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:16:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:16:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:16:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:16:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:16:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:16:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:16:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:16:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:16:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:16:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:16:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:16:31 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:16:32 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:16:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:16:38 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:16:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:16:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:16:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:16:38 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 18:16:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:16:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:16:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:16:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:16:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 18:16:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1220ad0e-3f5e-4d47-be01-4652e2390e87/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:16:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1220ad0e-3f5e-4d47-be01-4652e2390e87/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:16:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1220ad0e-3f5e-4d47-be01-4652e2390e87/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:16:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1220ad0e-3f5e-4d47-be01-4652e2390e87/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:16:39 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:16:39 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:16:39 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Hypervisor/Node resource view: name=user free_ram=8820MB free_disk=24.42135238647461GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 18:16:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:16:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:16:39 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance fb6b4d45-7c2b-4211-9939-9989a6a3c913 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:16:39 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 1220ad0e-3f5e-4d47-be01-4652e2390e87 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:16:39 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 18:16:39 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 18:16:39 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Refreshing inventories for resource provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 18:16:39 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Updating ProviderTree inventory for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 18:16:39 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Updating inventory in ProviderTree for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 18:16:39 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Refreshing aggregate associations for resource provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64, aggregates: None {{(pid=75100) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 18:16:39 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Refreshing trait associations for resource provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2 {{(pid=75100) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 18:16:39 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:16:39 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:16:39 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 18:16:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.354s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:16:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:16:44 user nova-compute[75100]: DEBUG nova.compute.manager [req-cfe3308c-e2fa-4f8a-aa27-d7d6d9454f03 req-6afbe65c-593d-4e7f-9fea-ce0c8fd04e3b service nova] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] Received event network-changed-b40ca80d-b78e-4bcc-ac31-203a76ebf3b7 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:16:44 user nova-compute[75100]: DEBUG nova.compute.manager [req-cfe3308c-e2fa-4f8a-aa27-d7d6d9454f03 req-6afbe65c-593d-4e7f-9fea-ce0c8fd04e3b service nova] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] Refreshing instance network info cache due to event network-changed-b40ca80d-b78e-4bcc-ac31-203a76ebf3b7. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 18:16:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cfe3308c-e2fa-4f8a-aa27-d7d6d9454f03 req-6afbe65c-593d-4e7f-9fea-ce0c8fd04e3b service nova] Acquiring lock "refresh_cache-1220ad0e-3f5e-4d47-be01-4652e2390e87" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:16:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cfe3308c-e2fa-4f8a-aa27-d7d6d9454f03 req-6afbe65c-593d-4e7f-9fea-ce0c8fd04e3b service nova] Acquired lock "refresh_cache-1220ad0e-3f5e-4d47-be01-4652e2390e87" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:16:44 user nova-compute[75100]: DEBUG nova.network.neutron [req-cfe3308c-e2fa-4f8a-aa27-d7d6d9454f03 req-6afbe65c-593d-4e7f-9fea-ce0c8fd04e3b service nova] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] Refreshing network info cache for port b40ca80d-b78e-4bcc-ac31-203a76ebf3b7 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 18:16:44 user nova-compute[75100]: DEBUG nova.network.neutron [req-cfe3308c-e2fa-4f8a-aa27-d7d6d9454f03 req-6afbe65c-593d-4e7f-9fea-ce0c8fd04e3b service nova] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] Updated VIF entry in instance network info cache for port b40ca80d-b78e-4bcc-ac31-203a76ebf3b7. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 18:16:44 user nova-compute[75100]: DEBUG nova.network.neutron [req-cfe3308c-e2fa-4f8a-aa27-d7d6d9454f03 req-6afbe65c-593d-4e7f-9fea-ce0c8fd04e3b service nova] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] Updating instance_info_cache with network_info: [{"id": "b40ca80d-b78e-4bcc-ac31-203a76ebf3b7", "address": "fa:16:3e:6d:45:a1", "network": {"id": "e906a397-504d-48d8-8726-187cfbb1f270", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2095832274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4e5cb8bdc24a009dcb3dbee36a6bce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb40ca80d-b7", "ovs_interfaceid": "b40ca80d-b78e-4bcc-ac31-203a76ebf3b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:16:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cfe3308c-e2fa-4f8a-aa27-d7d6d9454f03 req-6afbe65c-593d-4e7f-9fea-ce0c8fd04e3b service nova] Releasing lock "refresh_cache-1220ad0e-3f5e-4d47-be01-4652e2390e87" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:16:44 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:16:44 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:16:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:16:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:16:45 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:16:46 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:16:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:16:49 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:16:49 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 18:16:49 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Skipping network cache update for instance because it has been migrated to another host. {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9966}}
Nov 10 18:16:49 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Didn't find any instances for network info cache update. {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 18:16:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:16:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:16:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-57f5b502-eaa4-41e1-ad8c-f7effdf51f0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Acquiring lock "1220ad0e-3f5e-4d47-be01-4652e2390e87" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:16:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-57f5b502-eaa4-41e1-ad8c-f7effdf51f0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "1220ad0e-3f5e-4d47-be01-4652e2390e87" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:16:50 user nova-compute[75100]: DEBUG nova.objects.instance [None req-57f5b502-eaa4-41e1-ad8c-f7effdf51f0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lazy-loading 'flavor' on Instance uuid 1220ad0e-3f5e-4d47-be01-4652e2390e87 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:16:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-57f5b502-eaa4-41e1-ad8c-f7effdf51f0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "1220ad0e-3f5e-4d47-be01-4652e2390e87" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:16:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:16:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-57f5b502-eaa4-41e1-ad8c-f7effdf51f0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Acquiring lock "1220ad0e-3f5e-4d47-be01-4652e2390e87" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:16:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-57f5b502-eaa4-41e1-ad8c-f7effdf51f0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "1220ad0e-3f5e-4d47-be01-4652e2390e87" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:16:50 user nova-compute[75100]: INFO nova.compute.manager [None req-57f5b502-eaa4-41e1-ad8c-f7effdf51f0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] Attaching volume c3cfc5cd-645a-41a1-a4e7-74d3833a2218 to /dev/vdb
Nov 10 18:16:50 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:16:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:16:50 user nova-compute[75100]: DEBUG os_brick.utils [None req-57f5b502-eaa4-41e1-ad8c-f7effdf51f0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:16:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:16:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:16:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[61632e46-62a9-4caf-8e45-5b09984460b2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90b1a229568f\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:16:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:16:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:16:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a541dd1b-7a19-4904-8c0d-5e842d86612c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:16:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:16:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:16:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a10c1d-124a-46e3-a6d3-e289978c1c54]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:16:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e63c85-5757-47dd-8cf0-ff6a13afafe0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:16:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-57f5b502-eaa4-41e1-ad8c-f7effdf51f0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:16:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-57f5b502-eaa4-41e1-ad8c-f7effdf51f0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 18:16:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-57f5b502-eaa4-41e1-ad8c-f7effdf51f0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 18:16:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:16:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 18:16:50 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 18:16:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3022b87c-3803-4da1-8777-db889fec8e98]: (4, '') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:16:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-57f5b502-eaa4-41e1-ad8c-f7effdf51f0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 18:16:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-57f5b502-eaa4-41e1-ad8c-f7effdf51f0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 18:16:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-57f5b502-eaa4-41e1-ad8c-f7effdf51f0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 18:16:50 user nova-compute[75100]: DEBUG os_brick.utils [None req-57f5b502-eaa4-41e1-ad8c-f7effdf51f0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90b1a229568f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:16:50 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-57f5b502-eaa4-41e1-ad8c-f7effdf51f0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] Updating existing volume attachment record: 63345f05-6818-4fdf-88a9-56a32ba66454 {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 18:16:51 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:16:51 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 18:16:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:16:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:17:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:17:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:17:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:17:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:17:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:17:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:17:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:17:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:17:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:17:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:17:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:17:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:17:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:17:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:17:14 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57f5b502-eaa4-41e1-ad8c-f7effdf51f0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 18:17:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f5b502-eaa4-41e1-ad8c-f7effdf51f0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c3cfc5cd-645a-41a1-a4e7-74d3833a2218', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hMQaZdxm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:17:14 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-57f5b502-eaa4-41e1-ad8c-f7effdf51f0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:17:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-57f5b502-eaa4-41e1-ad8c-f7effdf51f0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:17:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-57f5b502-eaa4-41e1-ad8c-f7effdf51f0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:17:14 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-57f5b502-eaa4-41e1-ad8c-f7effdf51f0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:17:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-57f5b502-eaa4-41e1-ad8c-f7effdf51f0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3cfc5cd-645a-41a1-a4e7-74d3833a2218" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:17:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-57f5b502-eaa4-41e1-ad8c-f7effdf51f0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3cfc5cd-645a-41a1-a4e7-74d3833a2218" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:17:14 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-57f5b502-eaa4-41e1-ad8c-f7effdf51f0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 18:17:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3cfc5cd-645a-41a1-a4e7-74d3833a2218 -p 172.16.0.220:3260 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:17:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3cfc5cd-645a-41a1-a4e7-74d3833a2218 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:17:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[26474990-c230-4eb9-aa46-9a905864cc8d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:17:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f5b502-eaa4-41e1-ad8c-f7effdf51f0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 18:17:14 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:17:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3cfc5cd-645a-41a1-a4e7-74d3833a2218 -p 172.16.0.220:3260 --interface default --op new {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:17:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3cfc5cd-645a-41a1-a4e7-74d3833a2218 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:17:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d356799-38ae-4fac-8f9a-24b392cdee3f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3cfc5cd-645a-41a1-a4e7-74d3833a2218] added\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:17:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f5b502-eaa4-41e1-ad8c-f7effdf51f0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3cfc5cd-645a-41a1-a4e7-74d3833a2218] added
Nov 10 18:17:14 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:17:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3cfc5cd-645a-41a1-a4e7-74d3833a2218 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:17:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3cfc5cd-645a-41a1-a4e7-74d3833a2218 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:17:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[63cabbcd-47dd-4186-91a0-7792e3b5e506]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:17:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f5b502-eaa4-41e1-ad8c-f7effdf51f0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:17:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3cfc5cd-645a-41a1-a4e7-74d3833a2218 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:17:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3cfc5cd-645a-41a1-a4e7-74d3833a2218 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:17:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c02b71ab-a894-4af0-a01b-b635070536d4]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:17:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f5b502-eaa4-41e1-ad8c-f7effdf51f0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:17:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3cfc5cd-645a-41a1-a4e7-74d3833a2218 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hMQaZdxm {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:17:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3cfc5cd-645a-41a1-a4e7-74d3833a2218 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hMQaZdxm" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:17:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50908eb-95fd-4972-80cb-32bab35ba039]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:17:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f5b502-eaa4-41e1-ad8c-f7effdf51f0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hMQaZdxm'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:17:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3cfc5cd-645a-41a1-a4e7-74d3833a2218 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:17:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3cfc5cd-645a-41a1-a4e7-74d3833a2218 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:17:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[593aa1f2-ae94-49aa-aebf-10dbff6ae33f]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:17:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f5b502-eaa4-41e1-ad8c-f7effdf51f0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:17:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:17:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:17:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d418f1-cb8f-45c6-8486-f46afeb84cb0]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:17:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f5b502-eaa4-41e1-ad8c-f7effdf51f0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e (non-flash)
Nov 10 18:17:14 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:17:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f5b502-eaa4-41e1-ad8c-f7effdf51f0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e (non-flash)
Nov 10 18:17:14 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:17:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3cfc5cd-645a-41a1-a4e7-74d3833a2218 -p 172.16.0.220:3260 --login {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:17:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3cfc5cd-645a-41a1-a4e7-74d3833a2218 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:17:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d77ecc-1612-4ebd-a4ef-ff09c94d5533]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3cfc5cd-645a-41a1-a4e7-74d3833a2218, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c3cfc5cd-645a-41a1-a4e7-74d3833a2218, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:17:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f5b502-eaa4-41e1-ad8c-f7effdf51f0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3cfc5cd-645a-41a1-a4e7-74d3833a2218, portal: 172.16.0.220,3260]
Nov 10 18:17:14 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:c3cfc5cd-645a-41a1-a4e7-74d3833a2218, portal: 172.16.0.220,3260] successful.
Nov 10 18:17:14 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:17:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3cfc5cd-645a-41a1-a4e7-74d3833a2218 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:17:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3cfc5cd-645a-41a1-a4e7-74d3833a2218 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:17:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6b933f-05ad-4aff-bdeb-047ede379b82]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:17:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f5b502-eaa4-41e1-ad8c-f7effdf51f0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:17:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:17:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:17:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3ec328-4e2a-4dc8-b98f-10f7e308c2ef]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfc5cd-645a-41a1-a4e7-74d3833a2218 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:17:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f5b502-eaa4-41e1-ad8c-f7effdf51f0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e (non-flash)
Nov 10 18:17:14 user nova-compute[75100]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfc5cd-645a-41a1-a4e7-74d3833a2218 (non-flash)
Nov 10 18:17:14 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:17:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f5b502-eaa4-41e1-ad8c-f7effdf51f0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e (non-flash)
Nov 10 18:17:14 user nova-compute[75100]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfc5cd-645a-41a1-a4e7-74d3833a2218 (non-flash)
Nov 10 18:17:14 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:17:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-57f5b502-eaa4-41e1-ad8c-f7effdf51f0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3cfc5cd-645a-41a1-a4e7-74d3833a2218" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:17:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f5b502-eaa4-41e1-ad8c-f7effdf51f0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 18:17:14 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-57f5b502-eaa4-41e1-ad8c-f7effdf51f0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 18:17:14 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-57f5b502-eaa4-41e1-ad8c-f7effdf51f0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 18:17:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:17:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:17:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d366881b-aaa3-46c5-a4fb-0eabe7c3b605]: (4, ('- - 0', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:17:14 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-57f5b502-eaa4-41e1-ad8c-f7effdf51f0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 18:17:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f5b502-eaa4-41e1-ad8c-f7effdf51f0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c3cfc5cd-645a-41a1-a4e7-74d3833a2218', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hMQaZdxm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 18:17:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:17:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:17:15 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-57f5b502-eaa4-41e1-ad8c-f7effdf51f0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:17:15 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f5b502-eaa4-41e1-ad8c-f7effdf51f0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '23736626362373130', 'path': '/dev/sdb'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:17:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57f5b502-eaa4-41e1-ad8c-f7effdf51f0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736626362373130', 'path': '/dev/sdb'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 18:17:15 user nova-compute[75100]: DEBUG nova.objects.instance [None req-57f5b502-eaa4-41e1-ad8c-f7effdf51f0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lazy-loading 'flavor' on Instance uuid 1220ad0e-3f5e-4d47-be01-4652e2390e87 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:17:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-57f5b502-eaa4-41e1-ad8c-f7effdf51f0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 18:17:15 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:17:15 user nova-compute[75100]:   <source dev="/dev/sdb"/>
Nov 10 18:17:15 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 18:17:15 user nova-compute[75100]:   <serial>c3cfc5cd-645a-41a1-a4e7-74d3833a2218</serial>
Nov 10 18:17:15 user nova-compute[75100]: </disk>
Nov 10 18:17:15 user nova-compute[75100]:  {{(pid=75100) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 18:17:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-57f5b502-eaa4-41e1-ad8c-f7effdf51f0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 18:17:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-57f5b502-eaa4-41e1-ad8c-f7effdf51f0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 18:17:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-57f5b502-eaa4-41e1-ad8c-f7effdf51f0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] No VIF found with MAC fa:16:3e:6d:45:a1, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 18:17:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-57f5b502-eaa4-41e1-ad8c-f7effdf51f0b tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "1220ad0e-3f5e-4d47-be01-4652e2390e87" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.678s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:17:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-75ffeee3-2a83-49ee-b8bd-881a802df7c7 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Acquiring lock "1220ad0e-3f5e-4d47-be01-4652e2390e87" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:17:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-75ffeee3-2a83-49ee-b8bd-881a802df7c7 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "1220ad0e-3f5e-4d47-be01-4652e2390e87" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:17:16 user nova-compute[75100]: INFO nova.compute.manager [None req-75ffeee3-2a83-49ee-b8bd-881a802df7c7 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] Detaching volume c3cfc5cd-645a-41a1-a4e7-74d3833a2218
Nov 10 18:17:16 user nova-compute[75100]: INFO nova.virt.block_device [None req-75ffeee3-2a83-49ee-b8bd-881a802df7c7 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] Attempting to driver detach volume c3cfc5cd-645a-41a1-a4e7-74d3833a2218 from mountpoint /dev/vdb
Nov 10 18:17:16 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-75ffeee3-2a83-49ee-b8bd-881a802df7c7 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Attempting to detach device vdb from instance 1220ad0e-3f5e-4d47-be01-4652e2390e87 from the persistent domain config. {{(pid=75100) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 18:17:16 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-75ffeee3-2a83-49ee-b8bd-881a802df7c7 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 18:17:16 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:17:16 user nova-compute[75100]:   <source dev="/dev/sdb"/>
Nov 10 18:17:16 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 18:17:16 user nova-compute[75100]:   <serial>c3cfc5cd-645a-41a1-a4e7-74d3833a2218</serial>
Nov 10 18:17:16 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 18:17:16 user nova-compute[75100]: </disk>
Nov 10 18:17:16 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 18:17:16 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-75ffeee3-2a83-49ee-b8bd-881a802df7c7 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Successfully detached device vdb from instance 1220ad0e-3f5e-4d47-be01-4652e2390e87 from the persistent domain config.
Nov 10 18:17:16 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-75ffeee3-2a83-49ee-b8bd-881a802df7c7 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1220ad0e-3f5e-4d47-be01-4652e2390e87 from the live domain config. {{(pid=75100) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 18:17:16 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-75ffeee3-2a83-49ee-b8bd-881a802df7c7 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 18:17:16 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:17:16 user nova-compute[75100]:   <source dev="/dev/sdb"/>
Nov 10 18:17:16 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 18:17:16 user nova-compute[75100]:   <serial>c3cfc5cd-645a-41a1-a4e7-74d3833a2218</serial>
Nov 10 18:17:16 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 18:17:16 user nova-compute[75100]: </disk>
Nov 10 18:17:16 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 18:17:16 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-75ffeee3-2a83-49ee-b8bd-881a802df7c7 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1220ad0e-3f5e-4d47-be01-4652e2390e87 {{(pid=75100) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 18:17:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:17:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:17:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:17:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:17:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:17:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:17:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:17:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:17:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:17:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:17:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:17:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:17:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:17:31 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:17:32 user nova-compute[75100]: DEBUG nova.objects.instance [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lazy-loading 'flavor' on Instance uuid fb6b4d45-7c2b-4211-9939-9989a6a3c913 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:17:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Acquiring lock "refresh_cache-fb6b4d45-7c2b-4211-9939-9989a6a3c913" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:17:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Acquired lock "refresh_cache-fb6b4d45-7c2b-4211-9939-9989a6a3c913" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:17:32 user nova-compute[75100]: DEBUG nova.network.neutron [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 18:17:32 user nova-compute[75100]: DEBUG nova.objects.instance [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lazy-loading 'info_cache' on Instance uuid fb6b4d45-7c2b-4211-9939-9989a6a3c913 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:17:32 user nova-compute[75100]: DEBUG nova.objects.base [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Object Instance<fb6b4d45-7c2b-4211-9939-9989a6a3c913> lazy-loaded attributes: flavor,info_cache {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 18:17:33 user nova-compute[75100]: DEBUG nova.network.neutron [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Updating instance_info_cache with network_info: [{"id": "64ffd205-85a8-4c33-8ec4-40f8519b0bd5", "address": "fa:16:3e:d6:d0:ff", "network": {"id": "0c411791-eb03-4e00-9d7f-d032e2c16d46", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1808141765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc6fc8310f44f3788e13aa4f1eb8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ffd205-85", "ovs_interfaceid": "64ffd205-85a8-4c33-8ec4-40f8519b0bd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:17:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Releasing lock "refresh_cache-fb6b4d45-7c2b-4211-9939-9989a6a3c913" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:17:33 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Instance destroyed successfully.
Nov 10 18:17:33 user nova-compute[75100]: DEBUG nova.objects.instance [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lazy-loading 'resources' on Instance uuid fb6b4d45-7c2b-4211-9939-9989a6a3c913 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:17:33 user nova-compute[75100]: DEBUG nova.objects.base [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Object Instance<fb6b4d45-7c2b-4211-9939-9989a6a3c913> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 18:17:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:13:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1135440047',display_name='tempest-AttachVolumeTestJSON-server-1135440047',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1135440047',id=46,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcNRutHNHeVY/scgmxR9G4KJoQs59QhgQZEw5FvsqZrAjpQ/2uGeVsJVaEeZoz53+Lx9VAPkikUDH6vDzggddQ9KuRG+0ma+NlYbiZWBP5qgm948UdG/c0syluE8zjWJA==',key_name='tempest-keypair-1049460111',keypairs=<?>,launch_index=0,launched_at=2023-11-10T18:13:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='8cc6fc8310f44f3788e13aa4f1eb8c96',ramdisk_id='',reservation_id='r-nozvlwff',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-375321786',owner_user_name='tempest-AttachVolumeTestJSON-375321786-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T18:15:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='20c5bb15b9174fbc9df8ba12de10cea6',uuid=fb6b4d45-7c2b-4211-9939-9989a6a3c913,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "64ffd205-85a8-4c33-8ec4-40f8519b0bd5", "address": "fa:16:3e:d6:d0:ff", "network": {"id": "0c411791-eb03-4e00-9d7f-d032e2c16d46", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1808141765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc6fc8310f44f3788e13aa4f1eb8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ffd205-85", "ovs_interfaceid": "64ffd205-85a8-4c33-8ec4-40f8519b0bd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 18:17:33 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Converting VIF {"id": "64ffd205-85a8-4c33-8ec4-40f8519b0bd5", "address": "fa:16:3e:d6:d0:ff", "network": {"id": "0c411791-eb03-4e00-9d7f-d032e2c16d46", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1808141765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc6fc8310f44f3788e13aa4f1eb8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ffd205-85", "ovs_interfaceid": "64ffd205-85a8-4c33-8ec4-40f8519b0bd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:17:33 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:d0:ff,bridge_name='br-int',has_traffic_filtering=True,id=64ffd205-85a8-4c33-8ec4-40f8519b0bd5,network=Network(0c411791-eb03-4e00-9d7f-d032e2c16d46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64ffd205-85') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:17:33 user nova-compute[75100]: DEBUG os_vif [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:d0:ff,bridge_name='br-int',has_traffic_filtering=True,id=64ffd205-85a8-4c33-8ec4-40f8519b0bd5,network=Network(0c411791-eb03-4e00-9d7f-d032e2c16d46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64ffd205-85') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 18:17:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:17:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap64ffd205-85, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:17:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:17:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:17:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:17:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7b5279c0-cc43-4eee-8611-dae499589245) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:17:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:17:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:17:33 user nova-compute[75100]: INFO os_vif [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:d0:ff,bridge_name='br-int',has_traffic_filtering=True,id=64ffd205-85a8-4c33-8ec4-40f8519b0bd5,network=Network(0c411791-eb03-4e00-9d7f-d032e2c16d46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64ffd205-85')
Nov 10 18:17:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 18:17:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, {'target_iqn': 'iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oYSOkxne', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:17:33 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:17:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:17:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:17:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:17:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:17:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3fe0f33-d1e8-4acc-bd9e-e1d77076fd40]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c3cfc5cd-645a-41a1-a4e7-74d3833a2218\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:17:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 18:17:33 user nova-compute[75100]: No targets found.
Nov 10 18:17:33 user nova-compute[75100]: iSNS:
Nov 10 18:17:33 user nova-compute[75100]: No targets found.
Nov 10 18:17:33 user nova-compute[75100]: STATIC:
Nov 10 18:17:33 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:c3cfc5cd-645a-41a1-a4e7-74d3833a2218
Nov 10 18:17:33 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:17:33 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:17:33 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e
Nov 10 18:17:33 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:17:33 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:17:33 user nova-compute[75100]: FIRMWARE:
Nov 10 18:17:33 user nova-compute[75100]: No targets found.
Nov 10 18:17:33 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:17:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 18:17:33 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 18:17:33 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 18:17:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 18:17:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:17:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:17:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5116cfc-ac38-490f-8124-8d206830ad9b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3cfc5cd-645a-41a1-a4e7-74d3833a2218\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:17:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:17:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:17:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c65ab9d-0b1f-4653-a793-edee131bb346]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfc5cd-645a-41a1-a4e7-74d3833a2218 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:17:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e (non-flash)
Nov 10 18:17:33 user nova-compute[75100]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfc5cd-645a-41a1-a4e7-74d3833a2218 (non-flash)
Nov 10 18:17:33 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:17:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e (non-flash)
Nov 10 18:17:33 user nova-compute[75100]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfc5cd-645a-41a1-a4e7-74d3833a2218 (non-flash)
Nov 10 18:17:33 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:17:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3986b0790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e'): ({'sdc'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 18:17:33 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Removing single pathed devices sdc {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 18:17:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:17:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:17:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad27eda-f1b2-4175-9411-283d4651ea03]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:17:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:17:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:17:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[439686f6-2fc6-4ba7-b51d-9a059552cfef]: (4, ('ok\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:17:33 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Flushing IO for device /dev/sdc {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 18:17:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:17:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:17:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded6eb4c-d00b-4804-bf7a-1d676259b6fd]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:17:33 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 18:17:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:17:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:17:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[141600eb-01f5-44e5-9436-0106b2ec5e18]: (4, ('1', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:17:33 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 18:17:33 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] SCSI volumes sdc have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 18:17:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 18:17:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:17:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:17:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0d0c7e-741f-4e49-9553-30cef4e83244]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:17:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:17:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e -p 172.16.0.220:3260 --logout {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b090946-a226-4726-abad-a243dd72654e]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e, portal: 172.16.0.220,3260]
Nov 10 18:17:34 user nova-compute[75100]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e, portal: 172.16.0.220,3260] successful.
Nov 10 18:17:34 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e -p 172.16.0.220:3260 --op delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd4c368-96fd-40e5-a82d-e212f80fa93f]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] <== disconnect_volume: return (320ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Start _get_guest_xml network_info=[{"id": "64ffd205-85a8-4c33-8ec4-40f8519b0bd5", "address": "fa:16:3e:d6:d0:ff", "network": {"id": "0c411791-eb03-4e00-9d7f-d032e2c16d46", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1808141765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc6fc8310f44f3788e13aa4f1eb8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ffd205-85", "ovs_interfaceid": "64ffd205-85a8-4c33-8ec4-40f8519b0bd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'e3cc5321-4d40-49ee-885c-700e14741732'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oYSOkxne', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'fb6b4d45-7c2b-4211-9939-9989a6a3c913', 'attached_at': '', 'detached_at': '', 'volume_id': 'fc0ab4ad-3373-400c-a672-07ef9b16555e', 'serial': 'fc0ab4ad-3373-400c-a672-07ef9b16555e'}, 'mount_device': '/dev/vdb', 'attachment_id': 'c42fbfb5-9d8d-4c5f-953b-a78eb784e70c', 'device_type': 'disk', 'guest_format': None, 'boot_index': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG nova.objects.instance [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lazy-loading 'numa_topology' on Instance uuid fb6b4d45-7c2b-4211-9939-9989a6a3c913 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG nova.objects.base [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Object Instance<fb6b4d45-7c2b-4211-9939-9989a6a3c913> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 18:17:34 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:17:34 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:17:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T17:40:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG nova.objects.instance [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lazy-loading 'vcpu_model' on Instance uuid fb6b4d45-7c2b-4211-9939-9989a6a3c913 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG nova.objects.base [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Object Instance<fb6b4d45-7c2b-4211-9939-9989a6a3c913> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oYSOkxne', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:17:34 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:17:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:17:34 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:17:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:17:34 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 18:17:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e -p 172.16.0.220:3260 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[81328020-1c9d-4a8b-8111-50b13b4c43da]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 18:17:34 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e -p 172.16.0.220:3260 --interface default --op new {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f0b601-933d-427d-9eee-e4dbe585ece2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e] added\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e] added
Nov 10 18:17:34 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[acbc59b0-bbcf-4f80-baa0-de88246495e4]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d5c156-3e67-4a6e-86b4-d578ec62516d]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oYSOkxne {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oYSOkxne" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f734ab2-af2c-45da-ac14-0742e604df1a]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oYSOkxne'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba7df16-2316-4247-9217-b2f368064ca9]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a55479d-bcc4-4561-8fb5-59d380ad8d12]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfc5cd-645a-41a1-a4e7-74d3833a2218 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfc5cd-645a-41a1-a4e7-74d3833a2218 (non-flash)
Nov 10 18:17:34 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfc5cd-645a-41a1-a4e7-74d3833a2218 (non-flash)
Nov 10 18:17:34 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e -p 172.16.0.220:3260 --login {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d881528-f2cf-4b5d-844f-5aa39c6989c9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e, portal: 172.16.0.220,3260]
Nov 10 18:17:34 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e, portal: 172.16.0.220,3260] successful.
Nov 10 18:17:34 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9616f11e-4a86-47fe-a547-f94962353cc9]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6219faa8-b717-4b45-bcd9-94b0a082b988]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfc5cd-645a-41a1-a4e7-74d3833a2218 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfc5cd-645a-41a1-a4e7-74d3833a2218 (non-flash)
Nov 10 18:17:34 user nova-compute[75100]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e (non-flash)
Nov 10 18:17:34 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfc5cd-645a-41a1-a4e7-74d3833a2218 (non-flash)
Nov 10 18:17:34 user nova-compute[75100]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e (non-flash)
Nov 10 18:17:34 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] HCTL ('34', '-', '-', 0) found on session 43 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e834f45-a36b-4f63-b0c4-a4aef3fcfa6b]: (4, ('- - 0', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 18:17:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oYSOkxne', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 18:17:35 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:17:35 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '26663323262643462', 'path': '/dev/sdc'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:17:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26663323262643462', 'path': '/dev/sdc'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 18:17:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:13:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1135440047',display_name='tempest-AttachVolumeTestJSON-server-1135440047',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1135440047',id=46,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcNRutHNHeVY/scgmxR9G4KJoQs59QhgQZEw5FvsqZrAjpQ/2uGeVsJVaEeZoz53+Lx9VAPkikUDH6vDzggddQ9KuRG+0ma+NlYbiZWBP5qgm948UdG/c0syluE8zjWJA==',key_name='tempest-keypair-1049460111',keypairs=<?>,launch_index=0,launched_at=2023-11-10T18:13:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='8cc6fc8310f44f3788e13aa4f1eb8c96',ramdisk_id='',reservation_id='r-nozvlwff',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-375321786',owner_user_name='tempest-AttachVolumeTestJSON-375321786-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T18:15:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='20c5bb15b9174fbc9df8ba12de10cea6',uuid=fb6b4d45-7c2b-4211-9939-9989a6a3c913,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "64ffd205-85a8-4c33-8ec4-40f8519b0bd5", "address": "fa:16:3e:d6:d0:ff", "network": {"id": "0c411791-eb03-4e00-9d7f-d032e2c16d46", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1808141765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc6fc8310f44f3788e13aa4f1eb8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ffd205-85", "ovs_interfaceid": "64ffd205-85a8-4c33-8ec4-40f8519b0bd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 18:17:35 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Converting VIF {"id": "64ffd205-85a8-4c33-8ec4-40f8519b0bd5", "address": "fa:16:3e:d6:d0:ff", "network": {"id": "0c411791-eb03-4e00-9d7f-d032e2c16d46", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1808141765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc6fc8310f44f3788e13aa4f1eb8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ffd205-85", "ovs_interfaceid": "64ffd205-85a8-4c33-8ec4-40f8519b0bd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:17:35 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:d0:ff,bridge_name='br-int',has_traffic_filtering=True,id=64ffd205-85a8-4c33-8ec4-40f8519b0bd5,network=Network(0c411791-eb03-4e00-9d7f-d032e2c16d46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64ffd205-85') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:17:35 user nova-compute[75100]: DEBUG nova.objects.instance [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lazy-loading 'pci_devices' on Instance uuid fb6b4d45-7c2b-4211-9939-9989a6a3c913 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:17:35 user nova-compute[75100]: DEBUG nova.objects.base [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Object Instance<fb6b4d45-7c2b-4211-9939-9989a6a3c913> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 18:17:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] End _get_guest_xml xml=<domain type="kvm">
Nov 10 18:17:35 user nova-compute[75100]:   <uuid>fb6b4d45-7c2b-4211-9939-9989a6a3c913</uuid>
Nov 10 18:17:35 user nova-compute[75100]:   <name>instance-0000002e</name>
Nov 10 18:17:35 user nova-compute[75100]:   <memory>524288</memory>
Nov 10 18:17:35 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 10 18:17:35 user nova-compute[75100]:   <metadata>
Nov 10 18:17:35 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 18:17:35 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 10 18:17:35 user nova-compute[75100]:       <nova:name>tempest-AttachVolumeTestJSON-server-1135440047</nova:name>
Nov 10 18:17:35 user nova-compute[75100]:       <nova:creationTime>2023-11-10 18:17:34</nova:creationTime>
Nov 10 18:17:35 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 10 18:17:35 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 10 18:17:35 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 10 18:17:35 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 10 18:17:35 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 18:17:35 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 10 18:17:35 user nova-compute[75100]:       </nova:flavor>
Nov 10 18:17:35 user nova-compute[75100]:       <nova:owner>
Nov 10 18:17:35 user nova-compute[75100]:         <nova:user uuid="20c5bb15b9174fbc9df8ba12de10cea6">tempest-AttachVolumeTestJSON-375321786-project-member</nova:user>
Nov 10 18:17:35 user nova-compute[75100]:         <nova:project uuid="8cc6fc8310f44f3788e13aa4f1eb8c96">tempest-AttachVolumeTestJSON-375321786</nova:project>
Nov 10 18:17:35 user nova-compute[75100]:       </nova:owner>
Nov 10 18:17:35 user nova-compute[75100]:       <nova:root type="image" uuid="e3cc5321-4d40-49ee-885c-700e14741732"/>
Nov 10 18:17:35 user nova-compute[75100]:       <nova:ports>
Nov 10 18:17:35 user nova-compute[75100]:         <nova:port uuid="64ffd205-85a8-4c33-8ec4-40f8519b0bd5">
Nov 10 18:17:35 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 10 18:17:35 user nova-compute[75100]:         </nova:port>
Nov 10 18:17:35 user nova-compute[75100]:       </nova:ports>
Nov 10 18:17:35 user nova-compute[75100]:     </nova:instance>
Nov 10 18:17:35 user nova-compute[75100]:   </metadata>
Nov 10 18:17:35 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 10 18:17:35 user nova-compute[75100]:     <system>
Nov 10 18:17:35 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 18:17:35 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 10 18:17:35 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 10 18:17:35 user nova-compute[75100]:       <entry name="serial">fb6b4d45-7c2b-4211-9939-9989a6a3c913</entry>
Nov 10 18:17:35 user nova-compute[75100]:       <entry name="uuid">fb6b4d45-7c2b-4211-9939-9989a6a3c913</entry>
Nov 10 18:17:35 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 10 18:17:35 user nova-compute[75100]:     </system>
Nov 10 18:17:35 user nova-compute[75100]:   </sysinfo>
Nov 10 18:17:35 user nova-compute[75100]:   <os>
Nov 10 18:17:35 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 18:17:35 user nova-compute[75100]:     <boot dev="hd"/>
Nov 10 18:17:35 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 10 18:17:35 user nova-compute[75100]:   </os>
Nov 10 18:17:35 user nova-compute[75100]:   <features>
Nov 10 18:17:35 user nova-compute[75100]:     <acpi/>
Nov 10 18:17:35 user nova-compute[75100]:     <apic/>
Nov 10 18:17:35 user nova-compute[75100]:     <vmcoreinfo/>
Nov 10 18:17:35 user nova-compute[75100]:   </features>
Nov 10 18:17:35 user nova-compute[75100]:   <clock offset="utc">
Nov 10 18:17:35 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 18:17:35 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 18:17:35 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 10 18:17:35 user nova-compute[75100]:   </clock>
Nov 10 18:17:35 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 10 18:17:35 user nova-compute[75100]:     <model>Nehalem</model>
Nov 10 18:17:35 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 18:17:35 user nova-compute[75100]:   </cpu>
Nov 10 18:17:35 user nova-compute[75100]:   <devices>
Nov 10 18:17:35 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 10 18:17:35 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 18:17:35 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk"/>
Nov 10 18:17:35 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 10 18:17:35 user nova-compute[75100]:     </disk>
Nov 10 18:17:35 user nova-compute[75100]:     <disk type="block" device="disk">
Nov 10 18:17:35 user nova-compute[75100]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:17:35 user nova-compute[75100]:       <source dev="/dev/sdc"/>
Nov 10 18:17:35 user nova-compute[75100]:       <target dev="vdb" bus="virtio"/>
Nov 10 18:17:35 user nova-compute[75100]:       <serial>fc0ab4ad-3373-400c-a672-07ef9b16555e</serial>
Nov 10 18:17:35 user nova-compute[75100]:     </disk>
Nov 10 18:17:35 user nova-compute[75100]:     <interface type="ethernet">
Nov 10 18:17:35 user nova-compute[75100]:       <mac address="fa:16:3e:d6:d0:ff"/>
Nov 10 18:17:35 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 18:17:35 user nova-compute[75100]:       <mtu size="1442"/>
Nov 10 18:17:35 user nova-compute[75100]:       <target dev="tap64ffd205-85"/>
Nov 10 18:17:35 user nova-compute[75100]:     </interface>
Nov 10 18:17:35 user nova-compute[75100]:     <serial type="pty">
Nov 10 18:17:35 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/console.log" append="off"/>
Nov 10 18:17:35 user nova-compute[75100]:     </serial>
Nov 10 18:17:35 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 18:17:35 user nova-compute[75100]:     <video>
Nov 10 18:17:35 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 18:17:35 user nova-compute[75100]:     </video>
Nov 10 18:17:35 user nova-compute[75100]:     <rng model="virtio">
Nov 10 18:17:35 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 10 18:17:35 user nova-compute[75100]:     </rng>
Nov 10 18:17:35 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 10 18:17:35 user nova-compute[75100]:     <memballoon model="virtio">
Nov 10 18:17:35 user nova-compute[75100]:       <stats period="10"/>
Nov 10 18:17:35 user nova-compute[75100]:     </memballoon>
Nov 10 18:17:35 user nova-compute[75100]:   </devices>
Nov 10 18:17:35 user nova-compute[75100]: </domain>
Nov 10 18:17:35 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 18:17:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:17:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:17:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:17:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:17:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 18:17:35 user nova-compute[75100]: DEBUG nova.objects.instance [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lazy-loading 'trusted_certs' on Instance uuid fb6b4d45-7c2b-4211-9939-9989a6a3c913 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:17:35 user nova-compute[75100]: DEBUG nova.objects.base [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Object Instance<fb6b4d45-7c2b-4211-9939-9989a6a3c913> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 18:17:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:17:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.170s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:17:36 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 18:17:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:17:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:17:36 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Cannot resize image /opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 18:17:36 user nova-compute[75100]: DEBUG nova.objects.instance [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lazy-loading 'migration_context' on Instance uuid fb6b4d45-7c2b-4211-9939-9989a6a3c913 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:17:36 user nova-compute[75100]: DEBUG nova.objects.base [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Object Instance<fb6b4d45-7c2b-4211-9939-9989a6a3c913> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 18:17:36 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:13:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1135440047',display_name='tempest-AttachVolumeTestJSON-server-1135440047',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1135440047',id=46,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcNRutHNHeVY/scgmxR9G4KJoQs59QhgQZEw5FvsqZrAjpQ/2uGeVsJVaEeZoz53+Lx9VAPkikUDH6vDzggddQ9KuRG+0ma+NlYbiZWBP5qgm948UdG/c0syluE8zjWJA==',key_name='tempest-keypair-1049460111',keypairs=<?>,launch_index=0,launched_at=2023-11-10T18:13:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='8cc6fc8310f44f3788e13aa4f1eb8c96',ramdisk_id='',reservation_id='r-nozvlwff',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-375321786',owner_user_name='tempest-AttachVolumeTestJSON-375321786-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T18:15:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='20c5bb15b9174fbc9df8ba12de10cea6',uuid=fb6b4d45-7c2b-4211-9939-9989a6a3c913,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "64ffd205-85a8-4c33-8ec4-40f8519b0bd5", "address": "fa:16:3e:d6:d0:ff", "network": {"id": "0c411791-eb03-4e00-9d7f-d032e2c16d46", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1808141765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc6fc8310f44f3788e13aa4f1eb8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ffd205-85", "ovs_interfaceid": "64ffd205-85a8-4c33-8ec4-40f8519b0bd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 18:17:36 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Converting VIF {"id": "64ffd205-85a8-4c33-8ec4-40f8519b0bd5", "address": "fa:16:3e:d6:d0:ff", "network": {"id": "0c411791-eb03-4e00-9d7f-d032e2c16d46", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1808141765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc6fc8310f44f3788e13aa4f1eb8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ffd205-85", "ovs_interfaceid": "64ffd205-85a8-4c33-8ec4-40f8519b0bd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:17:36 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:d0:ff,bridge_name='br-int',has_traffic_filtering=True,id=64ffd205-85a8-4c33-8ec4-40f8519b0bd5,network=Network(0c411791-eb03-4e00-9d7f-d032e2c16d46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64ffd205-85') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:17:36 user nova-compute[75100]: DEBUG os_vif [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:d0:ff,bridge_name='br-int',has_traffic_filtering=True,id=64ffd205-85a8-4c33-8ec4-40f8519b0bd5,network=Network(0c411791-eb03-4e00-9d7f-d032e2c16d46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64ffd205-85') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 18:17:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:17:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:17:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 18:17:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:17:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bec451fb-2b1e-530e-9419-4051e35f1110', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:17:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:17:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:17:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:17:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap64ffd205-85, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:17:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap64ffd205-85, col_values=(('qos', UUID('d93e2567-29ae-4287-a71b-16b3abe4c107')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:17:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap64ffd205-85, col_values=(('external_ids', {'iface-id': '64ffd205-85a8-4c33-8ec4-40f8519b0bd5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:d0:ff', 'vm-uuid': 'fb6b4d45-7c2b-4211-9939-9989a6a3c913'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:17:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:17:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:17:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:17:36 user nova-compute[75100]: INFO os_vif [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:d0:ff,bridge_name='br-int',has_traffic_filtering=True,id=64ffd205-85a8-4c33-8ec4-40f8519b0bd5,network=Network(0c411791-eb03-4e00-9d7f-d032e2c16d46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64ffd205-85')
Nov 10 18:17:36 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-75ffeee3-2a83-49ee-b8bd-881a802df7c7 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1220ad0e-3f5e-4d47-be01-4652e2390e87 is timed out.
Nov 10 18:17:36 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-75ffeee3-2a83-49ee-b8bd-881a802df7c7 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Successfully detached device vdb from instance 1220ad0e-3f5e-4d47-be01-4652e2390e87 from the live domain config.
Nov 10 18:17:36 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75ffeee3-2a83-49ee-b8bd-881a802df7c7 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 18:17:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-75ffeee3-2a83-49ee-b8bd-881a802df7c7 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, {'target_iqn': 'iqn.2010-10.org.openstack:c3cfc5cd-645a-41a1-a4e7-74d3833a2218', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hMQaZdxm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:17:36 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-75ffeee3-2a83-49ee-b8bd-881a802df7c7 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:17:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-75ffeee3-2a83-49ee-b8bd-881a802df7c7 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:17:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-75ffeee3-2a83-49ee-b8bd-881a802df7c7 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:17:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:17:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:17:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[344581a5-17ee-4bc1-91a4-b74c69cfd2d4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c3cfc5cd-645a-41a1-a4e7-74d3833a2218\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:17:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-75ffeee3-2a83-49ee-b8bd-881a802df7c7 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 18:17:37 user nova-compute[75100]: No targets found.
Nov 10 18:17:37 user nova-compute[75100]: iSNS:
Nov 10 18:17:37 user nova-compute[75100]: No targets found.
Nov 10 18:17:37 user nova-compute[75100]: STATIC:
Nov 10 18:17:37 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:c3cfc5cd-645a-41a1-a4e7-74d3833a2218
Nov 10 18:17:37 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:17:37 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:17:37 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e
Nov 10 18:17:37 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:17:37 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:17:37 user nova-compute[75100]: FIRMWARE:
Nov 10 18:17:37 user nova-compute[75100]: No targets found.
Nov 10 18:17:37 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:17:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-75ffeee3-2a83-49ee-b8bd-881a802df7c7 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 18:17:37 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 18:17:37 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 18:17:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-75ffeee3-2a83-49ee-b8bd-881a802df7c7 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3cfc5cd-645a-41a1-a4e7-74d3833a2218', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 18:17:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:17:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:17:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6d740a-8c98-4759-a161-9d561335035f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3cfc5cd-645a-41a1-a4e7-74d3833a2218\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:17:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:17:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:17:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[46964db8-4052-4644-af49-93f3d60cf6e0]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfc5cd-645a-41a1-a4e7-74d3833a2218 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:17:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-75ffeee3-2a83-49ee-b8bd-881a802df7c7 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfc5cd-645a-41a1-a4e7-74d3833a2218 (non-flash)
Nov 10 18:17:37 user nova-compute[75100]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e (non-flash)
Nov 10 18:17:37 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:17:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-75ffeee3-2a83-49ee-b8bd-881a802df7c7 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfc5cd-645a-41a1-a4e7-74d3833a2218 (non-flash)
Nov 10 18:17:37 user nova-compute[75100]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e (non-flash)
Nov 10 18:17:37 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:17:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-75ffeee3-2a83-49ee-b8bd-881a802df7c7 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3bc61ef80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3cfc5cd-645a-41a1-a4e7-74d3833a2218'): ({'sdb'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 18:17:37 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-75ffeee3-2a83-49ee-b8bd-881a802df7c7 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Removing single pathed devices sdb {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 18:17:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:17:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:17:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d5a39a-841b-4993-ae8c-a87ac0173708]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:17:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:17:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:17:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b5fd03-1539-42a3-9cdb-5e3277993b56]: (4, ('ok\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:17:37 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-75ffeee3-2a83-49ee-b8bd-881a802df7c7 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Flushing IO for device /dev/sdb {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 18:17:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:17:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:17:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7004005e-966f-49f9-b27d-915127081207]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:17:37 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-75ffeee3-2a83-49ee-b8bd-881a802df7c7 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 18:17:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:17:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:17:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4507b071-7a7b-4958-859f-26dbfc37b0ba]: (4, ('1', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:17:37 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-75ffeee3-2a83-49ee-b8bd-881a802df7c7 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 18:17:37 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-75ffeee3-2a83-49ee-b8bd-881a802df7c7 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 18:17:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-75ffeee3-2a83-49ee-b8bd-881a802df7c7 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3cfc5cd-645a-41a1-a4e7-74d3833a2218')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 18:17:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3cfc5cd-645a-41a1-a4e7-74d3833a2218 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:17:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3cfc5cd-645a-41a1-a4e7-74d3833a2218 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:17:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3401b18-3d3b-4e66-8b0b-d9226265a310]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:17:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-75ffeee3-2a83-49ee-b8bd-881a802df7c7 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:17:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3cfc5cd-645a-41a1-a4e7-74d3833a2218 -p 172.16.0.220:3260 --logout {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:17:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3cfc5cd-645a-41a1-a4e7-74d3833a2218 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:17:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26aab2d-459b-4a9a-b8f9-0568ae62830a]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:c3cfc5cd-645a-41a1-a4e7-74d3833a2218, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:c3cfc5cd-645a-41a1-a4e7-74d3833a2218, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:17:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-75ffeee3-2a83-49ee-b8bd-881a802df7c7 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:c3cfc5cd-645a-41a1-a4e7-74d3833a2218, portal: 172.16.0.220,3260]
Nov 10 18:17:37 user nova-compute[75100]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:c3cfc5cd-645a-41a1-a4e7-74d3833a2218, portal: 172.16.0.220,3260] successful.
Nov 10 18:17:37 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:17:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3cfc5cd-645a-41a1-a4e7-74d3833a2218 -p 172.16.0.220:3260 --op delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:17:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3cfc5cd-645a-41a1-a4e7-74d3833a2218 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:17:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b01d85-8c12-4fde-abc2-efc2da783825]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:17:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-75ffeee3-2a83-49ee-b8bd-881a802df7c7 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:17:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-75ffeee3-2a83-49ee-b8bd-881a802df7c7 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:17:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-75ffeee3-2a83-49ee-b8bd-881a802df7c7 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] <== disconnect_volume: return (289ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:17:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75ffeee3-2a83-49ee-b8bd-881a802df7c7 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 18:17:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:17:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:17:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:17:37 user nova-compute[75100]: DEBUG nova.compute.manager [req-f9f08710-e8e9-400a-a6b2-6fb9aba7bd18 req-759cfc52-893d-4d5a-b8ef-00daf05b37a3 service nova] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Received event network-vif-plugged-64ffd205-85a8-4c33-8ec4-40f8519b0bd5 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:17:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f9f08710-e8e9-400a-a6b2-6fb9aba7bd18 req-759cfc52-893d-4d5a-b8ef-00daf05b37a3 service nova] Acquiring lock "fb6b4d45-7c2b-4211-9939-9989a6a3c913-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:17:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f9f08710-e8e9-400a-a6b2-6fb9aba7bd18 req-759cfc52-893d-4d5a-b8ef-00daf05b37a3 service nova] Lock "fb6b4d45-7c2b-4211-9939-9989a6a3c913-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:17:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f9f08710-e8e9-400a-a6b2-6fb9aba7bd18 req-759cfc52-893d-4d5a-b8ef-00daf05b37a3 service nova] Lock "fb6b4d45-7c2b-4211-9939-9989a6a3c913-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:17:37 user nova-compute[75100]: DEBUG nova.compute.manager [req-f9f08710-e8e9-400a-a6b2-6fb9aba7bd18 req-759cfc52-893d-4d5a-b8ef-00daf05b37a3 service nova] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] No waiting events found dispatching network-vif-plugged-64ffd205-85a8-4c33-8ec4-40f8519b0bd5 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:17:37 user nova-compute[75100]: WARNING nova.compute.manager [req-f9f08710-e8e9-400a-a6b2-6fb9aba7bd18 req-759cfc52-893d-4d5a-b8ef-00daf05b37a3 service nova] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Received unexpected event network-vif-plugged-64ffd205-85a8-4c33-8ec4-40f8519b0bd5 for instance with vm_state stopped and task_state powering-on.
Nov 10 18:17:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:17:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:17:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:17:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:17:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:17:38 user nova-compute[75100]: DEBUG nova.objects.instance [None req-75ffeee3-2a83-49ee-b8bd-881a802df7c7 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lazy-loading 'flavor' on Instance uuid 1220ad0e-3f5e-4d47-be01-4652e2390e87 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:17:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-75ffeee3-2a83-49ee-b8bd-881a802df7c7 tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "1220ad0e-3f5e-4d47-be01-4652e2390e87" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.993s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:17:39 user nova-compute[75100]: DEBUG nova.compute.manager [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 18:17:39 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Instance rebooted successfully.
Nov 10 18:17:39 user nova-compute[75100]: DEBUG nova.compute.manager [None req-c4b92f45-4479-49d3-abe1-cfa63771f745 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 18:17:39 user nova-compute[75100]: DEBUG nova.compute.manager [req-3a6758a9-c1bb-4357-80a3-2e8324ab963b req-b2fdcb34-abab-47ed-9778-ad072be7ce89 service nova] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Received event network-vif-plugged-64ffd205-85a8-4c33-8ec4-40f8519b0bd5 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:17:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3a6758a9-c1bb-4357-80a3-2e8324ab963b req-b2fdcb34-abab-47ed-9778-ad072be7ce89 service nova] Acquiring lock "fb6b4d45-7c2b-4211-9939-9989a6a3c913-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:17:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3a6758a9-c1bb-4357-80a3-2e8324ab963b req-b2fdcb34-abab-47ed-9778-ad072be7ce89 service nova] Lock "fb6b4d45-7c2b-4211-9939-9989a6a3c913-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:17:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3a6758a9-c1bb-4357-80a3-2e8324ab963b req-b2fdcb34-abab-47ed-9778-ad072be7ce89 service nova] Lock "fb6b4d45-7c2b-4211-9939-9989a6a3c913-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:17:39 user nova-compute[75100]: DEBUG nova.compute.manager [req-3a6758a9-c1bb-4357-80a3-2e8324ab963b req-b2fdcb34-abab-47ed-9778-ad072be7ce89 service nova] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] No waiting events found dispatching network-vif-plugged-64ffd205-85a8-4c33-8ec4-40f8519b0bd5 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:17:39 user nova-compute[75100]: WARNING nova.compute.manager [req-3a6758a9-c1bb-4357-80a3-2e8324ab963b req-b2fdcb34-abab-47ed-9778-ad072be7ce89 service nova] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Received unexpected event network-vif-plugged-64ffd205-85a8-4c33-8ec4-40f8519b0bd5 for instance with vm_state active and task_state None.
Nov 10 18:17:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:17:40 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:17:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:17:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:17:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:17:40 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 18:17:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:17:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Acquiring lock "8f04a49b-8124-4319-a4b2-b40786984c00" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:17:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Lock "8f04a49b-8124-4319-a4b2-b40786984c00" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:17:40 user nova-compute[75100]: INFO nova.compute.manager [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Unshelving
Nov 10 18:17:40 user nova-compute[75100]: INFO nova.virt.block_device [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Booting with volume e235bb5d-0f3a-4380-a53a-224a47d6584e at /dev/vda
Nov 10 18:17:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:17:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:17:40 user nova-compute[75100]: DEBUG os_brick.utils [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:17:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:17:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:17:40 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[02898093-f3ab-4896-b26a-89a8beaa5a68]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90b1a229568f\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:17:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:17:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:17:40 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1745cd-b158-4b60-983e-34341910c584]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:17:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:17:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:17:40 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8442b2e-7907-47ea-8790-f4cf5d21c405]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:17:40 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0de843-4dab-4f62-81f6-90271d34c010]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:17:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:17:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 18:17:40 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 18:17:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:17:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 18:17:40 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 18:17:40 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4576510-d60b-4a4a-909c-2090fbf57a6f]: (4, '') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:17:40 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 18:17:40 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 18:17:40 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 18:17:40 user nova-compute[75100]: DEBUG os_brick.utils [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90b1a229568f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:17:40 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Updating existing volume attachment record: 3004217d-3209-4d86-8a13-dcf5547c1058 {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 18:17:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:17:40 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 18:17:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1220ad0e-3f5e-4d47-be01-4652e2390e87/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:17:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1220ad0e-3f5e-4d47-be01-4652e2390e87/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:17:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1220ad0e-3f5e-4d47-be01-4652e2390e87/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:17:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1220ad0e-3f5e-4d47-be01-4652e2390e87/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:17:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:17:41 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:17:41 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:17:41 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Hypervisor/Node resource view: name=user free_ram=8837MB free_disk=24.41092300415039GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 18:17:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:17:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:17:41 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance fb6b4d45-7c2b-4211-9939-9989a6a3c913 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:17:41 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 1220ad0e-3f5e-4d47-be01-4652e2390e87 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:17:41 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 8f04a49b-8124-4319-a4b2-b40786984c00 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 10 18:17:41 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 18:17:41 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 18:17:41 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:17:41 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:17:41 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 18:17:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.261s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:17:45 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:17:45 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:17:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:17:46 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:17:47 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:17:49 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:17:49 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 18:17:49 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Rebuilding the list of instances to heal {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 18:17:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "refresh_cache-fb6b4d45-7c2b-4211-9939-9989a6a3c913" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:17:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquired lock "refresh_cache-fb6b4d45-7c2b-4211-9939-9989a6a3c913" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:17:49 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 18:17:49 user nova-compute[75100]: DEBUG nova.objects.instance [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lazy-loading 'info_cache' on Instance uuid fb6b4d45-7c2b-4211-9939-9989a6a3c913 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:17:50 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Updating instance_info_cache with network_info: [{"id": "64ffd205-85a8-4c33-8ec4-40f8519b0bd5", "address": "fa:16:3e:d6:d0:ff", "network": {"id": "0c411791-eb03-4e00-9d7f-d032e2c16d46", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1808141765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc6fc8310f44f3788e13aa4f1eb8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ffd205-85", "ovs_interfaceid": "64ffd205-85a8-4c33-8ec4-40f8519b0bd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:17:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Releasing lock "refresh_cache-fb6b4d45-7c2b-4211-9939-9989a6a3c913" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:17:50 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 18:17:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:17:53 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:17:53 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 18:17:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:17:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:18:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:18:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:18:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:18:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:18:04 user nova-compute[75100]: DEBUG nova.objects.instance [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Lazy-loading 'pci_requests' on Instance uuid 8f04a49b-8124-4319-a4b2-b40786984c00 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:18:04 user nova-compute[75100]: DEBUG nova.objects.instance [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Lazy-loading 'numa_topology' on Instance uuid 8f04a49b-8124-4319-a4b2-b40786984c00 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:18:04 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 18:18:04 user nova-compute[75100]: INFO nova.compute.claims [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Claim successful on node user
Nov 10 18:18:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:18:05 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:18:05 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:18:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.357s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:18:05 user nova-compute[75100]: INFO nova.network.neutron [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Updating port c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 10 18:18:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:18:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Acquiring lock "refresh_cache-8f04a49b-8124-4319-a4b2-b40786984c00" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:18:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Acquired lock "refresh_cache-8f04a49b-8124-4319-a4b2-b40786984c00" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:18:05 user nova-compute[75100]: DEBUG nova.network.neutron [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG nova.compute.manager [req-f5d4cafa-b49a-4304-921d-c711eea3ffb8 req-987d1eb0-9aae-4bca-bdae-e60fafb1f0d9 service nova] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Received event network-changed-c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG nova.compute.manager [req-f5d4cafa-b49a-4304-921d-c711eea3ffb8 req-987d1eb0-9aae-4bca-bdae-e60fafb1f0d9 service nova] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Refreshing instance network info cache due to event network-changed-c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f5d4cafa-b49a-4304-921d-c711eea3ffb8 req-987d1eb0-9aae-4bca-bdae-e60fafb1f0d9 service nova] Acquiring lock "refresh_cache-8f04a49b-8124-4319-a4b2-b40786984c00" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG nova.network.neutron [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Updating instance_info_cache with network_info: [{"id": "c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a", "address": "fa:16:3e:16:4f:0b", "network": {"id": "17352d7d-ab4a-4f2a-b647-e9fa7d9c355d", "bridge": "br-int", "label": "tempest-TestShelveInstance-756457394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88550719c2fd46d6a4e4dd8038fdad78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63ac7d6-ae", "ovs_interfaceid": "c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Releasing lock "refresh_cache-8f04a49b-8124-4319-a4b2-b40786984c00" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 18:18:06 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Creating image(s)
Nov 10 18:18:06 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Did not create local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Ensure instance console log exists: /opt/stack/data/nova/instances/8f04a49b-8124-4319-a4b2-b40786984c00/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Start _get_guest_xml network_info=[{"id": "c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a", "address": "fa:16:3e:16:4f:0b", "network": {"id": "17352d7d-ab4a-4f2a-b647-e9fa7d9c355d", "bridge": "br-int", "label": "tempest-TestShelveInstance-756457394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88550719c2fd46d6a4e4dd8038fdad78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63ac7d6-ae", "ovs_interfaceid": "c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NaXenRKr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8f04a49b-8124-4319-a4b2-b40786984c00', 'attached_at': '', 'detached_at': '', 'volume_id': 'e235bb5d-0f3a-4380-a53a-224a47d6584e', 'serial': 'e235bb5d-0f3a-4380-a53a-224a47d6584e'}, 'mount_device': '/dev/vda', 'attachment_id': '3004217d-3209-4d86-8a13-dcf5547c1058', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f5d4cafa-b49a-4304-921d-c711eea3ffb8 req-987d1eb0-9aae-4bca-bdae-e60fafb1f0d9 service nova] Acquired lock "refresh_cache-8f04a49b-8124-4319-a4b2-b40786984c00" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG nova.network.neutron [req-f5d4cafa-b49a-4304-921d-c711eea3ffb8 req-987d1eb0-9aae-4bca-bdae-e60fafb1f0d9 service nova] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Refreshing network info cache for port c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 18:18:06 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:18:06 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:18:06 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T17:40:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG nova.objects.instance [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8f04a49b-8124-4319-a4b2-b40786984c00 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG nova.objects.base [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Object Instance<8f04a49b-8124-4319-a4b2-b40786984c00> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NaXenRKr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:18:06 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:18:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:18:06 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:18:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:18:06 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 18:18:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e -p 172.16.0.220:3260 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ab869d-3c13-4307-893e-a48496b64e1f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 18:18:06 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e -p 172.16.0.220:3260 --interface default --op new {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[092f12d1-b313-454b-8c8b-e7020df7cae9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e] added\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e] added
Nov 10 18:18:06 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c62d7ec-eb6d-433d-a4b2-779f78cb8619]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7966abe4-a32b-40f6-9338-4ad13af752c3]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NaXenRKr {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NaXenRKr" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[da831994-df7a-4030-8a60-acd0074b8508]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NaXenRKr'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25e167b-a7ef-46dd-8ff0-e41bfcdaaf85]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6493be27-0844-4f83-a036-4e10eebd6fcb]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e (non-flash)
Nov 10 18:18:06 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e (non-flash)
Nov 10 18:18:06 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e -p 172.16.0.220:3260 --login {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d23a85eb-0624-4230-8cb8-a822c39d5f8d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Acquiring lock "1220ad0e-3f5e-4d47-be01-4652e2390e87" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d23a85eb-0624-4230-8cb8-a822c39d5f8d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "1220ad0e-3f5e-4d47-be01-4652e2390e87" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d23a85eb-0624-4230-8cb8-a822c39d5f8d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Acquiring lock "1220ad0e-3f5e-4d47-be01-4652e2390e87-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d23a85eb-0624-4230-8cb8-a822c39d5f8d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "1220ad0e-3f5e-4d47-be01-4652e2390e87-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d23a85eb-0624-4230-8cb8-a822c39d5f8d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "1220ad0e-3f5e-4d47-be01-4652e2390e87-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:18:06 user nova-compute[75100]: INFO nova.compute.manager [None req-d23a85eb-0624-4230-8cb8-a822c39d5f8d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] Terminating instance
Nov 10 18:18:06 user nova-compute[75100]: DEBUG nova.compute.manager [None req-d23a85eb-0624-4230-8cb8-a822c39d5f8d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[97398e9e-3ca9-4339-af1a-db8cd1f5d10f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e, portal: 172.16.0.220,3260]
Nov 10 18:18:06 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e, portal: 172.16.0.220,3260] successful.
Nov 10 18:18:06 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1883e5-bb5f-4842-8b7a-fd8d0ce8e9fc]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1158d734-97c8-474b-bbfe-f5dffa06aa15]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e (non-flash)
Nov 10 18:18:06 user nova-compute[75100]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e (non-flash)
Nov 10 18:18:06 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e (non-flash)
Nov 10 18:18:06 user nova-compute[75100]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e (non-flash)
Nov 10 18:18:06 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.032s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[08975125-b31d-40a1-a77d-e5bf026d24ff]: (4, ('- - 0', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 18:18:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NaXenRKr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 18:18:07 user nova-compute[75100]: DEBUG nova.network.neutron [req-f5d4cafa-b49a-4304-921d-c711eea3ffb8 req-987d1eb0-9aae-4bca-bdae-e60fafb1f0d9 service nova] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Updated VIF entry in instance network info cache for port c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 18:18:07 user nova-compute[75100]: DEBUG nova.network.neutron [req-f5d4cafa-b49a-4304-921d-c711eea3ffb8 req-987d1eb0-9aae-4bca-bdae-e60fafb1f0d9 service nova] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Updating instance_info_cache with network_info: [{"id": "c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a", "address": "fa:16:3e:16:4f:0b", "network": {"id": "17352d7d-ab4a-4f2a-b647-e9fa7d9c355d", "bridge": "br-int", "label": "tempest-TestShelveInstance-756457394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88550719c2fd46d6a4e4dd8038fdad78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63ac7d6-ae", "ovs_interfaceid": "c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:18:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f5d4cafa-b49a-4304-921d-c711eea3ffb8 req-987d1eb0-9aae-4bca-bdae-e60fafb1f0d9 service nova] Releasing lock "refresh_cache-8f04a49b-8124-4319-a4b2-b40786984c00" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:18:07 user nova-compute[75100]: DEBUG nova.compute.manager [req-ef7aae80-05dd-498d-b10e-99ff4a9ad6a2 req-381a8c30-34bf-474d-807e-fccd3fe6301a service nova] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] Received event network-vif-unplugged-b40ca80d-b78e-4bcc-ac31-203a76ebf3b7 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:18:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ef7aae80-05dd-498d-b10e-99ff4a9ad6a2 req-381a8c30-34bf-474d-807e-fccd3fe6301a service nova] Acquiring lock "1220ad0e-3f5e-4d47-be01-4652e2390e87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:18:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ef7aae80-05dd-498d-b10e-99ff4a9ad6a2 req-381a8c30-34bf-474d-807e-fccd3fe6301a service nova] Lock "1220ad0e-3f5e-4d47-be01-4652e2390e87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:18:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ef7aae80-05dd-498d-b10e-99ff4a9ad6a2 req-381a8c30-34bf-474d-807e-fccd3fe6301a service nova] Lock "1220ad0e-3f5e-4d47-be01-4652e2390e87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:18:07 user nova-compute[75100]: DEBUG nova.compute.manager [req-ef7aae80-05dd-498d-b10e-99ff4a9ad6a2 req-381a8c30-34bf-474d-807e-fccd3fe6301a service nova] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] No waiting events found dispatching network-vif-unplugged-b40ca80d-b78e-4bcc-ac31-203a76ebf3b7 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:18:07 user nova-compute[75100]: DEBUG nova.compute.manager [req-ef7aae80-05dd-498d-b10e-99ff4a9ad6a2 req-381a8c30-34bf-474d-807e-fccd3fe6301a service nova] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] Received event network-vif-unplugged-b40ca80d-b78e-4bcc-ac31-203a76ebf3b7 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 18:18:07 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] Instance destroyed successfully.
Nov 10 18:18:07 user nova-compute[75100]: DEBUG nova.objects.instance [None req-d23a85eb-0624-4230-8cb8-a822c39d5f8d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lazy-loading 'resources' on Instance uuid 1220ad0e-3f5e-4d47-be01-4652e2390e87 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:18:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-d23a85eb-0624-4230-8cb8-a822c39d5f8d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:14:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-523445808',display_name='tempest-AttachVolumeNegativeTest-server-523445808',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-523445808',id=48,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8eN2+ejV81w/zdOYTtf0JylCt8udcOs4J6RXjn86uKIHjViiGxD/QsKNhxQZVuLfU7qVQUveiHeAceYMTjjsJYa+Bb6BTLjGbSe/cvA8r5AWqkQ9e+km8jzG7d3EdSSg==',key_name='tempest-keypair-1428224260',keypairs=<?>,launch_index=0,launched_at=2023-11-10T18:14:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d4e5cb8bdc24a009dcb3dbee36a6bce',ramdisk_id='',reservation_id='r-m0jjy27z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1395057280',owner_user_name='tempest-AttachVolumeNegativeTest-1395057280-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T18:15:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efe92a172011414e8507cb6ddbfab0bb',uuid=1220ad0e-3f5e-4d47-be01-4652e2390e87,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b40ca80d-b78e-4bcc-ac31-203a76ebf3b7", "address": "fa:16:3e:6d:45:a1", "network": {"id": "e906a397-504d-48d8-8726-187cfbb1f270", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2095832274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4e5cb8bdc24a009dcb3dbee36a6bce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb40ca80d-b7", "ovs_interfaceid": "b40ca80d-b78e-4bcc-ac31-203a76ebf3b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 18:18:07 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-d23a85eb-0624-4230-8cb8-a822c39d5f8d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Converting VIF {"id": "b40ca80d-b78e-4bcc-ac31-203a76ebf3b7", "address": "fa:16:3e:6d:45:a1", "network": {"id": "e906a397-504d-48d8-8726-187cfbb1f270", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2095832274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4e5cb8bdc24a009dcb3dbee36a6bce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb40ca80d-b7", "ovs_interfaceid": "b40ca80d-b78e-4bcc-ac31-203a76ebf3b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:18:07 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-d23a85eb-0624-4230-8cb8-a822c39d5f8d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:45:a1,bridge_name='br-int',has_traffic_filtering=True,id=b40ca80d-b78e-4bcc-ac31-203a76ebf3b7,network=Network(e906a397-504d-48d8-8726-187cfbb1f270),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb40ca80d-b7') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:18:07 user nova-compute[75100]: DEBUG os_vif [None req-d23a85eb-0624-4230-8cb8-a822c39d5f8d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:45:a1,bridge_name='br-int',has_traffic_filtering=True,id=b40ca80d-b78e-4bcc-ac31-203a76ebf3b7,network=Network(e906a397-504d-48d8-8726-187cfbb1f270),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb40ca80d-b7') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 18:18:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:18:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb40ca80d-b7, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:18:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:18:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:18:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:18:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e935eeb0-c730-4250-9b01-3d20d6bd6169) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:18:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:18:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:18:07 user nova-compute[75100]: INFO os_vif [None req-d23a85eb-0624-4230-8cb8-a822c39d5f8d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:45:a1,bridge_name='br-int',has_traffic_filtering=True,id=b40ca80d-b78e-4bcc-ac31-203a76ebf3b7,network=Network(e906a397-504d-48d8-8726-187cfbb1f270),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb40ca80d-b7')
Nov 10 18:18:07 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-d23a85eb-0624-4230-8cb8-a822c39d5f8d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] Deleting instance files /opt/stack/data/nova/instances/1220ad0e-3f5e-4d47-be01-4652e2390e87_del
Nov 10 18:18:07 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-d23a85eb-0624-4230-8cb8-a822c39d5f8d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] Deletion of /opt/stack/data/nova/instances/1220ad0e-3f5e-4d47-be01-4652e2390e87_del complete
Nov 10 18:18:07 user nova-compute[75100]: INFO nova.compute.manager [None req-d23a85eb-0624-4230-8cb8-a822c39d5f8d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 10 18:18:07 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-d23a85eb-0624-4230-8cb8-a822c39d5f8d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 18:18:07 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 18:18:07 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 18:18:07 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:18:07 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '26265663436613536', 'path': '/dev/sdb'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:18:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26265663436613536', 'path': '/dev/sdb'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 18:18:08 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T18:13:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2027830495',display_name='tempest-TestShelveInstance-server-2027830495',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2027830495',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1902062708',keypairs=<?>,launch_index=0,launched_at=2023-11-10T18:14:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='88550719c2fd46d6a4e4dd8038fdad78',ramdisk_id='',reservation_id='r-z7a0122o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-691216050',owner_user_name='tempest-TestShelveInstance-691216050-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T18:17:41Z,user_data=None,user_id='899e3a2f60b24a52b71f73e7ca965699',uuid=8f04a49b-8124-4319-a4b2-b40786984c00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a", "address": "fa:16:3e:16:4f:0b", "network": {"id": "17352d7d-ab4a-4f2a-b647-e9fa7d9c355d", "bridge": "br-int", "label": "tempest-TestShelveInstance-756457394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88550719c2fd46d6a4e4dd8038fdad78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63ac7d6-ae", "ovs_interfaceid": "c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 18:18:08 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Converting VIF {"id": "c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a", "address": "fa:16:3e:16:4f:0b", "network": {"id": "17352d7d-ab4a-4f2a-b647-e9fa7d9c355d", "bridge": "br-int", "label": "tempest-TestShelveInstance-756457394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88550719c2fd46d6a4e4dd8038fdad78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63ac7d6-ae", "ovs_interfaceid": "c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:18:08 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:4f:0b,bridge_name='br-int',has_traffic_filtering=True,id=c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a,network=Network(17352d7d-ab4a-4f2a-b647-e9fa7d9c355d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63ac7d6-ae') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:18:08 user nova-compute[75100]: DEBUG nova.objects.instance [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Lazy-loading 'pci_devices' on Instance uuid 8f04a49b-8124-4319-a4b2-b40786984c00 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:18:08 user nova-compute[75100]: DEBUG nova.objects.base [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Object Instance<8f04a49b-8124-4319-a4b2-b40786984c00> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 18:18:08 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] End _get_guest_xml xml=<domain type="kvm">
Nov 10 18:18:08 user nova-compute[75100]:   <uuid>8f04a49b-8124-4319-a4b2-b40786984c00</uuid>
Nov 10 18:18:08 user nova-compute[75100]:   <name>instance-0000002f</name>
Nov 10 18:18:08 user nova-compute[75100]:   <memory>524288</memory>
Nov 10 18:18:08 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 10 18:18:08 user nova-compute[75100]:   <metadata>
Nov 10 18:18:08 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 18:18:08 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 10 18:18:08 user nova-compute[75100]:       <nova:name>tempest-TestShelveInstance-server-2027830495</nova:name>
Nov 10 18:18:08 user nova-compute[75100]:       <nova:creationTime>2023-11-10 18:18:06</nova:creationTime>
Nov 10 18:18:08 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 10 18:18:08 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 10 18:18:08 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 10 18:18:08 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 10 18:18:08 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 18:18:08 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 10 18:18:08 user nova-compute[75100]:       </nova:flavor>
Nov 10 18:18:08 user nova-compute[75100]:       <nova:owner>
Nov 10 18:18:08 user nova-compute[75100]:         <nova:user uuid="899e3a2f60b24a52b71f73e7ca965699">tempest-TestShelveInstance-691216050-project-member</nova:user>
Nov 10 18:18:08 user nova-compute[75100]:         <nova:project uuid="88550719c2fd46d6a4e4dd8038fdad78">tempest-TestShelveInstance-691216050</nova:project>
Nov 10 18:18:08 user nova-compute[75100]:       </nova:owner>
Nov 10 18:18:08 user nova-compute[75100]:       <nova:ports>
Nov 10 18:18:08 user nova-compute[75100]:         <nova:port uuid="c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a">
Nov 10 18:18:08 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 10 18:18:08 user nova-compute[75100]:         </nova:port>
Nov 10 18:18:08 user nova-compute[75100]:       </nova:ports>
Nov 10 18:18:08 user nova-compute[75100]:     </nova:instance>
Nov 10 18:18:08 user nova-compute[75100]:   </metadata>
Nov 10 18:18:08 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 10 18:18:08 user nova-compute[75100]:     <system>
Nov 10 18:18:08 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 18:18:08 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 10 18:18:08 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 10 18:18:08 user nova-compute[75100]:       <entry name="serial">8f04a49b-8124-4319-a4b2-b40786984c00</entry>
Nov 10 18:18:08 user nova-compute[75100]:       <entry name="uuid">8f04a49b-8124-4319-a4b2-b40786984c00</entry>
Nov 10 18:18:08 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 10 18:18:08 user nova-compute[75100]:     </system>
Nov 10 18:18:08 user nova-compute[75100]:   </sysinfo>
Nov 10 18:18:08 user nova-compute[75100]:   <os>
Nov 10 18:18:08 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 18:18:08 user nova-compute[75100]:     <boot dev="hd"/>
Nov 10 18:18:08 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 10 18:18:08 user nova-compute[75100]:   </os>
Nov 10 18:18:08 user nova-compute[75100]:   <features>
Nov 10 18:18:08 user nova-compute[75100]:     <acpi/>
Nov 10 18:18:08 user nova-compute[75100]:     <apic/>
Nov 10 18:18:08 user nova-compute[75100]:     <vmcoreinfo/>
Nov 10 18:18:08 user nova-compute[75100]:   </features>
Nov 10 18:18:08 user nova-compute[75100]:   <clock offset="utc">
Nov 10 18:18:08 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 18:18:08 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 18:18:08 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 10 18:18:08 user nova-compute[75100]:   </clock>
Nov 10 18:18:08 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 10 18:18:08 user nova-compute[75100]:     <model>Nehalem</model>
Nov 10 18:18:08 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 18:18:08 user nova-compute[75100]:   </cpu>
Nov 10 18:18:08 user nova-compute[75100]:   <devices>
Nov 10 18:18:08 user nova-compute[75100]:     <disk type="block" device="disk">
Nov 10 18:18:08 user nova-compute[75100]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:18:08 user nova-compute[75100]:       <source dev="/dev/sdb"/>
Nov 10 18:18:08 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 10 18:18:08 user nova-compute[75100]:       <serial>e235bb5d-0f3a-4380-a53a-224a47d6584e</serial>
Nov 10 18:18:08 user nova-compute[75100]:     </disk>
Nov 10 18:18:08 user nova-compute[75100]:     <interface type="ethernet">
Nov 10 18:18:08 user nova-compute[75100]:       <mac address="fa:16:3e:16:4f:0b"/>
Nov 10 18:18:08 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 18:18:08 user nova-compute[75100]:       <mtu size="1442"/>
Nov 10 18:18:08 user nova-compute[75100]:       <target dev="tapc63ac7d6-ae"/>
Nov 10 18:18:08 user nova-compute[75100]:     </interface>
Nov 10 18:18:08 user nova-compute[75100]:     <serial type="pty">
Nov 10 18:18:08 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/8f04a49b-8124-4319-a4b2-b40786984c00/console.log" append="off"/>
Nov 10 18:18:08 user nova-compute[75100]:     </serial>
Nov 10 18:18:08 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 18:18:08 user nova-compute[75100]:     <video>
Nov 10 18:18:08 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 18:18:08 user nova-compute[75100]:     </video>
Nov 10 18:18:08 user nova-compute[75100]:     <rng model="virtio">
Nov 10 18:18:08 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 10 18:18:08 user nova-compute[75100]:     </rng>
Nov 10 18:18:08 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 10 18:18:08 user nova-compute[75100]:     <memballoon model="virtio">
Nov 10 18:18:08 user nova-compute[75100]:       <stats period="10"/>
Nov 10 18:18:08 user nova-compute[75100]:     </memballoon>
Nov 10 18:18:08 user nova-compute[75100]:   </devices>
Nov 10 18:18:08 user nova-compute[75100]: </domain>
Nov 10 18:18:08 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 18:18:08 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T18:13:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2027830495',display_name='tempest-TestShelveInstance-server-2027830495',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2027830495',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1902062708',keypairs=<?>,launch_index=0,launched_at=2023-11-10T18:14:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='88550719c2fd46d6a4e4dd8038fdad78',ramdisk_id='',reservation_id='r-z7a0122o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-691216050',owner_user_name='tempest-TestShelveInstance-691216050-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T18:17:41Z,user_data=None,user_id='899e3a2f60b24a52b71f73e7ca965699',uuid=8f04a49b-8124-4319-a4b2-b40786984c00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a", "address": "fa:16:3e:16:4f:0b", "network": {"id": "17352d7d-ab4a-4f2a-b647-e9fa7d9c355d", "bridge": "br-int", "label": "tempest-TestShelveInstance-756457394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88550719c2fd46d6a4e4dd8038fdad78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63ac7d6-ae", "ovs_interfaceid": "c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 18:18:08 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Converting VIF {"id": "c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a", "address": "fa:16:3e:16:4f:0b", "network": {"id": "17352d7d-ab4a-4f2a-b647-e9fa7d9c355d", "bridge": "br-int", "label": "tempest-TestShelveInstance-756457394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88550719c2fd46d6a4e4dd8038fdad78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63ac7d6-ae", "ovs_interfaceid": "c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:18:08 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:4f:0b,bridge_name='br-int',has_traffic_filtering=True,id=c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a,network=Network(17352d7d-ab4a-4f2a-b647-e9fa7d9c355d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63ac7d6-ae') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:18:08 user nova-compute[75100]: DEBUG os_vif [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:4f:0b,bridge_name='br-int',has_traffic_filtering=True,id=c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a,network=Network(17352d7d-ab4a-4f2a-b647-e9fa7d9c355d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63ac7d6-ae') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 18:18:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:18:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:18:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 18:18:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:18:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ea7343f2-3fa3-5bcf-ab08-9fb1dd06aca0', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:18:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:18:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:18:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:18:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc63ac7d6-ae, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:18:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc63ac7d6-ae, col_values=(('qos', UUID('96e4ce44-8395-4d7c-b756-7e7d2fdb328b')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:18:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc63ac7d6-ae, col_values=(('external_ids', {'iface-id': 'c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:4f:0b', 'vm-uuid': '8f04a49b-8124-4319-a4b2-b40786984c00'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:18:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:18:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:18:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:18:08 user nova-compute[75100]: INFO os_vif [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:4f:0b,bridge_name='br-int',has_traffic_filtering=True,id=c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a,network=Network(17352d7d-ab4a-4f2a-b647-e9fa7d9c355d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63ac7d6-ae')
Nov 10 18:18:08 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 18:18:08 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] No VIF found with MAC fa:16:3e:16:4f:0b, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 18:18:08 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:18:08 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] Took 0.89 seconds to deallocate network for instance.
Nov 10 18:18:08 user nova-compute[75100]: DEBUG nova.compute.manager [req-b30049cc-22e0-4686-9195-e1e676162519 req-2f41aa40-32c5-4d63-802c-e179f25ecdc2 service nova] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] Received event network-vif-deleted-b40ca80d-b78e-4bcc-ac31-203a76ebf3b7 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:18:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d23a85eb-0624-4230-8cb8-a822c39d5f8d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:18:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d23a85eb-0624-4230-8cb8-a822c39d5f8d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:18:08 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-d23a85eb-0624-4230-8cb8-a822c39d5f8d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:18:08 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-d23a85eb-0624-4230-8cb8-a822c39d5f8d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:18:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d23a85eb-0624-4230-8cb8-a822c39d5f8d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.165s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:18:08 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-d23a85eb-0624-4230-8cb8-a822c39d5f8d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Deleted allocations for instance 1220ad0e-3f5e-4d47-be01-4652e2390e87
Nov 10 18:18:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d23a85eb-0624-4230-8cb8-a822c39d5f8d tempest-AttachVolumeNegativeTest-1395057280 tempest-AttachVolumeNegativeTest-1395057280-project-member] Lock "1220ad0e-3f5e-4d47-be01-4652e2390e87" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.103s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:18:09 user nova-compute[75100]: DEBUG nova.compute.manager [req-8318e0e3-b5e8-460e-b85a-a044a9a4c002 req-ca91d14c-5571-49d5-9882-c2775631ede3 service nova] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] Received event network-vif-plugged-b40ca80d-b78e-4bcc-ac31-203a76ebf3b7 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:18:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8318e0e3-b5e8-460e-b85a-a044a9a4c002 req-ca91d14c-5571-49d5-9882-c2775631ede3 service nova] Acquiring lock "1220ad0e-3f5e-4d47-be01-4652e2390e87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:18:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8318e0e3-b5e8-460e-b85a-a044a9a4c002 req-ca91d14c-5571-49d5-9882-c2775631ede3 service nova] Lock "1220ad0e-3f5e-4d47-be01-4652e2390e87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:18:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8318e0e3-b5e8-460e-b85a-a044a9a4c002 req-ca91d14c-5571-49d5-9882-c2775631ede3 service nova] Lock "1220ad0e-3f5e-4d47-be01-4652e2390e87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:18:09 user nova-compute[75100]: DEBUG nova.compute.manager [req-8318e0e3-b5e8-460e-b85a-a044a9a4c002 req-ca91d14c-5571-49d5-9882-c2775631ede3 service nova] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] No waiting events found dispatching network-vif-plugged-b40ca80d-b78e-4bcc-ac31-203a76ebf3b7 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:18:09 user nova-compute[75100]: WARNING nova.compute.manager [req-8318e0e3-b5e8-460e-b85a-a044a9a4c002 req-ca91d14c-5571-49d5-9882-c2775631ede3 service nova] [instance: 1220ad0e-3f5e-4d47-be01-4652e2390e87] Received unexpected event network-vif-plugged-b40ca80d-b78e-4bcc-ac31-203a76ebf3b7 for instance with vm_state deleted and task_state None.
Nov 10 18:18:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:18:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:18:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:18:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:18:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:18:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:18:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:18:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:18:11 user nova-compute[75100]: DEBUG nova.compute.manager [req-cc6aa850-64e0-4c45-92c5-abbd15c1015e req-803364be-706a-4b34-b6a4-5103862a6241 service nova] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Received event network-vif-plugged-c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:18:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cc6aa850-64e0-4c45-92c5-abbd15c1015e req-803364be-706a-4b34-b6a4-5103862a6241 service nova] Acquiring lock "8f04a49b-8124-4319-a4b2-b40786984c00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:18:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cc6aa850-64e0-4c45-92c5-abbd15c1015e req-803364be-706a-4b34-b6a4-5103862a6241 service nova] Lock "8f04a49b-8124-4319-a4b2-b40786984c00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:18:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cc6aa850-64e0-4c45-92c5-abbd15c1015e req-803364be-706a-4b34-b6a4-5103862a6241 service nova] Lock "8f04a49b-8124-4319-a4b2-b40786984c00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:18:11 user nova-compute[75100]: DEBUG nova.compute.manager [req-cc6aa850-64e0-4c45-92c5-abbd15c1015e req-803364be-706a-4b34-b6a4-5103862a6241 service nova] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] No waiting events found dispatching network-vif-plugged-c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:18:11 user nova-compute[75100]: WARNING nova.compute.manager [req-cc6aa850-64e0-4c45-92c5-abbd15c1015e req-803364be-706a-4b34-b6a4-5103862a6241 service nova] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Received unexpected event network-vif-plugged-c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a for instance with vm_state shelved_offloaded and task_state spawning.
Nov 10 18:18:11 user nova-compute[75100]: DEBUG nova.compute.manager [req-cc6aa850-64e0-4c45-92c5-abbd15c1015e req-803364be-706a-4b34-b6a4-5103862a6241 service nova] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Received event network-vif-plugged-c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:18:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cc6aa850-64e0-4c45-92c5-abbd15c1015e req-803364be-706a-4b34-b6a4-5103862a6241 service nova] Acquiring lock "8f04a49b-8124-4319-a4b2-b40786984c00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:18:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cc6aa850-64e0-4c45-92c5-abbd15c1015e req-803364be-706a-4b34-b6a4-5103862a6241 service nova] Lock "8f04a49b-8124-4319-a4b2-b40786984c00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:18:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cc6aa850-64e0-4c45-92c5-abbd15c1015e req-803364be-706a-4b34-b6a4-5103862a6241 service nova] Lock "8f04a49b-8124-4319-a4b2-b40786984c00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:18:11 user nova-compute[75100]: DEBUG nova.compute.manager [req-cc6aa850-64e0-4c45-92c5-abbd15c1015e req-803364be-706a-4b34-b6a4-5103862a6241 service nova] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] No waiting events found dispatching network-vif-plugged-c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:18:11 user nova-compute[75100]: WARNING nova.compute.manager [req-cc6aa850-64e0-4c45-92c5-abbd15c1015e req-803364be-706a-4b34-b6a4-5103862a6241 service nova] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Received unexpected event network-vif-plugged-c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a for instance with vm_state shelved_offloaded and task_state spawning.
Nov 10 18:18:11 user nova-compute[75100]: DEBUG nova.compute.manager [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 18:18:11 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 18:18:11 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Instance spawned successfully.
Nov 10 18:18:11 user nova-compute[75100]: DEBUG nova.compute.manager [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 18:18:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b527bd07-f8a5-45c0-a1e2-2d239d41db62 tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Lock "8f04a49b-8124-4319-a4b2-b40786984c00" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 31.039s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:18:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:18:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:18:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:18:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:18:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:18:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:18:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:18:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:18:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:18:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:18:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:18:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:18:32 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:18:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:18:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:18:35 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:18:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:18:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:18:40 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:18:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:18:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:18:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:18:40 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 18:18:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:18:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:18:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:18:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:18:40 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 18:18:40 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 18:18:41 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:18:41 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:18:41 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Hypervisor/Node resource view: name=user free_ram=8745MB free_disk=24.43700408935547GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 18:18:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:18:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:18:41 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance fb6b4d45-7c2b-4211-9939-9989a6a3c913 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:18:41 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 8f04a49b-8124-4319-a4b2-b40786984c00 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:18:41 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 18:18:41 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 18:18:41 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:18:41 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:18:41 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 18:18:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.225s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:18:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:18:45 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:18:47 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:18:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:18:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:18:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:18:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:18:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:18:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:18:48 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:18:48 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:18:49 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:18:49 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 18:18:49 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Didn't find any instances for network info cache update. {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 18:18:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:18:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:18:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:18:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:18:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:18:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:18:53 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:18:53 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:18:53 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 18:18:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:18:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:19:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:19:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:19:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:19:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:19:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:19:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:19:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:19:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:19:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:19:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:19:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:19:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:19:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:19:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:19:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:19:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5542fe59-f1b4-40df-936f-c07594754292 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Acquiring lock "fb6b4d45-7c2b-4211-9939-9989a6a3c913" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:19:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5542fe59-f1b4-40df-936f-c07594754292 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "fb6b4d45-7c2b-4211-9939-9989a6a3c913" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:19:24 user nova-compute[75100]: INFO nova.compute.manager [None req-5542fe59-f1b4-40df-936f-c07594754292 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Detaching volume fc0ab4ad-3373-400c-a672-07ef9b16555e
Nov 10 18:19:24 user nova-compute[75100]: INFO nova.virt.block_device [None req-5542fe59-f1b4-40df-936f-c07594754292 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Attempting to driver detach volume fc0ab4ad-3373-400c-a672-07ef9b16555e from mountpoint /dev/vdb
Nov 10 18:19:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5542fe59-f1b4-40df-936f-c07594754292 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Attempting to detach device vdb from instance fb6b4d45-7c2b-4211-9939-9989a6a3c913 from the persistent domain config. {{(pid=75100) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 18:19:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-5542fe59-f1b4-40df-936f-c07594754292 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 18:19:24 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:19:24 user nova-compute[75100]:   <source dev="/dev/sdc"/>
Nov 10 18:19:24 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 18:19:24 user nova-compute[75100]:   <serial>fc0ab4ad-3373-400c-a672-07ef9b16555e</serial>
Nov 10 18:19:24 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 10 18:19:24 user nova-compute[75100]: </disk>
Nov 10 18:19:24 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 18:19:24 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-5542fe59-f1b4-40df-936f-c07594754292 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Successfully detached device vdb from instance fb6b4d45-7c2b-4211-9939-9989a6a3c913 from the persistent domain config.
Nov 10 18:19:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5542fe59-f1b4-40df-936f-c07594754292 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fb6b4d45-7c2b-4211-9939-9989a6a3c913 from the live domain config. {{(pid=75100) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 18:19:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-5542fe59-f1b4-40df-936f-c07594754292 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 18:19:24 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:19:24 user nova-compute[75100]:   <source dev="/dev/sdc"/>
Nov 10 18:19:24 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 18:19:24 user nova-compute[75100]:   <serial>fc0ab4ad-3373-400c-a672-07ef9b16555e</serial>
Nov 10 18:19:24 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 10 18:19:24 user nova-compute[75100]: </disk>
Nov 10 18:19:24 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 18:19:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5542fe59-f1b4-40df-936f-c07594754292 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fb6b4d45-7c2b-4211-9939-9989a6a3c913 {{(pid=75100) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 18:19:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:19:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:19:31 user nova-compute[75100]: DEBUG nova.compute.manager [req-36797e83-249b-485b-b7b4-fadf05486c48 req-aa09f521-875a-4e34-9792-baf56ff0a2d3 service nova] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Received event network-changed-c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:19:31 user nova-compute[75100]: DEBUG nova.compute.manager [req-36797e83-249b-485b-b7b4-fadf05486c48 req-aa09f521-875a-4e34-9792-baf56ff0a2d3 service nova] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Refreshing instance network info cache due to event network-changed-c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 18:19:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-36797e83-249b-485b-b7b4-fadf05486c48 req-aa09f521-875a-4e34-9792-baf56ff0a2d3 service nova] Acquiring lock "refresh_cache-8f04a49b-8124-4319-a4b2-b40786984c00" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:19:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-36797e83-249b-485b-b7b4-fadf05486c48 req-aa09f521-875a-4e34-9792-baf56ff0a2d3 service nova] Acquired lock "refresh_cache-8f04a49b-8124-4319-a4b2-b40786984c00" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:19:31 user nova-compute[75100]: DEBUG nova.network.neutron [req-36797e83-249b-485b-b7b4-fadf05486c48 req-aa09f521-875a-4e34-9792-baf56ff0a2d3 service nova] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Refreshing network info cache for port c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 18:19:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2c5ab55d-4301-4011-9c05-1e391d81a1cc tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Acquiring lock "8f04a49b-8124-4319-a4b2-b40786984c00" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:19:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2c5ab55d-4301-4011-9c05-1e391d81a1cc tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Lock "8f04a49b-8124-4319-a4b2-b40786984c00" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:19:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2c5ab55d-4301-4011-9c05-1e391d81a1cc tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Acquiring lock "8f04a49b-8124-4319-a4b2-b40786984c00-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:19:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2c5ab55d-4301-4011-9c05-1e391d81a1cc tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Lock "8f04a49b-8124-4319-a4b2-b40786984c00-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:19:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2c5ab55d-4301-4011-9c05-1e391d81a1cc tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Lock "8f04a49b-8124-4319-a4b2-b40786984c00-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:19:31 user nova-compute[75100]: INFO nova.compute.manager [None req-2c5ab55d-4301-4011-9c05-1e391d81a1cc tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Terminating instance
Nov 10 18:19:31 user nova-compute[75100]: DEBUG nova.compute.manager [None req-2c5ab55d-4301-4011-9c05-1e391d81a1cc tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 18:19:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:19:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:19:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:19:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:19:31 user nova-compute[75100]: DEBUG nova.compute.manager [req-4c011abe-7485-44e2-9b32-7bdfe9dced58 req-9c1efc43-c4cc-426c-8d02-1816c724e0bf service nova] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Received event network-vif-unplugged-c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:19:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4c011abe-7485-44e2-9b32-7bdfe9dced58 req-9c1efc43-c4cc-426c-8d02-1816c724e0bf service nova] Acquiring lock "8f04a49b-8124-4319-a4b2-b40786984c00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:19:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4c011abe-7485-44e2-9b32-7bdfe9dced58 req-9c1efc43-c4cc-426c-8d02-1816c724e0bf service nova] Lock "8f04a49b-8124-4319-a4b2-b40786984c00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:19:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4c011abe-7485-44e2-9b32-7bdfe9dced58 req-9c1efc43-c4cc-426c-8d02-1816c724e0bf service nova] Lock "8f04a49b-8124-4319-a4b2-b40786984c00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:19:31 user nova-compute[75100]: DEBUG nova.compute.manager [req-4c011abe-7485-44e2-9b32-7bdfe9dced58 req-9c1efc43-c4cc-426c-8d02-1816c724e0bf service nova] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] No waiting events found dispatching network-vif-unplugged-c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:19:31 user nova-compute[75100]: DEBUG nova.compute.manager [req-4c011abe-7485-44e2-9b32-7bdfe9dced58 req-9c1efc43-c4cc-426c-8d02-1816c724e0bf service nova] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Received event network-vif-unplugged-c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 18:19:31 user nova-compute[75100]: DEBUG nova.network.neutron [req-36797e83-249b-485b-b7b4-fadf05486c48 req-aa09f521-875a-4e34-9792-baf56ff0a2d3 service nova] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Updated VIF entry in instance network info cache for port c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 18:19:31 user nova-compute[75100]: DEBUG nova.network.neutron [req-36797e83-249b-485b-b7b4-fadf05486c48 req-aa09f521-875a-4e34-9792-baf56ff0a2d3 service nova] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Updating instance_info_cache with network_info: [{"id": "c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a", "address": "fa:16:3e:16:4f:0b", "network": {"id": "17352d7d-ab4a-4f2a-b647-e9fa7d9c355d", "bridge": "br-int", "label": "tempest-TestShelveInstance-756457394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88550719c2fd46d6a4e4dd8038fdad78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63ac7d6-ae", "ovs_interfaceid": "c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-36797e83-249b-485b-b7b4-fadf05486c48 req-aa09f521-875a-4e34-9792-baf56ff0a2d3 service nova] Releasing lock "refresh_cache-8f04a49b-8124-4319-a4b2-b40786984c00" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:19:32 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Instance destroyed successfully.
Nov 10 18:19:32 user nova-compute[75100]: DEBUG nova.objects.instance [None req-2c5ab55d-4301-4011-9c05-1e391d81a1cc tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Lazy-loading 'resources' on Instance uuid 8f04a49b-8124-4319-a4b2-b40786984c00 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-2c5ab55d-4301-4011-9c05-1e391d81a1cc tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T18:13:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2027830495',display_name='tempest-TestShelveInstance-server-2027830495',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2027830495',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB9qEHEmYdMuWxE5gf70kraK1OXUOB4Q8BESIygRL+qQHvsdRICR3ppT56RlX1dWZbh86Resa7Vt9qrVDWMYfSY79L/T72hFPuMCGqoZUD9uGRGvYY4StURcY0jI+vYwBw==',key_name='tempest-TestShelveInstance-1902062708',keypairs=<?>,launch_index=0,launched_at=2023-11-10T18:18:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88550719c2fd46d6a4e4dd8038fdad78',ramdisk_id='',reservation_id='r-z7a0122o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-691216050',owner_user_name='tempest-TestShelveInstance-691216050-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T18:18:12Z,user_data=None,user_id='899e3a2f60b24a52b71f73e7ca965699',uuid=8f04a49b-8124-4319-a4b2-b40786984c00,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a", "address": "fa:16:3e:16:4f:0b", "network": {"id": "17352d7d-ab4a-4f2a-b647-e9fa7d9c355d", "bridge": "br-int", "label": "tempest-TestShelveInstance-756457394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88550719c2fd46d6a4e4dd8038fdad78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63ac7d6-ae", "ovs_interfaceid": "c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-2c5ab55d-4301-4011-9c05-1e391d81a1cc tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Converting VIF {"id": "c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a", "address": "fa:16:3e:16:4f:0b", "network": {"id": "17352d7d-ab4a-4f2a-b647-e9fa7d9c355d", "bridge": "br-int", "label": "tempest-TestShelveInstance-756457394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88550719c2fd46d6a4e4dd8038fdad78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63ac7d6-ae", "ovs_interfaceid": "c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-2c5ab55d-4301-4011-9c05-1e391d81a1cc tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:4f:0b,bridge_name='br-int',has_traffic_filtering=True,id=c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a,network=Network(17352d7d-ab4a-4f2a-b647-e9fa7d9c355d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63ac7d6-ae') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG os_vif [None req-2c5ab55d-4301-4011-9c05-1e391d81a1cc tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:4f:0b,bridge_name='br-int',has_traffic_filtering=True,id=c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a,network=Network(17352d7d-ab4a-4f2a-b647-e9fa7d9c355d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63ac7d6-ae') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc63ac7d6-ae, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=96e4ce44-8395-4d7c-b756-7e7d2fdb328b) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:19:32 user nova-compute[75100]: INFO os_vif [None req-2c5ab55d-4301-4011-9c05-1e391d81a1cc tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:4f:0b,bridge_name='br-int',has_traffic_filtering=True,id=c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a,network=Network(17352d7d-ab4a-4f2a-b647-e9fa7d9c355d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63ac7d6-ae')
Nov 10 18:19:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c5ab55d-4301-4011-9c05-1e391d81a1cc tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5ab55d-4301-4011-9c05-1e391d81a1cc tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, {'target_iqn': 'iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NaXenRKr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:19:32 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-2c5ab55d-4301-4011-9c05-1e391d81a1cc tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:19:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-2c5ab55d-4301-4011-9c05-1e391d81a1cc tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-2c5ab55d-4301-4011-9c05-1e391d81a1cc tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a65c45-8bfc-4121-b504-ad13007a60dd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5ab55d-4301-4011-9c05-1e391d81a1cc tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 18:19:32 user nova-compute[75100]: No targets found.
Nov 10 18:19:32 user nova-compute[75100]: iSNS:
Nov 10 18:19:32 user nova-compute[75100]: No targets found.
Nov 10 18:19:32 user nova-compute[75100]: STATIC:
Nov 10 18:19:32 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e
Nov 10 18:19:32 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:19:32 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:19:32 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e
Nov 10 18:19:32 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:19:32 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:19:32 user nova-compute[75100]: FIRMWARE:
Nov 10 18:19:32 user nova-compute[75100]: No targets found.
Nov 10 18:19:32 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5ab55d-4301-4011-9c05-1e391d81a1cc tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 18:19:32 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 18:19:32 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5ab55d-4301-4011-9c05-1e391d81a1cc tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c32be1f-e1ac-4c94-967c-c42732fd063d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[56504618-bf9e-40c5-a896-31b874a566b8]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5ab55d-4301-4011-9c05-1e391d81a1cc tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e (non-flash)
Nov 10 18:19:32 user nova-compute[75100]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e (non-flash)
Nov 10 18:19:32 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5ab55d-4301-4011-9c05-1e391d81a1cc tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e (non-flash)
Nov 10 18:19:32 user nova-compute[75100]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e (non-flash)
Nov 10 18:19:32 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5ab55d-4301-4011-9c05-1e391d81a1cc tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3dc2a4c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e'): ({'sdb'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-2c5ab55d-4301-4011-9c05-1e391d81a1cc tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Removing single pathed devices sdb {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a554c6fb-4ff2-44e4-8f0d-353378ef8728]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bdb945b-374b-4c21-8b42-4703ce9a99ec]: (4, ('ok\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-2c5ab55d-4301-4011-9c05-1e391d81a1cc tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Flushing IO for device /dev/sdb {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8926d631-bf2f-47cb-9b6d-9d256af83ca2]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-2c5ab55d-4301-4011-9c05-1e391d81a1cc tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7806f008-e4e9-4f30-92d1-a680db5d3683]: (4, ('1', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-2c5ab55d-4301-4011-9c05-1e391d81a1cc tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-2c5ab55d-4301-4011-9c05-1e391d81a1cc tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5ab55d-4301-4011-9c05-1e391d81a1cc tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f223a0ee-6cd4-4ca6-b624-9c039b86bc79]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5ab55d-4301-4011-9c05-1e391d81a1cc tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e -p 172.16.0.220:3260 --logout {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffcb0d00-9bc9-4108-8902-01ae36b55d25]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5ab55d-4301-4011-9c05-1e391d81a1cc tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e, portal: 172.16.0.220,3260]
Nov 10 18:19:32 user nova-compute[75100]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e, portal: 172.16.0.220,3260] successful.
Nov 10 18:19:32 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e -p 172.16.0.220:3260 --op delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e235bb5d-0f3a-4380-a53a-224a47d6584e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ebce82-18be-4133-b4fa-f00d391e525d]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5ab55d-4301-4011-9c05-1e391d81a1cc tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-2c5ab55d-4301-4011-9c05-1e391d81a1cc tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5ab55d-4301-4011-9c05-1e391d81a1cc tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] <== disconnect_volume: return (339ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c5ab55d-4301-4011-9c05-1e391d81a1cc tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 18:19:32 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-2c5ab55d-4301-4011-9c05-1e391d81a1cc tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Deleting instance files /opt/stack/data/nova/instances/8f04a49b-8124-4319-a4b2-b40786984c00_del
Nov 10 18:19:32 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-2c5ab55d-4301-4011-9c05-1e391d81a1cc tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Deletion of /opt/stack/data/nova/instances/8f04a49b-8124-4319-a4b2-b40786984c00_del complete
Nov 10 18:19:32 user nova-compute[75100]: INFO nova.compute.manager [None req-2c5ab55d-4301-4011-9c05-1e391d81a1cc tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Took 1.23 seconds to destroy the instance on the hypervisor.
Nov 10 18:19:32 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-2c5ab55d-4301-4011-9c05-1e391d81a1cc tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:19:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:19:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:19:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:19:33 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:19:33 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Took 1.02 seconds to deallocate network for instance.
Nov 10 18:19:33 user nova-compute[75100]: DEBUG nova.compute.manager [req-ceaeb62f-34d2-4707-a67e-141f30108a37 req-b0307fbc-67eb-4191-bfa1-26ed1c78d723 service nova] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Received event network-vif-deleted-c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:19:33 user nova-compute[75100]: DEBUG nova.compute.manager [req-cb5ec5e6-148a-44a0-a151-428ce2723f5f req-fd4b607f-6a82-4662-bcc1-aaa993eacaf4 service nova] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Received event network-vif-plugged-c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:19:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cb5ec5e6-148a-44a0-a151-428ce2723f5f req-fd4b607f-6a82-4662-bcc1-aaa993eacaf4 service nova] Acquiring lock "8f04a49b-8124-4319-a4b2-b40786984c00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:19:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cb5ec5e6-148a-44a0-a151-428ce2723f5f req-fd4b607f-6a82-4662-bcc1-aaa993eacaf4 service nova] Lock "8f04a49b-8124-4319-a4b2-b40786984c00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:19:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cb5ec5e6-148a-44a0-a151-428ce2723f5f req-fd4b607f-6a82-4662-bcc1-aaa993eacaf4 service nova] Lock "8f04a49b-8124-4319-a4b2-b40786984c00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:19:33 user nova-compute[75100]: DEBUG nova.compute.manager [req-cb5ec5e6-148a-44a0-a151-428ce2723f5f req-fd4b607f-6a82-4662-bcc1-aaa993eacaf4 service nova] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] No waiting events found dispatching network-vif-plugged-c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:19:33 user nova-compute[75100]: WARNING nova.compute.manager [req-cb5ec5e6-148a-44a0-a151-428ce2723f5f req-fd4b607f-6a82-4662-bcc1-aaa993eacaf4 service nova] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Received unexpected event network-vif-plugged-c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a for instance with vm_state active and task_state deleting.
Nov 10 18:19:33 user nova-compute[75100]: DEBUG nova.compute.manager [req-cb5ec5e6-148a-44a0-a151-428ce2723f5f req-fd4b607f-6a82-4662-bcc1-aaa993eacaf4 service nova] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Received event network-vif-plugged-c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:19:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cb5ec5e6-148a-44a0-a151-428ce2723f5f req-fd4b607f-6a82-4662-bcc1-aaa993eacaf4 service nova] Acquiring lock "8f04a49b-8124-4319-a4b2-b40786984c00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:19:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cb5ec5e6-148a-44a0-a151-428ce2723f5f req-fd4b607f-6a82-4662-bcc1-aaa993eacaf4 service nova] Lock "8f04a49b-8124-4319-a4b2-b40786984c00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:19:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cb5ec5e6-148a-44a0-a151-428ce2723f5f req-fd4b607f-6a82-4662-bcc1-aaa993eacaf4 service nova] Lock "8f04a49b-8124-4319-a4b2-b40786984c00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:19:33 user nova-compute[75100]: DEBUG nova.compute.manager [req-cb5ec5e6-148a-44a0-a151-428ce2723f5f req-fd4b607f-6a82-4662-bcc1-aaa993eacaf4 service nova] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] No waiting events found dispatching network-vif-plugged-c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:19:33 user nova-compute[75100]: WARNING nova.compute.manager [req-cb5ec5e6-148a-44a0-a151-428ce2723f5f req-fd4b607f-6a82-4662-bcc1-aaa993eacaf4 service nova] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Received unexpected event network-vif-plugged-c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a for instance with vm_state active and task_state deleting.
Nov 10 18:19:33 user nova-compute[75100]: DEBUG nova.compute.manager [req-cb5ec5e6-148a-44a0-a151-428ce2723f5f req-fd4b607f-6a82-4662-bcc1-aaa993eacaf4 service nova] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Received event network-vif-plugged-c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:19:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cb5ec5e6-148a-44a0-a151-428ce2723f5f req-fd4b607f-6a82-4662-bcc1-aaa993eacaf4 service nova] Acquiring lock "8f04a49b-8124-4319-a4b2-b40786984c00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:19:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cb5ec5e6-148a-44a0-a151-428ce2723f5f req-fd4b607f-6a82-4662-bcc1-aaa993eacaf4 service nova] Lock "8f04a49b-8124-4319-a4b2-b40786984c00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:19:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cb5ec5e6-148a-44a0-a151-428ce2723f5f req-fd4b607f-6a82-4662-bcc1-aaa993eacaf4 service nova] Lock "8f04a49b-8124-4319-a4b2-b40786984c00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:19:33 user nova-compute[75100]: DEBUG nova.compute.manager [req-cb5ec5e6-148a-44a0-a151-428ce2723f5f req-fd4b607f-6a82-4662-bcc1-aaa993eacaf4 service nova] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] No waiting events found dispatching network-vif-plugged-c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:19:33 user nova-compute[75100]: WARNING nova.compute.manager [req-cb5ec5e6-148a-44a0-a151-428ce2723f5f req-fd4b607f-6a82-4662-bcc1-aaa993eacaf4 service nova] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Received unexpected event network-vif-plugged-c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a for instance with vm_state active and task_state deleting.
Nov 10 18:19:33 user nova-compute[75100]: DEBUG nova.compute.manager [req-cb5ec5e6-148a-44a0-a151-428ce2723f5f req-fd4b607f-6a82-4662-bcc1-aaa993eacaf4 service nova] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Received event network-vif-unplugged-c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:19:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cb5ec5e6-148a-44a0-a151-428ce2723f5f req-fd4b607f-6a82-4662-bcc1-aaa993eacaf4 service nova] Acquiring lock "8f04a49b-8124-4319-a4b2-b40786984c00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:19:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cb5ec5e6-148a-44a0-a151-428ce2723f5f req-fd4b607f-6a82-4662-bcc1-aaa993eacaf4 service nova] Lock "8f04a49b-8124-4319-a4b2-b40786984c00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:19:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cb5ec5e6-148a-44a0-a151-428ce2723f5f req-fd4b607f-6a82-4662-bcc1-aaa993eacaf4 service nova] Lock "8f04a49b-8124-4319-a4b2-b40786984c00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:19:33 user nova-compute[75100]: DEBUG nova.compute.manager [req-cb5ec5e6-148a-44a0-a151-428ce2723f5f req-fd4b607f-6a82-4662-bcc1-aaa993eacaf4 service nova] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] No waiting events found dispatching network-vif-unplugged-c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:19:33 user nova-compute[75100]: DEBUG nova.compute.manager [req-cb5ec5e6-148a-44a0-a151-428ce2723f5f req-fd4b607f-6a82-4662-bcc1-aaa993eacaf4 service nova] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Received event network-vif-unplugged-c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 18:19:33 user nova-compute[75100]: DEBUG nova.compute.manager [req-cb5ec5e6-148a-44a0-a151-428ce2723f5f req-fd4b607f-6a82-4662-bcc1-aaa993eacaf4 service nova] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Received event network-vif-plugged-c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:19:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cb5ec5e6-148a-44a0-a151-428ce2723f5f req-fd4b607f-6a82-4662-bcc1-aaa993eacaf4 service nova] Acquiring lock "8f04a49b-8124-4319-a4b2-b40786984c00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:19:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cb5ec5e6-148a-44a0-a151-428ce2723f5f req-fd4b607f-6a82-4662-bcc1-aaa993eacaf4 service nova] Lock "8f04a49b-8124-4319-a4b2-b40786984c00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:19:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cb5ec5e6-148a-44a0-a151-428ce2723f5f req-fd4b607f-6a82-4662-bcc1-aaa993eacaf4 service nova] Lock "8f04a49b-8124-4319-a4b2-b40786984c00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:19:33 user nova-compute[75100]: DEBUG nova.compute.manager [req-cb5ec5e6-148a-44a0-a151-428ce2723f5f req-fd4b607f-6a82-4662-bcc1-aaa993eacaf4 service nova] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] No waiting events found dispatching network-vif-plugged-c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:19:33 user nova-compute[75100]: WARNING nova.compute.manager [req-cb5ec5e6-148a-44a0-a151-428ce2723f5f req-fd4b607f-6a82-4662-bcc1-aaa993eacaf4 service nova] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Received unexpected event network-vif-plugged-c63ac7d6-ae33-4bd8-b5b3-d5600cd5939a for instance with vm_state active and task_state deleting.
Nov 10 18:19:34 user nova-compute[75100]: INFO nova.compute.manager [None req-2c5ab55d-4301-4011-9c05-1e391d81a1cc tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Took 1.01 seconds to detach 1 volumes for instance.
Nov 10 18:19:34 user nova-compute[75100]: DEBUG nova.compute.manager [None req-2c5ab55d-4301-4011-9c05-1e391d81a1cc tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] [instance: 8f04a49b-8124-4319-a4b2-b40786984c00] Deleting volume: e235bb5d-0f3a-4380-a53a-224a47d6584e {{(pid=75100) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 10 18:19:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2c5ab55d-4301-4011-9c05-1e391d81a1cc tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:19:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2c5ab55d-4301-4011-9c05-1e391d81a1cc tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:19:35 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-2c5ab55d-4301-4011-9c05-1e391d81a1cc tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:19:35 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-2c5ab55d-4301-4011-9c05-1e391d81a1cc tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:19:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:19:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2c5ab55d-4301-4011-9c05-1e391d81a1cc tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.195s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:19:35 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-2c5ab55d-4301-4011-9c05-1e391d81a1cc tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Deleted allocations for instance 8f04a49b-8124-4319-a4b2-b40786984c00
Nov 10 18:19:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2c5ab55d-4301-4011-9c05-1e391d81a1cc tempest-TestShelveInstance-691216050 tempest-TestShelveInstance-691216050-project-member] Lock "8f04a49b-8124-4319-a4b2-b40786984c00" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.705s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:19:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:19:37 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:19:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:19:41 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:19:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:19:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:19:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:19:41 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 18:19:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:19:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:19:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:19:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:19:42 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:19:42 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:19:42 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Hypervisor/Node resource view: name=user free_ram=8898MB free_disk=24.435009002685547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 18:19:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:19:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:19:42 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance fb6b4d45-7c2b-4211-9939-9989a6a3c913 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:19:42 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 18:19:42 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 18:19:42 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:19:42 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:19:42 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 18:19:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.182s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:19:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:19:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:19:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:19:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:19:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:19:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:19:44 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-5542fe59-f1b4-40df-936f-c07594754292 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fb6b4d45-7c2b-4211-9939-9989a6a3c913 is timed out.
Nov 10 18:19:44 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-5542fe59-f1b4-40df-936f-c07594754292 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Successfully detached device vdb from instance fb6b4d45-7c2b-4211-9939-9989a6a3c913 from the live domain config.
Nov 10 18:19:44 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5542fe59-f1b4-40df-936f-c07594754292 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 18:19:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-5542fe59-f1b4-40df-936f-c07594754292 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, {'target_iqn': 'iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oYSOkxne', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:19:44 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-5542fe59-f1b4-40df-936f-c07594754292 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:19:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-5542fe59-f1b4-40df-936f-c07594754292 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:19:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-5542fe59-f1b4-40df-936f-c07594754292 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:19:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:19:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:19:44 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6a371c-f74c-4eff-abda-c15e69c4304f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:19:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-5542fe59-f1b4-40df-936f-c07594754292 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 18:19:44 user nova-compute[75100]: No targets found.
Nov 10 18:19:44 user nova-compute[75100]: iSNS:
Nov 10 18:19:44 user nova-compute[75100]: No targets found.
Nov 10 18:19:44 user nova-compute[75100]: STATIC:
Nov 10 18:19:44 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e
Nov 10 18:19:44 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:19:44 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:19:44 user nova-compute[75100]: FIRMWARE:
Nov 10 18:19:44 user nova-compute[75100]: No targets found.
Nov 10 18:19:44 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:19:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-5542fe59-f1b4-40df-936f-c07594754292 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 18:19:44 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 18:19:44 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 18:19:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-5542fe59-f1b4-40df-936f-c07594754292 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 18:19:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:19:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:19:44 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[703d0483-baa6-426b-ac42-8ab7584b270a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:19:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:19:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:19:44 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[079eab6d-ebf0-42ac-a79e-0000edee5581]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:19:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-5542fe59-f1b4-40df-936f-c07594754292 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e (non-flash)
Nov 10 18:19:44 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:19:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-5542fe59-f1b4-40df-936f-c07594754292 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e (non-flash)
Nov 10 18:19:44 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:19:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-5542fe59-f1b4-40df-936f-c07594754292 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3d42c3010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e'): ({'sdc'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 18:19:44 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-5542fe59-f1b4-40df-936f-c07594754292 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Removing single pathed devices sdc {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 18:19:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:19:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:19:44 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7252a215-5cff-4fce-8a78-0eb4c2acae71]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:19:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:19:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:19:44 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2d0856-4187-468a-b4fb-86fb493e10b4]: (4, ('ok\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:19:44 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-5542fe59-f1b4-40df-936f-c07594754292 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Flushing IO for device /dev/sdc {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 18:19:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:19:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:19:44 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f0cffc-d1cd-4811-94db-2fae7ed7b6e2]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:19:44 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-5542fe59-f1b4-40df-936f-c07594754292 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 18:19:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:19:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:19:45 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b3b7ed-db96-4fb9-b490-4e53ac41e2ca]: (4, ('1', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:19:45 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-5542fe59-f1b4-40df-936f-c07594754292 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 18:19:45 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-5542fe59-f1b4-40df-936f-c07594754292 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] SCSI volumes sdc have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 18:19:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-5542fe59-f1b4-40df-936f-c07594754292 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 18:19:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:19:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:19:45 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6557095b-3a4c-4de6-86d1-0835373aa15b]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:19:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-5542fe59-f1b4-40df-936f-c07594754292 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:19:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e -p 172.16.0.220:3260 --logout {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:19:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:19:45 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e57145a-7ad7-4128-97dd-7d72fe6a1f8f]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:19:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-5542fe59-f1b4-40df-936f-c07594754292 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e, portal: 172.16.0.220,3260]
Nov 10 18:19:45 user nova-compute[75100]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e, portal: 172.16.0.220,3260] successful.
Nov 10 18:19:45 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:19:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e -p 172.16.0.220:3260 --op delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:19:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc0ab4ad-3373-400c-a672-07ef9b16555e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:19:45 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[daacad22-6b8b-4d52-a946-f83c5d038e3f]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:19:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-5542fe59-f1b4-40df-936f-c07594754292 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:19:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-5542fe59-f1b4-40df-936f-c07594754292 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:19:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-5542fe59-f1b4-40df-936f-c07594754292 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] <== disconnect_volume: return (294ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:19:45 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5542fe59-f1b4-40df-936f-c07594754292 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 18:19:46 user nova-compute[75100]: DEBUG nova.objects.instance [None req-5542fe59-f1b4-40df-936f-c07594754292 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lazy-loading 'flavor' on Instance uuid fb6b4d45-7c2b-4211-9939-9989a6a3c913 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:19:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5542fe59-f1b4-40df-936f-c07594754292 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "fb6b4d45-7c2b-4211-9939-9989a6a3c913" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.875s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:19:46 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:19:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0f599373-e2f2-4591-9e47-a0f999b75686 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Acquiring lock "fb6b4d45-7c2b-4211-9939-9989a6a3c913" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:19:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0f599373-e2f2-4591-9e47-a0f999b75686 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "fb6b4d45-7c2b-4211-9939-9989a6a3c913" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:19:46 user nova-compute[75100]: DEBUG nova.compute.manager [None req-0f599373-e2f2-4591-9e47-a0f999b75686 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 18:19:46 user nova-compute[75100]: DEBUG nova.compute.manager [None req-0f599373-e2f2-4591-9e47-a0f999b75686 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75100) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 10 18:19:46 user nova-compute[75100]: DEBUG nova.objects.instance [None req-0f599373-e2f2-4591-9e47-a0f999b75686 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lazy-loading 'flavor' on Instance uuid fb6b4d45-7c2b-4211-9939-9989a6a3c913 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:19:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:19:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:19:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:19:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:19:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:19:47 user nova-compute[75100]: DEBUG nova.compute.manager [req-bccc617e-1955-4e27-8ab2-bb41f9cb9ee5 req-683fda88-c5c1-4a44-ba63-267f0306d775 service nova] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Received event network-vif-unplugged-64ffd205-85a8-4c33-8ec4-40f8519b0bd5 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:19:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-bccc617e-1955-4e27-8ab2-bb41f9cb9ee5 req-683fda88-c5c1-4a44-ba63-267f0306d775 service nova] Acquiring lock "fb6b4d45-7c2b-4211-9939-9989a6a3c913-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:19:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-bccc617e-1955-4e27-8ab2-bb41f9cb9ee5 req-683fda88-c5c1-4a44-ba63-267f0306d775 service nova] Lock "fb6b4d45-7c2b-4211-9939-9989a6a3c913-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:19:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-bccc617e-1955-4e27-8ab2-bb41f9cb9ee5 req-683fda88-c5c1-4a44-ba63-267f0306d775 service nova] Lock "fb6b4d45-7c2b-4211-9939-9989a6a3c913-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:19:47 user nova-compute[75100]: DEBUG nova.compute.manager [req-bccc617e-1955-4e27-8ab2-bb41f9cb9ee5 req-683fda88-c5c1-4a44-ba63-267f0306d775 service nova] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] No waiting events found dispatching network-vif-unplugged-64ffd205-85a8-4c33-8ec4-40f8519b0bd5 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:19:47 user nova-compute[75100]: WARNING nova.compute.manager [req-bccc617e-1955-4e27-8ab2-bb41f9cb9ee5 req-683fda88-c5c1-4a44-ba63-267f0306d775 service nova] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Received unexpected event network-vif-unplugged-64ffd205-85a8-4c33-8ec4-40f8519b0bd5 for instance with vm_state active and task_state powering-off.
Nov 10 18:19:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:19:47 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Instance destroyed successfully.
Nov 10 18:19:47 user nova-compute[75100]: DEBUG nova.compute.manager [None req-0f599373-e2f2-4591-9e47-a0f999b75686 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 18:19:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0f599373-e2f2-4591-9e47-a0f999b75686 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "fb6b4d45-7c2b-4211-9939-9989a6a3c913" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.824s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:19:48 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:19:49 user nova-compute[75100]: DEBUG nova.compute.manager [req-852a736a-a82c-40a5-a555-6f6d1a4d63dc req-d9eb6488-2404-4782-ae67-10aa393ab783 service nova] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Received event network-vif-plugged-64ffd205-85a8-4c33-8ec4-40f8519b0bd5 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:19:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-852a736a-a82c-40a5-a555-6f6d1a4d63dc req-d9eb6488-2404-4782-ae67-10aa393ab783 service nova] Acquiring lock "fb6b4d45-7c2b-4211-9939-9989a6a3c913-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:19:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-852a736a-a82c-40a5-a555-6f6d1a4d63dc req-d9eb6488-2404-4782-ae67-10aa393ab783 service nova] Lock "fb6b4d45-7c2b-4211-9939-9989a6a3c913-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:19:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-852a736a-a82c-40a5-a555-6f6d1a4d63dc req-d9eb6488-2404-4782-ae67-10aa393ab783 service nova] Lock "fb6b4d45-7c2b-4211-9939-9989a6a3c913-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:19:49 user nova-compute[75100]: DEBUG nova.compute.manager [req-852a736a-a82c-40a5-a555-6f6d1a4d63dc req-d9eb6488-2404-4782-ae67-10aa393ab783 service nova] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] No waiting events found dispatching network-vif-plugged-64ffd205-85a8-4c33-8ec4-40f8519b0bd5 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:19:49 user nova-compute[75100]: WARNING nova.compute.manager [req-852a736a-a82c-40a5-a555-6f6d1a4d63dc req-d9eb6488-2404-4782-ae67-10aa393ab783 service nova] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Received unexpected event network-vif-plugged-64ffd205-85a8-4c33-8ec4-40f8519b0bd5 for instance with vm_state stopped and task_state None.
Nov 10 18:19:49 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:19:50 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:19:51 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:19:51 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 18:19:51 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Rebuilding the list of instances to heal {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 18:19:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "refresh_cache-fb6b4d45-7c2b-4211-9939-9989a6a3c913" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:19:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquired lock "refresh_cache-fb6b4d45-7c2b-4211-9939-9989a6a3c913" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:19:51 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 18:19:51 user nova-compute[75100]: DEBUG nova.objects.instance [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lazy-loading 'info_cache' on Instance uuid fb6b4d45-7c2b-4211-9939-9989a6a3c913 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:19:52 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Updating instance_info_cache with network_info: [{"id": "64ffd205-85a8-4c33-8ec4-40f8519b0bd5", "address": "fa:16:3e:d6:d0:ff", "network": {"id": "0c411791-eb03-4e00-9d7f-d032e2c16d46", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1808141765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc6fc8310f44f3788e13aa4f1eb8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ffd205-85", "ovs_interfaceid": "64ffd205-85a8-4c33-8ec4-40f8519b0bd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:19:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:19:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:19:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:19:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:19:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:19:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:19:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Releasing lock "refresh_cache-fb6b4d45-7c2b-4211-9939-9989a6a3c913" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:19:52 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 18:19:54 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:19:54 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 18:19:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:19:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:20:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:20:07 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:20:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:20:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:20:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:20:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:20:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:20:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:20:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.imagecache [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Verify base images {{(pid=75100) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 10 18:20:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.imagecache [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Image id e3cc5321-4d40-49ee-885c-700e14741732 yields fingerprint 818b9e28e061d41a38d903968b229be2ed9ba520 {{(pid=75100) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 10 18:20:07 user nova-compute[75100]: INFO nova.virt.libvirt.imagecache [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] image e3cc5321-4d40-49ee-885c-700e14741732 at (/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520): checking
Nov 10 18:20:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.imagecache [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] image e3cc5321-4d40-49ee-885c-700e14741732 at (/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520): image is in use {{(pid=75100) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 10 18:20:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.imagecache [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75100) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 10 18:20:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.imagecache [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] fb6b4d45-7c2b-4211-9939-9989a6a3c913 is a valid instance name {{(pid=75100) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 10 18:20:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.imagecache [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] fb6b4d45-7c2b-4211-9939-9989a6a3c913 has a disk file {{(pid=75100) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 10 18:20:07 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:20:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:20:07 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:20:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.imagecache [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance fb6b4d45-7c2b-4211-9939-9989a6a3c913 is backed by 818b9e28e061d41a38d903968b229be2ed9ba520 {{(pid=75100) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 10 18:20:07 user nova-compute[75100]: WARNING nova.virt.libvirt.imagecache [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Unknown base file: /opt/stack/data/nova/instances/_base/459501bcfccfaec0db1be9fbec75d5813f56216d
Nov 10 18:20:07 user nova-compute[75100]: WARNING nova.virt.libvirt.imagecache [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Unknown base file: /opt/stack/data/nova/instances/_base/daecc5fa8ac6b547626a5a8d0d4e399d63fbf232
Nov 10 18:20:07 user nova-compute[75100]: WARNING nova.virt.libvirt.imagecache [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Unknown base file: /opt/stack/data/nova/instances/_base/8eedf2b9c68a1e7afb9bdd92ae6b7b46130f810e
Nov 10 18:20:07 user nova-compute[75100]: WARNING nova.virt.libvirt.imagecache [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Unknown base file: /opt/stack/data/nova/instances/_base/c5090bf38fcf4e6c952dd13213f6cbb47fa74b36
Nov 10 18:20:07 user nova-compute[75100]: WARNING nova.virt.libvirt.imagecache [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Unknown base file: /opt/stack/data/nova/instances/_base/73fed14145cf922fc471d7b2cf11b042ef0978a4
Nov 10 18:20:07 user nova-compute[75100]: WARNING nova.virt.libvirt.imagecache [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Unknown base file: /opt/stack/data/nova/instances/_base/32b0d5f28832cb638516d0f6fa49f7e7c143221f
Nov 10 18:20:07 user nova-compute[75100]: WARNING nova.virt.libvirt.imagecache [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Unknown base file: /opt/stack/data/nova/instances/_base/63e098e260c9cbc17986e4db78afe5b7a428c299
Nov 10 18:20:07 user nova-compute[75100]: INFO nova.virt.libvirt.imagecache [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Active base files: /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520
Nov 10 18:20:07 user nova-compute[75100]: INFO nova.virt.libvirt.imagecache [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Removable base files: /opt/stack/data/nova/instances/_base/459501bcfccfaec0db1be9fbec75d5813f56216d /opt/stack/data/nova/instances/_base/daecc5fa8ac6b547626a5a8d0d4e399d63fbf232 /opt/stack/data/nova/instances/_base/8eedf2b9c68a1e7afb9bdd92ae6b7b46130f810e /opt/stack/data/nova/instances/_base/c5090bf38fcf4e6c952dd13213f6cbb47fa74b36 /opt/stack/data/nova/instances/_base/73fed14145cf922fc471d7b2cf11b042ef0978a4 /opt/stack/data/nova/instances/_base/32b0d5f28832cb638516d0f6fa49f7e7c143221f /opt/stack/data/nova/instances/_base/63e098e260c9cbc17986e4db78afe5b7a428c299
Nov 10 18:20:07 user nova-compute[75100]: INFO nova.virt.libvirt.imagecache [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/459501bcfccfaec0db1be9fbec75d5813f56216d
Nov 10 18:20:07 user nova-compute[75100]: INFO nova.virt.libvirt.imagecache [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/daecc5fa8ac6b547626a5a8d0d4e399d63fbf232
Nov 10 18:20:07 user nova-compute[75100]: INFO nova.virt.libvirt.imagecache [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8eedf2b9c68a1e7afb9bdd92ae6b7b46130f810e
Nov 10 18:20:07 user nova-compute[75100]: INFO nova.virt.libvirt.imagecache [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c5090bf38fcf4e6c952dd13213f6cbb47fa74b36
Nov 10 18:20:07 user nova-compute[75100]: INFO nova.virt.libvirt.imagecache [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/73fed14145cf922fc471d7b2cf11b042ef0978a4
Nov 10 18:20:07 user nova-compute[75100]: INFO nova.virt.libvirt.imagecache [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/32b0d5f28832cb638516d0f6fa49f7e7c143221f
Nov 10 18:20:07 user nova-compute[75100]: INFO nova.virt.libvirt.imagecache [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/63e098e260c9cbc17986e4db78afe5b7a428c299
Nov 10 18:20:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.imagecache [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Verification complete {{(pid=75100) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 10 18:20:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.imagecache [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Verify swap images {{(pid=75100) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 10 18:20:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.imagecache [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Verify ephemeral images {{(pid=75100) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 10 18:20:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:20:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:20:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:20:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:20:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:20:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:20:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:20:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:20:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:20:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:20:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:20:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:20:32 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:20:38 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:20:39 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:20:39 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75100) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 18:20:42 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:20:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:20:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:20:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:20:42 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 18:20:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:20:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:20:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:20:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:20:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:20:43 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:20:43 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:20:43 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Hypervisor/Node resource view: name=user free_ram=9088MB free_disk=24.43234634399414GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 18:20:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:20:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:20:43 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance fb6b4d45-7c2b-4211-9939-9989a6a3c913 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:20:43 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 18:20:43 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 18:20:43 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:20:43 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:20:43 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 18:20:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.402s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:20:46 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:20:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:20:49 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:20:50 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:20:51 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:20:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:20:53 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:20:53 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 18:20:53 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Rebuilding the list of instances to heal {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 18:20:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "refresh_cache-fb6b4d45-7c2b-4211-9939-9989a6a3c913" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:20:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquired lock "refresh_cache-fb6b4d45-7c2b-4211-9939-9989a6a3c913" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:20:53 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 18:20:53 user nova-compute[75100]: DEBUG nova.objects.instance [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lazy-loading 'info_cache' on Instance uuid fb6b4d45-7c2b-4211-9939-9989a6a3c913 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:20:53 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Updating instance_info_cache with network_info: [{"id": "64ffd205-85a8-4c33-8ec4-40f8519b0bd5", "address": "fa:16:3e:d6:d0:ff", "network": {"id": "0c411791-eb03-4e00-9d7f-d032e2c16d46", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1808141765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc6fc8310f44f3788e13aa4f1eb8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ffd205-85", "ovs_interfaceid": "64ffd205-85a8-4c33-8ec4-40f8519b0bd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:20:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Releasing lock "refresh_cache-fb6b4d45-7c2b-4211-9939-9989a6a3c913" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:20:53 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 18:20:54 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:20:54 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 18:20:57 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:20:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:21:00 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:21:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:21:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:21:08 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:21:08 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Cleaning up deleted instances {{(pid=75100) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 18:21:08 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] There are 0 instances to clean {{(pid=75100) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 18:21:08 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:21:08 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Triggering sync for uuid fb6b4d45-7c2b-4211-9939-9989a6a3c913 {{(pid=75100) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 18:21:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "fb6b4d45-7c2b-4211-9939-9989a6a3c913" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:21:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "fb6b4d45-7c2b-4211-9939-9989a6a3c913" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:21:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "fb6b4d45-7c2b-4211-9939-9989a6a3c913" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:21:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:21:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:21:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:21:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:21:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:21:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:21:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:21:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:21:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:21:32 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:21:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:21:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:21:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:21:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Acquiring lock "d02fea18-bb78-472e-8947-909f4b6b5fde" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:21:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lock "d02fea18-bb78-472e-8947-909f4b6b5fde" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:21:37 user nova-compute[75100]: DEBUG nova.compute.manager [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 18:21:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:21:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:21:37 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 18:21:37 user nova-compute[75100]: INFO nova.compute.claims [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Claim successful on node user
Nov 10 18:21:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:21:37 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:21:37 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:21:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.256s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:21:37 user nova-compute[75100]: DEBUG nova.compute.manager [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 18:21:37 user nova-compute[75100]: DEBUG nova.compute.manager [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 18:21:37 user nova-compute[75100]: DEBUG nova.network.neutron [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 18:21:37 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 18:21:37 user nova-compute[75100]: DEBUG nova.compute.manager [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 18:21:37 user nova-compute[75100]: DEBUG nova.policy [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e6c06f310b524587ac7344729aa3a0bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38869dd0674640b1b72258b53dc8f5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 18:21:37 user nova-compute[75100]: DEBUG nova.compute.manager [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 18:21:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 18:21:37 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Creating image(s)
Nov 10 18:21:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Acquiring lock "/opt/stack/data/nova/instances/d02fea18-bb78-472e-8947-909f4b6b5fde/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:21:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lock "/opt/stack/data/nova/instances/d02fea18-bb78-472e-8947-909f4b6b5fde/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:21:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lock "/opt/stack/data/nova/instances/d02fea18-bb78-472e-8947-909f4b6b5fde/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:21:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:21:37 user nova-compute[75100]: DEBUG nova.objects.instance [None req-7a0fb892-a83c-49f0-937a-65d3d43af2b7 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lazy-loading 'flavor' on Instance uuid fb6b4d45-7c2b-4211-9939-9989a6a3c913 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:21:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7a0fb892-a83c-49f0-937a-65d3d43af2b7 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Acquiring lock "refresh_cache-fb6b4d45-7c2b-4211-9939-9989a6a3c913" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:21:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7a0fb892-a83c-49f0-937a-65d3d43af2b7 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Acquired lock "refresh_cache-fb6b4d45-7c2b-4211-9939-9989a6a3c913" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:21:37 user nova-compute[75100]: DEBUG nova.network.neutron [None req-7a0fb892-a83c-49f0-937a-65d3d43af2b7 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 18:21:37 user nova-compute[75100]: DEBUG nova.objects.instance [None req-7a0fb892-a83c-49f0-937a-65d3d43af2b7 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lazy-loading 'info_cache' on Instance uuid fb6b4d45-7c2b-4211-9939-9989a6a3c913 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:21:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.191s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:21:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Acquiring lock "818b9e28e061d41a38d903968b229be2ed9ba520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:21:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:21:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:21:37 user nova-compute[75100]: DEBUG nova.objects.base [None req-7a0fb892-a83c-49f0-937a-65d3d43af2b7 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Object Instance<fb6b4d45-7c2b-4211-9939-9989a6a3c913> lazy-loaded attributes: flavor,info_cache {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 18:21:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.205s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:21:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/d02fea18-bb78-472e-8947-909f4b6b5fde/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:21:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/d02fea18-bb78-472e-8947-909f4b6b5fde/disk 1073741824" returned: 0 in 0.145s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:21:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.355s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:21:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:21:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.190s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:21:38 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d02fea18-bb78-472e-8947-909f4b6b5fde/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 18:21:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d02fea18-bb78-472e-8947-909f4b6b5fde/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:21:38 user nova-compute[75100]: DEBUG nova.network.neutron [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Successfully created port: f7d27dda-1b70-4f3f-b866-c2705b01e396 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 18:21:38 user nova-compute[75100]: DEBUG nova.network.neutron [None req-7a0fb892-a83c-49f0-937a-65d3d43af2b7 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Updating instance_info_cache with network_info: [{"id": "64ffd205-85a8-4c33-8ec4-40f8519b0bd5", "address": "fa:16:3e:d6:d0:ff", "network": {"id": "0c411791-eb03-4e00-9d7f-d032e2c16d46", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1808141765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc6fc8310f44f3788e13aa4f1eb8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ffd205-85", "ovs_interfaceid": "64ffd205-85a8-4c33-8ec4-40f8519b0bd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:21:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7a0fb892-a83c-49f0-937a-65d3d43af2b7 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Releasing lock "refresh_cache-fb6b4d45-7c2b-4211-9939-9989a6a3c913" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:21:38 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Instance destroyed successfully.
Nov 10 18:21:38 user nova-compute[75100]: DEBUG nova.objects.instance [None req-7a0fb892-a83c-49f0-937a-65d3d43af2b7 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lazy-loading 'resources' on Instance uuid fb6b4d45-7c2b-4211-9939-9989a6a3c913 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:21:38 user nova-compute[75100]: DEBUG nova.objects.base [None req-7a0fb892-a83c-49f0-937a-65d3d43af2b7 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Object Instance<fb6b4d45-7c2b-4211-9939-9989a6a3c913> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 18:21:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-7a0fb892-a83c-49f0-937a-65d3d43af2b7 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:13:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1135440047',display_name='tempest-AttachVolumeTestJSON-server-1135440047',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1135440047',id=46,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcNRutHNHeVY/scgmxR9G4KJoQs59QhgQZEw5FvsqZrAjpQ/2uGeVsJVaEeZoz53+Lx9VAPkikUDH6vDzggddQ9KuRG+0ma+NlYbiZWBP5qgm948UdG/c0syluE8zjWJA==',key_name='tempest-keypair-1049460111',keypairs=<?>,launch_index=0,launched_at=2023-11-10T18:13:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='8cc6fc8310f44f3788e13aa4f1eb8c96',ramdisk_id='',reservation_id='r-nozvlwff',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-375321786',owner_user_name='tempest-AttachVolumeTestJSON-375321786-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T18:19:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='20c5bb15b9174fbc9df8ba12de10cea6',uuid=fb6b4d45-7c2b-4211-9939-9989a6a3c913,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "64ffd205-85a8-4c33-8ec4-40f8519b0bd5", "address": "fa:16:3e:d6:d0:ff", "network": {"id": "0c411791-eb03-4e00-9d7f-d032e2c16d46", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1808141765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc6fc8310f44f3788e13aa4f1eb8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ffd205-85", "ovs_interfaceid": "64ffd205-85a8-4c33-8ec4-40f8519b0bd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 18:21:38 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-7a0fb892-a83c-49f0-937a-65d3d43af2b7 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Converting VIF {"id": "64ffd205-85a8-4c33-8ec4-40f8519b0bd5", "address": "fa:16:3e:d6:d0:ff", "network": {"id": "0c411791-eb03-4e00-9d7f-d032e2c16d46", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1808141765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc6fc8310f44f3788e13aa4f1eb8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ffd205-85", "ovs_interfaceid": "64ffd205-85a8-4c33-8ec4-40f8519b0bd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:21:38 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-7a0fb892-a83c-49f0-937a-65d3d43af2b7 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:d0:ff,bridge_name='br-int',has_traffic_filtering=True,id=64ffd205-85a8-4c33-8ec4-40f8519b0bd5,network=Network(0c411791-eb03-4e00-9d7f-d032e2c16d46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64ffd205-85') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:21:38 user nova-compute[75100]: DEBUG os_vif [None req-7a0fb892-a83c-49f0-937a-65d3d43af2b7 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:d0:ff,bridge_name='br-int',has_traffic_filtering=True,id=64ffd205-85a8-4c33-8ec4-40f8519b0bd5,network=Network(0c411791-eb03-4e00-9d7f-d032e2c16d46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64ffd205-85') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 18:21:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:21:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap64ffd205-85, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:21:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:21:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d02fea18-bb78-472e-8947-909f4b6b5fde/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:21:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:21:38 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Cannot resize image /opt/stack/data/nova/instances/d02fea18-bb78-472e-8947-909f4b6b5fde/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 18:21:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 18:21:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Ensure instance console log exists: /opt/stack/data/nova/instances/d02fea18-bb78-472e-8947-909f4b6b5fde/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 18:21:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:21:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:21:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:21:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:21:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d93e2567-29ae-4287-a71b-16b3abe4c107) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:21:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:21:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:21:38 user nova-compute[75100]: INFO os_vif [None req-7a0fb892-a83c-49f0-937a-65d3d43af2b7 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:d0:ff,bridge_name='br-int',has_traffic_filtering=True,id=64ffd205-85a8-4c33-8ec4-40f8519b0bd5,network=Network(0c411791-eb03-4e00-9d7f-d032e2c16d46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64ffd205-85')
Nov 10 18:21:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7a0fb892-a83c-49f0-937a-65d3d43af2b7 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Start _get_guest_xml network_info=[{"id": "64ffd205-85a8-4c33-8ec4-40f8519b0bd5", "address": "fa:16:3e:d6:d0:ff", "network": {"id": "0c411791-eb03-4e00-9d7f-d032e2c16d46", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1808141765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc6fc8310f44f3788e13aa4f1eb8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ffd205-85", "ovs_interfaceid": "64ffd205-85a8-4c33-8ec4-40f8519b0bd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'e3cc5321-4d40-49ee-885c-700e14741732'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 18:21:38 user nova-compute[75100]: DEBUG nova.objects.instance [None req-7a0fb892-a83c-49f0-937a-65d3d43af2b7 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lazy-loading 'numa_topology' on Instance uuid fb6b4d45-7c2b-4211-9939-9989a6a3c913 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:21:38 user nova-compute[75100]: DEBUG nova.objects.base [None req-7a0fb892-a83c-49f0-937a-65d3d43af2b7 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Object Instance<fb6b4d45-7c2b-4211-9939-9989a6a3c913> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 18:21:38 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-7a0fb892-a83c-49f0-937a-65d3d43af2b7 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:21:38 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-7a0fb892-a83c-49f0-937a-65d3d43af2b7 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:21:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-7a0fb892-a83c-49f0-937a-65d3d43af2b7 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 18:21:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-7a0fb892-a83c-49f0-937a-65d3d43af2b7 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 18:21:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-7a0fb892-a83c-49f0-937a-65d3d43af2b7 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 18:21:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-7a0fb892-a83c-49f0-937a-65d3d43af2b7 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 18:21:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7a0fb892-a83c-49f0-937a-65d3d43af2b7 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 18:21:38 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7a0fb892-a83c-49f0-937a-65d3d43af2b7 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T17:40:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 18:21:38 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7a0fb892-a83c-49f0-937a-65d3d43af2b7 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 18:21:38 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7a0fb892-a83c-49f0-937a-65d3d43af2b7 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 18:21:38 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7a0fb892-a83c-49f0-937a-65d3d43af2b7 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 18:21:38 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7a0fb892-a83c-49f0-937a-65d3d43af2b7 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 18:21:38 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7a0fb892-a83c-49f0-937a-65d3d43af2b7 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 18:21:38 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7a0fb892-a83c-49f0-937a-65d3d43af2b7 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 18:21:38 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7a0fb892-a83c-49f0-937a-65d3d43af2b7 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 18:21:38 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7a0fb892-a83c-49f0-937a-65d3d43af2b7 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 18:21:38 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7a0fb892-a83c-49f0-937a-65d3d43af2b7 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 18:21:38 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7a0fb892-a83c-49f0-937a-65d3d43af2b7 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 18:21:38 user nova-compute[75100]: DEBUG nova.objects.instance [None req-7a0fb892-a83c-49f0-937a-65d3d43af2b7 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lazy-loading 'vcpu_model' on Instance uuid fb6b4d45-7c2b-4211-9939-9989a6a3c913 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:21:38 user nova-compute[75100]: DEBUG nova.objects.base [None req-7a0fb892-a83c-49f0-937a-65d3d43af2b7 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Object Instance<fb6b4d45-7c2b-4211-9939-9989a6a3c913> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 18:21:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-7a0fb892-a83c-49f0-937a-65d3d43af2b7 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:13:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1135440047',display_name='tempest-AttachVolumeTestJSON-server-1135440047',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1135440047',id=46,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcNRutHNHeVY/scgmxR9G4KJoQs59QhgQZEw5FvsqZrAjpQ/2uGeVsJVaEeZoz53+Lx9VAPkikUDH6vDzggddQ9KuRG+0ma+NlYbiZWBP5qgm948UdG/c0syluE8zjWJA==',key_name='tempest-keypair-1049460111',keypairs=<?>,launch_index=0,launched_at=2023-11-10T18:13:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='8cc6fc8310f44f3788e13aa4f1eb8c96',ramdisk_id='',reservation_id='r-nozvlwff',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-375321786',owner_user_name='tempest-AttachVolumeTestJSON-375321786-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T18:19:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='20c5bb15b9174fbc9df8ba12de10cea6',uuid=fb6b4d45-7c2b-4211-9939-9989a6a3c913,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "64ffd205-85a8-4c33-8ec4-40f8519b0bd5", "address": "fa:16:3e:d6:d0:ff", "network": {"id": "0c411791-eb03-4e00-9d7f-d032e2c16d46", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1808141765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc6fc8310f44f3788e13aa4f1eb8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ffd205-85", "ovs_interfaceid": "64ffd205-85a8-4c33-8ec4-40f8519b0bd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 18:21:38 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-7a0fb892-a83c-49f0-937a-65d3d43af2b7 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Converting VIF {"id": "64ffd205-85a8-4c33-8ec4-40f8519b0bd5", "address": "fa:16:3e:d6:d0:ff", "network": {"id": "0c411791-eb03-4e00-9d7f-d032e2c16d46", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1808141765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc6fc8310f44f3788e13aa4f1eb8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ffd205-85", "ovs_interfaceid": "64ffd205-85a8-4c33-8ec4-40f8519b0bd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:21:38 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-7a0fb892-a83c-49f0-937a-65d3d43af2b7 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:d0:ff,bridge_name='br-int',has_traffic_filtering=True,id=64ffd205-85a8-4c33-8ec4-40f8519b0bd5,network=Network(0c411791-eb03-4e00-9d7f-d032e2c16d46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64ffd205-85') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:21:38 user nova-compute[75100]: DEBUG nova.objects.instance [None req-7a0fb892-a83c-49f0-937a-65d3d43af2b7 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lazy-loading 'pci_devices' on Instance uuid fb6b4d45-7c2b-4211-9939-9989a6a3c913 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:21:38 user nova-compute[75100]: DEBUG nova.objects.base [None req-7a0fb892-a83c-49f0-937a-65d3d43af2b7 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Object Instance<fb6b4d45-7c2b-4211-9939-9989a6a3c913> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 18:21:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7a0fb892-a83c-49f0-937a-65d3d43af2b7 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] End _get_guest_xml xml=<domain type="kvm">
Nov 10 18:21:38 user nova-compute[75100]:   <uuid>fb6b4d45-7c2b-4211-9939-9989a6a3c913</uuid>
Nov 10 18:21:38 user nova-compute[75100]:   <name>instance-0000002e</name>
Nov 10 18:21:38 user nova-compute[75100]:   <memory>524288</memory>
Nov 10 18:21:38 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 10 18:21:38 user nova-compute[75100]:   <metadata>
Nov 10 18:21:38 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 18:21:38 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 10 18:21:38 user nova-compute[75100]:       <nova:name>tempest-AttachVolumeTestJSON-server-1135440047</nova:name>
Nov 10 18:21:38 user nova-compute[75100]:       <nova:creationTime>2023-11-10 18:21:38</nova:creationTime>
Nov 10 18:21:38 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 10 18:21:38 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 10 18:21:38 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 10 18:21:38 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 10 18:21:38 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 18:21:38 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 10 18:21:38 user nova-compute[75100]:       </nova:flavor>
Nov 10 18:21:38 user nova-compute[75100]:       <nova:owner>
Nov 10 18:21:38 user nova-compute[75100]:         <nova:user uuid="20c5bb15b9174fbc9df8ba12de10cea6">tempest-AttachVolumeTestJSON-375321786-project-member</nova:user>
Nov 10 18:21:38 user nova-compute[75100]:         <nova:project uuid="8cc6fc8310f44f3788e13aa4f1eb8c96">tempest-AttachVolumeTestJSON-375321786</nova:project>
Nov 10 18:21:38 user nova-compute[75100]:       </nova:owner>
Nov 10 18:21:38 user nova-compute[75100]:       <nova:root type="image" uuid="e3cc5321-4d40-49ee-885c-700e14741732"/>
Nov 10 18:21:38 user nova-compute[75100]:       <nova:ports>
Nov 10 18:21:38 user nova-compute[75100]:         <nova:port uuid="64ffd205-85a8-4c33-8ec4-40f8519b0bd5">
Nov 10 18:21:38 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 10 18:21:38 user nova-compute[75100]:         </nova:port>
Nov 10 18:21:38 user nova-compute[75100]:       </nova:ports>
Nov 10 18:21:38 user nova-compute[75100]:     </nova:instance>
Nov 10 18:21:38 user nova-compute[75100]:   </metadata>
Nov 10 18:21:38 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 10 18:21:38 user nova-compute[75100]:     <system>
Nov 10 18:21:38 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 18:21:38 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 10 18:21:38 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 10 18:21:38 user nova-compute[75100]:       <entry name="serial">fb6b4d45-7c2b-4211-9939-9989a6a3c913</entry>
Nov 10 18:21:38 user nova-compute[75100]:       <entry name="uuid">fb6b4d45-7c2b-4211-9939-9989a6a3c913</entry>
Nov 10 18:21:38 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 10 18:21:38 user nova-compute[75100]:     </system>
Nov 10 18:21:38 user nova-compute[75100]:   </sysinfo>
Nov 10 18:21:38 user nova-compute[75100]:   <os>
Nov 10 18:21:38 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 18:21:38 user nova-compute[75100]:     <boot dev="hd"/>
Nov 10 18:21:38 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 10 18:21:38 user nova-compute[75100]:   </os>
Nov 10 18:21:38 user nova-compute[75100]:   <features>
Nov 10 18:21:38 user nova-compute[75100]:     <acpi/>
Nov 10 18:21:38 user nova-compute[75100]:     <apic/>
Nov 10 18:21:38 user nova-compute[75100]:     <vmcoreinfo/>
Nov 10 18:21:38 user nova-compute[75100]:   </features>
Nov 10 18:21:38 user nova-compute[75100]:   <clock offset="utc">
Nov 10 18:21:38 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 18:21:38 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 18:21:38 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 10 18:21:38 user nova-compute[75100]:   </clock>
Nov 10 18:21:38 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 10 18:21:38 user nova-compute[75100]:     <model>Nehalem</model>
Nov 10 18:21:38 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 18:21:38 user nova-compute[75100]:   </cpu>
Nov 10 18:21:38 user nova-compute[75100]:   <devices>
Nov 10 18:21:38 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 10 18:21:38 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 18:21:38 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk"/>
Nov 10 18:21:38 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 10 18:21:38 user nova-compute[75100]:     </disk>
Nov 10 18:21:38 user nova-compute[75100]:     <interface type="ethernet">
Nov 10 18:21:38 user nova-compute[75100]:       <mac address="fa:16:3e:d6:d0:ff"/>
Nov 10 18:21:38 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 18:21:38 user nova-compute[75100]:       <mtu size="1442"/>
Nov 10 18:21:38 user nova-compute[75100]:       <target dev="tap64ffd205-85"/>
Nov 10 18:21:38 user nova-compute[75100]:     </interface>
Nov 10 18:21:38 user nova-compute[75100]:     <serial type="pty">
Nov 10 18:21:38 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/console.log" append="off"/>
Nov 10 18:21:38 user nova-compute[75100]:     </serial>
Nov 10 18:21:38 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 18:21:38 user nova-compute[75100]:     <video>
Nov 10 18:21:38 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 18:21:38 user nova-compute[75100]:     </video>
Nov 10 18:21:38 user nova-compute[75100]:     <rng model="virtio">
Nov 10 18:21:38 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 10 18:21:38 user nova-compute[75100]:     </rng>
Nov 10 18:21:38 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 10 18:21:38 user nova-compute[75100]:     <memballoon model="virtio">
Nov 10 18:21:38 user nova-compute[75100]:       <stats period="10"/>
Nov 10 18:21:38 user nova-compute[75100]:     </memballoon>
Nov 10 18:21:38 user nova-compute[75100]:   </devices>
Nov 10 18:21:38 user nova-compute[75100]: </domain>
Nov 10 18:21:38 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 18:21:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-7a0fb892-a83c-49f0-937a-65d3d43af2b7 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:21:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-7a0fb892-a83c-49f0-937a-65d3d43af2b7 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:21:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-7a0fb892-a83c-49f0-937a-65d3d43af2b7 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG nova.network.neutron [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Successfully updated port: f7d27dda-1b70-4f3f-b866-c2705b01e396 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-7a0fb892-a83c-49f0-937a-65d3d43af2b7 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG nova.objects.instance [None req-7a0fb892-a83c-49f0-937a-65d3d43af2b7 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lazy-loading 'trusted_certs' on Instance uuid fb6b4d45-7c2b-4211-9939-9989a6a3c913 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Acquiring lock "refresh_cache-d02fea18-bb78-472e-8947-909f4b6b5fde" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Acquired lock "refresh_cache-d02fea18-bb78-472e-8947-909f4b6b5fde" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG nova.network.neutron [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG nova.objects.base [None req-7a0fb892-a83c-49f0-937a-65d3d43af2b7 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Object Instance<fb6b4d45-7c2b-4211-9939-9989a6a3c913> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-7a0fb892-a83c-49f0-937a-65d3d43af2b7 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG nova.network.neutron [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG nova.compute.manager [req-ee23ef08-afee-4511-973c-81a177faf605 req-7b09933f-c9b2-4899-805d-2fc3a8b1f259 service nova] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Received event network-changed-f7d27dda-1b70-4f3f-b866-c2705b01e396 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG nova.compute.manager [req-ee23ef08-afee-4511-973c-81a177faf605 req-7b09933f-c9b2-4899-805d-2fc3a8b1f259 service nova] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Refreshing instance network info cache due to event network-changed-f7d27dda-1b70-4f3f-b866-c2705b01e396. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ee23ef08-afee-4511-973c-81a177faf605 req-7b09933f-c9b2-4899-805d-2fc3a8b1f259 service nova] Acquiring lock "refresh_cache-d02fea18-bb78-472e-8947-909f4b6b5fde" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-7a0fb892-a83c-49f0-937a-65d3d43af2b7 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.179s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-7a0fb892-a83c-49f0-937a-65d3d43af2b7 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-7a0fb892-a83c-49f0-937a-65d3d43af2b7 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG nova.network.neutron [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Updating instance_info_cache with network_info: [{"id": "f7d27dda-1b70-4f3f-b866-c2705b01e396", "address": "fa:16:3e:b3:cf:91", "network": {"id": "9b61fda2-5437-4085-889d-35a4edda72bc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1424647024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38869dd0674640b1b72258b53dc8f5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7d27dda-1b", "ovs_interfaceid": "f7d27dda-1b70-4f3f-b866-c2705b01e396", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Releasing lock "refresh_cache-d02fea18-bb78-472e-8947-909f4b6b5fde" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG nova.compute.manager [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Instance network_info: |[{"id": "f7d27dda-1b70-4f3f-b866-c2705b01e396", "address": "fa:16:3e:b3:cf:91", "network": {"id": "9b61fda2-5437-4085-889d-35a4edda72bc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1424647024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38869dd0674640b1b72258b53dc8f5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7d27dda-1b", "ovs_interfaceid": "f7d27dda-1b70-4f3f-b866-c2705b01e396", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ee23ef08-afee-4511-973c-81a177faf605 req-7b09933f-c9b2-4899-805d-2fc3a8b1f259 service nova] Acquired lock "refresh_cache-d02fea18-bb78-472e-8947-909f4b6b5fde" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG nova.network.neutron [req-ee23ef08-afee-4511-973c-81a177faf605 req-7b09933f-c9b2-4899-805d-2fc3a8b1f259 service nova] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Refreshing network info cache for port f7d27dda-1b70-4f3f-b866-c2705b01e396 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Start _get_guest_xml network_info=[{"id": "f7d27dda-1b70-4f3f-b866-c2705b01e396", "address": "fa:16:3e:b3:cf:91", "network": {"id": "9b61fda2-5437-4085-889d-35a4edda72bc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1424647024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38869dd0674640b1b72258b53dc8f5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7d27dda-1b", "ovs_interfaceid": "f7d27dda-1b70-4f3f-b866-c2705b01e396", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'e3cc5321-4d40-49ee-885c-700e14741732'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 18:21:39 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:21:39 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:21:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T17:40:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:21:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1947290224',display_name='tempest-SnapshotDataIntegrityTests-server-1947290224',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1947290224',id=49,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6pvXTJ7G6EdpLcOaGzqjuyc4qsZcZrBUiIRaIFkewlXSrOSxvECdwUY2WJBA92SsMT8ZcO/35Txv8sPEdEtD6xmUkGaTq7ko2Bjq8fgfGK9/IMaZAaGNJGWHpcds5lgw==',key_name='tempest-keypair-1240068900',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='38869dd0674640b1b72258b53dc8f5db',ramdisk_id='',reservation_id='r-04atrpd3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1069078983',owner_user_name='tempest-SnapshotDataIntegrityTests-1069078983-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T18:21:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6c06f310b524587ac7344729aa3a0bb',uuid=d02fea18-bb78-472e-8947-909f4b6b5fde,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f7d27dda-1b70-4f3f-b866-c2705b01e396", "address": "fa:16:3e:b3:cf:91", "network": {"id": "9b61fda2-5437-4085-889d-35a4edda72bc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1424647024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38869dd0674640b1b72258b53dc8f5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7d27dda-1b", "ovs_interfaceid": "f7d27dda-1b70-4f3f-b866-c2705b01e396", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Converting VIF {"id": "f7d27dda-1b70-4f3f-b866-c2705b01e396", "address": "fa:16:3e:b3:cf:91", "network": {"id": "9b61fda2-5437-4085-889d-35a4edda72bc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1424647024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38869dd0674640b1b72258b53dc8f5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7d27dda-1b", "ovs_interfaceid": "f7d27dda-1b70-4f3f-b866-c2705b01e396", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:cf:91,bridge_name='br-int',has_traffic_filtering=True,id=f7d27dda-1b70-4f3f-b866-c2705b01e396,network=Network(9b61fda2-5437-4085-889d-35a4edda72bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7d27dda-1b') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG nova.objects.instance [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lazy-loading 'pci_devices' on Instance uuid d02fea18-bb78-472e-8947-909f4b6b5fde {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-7a0fb892-a83c-49f0-937a-65d3d43af2b7 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-7a0fb892-a83c-49f0-937a-65d3d43af2b7 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Cannot resize image /opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG nova.objects.instance [None req-7a0fb892-a83c-49f0-937a-65d3d43af2b7 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lazy-loading 'migration_context' on Instance uuid fb6b4d45-7c2b-4211-9939-9989a6a3c913 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] End _get_guest_xml xml=<domain type="kvm">
Nov 10 18:21:39 user nova-compute[75100]:   <uuid>d02fea18-bb78-472e-8947-909f4b6b5fde</uuid>
Nov 10 18:21:39 user nova-compute[75100]:   <name>instance-00000031</name>
Nov 10 18:21:39 user nova-compute[75100]:   <memory>524288</memory>
Nov 10 18:21:39 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 10 18:21:39 user nova-compute[75100]:   <metadata>
Nov 10 18:21:39 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 18:21:39 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 10 18:21:39 user nova-compute[75100]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1947290224</nova:name>
Nov 10 18:21:39 user nova-compute[75100]:       <nova:creationTime>2023-11-10 18:21:39</nova:creationTime>
Nov 10 18:21:39 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 10 18:21:39 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 10 18:21:39 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 10 18:21:39 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 10 18:21:39 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 18:21:39 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 10 18:21:39 user nova-compute[75100]:       </nova:flavor>
Nov 10 18:21:39 user nova-compute[75100]:       <nova:owner>
Nov 10 18:21:39 user nova-compute[75100]:         <nova:user uuid="e6c06f310b524587ac7344729aa3a0bb">tempest-SnapshotDataIntegrityTests-1069078983-project-member</nova:user>
Nov 10 18:21:39 user nova-compute[75100]:         <nova:project uuid="38869dd0674640b1b72258b53dc8f5db">tempest-SnapshotDataIntegrityTests-1069078983</nova:project>
Nov 10 18:21:39 user nova-compute[75100]:       </nova:owner>
Nov 10 18:21:39 user nova-compute[75100]:       <nova:root type="image" uuid="e3cc5321-4d40-49ee-885c-700e14741732"/>
Nov 10 18:21:39 user nova-compute[75100]:       <nova:ports>
Nov 10 18:21:39 user nova-compute[75100]:         <nova:port uuid="f7d27dda-1b70-4f3f-b866-c2705b01e396">
Nov 10 18:21:39 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 10 18:21:39 user nova-compute[75100]:         </nova:port>
Nov 10 18:21:39 user nova-compute[75100]:       </nova:ports>
Nov 10 18:21:39 user nova-compute[75100]:     </nova:instance>
Nov 10 18:21:39 user nova-compute[75100]:   </metadata>
Nov 10 18:21:39 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 10 18:21:39 user nova-compute[75100]:     <system>
Nov 10 18:21:39 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 18:21:39 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 10 18:21:39 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 10 18:21:39 user nova-compute[75100]:       <entry name="serial">d02fea18-bb78-472e-8947-909f4b6b5fde</entry>
Nov 10 18:21:39 user nova-compute[75100]:       <entry name="uuid">d02fea18-bb78-472e-8947-909f4b6b5fde</entry>
Nov 10 18:21:39 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 10 18:21:39 user nova-compute[75100]:     </system>
Nov 10 18:21:39 user nova-compute[75100]:   </sysinfo>
Nov 10 18:21:39 user nova-compute[75100]:   <os>
Nov 10 18:21:39 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 18:21:39 user nova-compute[75100]:     <boot dev="hd"/>
Nov 10 18:21:39 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 10 18:21:39 user nova-compute[75100]:   </os>
Nov 10 18:21:39 user nova-compute[75100]:   <features>
Nov 10 18:21:39 user nova-compute[75100]:     <acpi/>
Nov 10 18:21:39 user nova-compute[75100]:     <apic/>
Nov 10 18:21:39 user nova-compute[75100]:     <vmcoreinfo/>
Nov 10 18:21:39 user nova-compute[75100]:   </features>
Nov 10 18:21:39 user nova-compute[75100]:   <clock offset="utc">
Nov 10 18:21:39 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 18:21:39 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 18:21:39 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 10 18:21:39 user nova-compute[75100]:   </clock>
Nov 10 18:21:39 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 10 18:21:39 user nova-compute[75100]:     <model>Nehalem</model>
Nov 10 18:21:39 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 18:21:39 user nova-compute[75100]:   </cpu>
Nov 10 18:21:39 user nova-compute[75100]:   <devices>
Nov 10 18:21:39 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 10 18:21:39 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 18:21:39 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/d02fea18-bb78-472e-8947-909f4b6b5fde/disk"/>
Nov 10 18:21:39 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 10 18:21:39 user nova-compute[75100]:     </disk>
Nov 10 18:21:39 user nova-compute[75100]:     <interface type="ethernet">
Nov 10 18:21:39 user nova-compute[75100]:       <mac address="fa:16:3e:b3:cf:91"/>
Nov 10 18:21:39 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 18:21:39 user nova-compute[75100]:       <mtu size="1442"/>
Nov 10 18:21:39 user nova-compute[75100]:       <target dev="tapf7d27dda-1b"/>
Nov 10 18:21:39 user nova-compute[75100]:     </interface>
Nov 10 18:21:39 user nova-compute[75100]:     <serial type="pty">
Nov 10 18:21:39 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/d02fea18-bb78-472e-8947-909f4b6b5fde/console.log" append="off"/>
Nov 10 18:21:39 user nova-compute[75100]:     </serial>
Nov 10 18:21:39 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 18:21:39 user nova-compute[75100]:     <video>
Nov 10 18:21:39 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 18:21:39 user nova-compute[75100]:     </video>
Nov 10 18:21:39 user nova-compute[75100]:     <rng model="virtio">
Nov 10 18:21:39 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 10 18:21:39 user nova-compute[75100]:     </rng>
Nov 10 18:21:39 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 10 18:21:39 user nova-compute[75100]:     <memballoon model="virtio">
Nov 10 18:21:39 user nova-compute[75100]:       <stats period="10"/>
Nov 10 18:21:39 user nova-compute[75100]:     </memballoon>
Nov 10 18:21:39 user nova-compute[75100]:   </devices>
Nov 10 18:21:39 user nova-compute[75100]: </domain>
Nov 10 18:21:39 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:21:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1947290224',display_name='tempest-SnapshotDataIntegrityTests-server-1947290224',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1947290224',id=49,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6pvXTJ7G6EdpLcOaGzqjuyc4qsZcZrBUiIRaIFkewlXSrOSxvECdwUY2WJBA92SsMT8ZcO/35Txv8sPEdEtD6xmUkGaTq7ko2Bjq8fgfGK9/IMaZAaGNJGWHpcds5lgw==',key_name='tempest-keypair-1240068900',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='38869dd0674640b1b72258b53dc8f5db',ramdisk_id='',reservation_id='r-04atrpd3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1069078983',owner_user_name='tempest-SnapshotDataIntegrityTests-1069078983-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T18:21:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6c06f310b524587ac7344729aa3a0bb',uuid=d02fea18-bb78-472e-8947-909f4b6b5fde,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f7d27dda-1b70-4f3f-b866-c2705b01e396", "address": "fa:16:3e:b3:cf:91", "network": {"id": "9b61fda2-5437-4085-889d-35a4edda72bc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1424647024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38869dd0674640b1b72258b53dc8f5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7d27dda-1b", "ovs_interfaceid": "f7d27dda-1b70-4f3f-b866-c2705b01e396", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Converting VIF {"id": "f7d27dda-1b70-4f3f-b866-c2705b01e396", "address": "fa:16:3e:b3:cf:91", "network": {"id": "9b61fda2-5437-4085-889d-35a4edda72bc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1424647024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38869dd0674640b1b72258b53dc8f5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7d27dda-1b", "ovs_interfaceid": "f7d27dda-1b70-4f3f-b866-c2705b01e396", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:cf:91,bridge_name='br-int',has_traffic_filtering=True,id=f7d27dda-1b70-4f3f-b866-c2705b01e396,network=Network(9b61fda2-5437-4085-889d-35a4edda72bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7d27dda-1b') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG os_vif [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:cf:91,bridge_name='br-int',has_traffic_filtering=True,id=f7d27dda-1b70-4f3f-b866-c2705b01e396,network=Network(9b61fda2-5437-4085-889d-35a4edda72bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7d27dda-1b') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG nova.objects.base [None req-7a0fb892-a83c-49f0-937a-65d3d43af2b7 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Object Instance<fb6b4d45-7c2b-4211-9939-9989a6a3c913> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-7a0fb892-a83c-49f0-937a-65d3d43af2b7 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:13:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1135440047',display_name='tempest-AttachVolumeTestJSON-server-1135440047',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1135440047',id=46,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcNRutHNHeVY/scgmxR9G4KJoQs59QhgQZEw5FvsqZrAjpQ/2uGeVsJVaEeZoz53+Lx9VAPkikUDH6vDzggddQ9KuRG+0ma+NlYbiZWBP5qgm948UdG/c0syluE8zjWJA==',key_name='tempest-keypair-1049460111',keypairs=<?>,launch_index=0,launched_at=2023-11-10T18:13:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='8cc6fc8310f44f3788e13aa4f1eb8c96',ramdisk_id='',reservation_id='r-nozvlwff',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-375321786',owner_user_name='tempest-AttachVolumeTestJSON-375321786-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T18:19:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='20c5bb15b9174fbc9df8ba12de10cea6',uuid=fb6b4d45-7c2b-4211-9939-9989a6a3c913,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "64ffd205-85a8-4c33-8ec4-40f8519b0bd5", "address": "fa:16:3e:d6:d0:ff", "network": {"id": "0c411791-eb03-4e00-9d7f-d032e2c16d46", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1808141765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc6fc8310f44f3788e13aa4f1eb8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ffd205-85", "ovs_interfaceid": "64ffd205-85a8-4c33-8ec4-40f8519b0bd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-7a0fb892-a83c-49f0-937a-65d3d43af2b7 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Converting VIF {"id": "64ffd205-85a8-4c33-8ec4-40f8519b0bd5", "address": "fa:16:3e:d6:d0:ff", "network": {"id": "0c411791-eb03-4e00-9d7f-d032e2c16d46", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1808141765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc6fc8310f44f3788e13aa4f1eb8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ffd205-85", "ovs_interfaceid": "64ffd205-85a8-4c33-8ec4-40f8519b0bd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-7a0fb892-a83c-49f0-937a-65d3d43af2b7 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:d0:ff,bridge_name='br-int',has_traffic_filtering=True,id=64ffd205-85a8-4c33-8ec4-40f8519b0bd5,network=Network(0c411791-eb03-4e00-9d7f-d032e2c16d46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64ffd205-85') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG os_vif [None req-7a0fb892-a83c-49f0-937a-65d3d43af2b7 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:d0:ff,bridge_name='br-int',has_traffic_filtering=True,id=64ffd205-85a8-4c33-8ec4-40f8519b0bd5,network=Network(0c411791-eb03-4e00-9d7f-d032e2c16d46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64ffd205-85') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '90b113a4-3c8b-511f-9f2b-f7a10470722b', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bec451fb-2b1e-530e-9419-4051e35f1110', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf7d27dda-1b, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf7d27dda-1b, col_values=(('qos', UUID('d74172ea-a3ce-4809-b77b-b84f174c8233')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf7d27dda-1b, col_values=(('external_ids', {'iface-id': 'f7d27dda-1b70-4f3f-b866-c2705b01e396', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:cf:91', 'vm-uuid': 'd02fea18-bb78-472e-8947-909f4b6b5fde'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:21:39 user nova-compute[75100]: INFO os_vif [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:cf:91,bridge_name='br-int',has_traffic_filtering=True,id=f7d27dda-1b70-4f3f-b866-c2705b01e396,network=Network(9b61fda2-5437-4085-889d-35a4edda72bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7d27dda-1b')
Nov 10 18:21:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap64ffd205-85, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap64ffd205-85, col_values=(('qos', UUID('0553a735-304a-4888-95f1-76d9c6bdd9d8')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap64ffd205-85, col_values=(('external_ids', {'iface-id': '64ffd205-85a8-4c33-8ec4-40f8519b0bd5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:d0:ff', 'vm-uuid': 'fb6b4d45-7c2b-4211-9939-9989a6a3c913'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:21:39 user nova-compute[75100]: INFO os_vif [None req-7a0fb892-a83c-49f0-937a-65d3d43af2b7 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:d0:ff,bridge_name='br-int',has_traffic_filtering=True,id=64ffd205-85a8-4c33-8ec4-40f8519b0bd5,network=Network(0c411791-eb03-4e00-9d7f-d032e2c16d46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64ffd205-85')
Nov 10 18:21:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] No VIF found with MAC fa:16:3e:b3:cf:91, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG nova.network.neutron [req-ee23ef08-afee-4511-973c-81a177faf605 req-7b09933f-c9b2-4899-805d-2fc3a8b1f259 service nova] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Updated VIF entry in instance network info cache for port f7d27dda-1b70-4f3f-b866-c2705b01e396. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG nova.network.neutron [req-ee23ef08-afee-4511-973c-81a177faf605 req-7b09933f-c9b2-4899-805d-2fc3a8b1f259 service nova] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Updating instance_info_cache with network_info: [{"id": "f7d27dda-1b70-4f3f-b866-c2705b01e396", "address": "fa:16:3e:b3:cf:91", "network": {"id": "9b61fda2-5437-4085-889d-35a4edda72bc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1424647024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38869dd0674640b1b72258b53dc8f5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7d27dda-1b", "ovs_interfaceid": "f7d27dda-1b70-4f3f-b866-c2705b01e396", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:21:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ee23ef08-afee-4511-973c-81a177faf605 req-7b09933f-c9b2-4899-805d-2fc3a8b1f259 service nova] Releasing lock "refresh_cache-d02fea18-bb78-472e-8947-909f4b6b5fde" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:21:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:21:40 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:21:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:21:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:21:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:21:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:21:42 user nova-compute[75100]: DEBUG nova.compute.manager [req-6fdedf3e-afd6-4836-96a3-1b429e8e374c req-1e807bbe-26ea-4b70-b641-4f6119da8ac1 service nova] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Received event network-vif-plugged-64ffd205-85a8-4c33-8ec4-40f8519b0bd5 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:21:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6fdedf3e-afd6-4836-96a3-1b429e8e374c req-1e807bbe-26ea-4b70-b641-4f6119da8ac1 service nova] Acquiring lock "fb6b4d45-7c2b-4211-9939-9989a6a3c913-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:21:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6fdedf3e-afd6-4836-96a3-1b429e8e374c req-1e807bbe-26ea-4b70-b641-4f6119da8ac1 service nova] Lock "fb6b4d45-7c2b-4211-9939-9989a6a3c913-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:21:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6fdedf3e-afd6-4836-96a3-1b429e8e374c req-1e807bbe-26ea-4b70-b641-4f6119da8ac1 service nova] Lock "fb6b4d45-7c2b-4211-9939-9989a6a3c913-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:21:42 user nova-compute[75100]: DEBUG nova.compute.manager [req-6fdedf3e-afd6-4836-96a3-1b429e8e374c req-1e807bbe-26ea-4b70-b641-4f6119da8ac1 service nova] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] No waiting events found dispatching network-vif-plugged-64ffd205-85a8-4c33-8ec4-40f8519b0bd5 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:21:42 user nova-compute[75100]: WARNING nova.compute.manager [req-6fdedf3e-afd6-4836-96a3-1b429e8e374c req-1e807bbe-26ea-4b70-b641-4f6119da8ac1 service nova] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Received unexpected event network-vif-plugged-64ffd205-85a8-4c33-8ec4-40f8519b0bd5 for instance with vm_state stopped and task_state powering-on.
Nov 10 18:21:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:21:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:21:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:21:42 user nova-compute[75100]: DEBUG nova.compute.manager [req-ff92348f-07d9-42c5-8b42-d136138d03bb req-d4ca9ea7-b2b5-4455-8e32-154d5e29d78d service nova] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Received event network-vif-plugged-f7d27dda-1b70-4f3f-b866-c2705b01e396 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:21:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ff92348f-07d9-42c5-8b42-d136138d03bb req-d4ca9ea7-b2b5-4455-8e32-154d5e29d78d service nova] Acquiring lock "d02fea18-bb78-472e-8947-909f4b6b5fde-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:21:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ff92348f-07d9-42c5-8b42-d136138d03bb req-d4ca9ea7-b2b5-4455-8e32-154d5e29d78d service nova] Lock "d02fea18-bb78-472e-8947-909f4b6b5fde-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:21:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ff92348f-07d9-42c5-8b42-d136138d03bb req-d4ca9ea7-b2b5-4455-8e32-154d5e29d78d service nova] Lock "d02fea18-bb78-472e-8947-909f4b6b5fde-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:21:42 user nova-compute[75100]: DEBUG nova.compute.manager [req-ff92348f-07d9-42c5-8b42-d136138d03bb req-d4ca9ea7-b2b5-4455-8e32-154d5e29d78d service nova] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] No waiting events found dispatching network-vif-plugged-f7d27dda-1b70-4f3f-b866-c2705b01e396 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:21:42 user nova-compute[75100]: WARNING nova.compute.manager [req-ff92348f-07d9-42c5-8b42-d136138d03bb req-d4ca9ea7-b2b5-4455-8e32-154d5e29d78d service nova] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Received unexpected event network-vif-plugged-f7d27dda-1b70-4f3f-b866-c2705b01e396 for instance with vm_state building and task_state spawning.
Nov 10 18:21:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:21:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:21:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:21:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:21:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:21:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:21:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:21:44 user nova-compute[75100]: DEBUG nova.compute.manager [req-05f7836b-5942-46b5-81d2-0330b104cc53 req-f788703a-06d4-4732-9891-43f3b6a53a42 service nova] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Received event network-vif-plugged-64ffd205-85a8-4c33-8ec4-40f8519b0bd5 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:21:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-05f7836b-5942-46b5-81d2-0330b104cc53 req-f788703a-06d4-4732-9891-43f3b6a53a42 service nova] Acquiring lock "fb6b4d45-7c2b-4211-9939-9989a6a3c913-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:21:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-05f7836b-5942-46b5-81d2-0330b104cc53 req-f788703a-06d4-4732-9891-43f3b6a53a42 service nova] Lock "fb6b4d45-7c2b-4211-9939-9989a6a3c913-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:21:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-05f7836b-5942-46b5-81d2-0330b104cc53 req-f788703a-06d4-4732-9891-43f3b6a53a42 service nova] Lock "fb6b4d45-7c2b-4211-9939-9989a6a3c913-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:21:44 user nova-compute[75100]: DEBUG nova.compute.manager [req-05f7836b-5942-46b5-81d2-0330b104cc53 req-f788703a-06d4-4732-9891-43f3b6a53a42 service nova] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] No waiting events found dispatching network-vif-plugged-64ffd205-85a8-4c33-8ec4-40f8519b0bd5 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:21:44 user nova-compute[75100]: WARNING nova.compute.manager [req-05f7836b-5942-46b5-81d2-0330b104cc53 req-f788703a-06d4-4732-9891-43f3b6a53a42 service nova] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Received unexpected event network-vif-plugged-64ffd205-85a8-4c33-8ec4-40f8519b0bd5 for instance with vm_state stopped and task_state powering-on.
Nov 10 18:21:44 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:21:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:21:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:21:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:21:44 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 18:21:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:21:44 user nova-compute[75100]: DEBUG nova.compute.manager [req-fe537e31-1cce-45e6-b5fb-103040cbcbb1 req-2829c7a7-3cc2-4775-94be-da219ced0693 service nova] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Received event network-vif-plugged-f7d27dda-1b70-4f3f-b866-c2705b01e396 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:21:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-fe537e31-1cce-45e6-b5fb-103040cbcbb1 req-2829c7a7-3cc2-4775-94be-da219ced0693 service nova] Acquiring lock "d02fea18-bb78-472e-8947-909f4b6b5fde-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:21:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-fe537e31-1cce-45e6-b5fb-103040cbcbb1 req-2829c7a7-3cc2-4775-94be-da219ced0693 service nova] Lock "d02fea18-bb78-472e-8947-909f4b6b5fde-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:21:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-fe537e31-1cce-45e6-b5fb-103040cbcbb1 req-2829c7a7-3cc2-4775-94be-da219ced0693 service nova] Lock "d02fea18-bb78-472e-8947-909f4b6b5fde-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:21:44 user nova-compute[75100]: DEBUG nova.compute.manager [req-fe537e31-1cce-45e6-b5fb-103040cbcbb1 req-2829c7a7-3cc2-4775-94be-da219ced0693 service nova] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] No waiting events found dispatching network-vif-plugged-f7d27dda-1b70-4f3f-b866-c2705b01e396 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:21:44 user nova-compute[75100]: WARNING nova.compute.manager [req-fe537e31-1cce-45e6-b5fb-103040cbcbb1 req-2829c7a7-3cc2-4775-94be-da219ced0693 service nova] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Received unexpected event network-vif-plugged-f7d27dda-1b70-4f3f-b866-c2705b01e396 for instance with vm_state building and task_state spawning.
Nov 10 18:21:44 user nova-compute[75100]: DEBUG nova.compute.manager [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 18:21:44 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 18:21:44 user nova-compute[75100]: DEBUG nova.compute.manager [None req-7a0fb892-a83c-49f0-937a-65d3d43af2b7 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 18:21:44 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Instance spawned successfully.
Nov 10 18:21:44 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 18:21:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:21:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:21:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:21:44 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Instance rebooted successfully.
Nov 10 18:21:44 user nova-compute[75100]: DEBUG nova.compute.manager [None req-7a0fb892-a83c-49f0-937a-65d3d43af2b7 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 18:21:44 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:21:44 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:21:44 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:21:44 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:21:44 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:21:44 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:21:44 user nova-compute[75100]: INFO nova.compute.manager [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Took 7.08 seconds to spawn the instance on the hypervisor.
Nov 10 18:21:44 user nova-compute[75100]: DEBUG nova.compute.manager [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 18:21:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:21:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d02fea18-bb78-472e-8947-909f4b6b5fde/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:21:44 user nova-compute[75100]: INFO nova.compute.manager [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Took 7.68 seconds to build instance.
Nov 10 18:21:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3a1e4e89-8295-4a7b-ad3d-134542d57937 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lock "d02fea18-bb78-472e-8947-909f4b6b5fde" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.776s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:21:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d02fea18-bb78-472e-8947-909f4b6b5fde/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:21:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d02fea18-bb78-472e-8947-909f4b6b5fde/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:21:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:21:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d02fea18-bb78-472e-8947-909f4b6b5fde/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:21:45 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:21:45 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:21:45 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Hypervisor/Node resource view: name=user free_ram=9002MB free_disk=24.420894622802734GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 18:21:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:21:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:21:45 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance fb6b4d45-7c2b-4211-9939-9989a6a3c913 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:21:45 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance d02fea18-bb78-472e-8947-909f4b6b5fde actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:21:45 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 18:21:45 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 18:21:45 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Refreshing inventories for resource provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 18:21:45 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Updating ProviderTree inventory for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 18:21:45 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Updating inventory in ProviderTree for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 18:21:45 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Refreshing aggregate associations for resource provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64, aggregates: None {{(pid=75100) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 18:21:45 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Refreshing trait associations for resource provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2 {{(pid=75100) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 18:21:45 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:21:45 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:21:45 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 18:21:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.321s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:21:48 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:21:49 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:21:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:21:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:21:50 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:21:51 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:21:54 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:21:54 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 18:21:54 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Rebuilding the list of instances to heal {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 18:21:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "refresh_cache-fb6b4d45-7c2b-4211-9939-9989a6a3c913" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:21:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquired lock "refresh_cache-fb6b4d45-7c2b-4211-9939-9989a6a3c913" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:21:54 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 18:21:54 user nova-compute[75100]: DEBUG nova.objects.instance [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lazy-loading 'info_cache' on Instance uuid fb6b4d45-7c2b-4211-9939-9989a6a3c913 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:21:54 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:21:54 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Updating instance_info_cache with network_info: [{"id": "64ffd205-85a8-4c33-8ec4-40f8519b0bd5", "address": "fa:16:3e:d6:d0:ff", "network": {"id": "0c411791-eb03-4e00-9d7f-d032e2c16d46", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1808141765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc6fc8310f44f3788e13aa4f1eb8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ffd205-85", "ovs_interfaceid": "64ffd205-85a8-4c33-8ec4-40f8519b0bd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:21:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Releasing lock "refresh_cache-fb6b4d45-7c2b-4211-9939-9989a6a3c913" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:21:54 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 18:21:54 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:21:54 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 18:21:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:21:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:22:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:22:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:22:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:22:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:22:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:22:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:22:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:22:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:22:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:22:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:22:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:22:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:22:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:22:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:22:33 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:22:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:22:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:22:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:22:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:22:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:22:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:22:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:22:42 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:22:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:22:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:22:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:22:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:22:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:22:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:22:45 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:22:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:22:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:22:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:22:45 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 18:22:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:22:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:22:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:22:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:22:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d02fea18-bb78-472e-8947-909f4b6b5fde/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:22:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d02fea18-bb78-472e-8947-909f4b6b5fde/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:22:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d02fea18-bb78-472e-8947-909f4b6b5fde/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:22:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d02fea18-bb78-472e-8947-909f4b6b5fde/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:22:46 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:22:46 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:22:46 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Hypervisor/Node resource view: name=user free_ram=8856MB free_disk=24.392059326171875GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 18:22:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:22:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:22:46 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance fb6b4d45-7c2b-4211-9939-9989a6a3c913 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:22:46 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance d02fea18-bb78-472e-8947-909f4b6b5fde actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:22:46 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 18:22:46 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 18:22:46 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:22:46 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:22:46 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 18:22:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.208s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:22:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:22:50 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:22:50 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:22:50 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:22:51 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:22:54 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:22:54 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 18:22:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "refresh_cache-d02fea18-bb78-472e-8947-909f4b6b5fde" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:22:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquired lock "refresh_cache-d02fea18-bb78-472e-8947-909f4b6b5fde" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:22:54 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 18:22:54 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:22:54 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Updating instance_info_cache with network_info: [{"id": "f7d27dda-1b70-4f3f-b866-c2705b01e396", "address": "fa:16:3e:b3:cf:91", "network": {"id": "9b61fda2-5437-4085-889d-35a4edda72bc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1424647024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38869dd0674640b1b72258b53dc8f5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7d27dda-1b", "ovs_interfaceid": "f7d27dda-1b70-4f3f-b866-c2705b01e396", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:22:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Releasing lock "refresh_cache-d02fea18-bb78-472e-8947-909f4b6b5fde" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:22:54 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 18:22:55 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:22:55 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 18:22:58 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:22:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:23:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:23:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:23:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:23:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:23:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:23:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:23:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:23:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:23:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:23:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:23:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:23:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:23:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:23:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4996-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:23:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:23:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:23:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:23:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:23:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:23:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:23:28 user nova-compute[75100]: DEBUG nova.compute.manager [req-78724b2d-2719-4cd0-a212-d8b11343c9e6 req-2e86d47c-80e0-45af-a897-db564bc91fb9 service nova] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Received event network-changed-f7d27dda-1b70-4f3f-b866-c2705b01e396 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:23:28 user nova-compute[75100]: DEBUG nova.compute.manager [req-78724b2d-2719-4cd0-a212-d8b11343c9e6 req-2e86d47c-80e0-45af-a897-db564bc91fb9 service nova] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Refreshing instance network info cache due to event network-changed-f7d27dda-1b70-4f3f-b866-c2705b01e396. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 18:23:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-78724b2d-2719-4cd0-a212-d8b11343c9e6 req-2e86d47c-80e0-45af-a897-db564bc91fb9 service nova] Acquiring lock "refresh_cache-d02fea18-bb78-472e-8947-909f4b6b5fde" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:23:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-78724b2d-2719-4cd0-a212-d8b11343c9e6 req-2e86d47c-80e0-45af-a897-db564bc91fb9 service nova] Acquired lock "refresh_cache-d02fea18-bb78-472e-8947-909f4b6b5fde" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:23:28 user nova-compute[75100]: DEBUG nova.network.neutron [req-78724b2d-2719-4cd0-a212-d8b11343c9e6 req-2e86d47c-80e0-45af-a897-db564bc91fb9 service nova] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Refreshing network info cache for port f7d27dda-1b70-4f3f-b866-c2705b01e396 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 18:23:28 user nova-compute[75100]: DEBUG nova.network.neutron [req-78724b2d-2719-4cd0-a212-d8b11343c9e6 req-2e86d47c-80e0-45af-a897-db564bc91fb9 service nova] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Updated VIF entry in instance network info cache for port f7d27dda-1b70-4f3f-b866-c2705b01e396. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 18:23:28 user nova-compute[75100]: DEBUG nova.network.neutron [req-78724b2d-2719-4cd0-a212-d8b11343c9e6 req-2e86d47c-80e0-45af-a897-db564bc91fb9 service nova] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Updating instance_info_cache with network_info: [{"id": "f7d27dda-1b70-4f3f-b866-c2705b01e396", "address": "fa:16:3e:b3:cf:91", "network": {"id": "9b61fda2-5437-4085-889d-35a4edda72bc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1424647024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38869dd0674640b1b72258b53dc8f5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7d27dda-1b", "ovs_interfaceid": "f7d27dda-1b70-4f3f-b866-c2705b01e396", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:23:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-78724b2d-2719-4cd0-a212-d8b11343c9e6 req-2e86d47c-80e0-45af-a897-db564bc91fb9 service nova] Releasing lock "refresh_cache-d02fea18-bb78-472e-8947-909f4b6b5fde" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:23:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9f1e2b80-13c0-428d-972b-6192fd909a77 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Acquiring lock "fb6b4d45-7c2b-4211-9939-9989a6a3c913" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:23:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9f1e2b80-13c0-428d-972b-6192fd909a77 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "fb6b4d45-7c2b-4211-9939-9989a6a3c913" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:23:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9f1e2b80-13c0-428d-972b-6192fd909a77 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Acquiring lock "fb6b4d45-7c2b-4211-9939-9989a6a3c913-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:23:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9f1e2b80-13c0-428d-972b-6192fd909a77 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "fb6b4d45-7c2b-4211-9939-9989a6a3c913-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:23:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9f1e2b80-13c0-428d-972b-6192fd909a77 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "fb6b4d45-7c2b-4211-9939-9989a6a3c913-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:23:29 user nova-compute[75100]: INFO nova.compute.manager [None req-9f1e2b80-13c0-428d-972b-6192fd909a77 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Terminating instance
Nov 10 18:23:29 user nova-compute[75100]: DEBUG nova.compute.manager [None req-9f1e2b80-13c0-428d-972b-6192fd909a77 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 18:23:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:23:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:23:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:23:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:23:29 user nova-compute[75100]: DEBUG nova.compute.manager [req-cf5e97b7-0caf-40c7-b3cd-18c64104bedd req-881f97ea-8cd0-47f9-baf3-0e6c794be14e service nova] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Received event network-vif-unplugged-64ffd205-85a8-4c33-8ec4-40f8519b0bd5 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:23:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cf5e97b7-0caf-40c7-b3cd-18c64104bedd req-881f97ea-8cd0-47f9-baf3-0e6c794be14e service nova] Acquiring lock "fb6b4d45-7c2b-4211-9939-9989a6a3c913-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:23:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cf5e97b7-0caf-40c7-b3cd-18c64104bedd req-881f97ea-8cd0-47f9-baf3-0e6c794be14e service nova] Lock "fb6b4d45-7c2b-4211-9939-9989a6a3c913-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:23:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cf5e97b7-0caf-40c7-b3cd-18c64104bedd req-881f97ea-8cd0-47f9-baf3-0e6c794be14e service nova] Lock "fb6b4d45-7c2b-4211-9939-9989a6a3c913-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:23:29 user nova-compute[75100]: DEBUG nova.compute.manager [req-cf5e97b7-0caf-40c7-b3cd-18c64104bedd req-881f97ea-8cd0-47f9-baf3-0e6c794be14e service nova] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] No waiting events found dispatching network-vif-unplugged-64ffd205-85a8-4c33-8ec4-40f8519b0bd5 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:23:29 user nova-compute[75100]: DEBUG nova.compute.manager [req-cf5e97b7-0caf-40c7-b3cd-18c64104bedd req-881f97ea-8cd0-47f9-baf3-0e6c794be14e service nova] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Received event network-vif-unplugged-64ffd205-85a8-4c33-8ec4-40f8519b0bd5 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 18:23:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:23:29 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Instance destroyed successfully.
Nov 10 18:23:29 user nova-compute[75100]: DEBUG nova.objects.instance [None req-9f1e2b80-13c0-428d-972b-6192fd909a77 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lazy-loading 'resources' on Instance uuid fb6b4d45-7c2b-4211-9939-9989a6a3c913 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:23:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-9f1e2b80-13c0-428d-972b-6192fd909a77 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:13:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1135440047',display_name='tempest-AttachVolumeTestJSON-server-1135440047',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1135440047',id=46,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcNRutHNHeVY/scgmxR9G4KJoQs59QhgQZEw5FvsqZrAjpQ/2uGeVsJVaEeZoz53+Lx9VAPkikUDH6vDzggddQ9KuRG+0ma+NlYbiZWBP5qgm948UdG/c0syluE8zjWJA==',key_name='tempest-keypair-1049460111',keypairs=<?>,launch_index=0,launched_at=2023-11-10T18:13:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8cc6fc8310f44f3788e13aa4f1eb8c96',ramdisk_id='',reservation_id='r-nozvlwff',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-375321786',owner_user_name='tempest-AttachVolumeTestJSON-375321786-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T18:21:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='20c5bb15b9174fbc9df8ba12de10cea6',uuid=fb6b4d45-7c2b-4211-9939-9989a6a3c913,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "64ffd205-85a8-4c33-8ec4-40f8519b0bd5", "address": "fa:16:3e:d6:d0:ff", "network": {"id": "0c411791-eb03-4e00-9d7f-d032e2c16d46", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1808141765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc6fc8310f44f3788e13aa4f1eb8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ffd205-85", "ovs_interfaceid": "64ffd205-85a8-4c33-8ec4-40f8519b0bd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 18:23:29 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-9f1e2b80-13c0-428d-972b-6192fd909a77 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Converting VIF {"id": "64ffd205-85a8-4c33-8ec4-40f8519b0bd5", "address": "fa:16:3e:d6:d0:ff", "network": {"id": "0c411791-eb03-4e00-9d7f-d032e2c16d46", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1808141765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc6fc8310f44f3788e13aa4f1eb8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ffd205-85", "ovs_interfaceid": "64ffd205-85a8-4c33-8ec4-40f8519b0bd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:23:29 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-9f1e2b80-13c0-428d-972b-6192fd909a77 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d6:d0:ff,bridge_name='br-int',has_traffic_filtering=True,id=64ffd205-85a8-4c33-8ec4-40f8519b0bd5,network=Network(0c411791-eb03-4e00-9d7f-d032e2c16d46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64ffd205-85') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:23:29 user nova-compute[75100]: DEBUG os_vif [None req-9f1e2b80-13c0-428d-972b-6192fd909a77 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:d0:ff,bridge_name='br-int',has_traffic_filtering=True,id=64ffd205-85a8-4c33-8ec4-40f8519b0bd5,network=Network(0c411791-eb03-4e00-9d7f-d032e2c16d46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64ffd205-85') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 18:23:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:23:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap64ffd205-85, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:23:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:23:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:23:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:23:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0553a735-304a-4888-95f1-76d9c6bdd9d8) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:23:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:23:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:23:29 user nova-compute[75100]: INFO os_vif [None req-9f1e2b80-13c0-428d-972b-6192fd909a77 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:d0:ff,bridge_name='br-int',has_traffic_filtering=True,id=64ffd205-85a8-4c33-8ec4-40f8519b0bd5,network=Network(0c411791-eb03-4e00-9d7f-d032e2c16d46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64ffd205-85')
Nov 10 18:23:29 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-9f1e2b80-13c0-428d-972b-6192fd909a77 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Deleting instance files /opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913_del
Nov 10 18:23:29 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-9f1e2b80-13c0-428d-972b-6192fd909a77 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Deletion of /opt/stack/data/nova/instances/fb6b4d45-7c2b-4211-9939-9989a6a3c913_del complete
Nov 10 18:23:29 user nova-compute[75100]: INFO nova.compute.manager [None req-9f1e2b80-13c0-428d-972b-6192fd909a77 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Took 0.67 seconds to destroy the instance on the hypervisor.
Nov 10 18:23:29 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-9f1e2b80-13c0-428d-972b-6192fd909a77 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 18:23:29 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 18:23:29 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 18:23:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:23:30 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:23:31 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Took 1.24 seconds to deallocate network for instance.
Nov 10 18:23:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9f1e2b80-13c0-428d-972b-6192fd909a77 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:23:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9f1e2b80-13c0-428d-972b-6192fd909a77 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:23:31 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-9f1e2b80-13c0-428d-972b-6192fd909a77 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:23:31 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-9f1e2b80-13c0-428d-972b-6192fd909a77 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:23:31 user nova-compute[75100]: DEBUG nova.compute.manager [req-2a676314-6371-493f-be51-eb1b6d1436ef req-f749a188-528a-4c7d-93d3-409dd31b953b service nova] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Received event network-vif-plugged-64ffd205-85a8-4c33-8ec4-40f8519b0bd5 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:23:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2a676314-6371-493f-be51-eb1b6d1436ef req-f749a188-528a-4c7d-93d3-409dd31b953b service nova] Acquiring lock "fb6b4d45-7c2b-4211-9939-9989a6a3c913-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:23:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2a676314-6371-493f-be51-eb1b6d1436ef req-f749a188-528a-4c7d-93d3-409dd31b953b service nova] Lock "fb6b4d45-7c2b-4211-9939-9989a6a3c913-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:23:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2a676314-6371-493f-be51-eb1b6d1436ef req-f749a188-528a-4c7d-93d3-409dd31b953b service nova] Lock "fb6b4d45-7c2b-4211-9939-9989a6a3c913-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:23:31 user nova-compute[75100]: DEBUG nova.compute.manager [req-2a676314-6371-493f-be51-eb1b6d1436ef req-f749a188-528a-4c7d-93d3-409dd31b953b service nova] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] No waiting events found dispatching network-vif-plugged-64ffd205-85a8-4c33-8ec4-40f8519b0bd5 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:23:31 user nova-compute[75100]: WARNING nova.compute.manager [req-2a676314-6371-493f-be51-eb1b6d1436ef req-f749a188-528a-4c7d-93d3-409dd31b953b service nova] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Received unexpected event network-vif-plugged-64ffd205-85a8-4c33-8ec4-40f8519b0bd5 for instance with vm_state deleted and task_state None.
Nov 10 18:23:31 user nova-compute[75100]: DEBUG nova.compute.manager [req-2a676314-6371-493f-be51-eb1b6d1436ef req-f749a188-528a-4c7d-93d3-409dd31b953b service nova] [instance: fb6b4d45-7c2b-4211-9939-9989a6a3c913] Received event network-vif-deleted-64ffd205-85a8-4c33-8ec4-40f8519b0bd5 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:23:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9f1e2b80-13c0-428d-972b-6192fd909a77 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.390s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:23:31 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-9f1e2b80-13c0-428d-972b-6192fd909a77 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Deleted allocations for instance fb6b4d45-7c2b-4211-9939-9989a6a3c913
Nov 10 18:23:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9f1e2b80-13c0-428d-972b-6192fd909a77 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "fb6b4d45-7c2b-4211-9939-9989a6a3c913" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.489s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:23:33 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:23:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-50dc401d-bba2-47e3-bb7d-1fc8f833f6db tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Acquiring lock "d02fea18-bb78-472e-8947-909f4b6b5fde" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:23:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-50dc401d-bba2-47e3-bb7d-1fc8f833f6db tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lock "d02fea18-bb78-472e-8947-909f4b6b5fde" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:23:34 user nova-compute[75100]: DEBUG nova.objects.instance [None req-50dc401d-bba2-47e3-bb7d-1fc8f833f6db tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lazy-loading 'flavor' on Instance uuid d02fea18-bb78-472e-8947-909f4b6b5fde {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:23:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-50dc401d-bba2-47e3-bb7d-1fc8f833f6db tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lock "d02fea18-bb78-472e-8947-909f4b6b5fde" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:23:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:23:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-50dc401d-bba2-47e3-bb7d-1fc8f833f6db tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Acquiring lock "d02fea18-bb78-472e-8947-909f4b6b5fde" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:23:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-50dc401d-bba2-47e3-bb7d-1fc8f833f6db tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lock "d02fea18-bb78-472e-8947-909f4b6b5fde" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:23:34 user nova-compute[75100]: INFO nova.compute.manager [None req-50dc401d-bba2-47e3-bb7d-1fc8f833f6db tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Attaching volume 3ccd68e6-10ce-46b1-9640-9d1844cf1fa0 to /dev/vdb
Nov 10 18:23:34 user nova-compute[75100]: DEBUG os_brick.utils [None req-50dc401d-bba2-47e3-bb7d-1fc8f833f6db tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:23:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:23:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:23:34 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a065d911-18f4-40a0-8cee-db941fd4e12e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90b1a229568f\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:23:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:23:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:23:34 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d332fae5-e0d4-4349-a612-06fa26089994]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:23:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:23:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:23:34 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[28657841-4a48-4305-b08e-a85deef66204]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:23:34 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06f4866-624b-492b-9dcf-a5b8e13271e1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:23:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-50dc401d-bba2-47e3-bb7d-1fc8f833f6db tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:23:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-50dc401d-bba2-47e3-bb7d-1fc8f833f6db tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 18:23:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-50dc401d-bba2-47e3-bb7d-1fc8f833f6db tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 18:23:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:23:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 18:23:34 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 18:23:34 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f145e9-b77f-4769-9a40-07c7b4addd88]: (4, '') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:23:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-50dc401d-bba2-47e3-bb7d-1fc8f833f6db tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 18:23:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-50dc401d-bba2-47e3-bb7d-1fc8f833f6db tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 18:23:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-50dc401d-bba2-47e3-bb7d-1fc8f833f6db tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 18:23:34 user nova-compute[75100]: DEBUG os_brick.utils [None req-50dc401d-bba2-47e3-bb7d-1fc8f833f6db tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90b1a229568f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:23:34 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-50dc401d-bba2-47e3-bb7d-1fc8f833f6db tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Updating existing volume attachment record: c099fe87-bd94-4ad6-a445-9dcea04609ec {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 18:23:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:23:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:23:42 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:23:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:23:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:23:46 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:23:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:23:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:23:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:23:46 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 18:23:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d02fea18-bb78-472e-8947-909f4b6b5fde/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:23:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d02fea18-bb78-472e-8947-909f4b6b5fde/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:23:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d02fea18-bb78-472e-8947-909f4b6b5fde/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:23:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d02fea18-bb78-472e-8947-909f4b6b5fde/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:23:47 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:23:47 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:23:47 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Hypervisor/Node resource view: name=user free_ram=8954MB free_disk=24.419208526611328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 18:23:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:23:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:23:47 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance d02fea18-bb78-472e-8947-909f4b6b5fde actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:23:47 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 18:23:47 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 18:23:47 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:23:47 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:23:47 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 18:23:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.186s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:23:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:23:51 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:23:51 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:23:51 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:23:51 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:23:54 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:23:54 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 18:23:54 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Rebuilding the list of instances to heal {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 18:23:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "refresh_cache-d02fea18-bb78-472e-8947-909f4b6b5fde" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:23:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquired lock "refresh_cache-d02fea18-bb78-472e-8947-909f4b6b5fde" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:23:54 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 18:23:54 user nova-compute[75100]: DEBUG nova.objects.instance [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lazy-loading 'info_cache' on Instance uuid d02fea18-bb78-472e-8947-909f4b6b5fde {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:23:54 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:23:54 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:23:54 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:23:54 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:23:54 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:23:54 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:23:54 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Updating instance_info_cache with network_info: [{"id": "f7d27dda-1b70-4f3f-b866-c2705b01e396", "address": "fa:16:3e:b3:cf:91", "network": {"id": "9b61fda2-5437-4085-889d-35a4edda72bc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1424647024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38869dd0674640b1b72258b53dc8f5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7d27dda-1b", "ovs_interfaceid": "f7d27dda-1b70-4f3f-b866-c2705b01e396", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:23:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Releasing lock "refresh_cache-d02fea18-bb78-472e-8947-909f4b6b5fde" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:23:54 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 18:23:55 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:23:55 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 18:23:57 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50dc401d-bba2-47e3-bb7d-1fc8f833f6db tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 18:23:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-50dc401d-bba2-47e3-bb7d-1fc8f833f6db tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3ccd68e6-10ce-46b1-9640-9d1844cf1fa0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AVanJlyj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:23:57 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-50dc401d-bba2-47e3-bb7d-1fc8f833f6db tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:23:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-50dc401d-bba2-47e3-bb7d-1fc8f833f6db tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:23:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-50dc401d-bba2-47e3-bb7d-1fc8f833f6db tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:23:57 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-50dc401d-bba2-47e3-bb7d-1fc8f833f6db tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:23:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-50dc401d-bba2-47e3-bb7d-1fc8f833f6db tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ccd68e6-10ce-46b1-9640-9d1844cf1fa0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:23:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-50dc401d-bba2-47e3-bb7d-1fc8f833f6db tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ccd68e6-10ce-46b1-9640-9d1844cf1fa0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:23:57 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-50dc401d-bba2-47e3-bb7d-1fc8f833f6db tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 18:23:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ccd68e6-10ce-46b1-9640-9d1844cf1fa0 -p 172.16.0.220:3260 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:23:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ccd68e6-10ce-46b1-9640-9d1844cf1fa0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:23:57 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dfa47d9-b3be-46ce-b0cd-0bbd0ec7c079]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:23:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-50dc401d-bba2-47e3-bb7d-1fc8f833f6db tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 18:23:57 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:23:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ccd68e6-10ce-46b1-9640-9d1844cf1fa0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:23:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ccd68e6-10ce-46b1-9640-9d1844cf1fa0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:23:57 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb50725-7a0b-4a44-a944-beffbccaca03]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ccd68e6-10ce-46b1-9640-9d1844cf1fa0] added\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:23:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-50dc401d-bba2-47e3-bb7d-1fc8f833f6db tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ccd68e6-10ce-46b1-9640-9d1844cf1fa0] added
Nov 10 18:23:57 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:23:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ccd68e6-10ce-46b1-9640-9d1844cf1fa0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:23:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ccd68e6-10ce-46b1-9640-9d1844cf1fa0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:23:57 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0fc0025-fd4d-40f3-b9d6-9aadabf1d5fc]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:23:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-50dc401d-bba2-47e3-bb7d-1fc8f833f6db tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:23:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ccd68e6-10ce-46b1-9640-9d1844cf1fa0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:23:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ccd68e6-10ce-46b1-9640-9d1844cf1fa0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:23:57 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb45147-6d9e-4efa-9658-96e2fd6a0037]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:23:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-50dc401d-bba2-47e3-bb7d-1fc8f833f6db tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:23:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ccd68e6-10ce-46b1-9640-9d1844cf1fa0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AVanJlyj {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:23:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ccd68e6-10ce-46b1-9640-9d1844cf1fa0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AVanJlyj" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:23:57 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0b6fac-5bc0-4910-829d-6b50305558e3]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:23:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-50dc401d-bba2-47e3-bb7d-1fc8f833f6db tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AVanJlyj'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:23:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ccd68e6-10ce-46b1-9640-9d1844cf1fa0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:23:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ccd68e6-10ce-46b1-9640-9d1844cf1fa0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:23:57 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0bb407f-9851-4f17-9673-97b25cf55149]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:23:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-50dc401d-bba2-47e3-bb7d-1fc8f833f6db tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:23:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:23:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.024s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:23:57 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc24060-8dcc-4828-a0e1-35f85471ba02]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:23:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-50dc401d-bba2-47e3-bb7d-1fc8f833f6db tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 10 18:23:57 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:23:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-50dc401d-bba2-47e3-bb7d-1fc8f833f6db tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 10 18:23:57 user nova-compute[75100]:  {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:23:57 user nova-compute[75100]: WARNING os_brick.initiator.connectors.iscsi [None req-50dc401d-bba2-47e3-bb7d-1fc8f833f6db tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 10 18:23:57 user nova-compute[75100]: 
Nov 10 18:23:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ccd68e6-10ce-46b1-9640-9d1844cf1fa0 -p 172.16.0.220:3260 --login {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:23:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ccd68e6-10ce-46b1-9640-9d1844cf1fa0 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:23:57 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8300633c-eaab-4135-8e87-2f7a8abfd1c7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ccd68e6-10ce-46b1-9640-9d1844cf1fa0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3ccd68e6-10ce-46b1-9640-9d1844cf1fa0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:23:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-50dc401d-bba2-47e3-bb7d-1fc8f833f6db tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ccd68e6-10ce-46b1-9640-9d1844cf1fa0, portal: 172.16.0.220,3260]
Nov 10 18:23:57 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:3ccd68e6-10ce-46b1-9640-9d1844cf1fa0, portal: 172.16.0.220,3260] successful.
Nov 10 18:23:57 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:23:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ccd68e6-10ce-46b1-9640-9d1844cf1fa0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:23:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ccd68e6-10ce-46b1-9640-9d1844cf1fa0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:23:57 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a5c3e2-810e-4b63-bafa-58af7327cecd]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:23:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-50dc401d-bba2-47e3-bb7d-1fc8f833f6db tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:23:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:23:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:23:57 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1539446e-ce9e-47aa-b82c-b7b32c359822]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ccd68e6-10ce-46b1-9640-9d1844cf1fa0 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:23:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-50dc401d-bba2-47e3-bb7d-1fc8f833f6db tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ccd68e6-10ce-46b1-9640-9d1844cf1fa0 (non-flash)
Nov 10 18:23:57 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:23:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-50dc401d-bba2-47e3-bb7d-1fc8f833f6db tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ccd68e6-10ce-46b1-9640-9d1844cf1fa0 (non-flash)
Nov 10 18:23:57 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:23:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-50dc401d-bba2-47e3-bb7d-1fc8f833f6db tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ccd68e6-10ce-46b1-9640-9d1844cf1fa0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:23:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-50dc401d-bba2-47e3-bb7d-1fc8f833f6db tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 18:23:57 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-50dc401d-bba2-47e3-bb7d-1fc8f833f6db tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 18:23:57 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-50dc401d-bba2-47e3-bb7d-1fc8f833f6db tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 18:23:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:23:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:23:57 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8954a91e-23b9-4439-a6e2-8d990cffda4f]: (4, ('- - 0', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:23:57 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-50dc401d-bba2-47e3-bb7d-1fc8f833f6db tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 18:23:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-50dc401d-bba2-47e3-bb7d-1fc8f833f6db tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3ccd68e6-10ce-46b1-9640-9d1844cf1fa0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AVanJlyj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 18:23:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-50dc401d-bba2-47e3-bb7d-1fc8f833f6db tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:23:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-50dc401d-bba2-47e3-bb7d-1fc8f833f6db tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23662343832313665', 'path': '/dev/sdb'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:23:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50dc401d-bba2-47e3-bb7d-1fc8f833f6db tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662343832313665', 'path': '/dev/sdb'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 18:23:59 user nova-compute[75100]: DEBUG nova.objects.instance [None req-50dc401d-bba2-47e3-bb7d-1fc8f833f6db tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lazy-loading 'flavor' on Instance uuid d02fea18-bb78-472e-8947-909f4b6b5fde {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:23:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-50dc401d-bba2-47e3-bb7d-1fc8f833f6db tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 18:23:59 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:23:59 user nova-compute[75100]:   <source dev="/dev/sdb"/>
Nov 10 18:23:59 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 18:23:59 user nova-compute[75100]:   <serial>3ccd68e6-10ce-46b1-9640-9d1844cf1fa0</serial>
Nov 10 18:23:59 user nova-compute[75100]: </disk>
Nov 10 18:23:59 user nova-compute[75100]:  {{(pid=75100) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 18:23:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-50dc401d-bba2-47e3-bb7d-1fc8f833f6db tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 18:23:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-50dc401d-bba2-47e3-bb7d-1fc8f833f6db tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 18:23:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-50dc401d-bba2-47e3-bb7d-1fc8f833f6db tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] No VIF found with MAC fa:16:3e:b3:cf:91, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 18:23:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-50dc401d-bba2-47e3-bb7d-1fc8f833f6db tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lock "d02fea18-bb78-472e-8947-909f4b6b5fde" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.841s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:23:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:24:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:24:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:24:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:24:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:24:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:24:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:24:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:24:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:24:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Acquiring lock "719d5fd5-8185-454f-a3a7-dbef383e8953" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:24:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "719d5fd5-8185-454f-a3a7-dbef383e8953" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:24:23 user nova-compute[75100]: DEBUG nova.compute.manager [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 18:24:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:24:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:24:23 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 18:24:23 user nova-compute[75100]: INFO nova.compute.claims [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Claim successful on node user
Nov 10 18:24:23 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:24:23 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:24:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.281s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:24:23 user nova-compute[75100]: DEBUG nova.compute.manager [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 18:24:23 user nova-compute[75100]: DEBUG nova.compute.manager [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 18:24:23 user nova-compute[75100]: DEBUG nova.network.neutron [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 18:24:23 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 18:24:23 user nova-compute[75100]: DEBUG nova.compute.manager [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 18:24:23 user nova-compute[75100]: DEBUG nova.policy [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '20c5bb15b9174fbc9df8ba12de10cea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cc6fc8310f44f3788e13aa4f1eb8c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 18:24:23 user nova-compute[75100]: DEBUG nova.compute.manager [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 18:24:23 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 18:24:23 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Creating image(s)
Nov 10 18:24:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Acquiring lock "/opt/stack/data/nova/instances/719d5fd5-8185-454f-a3a7-dbef383e8953/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:24:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "/opt/stack/data/nova/instances/719d5fd5-8185-454f-a3a7-dbef383e8953/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:24:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "/opt/stack/data/nova/instances/719d5fd5-8185-454f-a3a7-dbef383e8953/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:24:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:24:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.175s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:24:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Acquiring lock "818b9e28e061d41a38d903968b229be2ed9ba520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:24:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:24:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:24:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.176s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:24:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/719d5fd5-8185-454f-a3a7-dbef383e8953/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:24:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/719d5fd5-8185-454f-a3a7-dbef383e8953/disk 1073741824" returned: 0 in 0.055s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:24:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:24:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:24:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.181s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:24:24 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Checking if we can resize image /opt/stack/data/nova/instances/719d5fd5-8185-454f-a3a7-dbef383e8953/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 18:24:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/719d5fd5-8185-454f-a3a7-dbef383e8953/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:24:24 user nova-compute[75100]: DEBUG nova.network.neutron [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Successfully created port: e98975d1-25ad-4973-9073-0ca95b177a2a {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 18:24:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/719d5fd5-8185-454f-a3a7-dbef383e8953/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:24:24 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Cannot resize image /opt/stack/data/nova/instances/719d5fd5-8185-454f-a3a7-dbef383e8953/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 18:24:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 18:24:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Ensure instance console log exists: /opt/stack/data/nova/instances/719d5fd5-8185-454f-a3a7-dbef383e8953/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 18:24:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:24:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:24:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:24:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:24:25 user nova-compute[75100]: DEBUG nova.network.neutron [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Successfully updated port: e98975d1-25ad-4973-9073-0ca95b177a2a {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 18:24:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Acquiring lock "refresh_cache-719d5fd5-8185-454f-a3a7-dbef383e8953" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:24:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Acquired lock "refresh_cache-719d5fd5-8185-454f-a3a7-dbef383e8953" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:24:25 user nova-compute[75100]: DEBUG nova.network.neutron [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 18:24:25 user nova-compute[75100]: DEBUG nova.compute.manager [req-c436e248-721c-4531-a02a-0fb84174a7a3 req-53985ea8-a9f5-41d4-8502-363544441bc4 service nova] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Received event network-changed-e98975d1-25ad-4973-9073-0ca95b177a2a {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:24:25 user nova-compute[75100]: DEBUG nova.compute.manager [req-c436e248-721c-4531-a02a-0fb84174a7a3 req-53985ea8-a9f5-41d4-8502-363544441bc4 service nova] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Refreshing instance network info cache due to event network-changed-e98975d1-25ad-4973-9073-0ca95b177a2a. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 18:24:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c436e248-721c-4531-a02a-0fb84174a7a3 req-53985ea8-a9f5-41d4-8502-363544441bc4 service nova] Acquiring lock "refresh_cache-719d5fd5-8185-454f-a3a7-dbef383e8953" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:24:25 user nova-compute[75100]: DEBUG nova.network.neutron [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 18:24:25 user nova-compute[75100]: DEBUG nova.network.neutron [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Updating instance_info_cache with network_info: [{"id": "e98975d1-25ad-4973-9073-0ca95b177a2a", "address": "fa:16:3e:ce:17:25", "network": {"id": "0c411791-eb03-4e00-9d7f-d032e2c16d46", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1808141765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc6fc8310f44f3788e13aa4f1eb8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape98975d1-25", "ovs_interfaceid": "e98975d1-25ad-4973-9073-0ca95b177a2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:24:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Releasing lock "refresh_cache-719d5fd5-8185-454f-a3a7-dbef383e8953" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:24:25 user nova-compute[75100]: DEBUG nova.compute.manager [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Instance network_info: |[{"id": "e98975d1-25ad-4973-9073-0ca95b177a2a", "address": "fa:16:3e:ce:17:25", "network": {"id": "0c411791-eb03-4e00-9d7f-d032e2c16d46", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1808141765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc6fc8310f44f3788e13aa4f1eb8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape98975d1-25", "ovs_interfaceid": "e98975d1-25ad-4973-9073-0ca95b177a2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 18:24:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c436e248-721c-4531-a02a-0fb84174a7a3 req-53985ea8-a9f5-41d4-8502-363544441bc4 service nova] Acquired lock "refresh_cache-719d5fd5-8185-454f-a3a7-dbef383e8953" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:24:25 user nova-compute[75100]: DEBUG nova.network.neutron [req-c436e248-721c-4531-a02a-0fb84174a7a3 req-53985ea8-a9f5-41d4-8502-363544441bc4 service nova] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Refreshing network info cache for port e98975d1-25ad-4973-9073-0ca95b177a2a {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 18:24:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Start _get_guest_xml network_info=[{"id": "e98975d1-25ad-4973-9073-0ca95b177a2a", "address": "fa:16:3e:ce:17:25", "network": {"id": "0c411791-eb03-4e00-9d7f-d032e2c16d46", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1808141765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc6fc8310f44f3788e13aa4f1eb8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape98975d1-25", "ovs_interfaceid": "e98975d1-25ad-4973-9073-0ca95b177a2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'e3cc5321-4d40-49ee-885c-700e14741732'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 18:24:25 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:24:25 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:24:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 18:24:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 18:24:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 18:24:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 18:24:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 18:24:25 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T17:40:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 18:24:25 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 18:24:25 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 18:24:25 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 18:24:25 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 18:24:25 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 18:24:25 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 18:24:25 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 18:24:25 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 18:24:25 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 18:24:25 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 18:24:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:24:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1938732856',display_name='tempest-AttachVolumeTestJSON-server-1938732856',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1938732856',id=50,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB+CbnlQQfwRudtf9FaS37R9aRvSsuwh49ufpL++O9NAWeUpt4WEKhKwXCmWLU7+bmBHU7tcyZzzhzazT8p47QX+A1ppGhF2QLGNJQV5M//yq1ZC8DX2M1UiSU0/CSfNsw==',key_name='tempest-keypair-338677957',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8cc6fc8310f44f3788e13aa4f1eb8c96',ramdisk_id='',reservation_id='r-sek93ozd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-375321786',owner_user_name='tempest-AttachVolumeTestJSON-375321786-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T18:24:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='20c5bb15b9174fbc9df8ba12de10cea6',uuid=719d5fd5-8185-454f-a3a7-dbef383e8953,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e98975d1-25ad-4973-9073-0ca95b177a2a", "address": "fa:16:3e:ce:17:25", "network": {"id": "0c411791-eb03-4e00-9d7f-d032e2c16d46", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1808141765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc6fc8310f44f3788e13aa4f1eb8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape98975d1-25", "ovs_interfaceid": "e98975d1-25ad-4973-9073-0ca95b177a2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 18:24:25 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Converting VIF {"id": "e98975d1-25ad-4973-9073-0ca95b177a2a", "address": "fa:16:3e:ce:17:25", "network": {"id": "0c411791-eb03-4e00-9d7f-d032e2c16d46", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1808141765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc6fc8310f44f3788e13aa4f1eb8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape98975d1-25", "ovs_interfaceid": "e98975d1-25ad-4973-9073-0ca95b177a2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:24:25 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:17:25,bridge_name='br-int',has_traffic_filtering=True,id=e98975d1-25ad-4973-9073-0ca95b177a2a,network=Network(0c411791-eb03-4e00-9d7f-d032e2c16d46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape98975d1-25') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:24:25 user nova-compute[75100]: DEBUG nova.objects.instance [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lazy-loading 'pci_devices' on Instance uuid 719d5fd5-8185-454f-a3a7-dbef383e8953 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:24:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] End _get_guest_xml xml=<domain type="kvm">
Nov 10 18:24:25 user nova-compute[75100]:   <uuid>719d5fd5-8185-454f-a3a7-dbef383e8953</uuid>
Nov 10 18:24:25 user nova-compute[75100]:   <name>instance-00000032</name>
Nov 10 18:24:25 user nova-compute[75100]:   <memory>524288</memory>
Nov 10 18:24:25 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 10 18:24:25 user nova-compute[75100]:   <metadata>
Nov 10 18:24:25 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 18:24:25 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 10 18:24:25 user nova-compute[75100]:       <nova:name>tempest-AttachVolumeTestJSON-server-1938732856</nova:name>
Nov 10 18:24:25 user nova-compute[75100]:       <nova:creationTime>2023-11-10 18:24:25</nova:creationTime>
Nov 10 18:24:25 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 10 18:24:25 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 10 18:24:25 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 10 18:24:25 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 10 18:24:25 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 18:24:25 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 10 18:24:25 user nova-compute[75100]:       </nova:flavor>
Nov 10 18:24:25 user nova-compute[75100]:       <nova:owner>
Nov 10 18:24:25 user nova-compute[75100]:         <nova:user uuid="20c5bb15b9174fbc9df8ba12de10cea6">tempest-AttachVolumeTestJSON-375321786-project-member</nova:user>
Nov 10 18:24:25 user nova-compute[75100]:         <nova:project uuid="8cc6fc8310f44f3788e13aa4f1eb8c96">tempest-AttachVolumeTestJSON-375321786</nova:project>
Nov 10 18:24:25 user nova-compute[75100]:       </nova:owner>
Nov 10 18:24:25 user nova-compute[75100]:       <nova:root type="image" uuid="e3cc5321-4d40-49ee-885c-700e14741732"/>
Nov 10 18:24:25 user nova-compute[75100]:       <nova:ports>
Nov 10 18:24:25 user nova-compute[75100]:         <nova:port uuid="e98975d1-25ad-4973-9073-0ca95b177a2a">
Nov 10 18:24:25 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 10 18:24:25 user nova-compute[75100]:         </nova:port>
Nov 10 18:24:25 user nova-compute[75100]:       </nova:ports>
Nov 10 18:24:25 user nova-compute[75100]:     </nova:instance>
Nov 10 18:24:25 user nova-compute[75100]:   </metadata>
Nov 10 18:24:25 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 10 18:24:25 user nova-compute[75100]:     <system>
Nov 10 18:24:25 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 18:24:25 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 10 18:24:25 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 10 18:24:25 user nova-compute[75100]:       <entry name="serial">719d5fd5-8185-454f-a3a7-dbef383e8953</entry>
Nov 10 18:24:25 user nova-compute[75100]:       <entry name="uuid">719d5fd5-8185-454f-a3a7-dbef383e8953</entry>
Nov 10 18:24:25 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 10 18:24:25 user nova-compute[75100]:     </system>
Nov 10 18:24:25 user nova-compute[75100]:   </sysinfo>
Nov 10 18:24:25 user nova-compute[75100]:   <os>
Nov 10 18:24:25 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 18:24:25 user nova-compute[75100]:     <boot dev="hd"/>
Nov 10 18:24:25 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 10 18:24:25 user nova-compute[75100]:   </os>
Nov 10 18:24:25 user nova-compute[75100]:   <features>
Nov 10 18:24:25 user nova-compute[75100]:     <acpi/>
Nov 10 18:24:25 user nova-compute[75100]:     <apic/>
Nov 10 18:24:25 user nova-compute[75100]:     <vmcoreinfo/>
Nov 10 18:24:25 user nova-compute[75100]:   </features>
Nov 10 18:24:25 user nova-compute[75100]:   <clock offset="utc">
Nov 10 18:24:25 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 18:24:25 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 18:24:25 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 10 18:24:25 user nova-compute[75100]:   </clock>
Nov 10 18:24:25 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 10 18:24:25 user nova-compute[75100]:     <model>Nehalem</model>
Nov 10 18:24:25 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 18:24:25 user nova-compute[75100]:   </cpu>
Nov 10 18:24:25 user nova-compute[75100]:   <devices>
Nov 10 18:24:25 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 10 18:24:25 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 18:24:25 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/719d5fd5-8185-454f-a3a7-dbef383e8953/disk"/>
Nov 10 18:24:25 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 10 18:24:25 user nova-compute[75100]:     </disk>
Nov 10 18:24:25 user nova-compute[75100]:     <interface type="ethernet">
Nov 10 18:24:25 user nova-compute[75100]:       <mac address="fa:16:3e:ce:17:25"/>
Nov 10 18:24:25 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 18:24:25 user nova-compute[75100]:       <mtu size="1442"/>
Nov 10 18:24:25 user nova-compute[75100]:       <target dev="tape98975d1-25"/>
Nov 10 18:24:25 user nova-compute[75100]:     </interface>
Nov 10 18:24:25 user nova-compute[75100]:     <serial type="pty">
Nov 10 18:24:25 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/719d5fd5-8185-454f-a3a7-dbef383e8953/console.log" append="off"/>
Nov 10 18:24:25 user nova-compute[75100]:     </serial>
Nov 10 18:24:25 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 18:24:25 user nova-compute[75100]:     <video>
Nov 10 18:24:25 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 18:24:25 user nova-compute[75100]:     </video>
Nov 10 18:24:25 user nova-compute[75100]:     <rng model="virtio">
Nov 10 18:24:25 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 10 18:24:25 user nova-compute[75100]:     </rng>
Nov 10 18:24:25 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 10 18:24:25 user nova-compute[75100]:     <memballoon model="virtio">
Nov 10 18:24:25 user nova-compute[75100]:       <stats period="10"/>
Nov 10 18:24:25 user nova-compute[75100]:     </memballoon>
Nov 10 18:24:25 user nova-compute[75100]:   </devices>
Nov 10 18:24:25 user nova-compute[75100]: </domain>
Nov 10 18:24:25 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 18:24:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:24:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1938732856',display_name='tempest-AttachVolumeTestJSON-server-1938732856',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1938732856',id=50,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB+CbnlQQfwRudtf9FaS37R9aRvSsuwh49ufpL++O9NAWeUpt4WEKhKwXCmWLU7+bmBHU7tcyZzzhzazT8p47QX+A1ppGhF2QLGNJQV5M//yq1ZC8DX2M1UiSU0/CSfNsw==',key_name='tempest-keypair-338677957',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8cc6fc8310f44f3788e13aa4f1eb8c96',ramdisk_id='',reservation_id='r-sek93ozd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-375321786',owner_user_name='tempest-AttachVolumeTestJSON-375321786-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T18:24:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='20c5bb15b9174fbc9df8ba12de10cea6',uuid=719d5fd5-8185-454f-a3a7-dbef383e8953,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e98975d1-25ad-4973-9073-0ca95b177a2a", "address": "fa:16:3e:ce:17:25", "network": {"id": "0c411791-eb03-4e00-9d7f-d032e2c16d46", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1808141765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc6fc8310f44f3788e13aa4f1eb8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape98975d1-25", "ovs_interfaceid": "e98975d1-25ad-4973-9073-0ca95b177a2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 18:24:25 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Converting VIF {"id": "e98975d1-25ad-4973-9073-0ca95b177a2a", "address": "fa:16:3e:ce:17:25", "network": {"id": "0c411791-eb03-4e00-9d7f-d032e2c16d46", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1808141765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc6fc8310f44f3788e13aa4f1eb8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape98975d1-25", "ovs_interfaceid": "e98975d1-25ad-4973-9073-0ca95b177a2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:24:25 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:17:25,bridge_name='br-int',has_traffic_filtering=True,id=e98975d1-25ad-4973-9073-0ca95b177a2a,network=Network(0c411791-eb03-4e00-9d7f-d032e2c16d46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape98975d1-25') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:24:25 user nova-compute[75100]: DEBUG os_vif [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:17:25,bridge_name='br-int',has_traffic_filtering=True,id=e98975d1-25ad-4973-9073-0ca95b177a2a,network=Network(0c411791-eb03-4e00-9d7f-d032e2c16d46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape98975d1-25') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 18:24:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:24:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:24:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 18:24:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:24:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '86250e57-6deb-53d1-ac7a-382c0fa47550', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:24:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:24:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:24:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:24:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape98975d1-25, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:24:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape98975d1-25, col_values=(('qos', UUID('60161d7e-7002-4b1e-81e2-5404652d6601')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:24:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape98975d1-25, col_values=(('external_ids', {'iface-id': 'e98975d1-25ad-4973-9073-0ca95b177a2a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:17:25', 'vm-uuid': '719d5fd5-8185-454f-a3a7-dbef383e8953'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:24:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:24:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:24:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:24:25 user nova-compute[75100]: INFO os_vif [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:17:25,bridge_name='br-int',has_traffic_filtering=True,id=e98975d1-25ad-4973-9073-0ca95b177a2a,network=Network(0c411791-eb03-4e00-9d7f-d032e2c16d46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape98975d1-25')
Nov 10 18:24:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 18:24:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] No VIF found with MAC fa:16:3e:ce:17:25, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 18:24:26 user nova-compute[75100]: DEBUG nova.network.neutron [req-c436e248-721c-4531-a02a-0fb84174a7a3 req-53985ea8-a9f5-41d4-8502-363544441bc4 service nova] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Updated VIF entry in instance network info cache for port e98975d1-25ad-4973-9073-0ca95b177a2a. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 18:24:26 user nova-compute[75100]: DEBUG nova.network.neutron [req-c436e248-721c-4531-a02a-0fb84174a7a3 req-53985ea8-a9f5-41d4-8502-363544441bc4 service nova] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Updating instance_info_cache with network_info: [{"id": "e98975d1-25ad-4973-9073-0ca95b177a2a", "address": "fa:16:3e:ce:17:25", "network": {"id": "0c411791-eb03-4e00-9d7f-d032e2c16d46", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1808141765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc6fc8310f44f3788e13aa4f1eb8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape98975d1-25", "ovs_interfaceid": "e98975d1-25ad-4973-9073-0ca95b177a2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:24:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c436e248-721c-4531-a02a-0fb84174a7a3 req-53985ea8-a9f5-41d4-8502-363544441bc4 service nova] Releasing lock "refresh_cache-719d5fd5-8185-454f-a3a7-dbef383e8953" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:24:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:24:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:24:27 user nova-compute[75100]: DEBUG nova.compute.manager [req-1245b6ff-1b7f-4f98-9e29-88019c1b1cac req-293e5490-1286-43a1-9add-a39c16651c7b service nova] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Received event network-vif-plugged-e98975d1-25ad-4973-9073-0ca95b177a2a {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:24:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-1245b6ff-1b7f-4f98-9e29-88019c1b1cac req-293e5490-1286-43a1-9add-a39c16651c7b service nova] Acquiring lock "719d5fd5-8185-454f-a3a7-dbef383e8953-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:24:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-1245b6ff-1b7f-4f98-9e29-88019c1b1cac req-293e5490-1286-43a1-9add-a39c16651c7b service nova] Lock "719d5fd5-8185-454f-a3a7-dbef383e8953-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:24:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-1245b6ff-1b7f-4f98-9e29-88019c1b1cac req-293e5490-1286-43a1-9add-a39c16651c7b service nova] Lock "719d5fd5-8185-454f-a3a7-dbef383e8953-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:24:27 user nova-compute[75100]: DEBUG nova.compute.manager [req-1245b6ff-1b7f-4f98-9e29-88019c1b1cac req-293e5490-1286-43a1-9add-a39c16651c7b service nova] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] No waiting events found dispatching network-vif-plugged-e98975d1-25ad-4973-9073-0ca95b177a2a {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:24:27 user nova-compute[75100]: WARNING nova.compute.manager [req-1245b6ff-1b7f-4f98-9e29-88019c1b1cac req-293e5490-1286-43a1-9add-a39c16651c7b service nova] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Received unexpected event network-vif-plugged-e98975d1-25ad-4973-9073-0ca95b177a2a for instance with vm_state building and task_state spawning.
Nov 10 18:24:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:24:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:24:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:24:29 user nova-compute[75100]: DEBUG nova.compute.manager [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 18:24:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 18:24:29 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Instance spawned successfully.
Nov 10 18:24:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 18:24:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:24:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:24:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:24:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:24:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:24:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:24:29 user nova-compute[75100]: INFO nova.compute.manager [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Took 5.43 seconds to spawn the instance on the hypervisor.
Nov 10 18:24:29 user nova-compute[75100]: DEBUG nova.compute.manager [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 18:24:29 user nova-compute[75100]: DEBUG nova.compute.manager [req-eb4cc483-4075-48f6-8fbd-db1bcf2d3f7a req-f793ee07-c918-4763-b553-7eaf9ddc7cb2 service nova] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Received event network-vif-plugged-e98975d1-25ad-4973-9073-0ca95b177a2a {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:24:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-eb4cc483-4075-48f6-8fbd-db1bcf2d3f7a req-f793ee07-c918-4763-b553-7eaf9ddc7cb2 service nova] Acquiring lock "719d5fd5-8185-454f-a3a7-dbef383e8953-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:24:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-eb4cc483-4075-48f6-8fbd-db1bcf2d3f7a req-f793ee07-c918-4763-b553-7eaf9ddc7cb2 service nova] Lock "719d5fd5-8185-454f-a3a7-dbef383e8953-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:24:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-eb4cc483-4075-48f6-8fbd-db1bcf2d3f7a req-f793ee07-c918-4763-b553-7eaf9ddc7cb2 service nova] Lock "719d5fd5-8185-454f-a3a7-dbef383e8953-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:24:29 user nova-compute[75100]: DEBUG nova.compute.manager [req-eb4cc483-4075-48f6-8fbd-db1bcf2d3f7a req-f793ee07-c918-4763-b553-7eaf9ddc7cb2 service nova] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] No waiting events found dispatching network-vif-plugged-e98975d1-25ad-4973-9073-0ca95b177a2a {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:24:29 user nova-compute[75100]: WARNING nova.compute.manager [req-eb4cc483-4075-48f6-8fbd-db1bcf2d3f7a req-f793ee07-c918-4763-b553-7eaf9ddc7cb2 service nova] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Received unexpected event network-vif-plugged-e98975d1-25ad-4973-9073-0ca95b177a2a for instance with vm_state building and task_state spawning.
Nov 10 18:24:29 user nova-compute[75100]: INFO nova.compute.manager [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Took 6.06 seconds to build instance.
Nov 10 18:24:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-40e8b387-24bd-445a-acd3-d232c3407915 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "719d5fd5-8185-454f-a3a7-dbef383e8953" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.157s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:24:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:24:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:24:35 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:24:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:24:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:24:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:24:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:24:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:24:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:24:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-dbc984f7-637d-4977-a40d-6fede763c0a7 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Acquiring lock "d02fea18-bb78-472e-8947-909f4b6b5fde" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:24:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-dbc984f7-637d-4977-a40d-6fede763c0a7 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lock "d02fea18-bb78-472e-8947-909f4b6b5fde" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:24:38 user nova-compute[75100]: INFO nova.compute.manager [None req-dbc984f7-637d-4977-a40d-6fede763c0a7 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Detaching volume 3ccd68e6-10ce-46b1-9640-9d1844cf1fa0
Nov 10 18:24:38 user nova-compute[75100]: INFO nova.virt.block_device [None req-dbc984f7-637d-4977-a40d-6fede763c0a7 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Attempting to driver detach volume 3ccd68e6-10ce-46b1-9640-9d1844cf1fa0 from mountpoint /dev/vdb
Nov 10 18:24:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-dbc984f7-637d-4977-a40d-6fede763c0a7 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Attempting to detach device vdb from instance d02fea18-bb78-472e-8947-909f4b6b5fde from the persistent domain config. {{(pid=75100) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 18:24:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-dbc984f7-637d-4977-a40d-6fede763c0a7 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 18:24:38 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:24:38 user nova-compute[75100]:   <source dev="/dev/sdb"/>
Nov 10 18:24:38 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 18:24:38 user nova-compute[75100]:   <serial>3ccd68e6-10ce-46b1-9640-9d1844cf1fa0</serial>
Nov 10 18:24:38 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 18:24:38 user nova-compute[75100]: </disk>
Nov 10 18:24:38 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 18:24:38 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-dbc984f7-637d-4977-a40d-6fede763c0a7 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Successfully detached device vdb from instance d02fea18-bb78-472e-8947-909f4b6b5fde from the persistent domain config.
Nov 10 18:24:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-dbc984f7-637d-4977-a40d-6fede763c0a7 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d02fea18-bb78-472e-8947-909f4b6b5fde from the live domain config. {{(pid=75100) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 18:24:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-dbc984f7-637d-4977-a40d-6fede763c0a7 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 18:24:38 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:24:38 user nova-compute[75100]:   <source dev="/dev/sdb"/>
Nov 10 18:24:38 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 18:24:38 user nova-compute[75100]:   <serial>3ccd68e6-10ce-46b1-9640-9d1844cf1fa0</serial>
Nov 10 18:24:38 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 18:24:38 user nova-compute[75100]: </disk>
Nov 10 18:24:38 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 18:24:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-dbc984f7-637d-4977-a40d-6fede763c0a7 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d02fea18-bb78-472e-8947-909f4b6b5fde {{(pid=75100) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 18:24:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:24:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:24:43 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:24:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:24:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:24:48 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:24:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:24:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:24:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:24:48 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 18:24:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/719d5fd5-8185-454f-a3a7-dbef383e8953/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:24:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/719d5fd5-8185-454f-a3a7-dbef383e8953/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:24:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/719d5fd5-8185-454f-a3a7-dbef383e8953/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:24:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/719d5fd5-8185-454f-a3a7-dbef383e8953/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:24:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d02fea18-bb78-472e-8947-909f4b6b5fde/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:24:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d02fea18-bb78-472e-8947-909f4b6b5fde/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:24:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d02fea18-bb78-472e-8947-909f4b6b5fde/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:24:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d02fea18-bb78-472e-8947-909f4b6b5fde/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:24:49 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:24:49 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:24:49 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Hypervisor/Node resource view: name=user free_ram=8749MB free_disk=24.388893127441406GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 18:24:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:24:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:24:49 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance d02fea18-bb78-472e-8947-909f4b6b5fde actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:24:49 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 719d5fd5-8185-454f-a3a7-dbef383e8953 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:24:49 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 18:24:49 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 18:24:49 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:24:49 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:24:49 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 18:24:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.251s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:24:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:24:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:24:52 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:24:52 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:24:52 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:24:52 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:24:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:24:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:24:56 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:24:56 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 18:24:56 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Rebuilding the list of instances to heal {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 18:24:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "refresh_cache-d02fea18-bb78-472e-8947-909f4b6b5fde" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:24:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquired lock "refresh_cache-d02fea18-bb78-472e-8947-909f4b6b5fde" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:24:56 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 18:24:56 user nova-compute[75100]: DEBUG nova.objects.instance [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lazy-loading 'info_cache' on Instance uuid d02fea18-bb78-472e-8947-909f4b6b5fde {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:24:56 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Updating instance_info_cache with network_info: [{"id": "f7d27dda-1b70-4f3f-b866-c2705b01e396", "address": "fa:16:3e:b3:cf:91", "network": {"id": "9b61fda2-5437-4085-889d-35a4edda72bc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1424647024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38869dd0674640b1b72258b53dc8f5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7d27dda-1b", "ovs_interfaceid": "f7d27dda-1b70-4f3f-b866-c2705b01e396", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:24:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Releasing lock "refresh_cache-d02fea18-bb78-472e-8947-909f4b6b5fde" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:24:56 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 18:24:57 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:24:57 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 18:24:58 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:24:59 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-dbc984f7-637d-4977-a40d-6fede763c0a7 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d02fea18-bb78-472e-8947-909f4b6b5fde is timed out.
Nov 10 18:24:59 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-dbc984f7-637d-4977-a40d-6fede763c0a7 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Successfully detached device vdb from instance d02fea18-bb78-472e-8947-909f4b6b5fde from the live domain config.
Nov 10 18:24:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbc984f7-637d-4977-a40d-6fede763c0a7 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 18:24:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbc984f7-637d-4977-a40d-6fede763c0a7 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, {'target_iqn': 'iqn.2010-10.org.openstack:3ccd68e6-10ce-46b1-9640-9d1844cf1fa0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AVanJlyj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:24:59 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-dbc984f7-637d-4977-a40d-6fede763c0a7 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:24:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-dbc984f7-637d-4977-a40d-6fede763c0a7 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:24:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-dbc984f7-637d-4977-a40d-6fede763c0a7 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:24:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:24:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:24:59 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[613c6229-2fb1-4935-8399-a2ddbd240f54]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3ccd68e6-10ce-46b1-9640-9d1844cf1fa0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:24:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbc984f7-637d-4977-a40d-6fede763c0a7 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 18:24:59 user nova-compute[75100]: No targets found.
Nov 10 18:24:59 user nova-compute[75100]: iSNS:
Nov 10 18:24:59 user nova-compute[75100]: No targets found.
Nov 10 18:24:59 user nova-compute[75100]: STATIC:
Nov 10 18:24:59 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:3ccd68e6-10ce-46b1-9640-9d1844cf1fa0
Nov 10 18:24:59 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:24:59 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:24:59 user nova-compute[75100]: FIRMWARE:
Nov 10 18:24:59 user nova-compute[75100]: No targets found.
Nov 10 18:24:59 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:24:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbc984f7-637d-4977-a40d-6fede763c0a7 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 18:24:59 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 18:24:59 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 18:24:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbc984f7-637d-4977-a40d-6fede763c0a7 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ccd68e6-10ce-46b1-9640-9d1844cf1fa0', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 18:24:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:24:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:24:59 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9b41b0-73dd-45ef-a05e-3c325977ac9c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ccd68e6-10ce-46b1-9640-9d1844cf1fa0\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:24:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:24:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:24:59 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[77fc4bd7-0fa9-4e3a-bc14-56ba4926b9fe]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ccd68e6-10ce-46b1-9640-9d1844cf1fa0 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:24:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbc984f7-637d-4977-a40d-6fede763c0a7 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ccd68e6-10ce-46b1-9640-9d1844cf1fa0 (non-flash)
Nov 10 18:24:59 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:24:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbc984f7-637d-4977-a40d-6fede763c0a7 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ccd68e6-10ce-46b1-9640-9d1844cf1fa0 (non-flash)
Nov 10 18:24:59 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:24:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbc984f7-637d-4977-a40d-6fede763c0a7 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3bc639090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ccd68e6-10ce-46b1-9640-9d1844cf1fa0'): ({'sdb'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 18:24:59 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-dbc984f7-637d-4977-a40d-6fede763c0a7 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Removing single pathed devices sdb {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 18:24:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:24:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:24:59 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d775bd-ac74-4fc3-a854-2b307963deeb]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:24:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:24:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:24:59 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b02010-3593-4dc6-ae32-2531c318769a]: (4, ('ok\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:24:59 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-dbc984f7-637d-4977-a40d-6fede763c0a7 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Flushing IO for device /dev/sdb {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 18:24:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:24:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:24:59 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[91244e6b-dbd3-4561-b2dc-e525ba5e5116]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:24:59 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-dbc984f7-637d-4977-a40d-6fede763c0a7 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 18:24:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:24:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:24:59 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd0fa56-32a7-45ba-babe-64b81c6cb423]: (4, ('1', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:24:59 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-dbc984f7-637d-4977-a40d-6fede763c0a7 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 18:24:59 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-dbc984f7-637d-4977-a40d-6fede763c0a7 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 18:24:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbc984f7-637d-4977-a40d-6fede763c0a7 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ccd68e6-10ce-46b1-9640-9d1844cf1fa0')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 18:24:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ccd68e6-10ce-46b1-9640-9d1844cf1fa0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:24:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ccd68e6-10ce-46b1-9640-9d1844cf1fa0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:24:59 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8292063d-84b7-44da-91b5-5f990e7e4b91]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:24:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbc984f7-637d-4977-a40d-6fede763c0a7 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:24:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ccd68e6-10ce-46b1-9640-9d1844cf1fa0 -p 172.16.0.220:3260 --logout {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:24:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ccd68e6-10ce-46b1-9640-9d1844cf1fa0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:24:59 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[08999dd4-abe3-41d5-951c-337c638a15d1]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:3ccd68e6-10ce-46b1-9640-9d1844cf1fa0, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:3ccd68e6-10ce-46b1-9640-9d1844cf1fa0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:24:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbc984f7-637d-4977-a40d-6fede763c0a7 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:3ccd68e6-10ce-46b1-9640-9d1844cf1fa0, portal: 172.16.0.220,3260]
Nov 10 18:24:59 user nova-compute[75100]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:3ccd68e6-10ce-46b1-9640-9d1844cf1fa0, portal: 172.16.0.220,3260] successful.
Nov 10 18:24:59 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:24:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ccd68e6-10ce-46b1-9640-9d1844cf1fa0 -p 172.16.0.220:3260 --op delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:24:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ccd68e6-10ce-46b1-9640-9d1844cf1fa0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:24:59 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4218481c-c580-4225-a8bb-5618e2cf30a8]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:24:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbc984f7-637d-4977-a40d-6fede763c0a7 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:24:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-dbc984f7-637d-4977-a40d-6fede763c0a7 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:24:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbc984f7-637d-4977-a40d-6fede763c0a7 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] <== disconnect_volume: return (290ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:24:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbc984f7-637d-4977-a40d-6fede763c0a7 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 18:25:00 user nova-compute[75100]: DEBUG nova.objects.instance [None req-dbc984f7-637d-4977-a40d-6fede763c0a7 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lazy-loading 'flavor' on Instance uuid d02fea18-bb78-472e-8947-909f4b6b5fde {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:25:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-dbc984f7-637d-4977-a40d-6fede763c0a7 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lock "d02fea18-bb78-472e-8947-909f4b6b5fde" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.931s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:25:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:25:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:25:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:25:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:25:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:25:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:25:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:25:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:25:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:25:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:25:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:25:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:25:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:25:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:25:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:25:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:25:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:25:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:25:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:25:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:25:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:25:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:25:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:25:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:25:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:25:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:25:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:25:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1723052a-3475-41c4-8e6b-d489d7cf5b3b tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Acquiring lock "d02fea18-bb78-472e-8947-909f4b6b5fde" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:25:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1723052a-3475-41c4-8e6b-d489d7cf5b3b tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lock "d02fea18-bb78-472e-8947-909f4b6b5fde" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:25:34 user nova-compute[75100]: DEBUG nova.objects.instance [None req-1723052a-3475-41c4-8e6b-d489d7cf5b3b tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lazy-loading 'flavor' on Instance uuid d02fea18-bb78-472e-8947-909f4b6b5fde {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:25:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1723052a-3475-41c4-8e6b-d489d7cf5b3b tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lock "d02fea18-bb78-472e-8947-909f4b6b5fde" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:25:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1723052a-3475-41c4-8e6b-d489d7cf5b3b tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Acquiring lock "d02fea18-bb78-472e-8947-909f4b6b5fde" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:25:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1723052a-3475-41c4-8e6b-d489d7cf5b3b tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lock "d02fea18-bb78-472e-8947-909f4b6b5fde" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:25:35 user nova-compute[75100]: INFO nova.compute.manager [None req-1723052a-3475-41c4-8e6b-d489d7cf5b3b tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Attaching volume 9a222f2b-1ead-49a7-9c19-1610e5ba0a4d to /dev/vdb
Nov 10 18:25:35 user nova-compute[75100]: DEBUG os_brick.utils [None req-1723052a-3475-41c4-8e6b-d489d7cf5b3b tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:25:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:25:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:25:35 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[97243dd3-755a-4567-89e2-313d66c9ac8f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90b1a229568f\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:25:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:25:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:25:35 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[db74dce4-5bae-47a5-80a9-c46095d2d5d3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:25:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:25:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:25:35 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f495e6-4118-4dda-8d1e-fdbcf5b040e5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:25:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:25:35 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[22594381-5fc2-45d1-a02e-e2ffd5a6fcc4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:25:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-1723052a-3475-41c4-8e6b-d489d7cf5b3b tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:25:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-1723052a-3475-41c4-8e6b-d489d7cf5b3b tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 18:25:35 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1723052a-3475-41c4-8e6b-d489d7cf5b3b tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 18:25:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:25:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 18:25:35 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 18:25:35 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa179fc7-6668-4034-9b9c-f8faca784559]: (4, '') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:25:35 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-1723052a-3475-41c4-8e6b-d489d7cf5b3b tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 18:25:35 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-1723052a-3475-41c4-8e6b-d489d7cf5b3b tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 18:25:35 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-1723052a-3475-41c4-8e6b-d489d7cf5b3b tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 18:25:35 user nova-compute[75100]: DEBUG os_brick.utils [None req-1723052a-3475-41c4-8e6b-d489d7cf5b3b tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90b1a229568f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:25:35 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-1723052a-3475-41c4-8e6b-d489d7cf5b3b tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Updating existing volume attachment record: 6ba0d69a-2367-4ca5-9638-196ea4fdf306 {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 18:25:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:25:37 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:25:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:25:44 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:25:44 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:25:44 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75100) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 18:25:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:25:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:25:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:25:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:25:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:25:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:25:49 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:25:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:25:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:25:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:25:49 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 18:25:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/719d5fd5-8185-454f-a3a7-dbef383e8953/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:25:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/719d5fd5-8185-454f-a3a7-dbef383e8953/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:25:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/719d5fd5-8185-454f-a3a7-dbef383e8953/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:25:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/719d5fd5-8185-454f-a3a7-dbef383e8953/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:25:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d02fea18-bb78-472e-8947-909f4b6b5fde/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:25:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d02fea18-bb78-472e-8947-909f4b6b5fde/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:25:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d02fea18-bb78-472e-8947-909f4b6b5fde/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:25:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d02fea18-bb78-472e-8947-909f4b6b5fde/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:25:50 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:25:50 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:25:50 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Hypervisor/Node resource view: name=user free_ram=8846MB free_disk=24.387813568115234GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 18:25:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:25:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:25:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:25:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:25:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:25:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:25:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:25:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:25:50 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance d02fea18-bb78-472e-8947-909f4b6b5fde actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:25:50 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 719d5fd5-8185-454f-a3a7-dbef383e8953 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:25:50 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 18:25:50 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 18:25:50 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:25:50 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:25:50 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 18:25:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.295s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:25:53 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:25:53 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:25:53 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:25:53 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:25:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:25:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:25:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:25:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:25:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:25:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:25:56 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:25:56 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 18:25:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "refresh_cache-719d5fd5-8185-454f-a3a7-dbef383e8953" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:25:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquired lock "refresh_cache-719d5fd5-8185-454f-a3a7-dbef383e8953" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:25:56 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 18:25:56 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Updating instance_info_cache with network_info: [{"id": "e98975d1-25ad-4973-9073-0ca95b177a2a", "address": "fa:16:3e:ce:17:25", "network": {"id": "0c411791-eb03-4e00-9d7f-d032e2c16d46", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1808141765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc6fc8310f44f3788e13aa4f1eb8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape98975d1-25", "ovs_interfaceid": "e98975d1-25ad-4973-9073-0ca95b177a2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:25:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Releasing lock "refresh_cache-719d5fd5-8185-454f-a3a7-dbef383e8953" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:25:56 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 18:25:58 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1723052a-3475-41c4-8e6b-d489d7cf5b3b tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 18:25:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1723052a-3475-41c4-8e6b-d489d7cf5b3b tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9a222f2b-1ead-49a7-9c19-1610e5ba0a4d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nBvghYRb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:25:58 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-1723052a-3475-41c4-8e6b-d489d7cf5b3b tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:25:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-1723052a-3475-41c4-8e6b-d489d7cf5b3b tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:25:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-1723052a-3475-41c4-8e6b-d489d7cf5b3b tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:25:58 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-1723052a-3475-41c4-8e6b-d489d7cf5b3b tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:25:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-1723052a-3475-41c4-8e6b-d489d7cf5b3b tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a222f2b-1ead-49a7-9c19-1610e5ba0a4d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:25:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-1723052a-3475-41c4-8e6b-d489d7cf5b3b tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a222f2b-1ead-49a7-9c19-1610e5ba0a4d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:25:58 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-1723052a-3475-41c4-8e6b-d489d7cf5b3b tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 18:25:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a222f2b-1ead-49a7-9c19-1610e5ba0a4d -p 172.16.0.220:3260 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:25:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a222f2b-1ead-49a7-9c19-1610e5ba0a4d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:25:58 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6b9165-815c-46c2-8999-891920df9ebc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:25:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1723052a-3475-41c4-8e6b-d489d7cf5b3b tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 18:25:58 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:25:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a222f2b-1ead-49a7-9c19-1610e5ba0a4d -p 172.16.0.220:3260 --interface default --op new {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:25:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a222f2b-1ead-49a7-9c19-1610e5ba0a4d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:25:58 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1b2016-146d-45a2-a310-03021aee9679]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a222f2b-1ead-49a7-9c19-1610e5ba0a4d] added\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:25:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1723052a-3475-41c4-8e6b-d489d7cf5b3b tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a222f2b-1ead-49a7-9c19-1610e5ba0a4d] added
Nov 10 18:25:58 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:25:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a222f2b-1ead-49a7-9c19-1610e5ba0a4d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:25:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a222f2b-1ead-49a7-9c19-1610e5ba0a4d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:25:58 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c73426b-b307-4839-aac8-b67e3bbf2cab]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:25:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1723052a-3475-41c4-8e6b-d489d7cf5b3b tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:25:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a222f2b-1ead-49a7-9c19-1610e5ba0a4d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:25:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a222f2b-1ead-49a7-9c19-1610e5ba0a4d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:25:58 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4374da1f-0f95-4970-ae43-d8337a457b01]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:25:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1723052a-3475-41c4-8e6b-d489d7cf5b3b tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:25:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a222f2b-1ead-49a7-9c19-1610e5ba0a4d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nBvghYRb {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:25:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a222f2b-1ead-49a7-9c19-1610e5ba0a4d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nBvghYRb" returned: 0 in 0.026s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:25:58 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8b5d3f-0dfe-4627-bb02-094bbb2ec245]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:25:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1723052a-3475-41c4-8e6b-d489d7cf5b3b tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nBvghYRb'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:25:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a222f2b-1ead-49a7-9c19-1610e5ba0a4d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:25:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a222f2b-1ead-49a7-9c19-1610e5ba0a4d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:25:58 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e10eb9-f301-4829-95da-3d17f8df1a06]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:25:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1723052a-3475-41c4-8e6b-d489d7cf5b3b tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:25:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:25:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:25:58 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[26fcf923-d7a5-405e-9304-f764783fbbb8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:25:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1723052a-3475-41c4-8e6b-d489d7cf5b3b tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 10 18:25:58 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:25:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1723052a-3475-41c4-8e6b-d489d7cf5b3b tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 10 18:25:58 user nova-compute[75100]:  {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:25:58 user nova-compute[75100]: WARNING os_brick.initiator.connectors.iscsi [None req-1723052a-3475-41c4-8e6b-d489d7cf5b3b tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 10 18:25:58 user nova-compute[75100]: 
Nov 10 18:25:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a222f2b-1ead-49a7-9c19-1610e5ba0a4d -p 172.16.0.220:3260 --login {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:25:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a222f2b-1ead-49a7-9c19-1610e5ba0a4d -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:25:58 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[376810b4-8f0e-4861-b4a0-a46c21db20e4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a222f2b-1ead-49a7-9c19-1610e5ba0a4d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9a222f2b-1ead-49a7-9c19-1610e5ba0a4d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:25:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1723052a-3475-41c4-8e6b-d489d7cf5b3b tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a222f2b-1ead-49a7-9c19-1610e5ba0a4d, portal: 172.16.0.220,3260]
Nov 10 18:25:58 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:9a222f2b-1ead-49a7-9c19-1610e5ba0a4d, portal: 172.16.0.220,3260] successful.
Nov 10 18:25:58 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:25:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a222f2b-1ead-49a7-9c19-1610e5ba0a4d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:25:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a222f2b-1ead-49a7-9c19-1610e5ba0a4d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:25:58 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ab4c18-e98d-4ef2-a680-3ea1d0a48dca]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:25:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1723052a-3475-41c4-8e6b-d489d7cf5b3b tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:25:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:25:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:25:58 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[079f616b-3f6a-478c-ba27-32b1a4ae9e76]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a222f2b-1ead-49a7-9c19-1610e5ba0a4d (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:25:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1723052a-3475-41c4-8e6b-d489d7cf5b3b tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a222f2b-1ead-49a7-9c19-1610e5ba0a4d (non-flash)
Nov 10 18:25:58 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:25:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1723052a-3475-41c4-8e6b-d489d7cf5b3b tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a222f2b-1ead-49a7-9c19-1610e5ba0a4d (non-flash)
Nov 10 18:25:58 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:25:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-1723052a-3475-41c4-8e6b-d489d7cf5b3b tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a222f2b-1ead-49a7-9c19-1610e5ba0a4d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:25:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1723052a-3475-41c4-8e6b-d489d7cf5b3b tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 18:25:58 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-1723052a-3475-41c4-8e6b-d489d7cf5b3b tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 18:25:58 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-1723052a-3475-41c4-8e6b-d489d7cf5b3b tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 18:25:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:25:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:25:58 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c16f90-4555-46f0-96e2-038fb69f2054]: (4, ('- - 0', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:25:58 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-1723052a-3475-41c4-8e6b-d489d7cf5b3b tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 18:25:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1723052a-3475-41c4-8e6b-d489d7cf5b3b tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9a222f2b-1ead-49a7-9c19-1610e5ba0a4d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nBvghYRb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 18:25:58 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:25:58 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 18:25:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-1723052a-3475-41c4-8e6b-d489d7cf5b3b tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:25:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1723052a-3475-41c4-8e6b-d489d7cf5b3b tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '23732383064633230', 'path': '/dev/sdb'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:25:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1723052a-3475-41c4-8e6b-d489d7cf5b3b tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23732383064633230', 'path': '/dev/sdb'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 18:25:59 user nova-compute[75100]: DEBUG nova.objects.instance [None req-1723052a-3475-41c4-8e6b-d489d7cf5b3b tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lazy-loading 'flavor' on Instance uuid d02fea18-bb78-472e-8947-909f4b6b5fde {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:25:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-1723052a-3475-41c4-8e6b-d489d7cf5b3b tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 18:25:59 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:25:59 user nova-compute[75100]:   <source dev="/dev/sdb"/>
Nov 10 18:25:59 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 18:25:59 user nova-compute[75100]:   <serial>9a222f2b-1ead-49a7-9c19-1610e5ba0a4d</serial>
Nov 10 18:25:59 user nova-compute[75100]: </disk>
Nov 10 18:25:59 user nova-compute[75100]:  {{(pid=75100) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 18:25:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-1723052a-3475-41c4-8e6b-d489d7cf5b3b tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 18:25:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-1723052a-3475-41c4-8e6b-d489d7cf5b3b tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 18:25:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-1723052a-3475-41c4-8e6b-d489d7cf5b3b tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] No VIF found with MAC fa:16:3e:b3:cf:91, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 18:25:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1723052a-3475-41c4-8e6b-d489d7cf5b3b tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lock "d02fea18-bb78-472e-8947-909f4b6b5fde" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.733s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:26:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:26:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-16de6f61-f944-4151-96a0-c824a92cb540 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Acquiring lock "d02fea18-bb78-472e-8947-909f4b6b5fde" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:26:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-16de6f61-f944-4151-96a0-c824a92cb540 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lock "d02fea18-bb78-472e-8947-909f4b6b5fde" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:26:02 user nova-compute[75100]: INFO nova.compute.manager [None req-16de6f61-f944-4151-96a0-c824a92cb540 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Detaching volume 9a222f2b-1ead-49a7-9c19-1610e5ba0a4d
Nov 10 18:26:02 user nova-compute[75100]: INFO nova.virt.block_device [None req-16de6f61-f944-4151-96a0-c824a92cb540 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Attempting to driver detach volume 9a222f2b-1ead-49a7-9c19-1610e5ba0a4d from mountpoint /dev/vdb
Nov 10 18:26:02 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-16de6f61-f944-4151-96a0-c824a92cb540 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Attempting to detach device vdb from instance d02fea18-bb78-472e-8947-909f4b6b5fde from the persistent domain config. {{(pid=75100) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 18:26:02 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-16de6f61-f944-4151-96a0-c824a92cb540 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 18:26:02 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:26:02 user nova-compute[75100]:   <source dev="/dev/sdb"/>
Nov 10 18:26:02 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 18:26:02 user nova-compute[75100]:   <serial>9a222f2b-1ead-49a7-9c19-1610e5ba0a4d</serial>
Nov 10 18:26:02 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 18:26:02 user nova-compute[75100]: </disk>
Nov 10 18:26:02 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 18:26:02 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-16de6f61-f944-4151-96a0-c824a92cb540 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Successfully detached device vdb from instance d02fea18-bb78-472e-8947-909f4b6b5fde from the persistent domain config.
Nov 10 18:26:02 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-16de6f61-f944-4151-96a0-c824a92cb540 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d02fea18-bb78-472e-8947-909f4b6b5fde from the live domain config. {{(pid=75100) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 18:26:02 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-16de6f61-f944-4151-96a0-c824a92cb540 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 18:26:02 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:26:02 user nova-compute[75100]:   <source dev="/dev/sdb"/>
Nov 10 18:26:02 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 18:26:02 user nova-compute[75100]:   <serial>9a222f2b-1ead-49a7-9c19-1610e5ba0a4d</serial>
Nov 10 18:26:02 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 18:26:02 user nova-compute[75100]: </disk>
Nov 10 18:26:02 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 18:26:02 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-16de6f61-f944-4151-96a0-c824a92cb540 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d02fea18-bb78-472e-8947-909f4b6b5fde {{(pid=75100) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 18:26:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:26:05 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:26:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:26:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:26:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:26:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:26:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:26:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:26:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:26:13 user nova-compute[75100]: DEBUG nova.compute.manager [req-4754d377-d1c9-410d-8e01-6b6fe09f0235 req-9e3858a7-872f-49b9-ac49-84c1882b1eb0 service nova] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Received event network-changed-e98975d1-25ad-4973-9073-0ca95b177a2a {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:26:13 user nova-compute[75100]: DEBUG nova.compute.manager [req-4754d377-d1c9-410d-8e01-6b6fe09f0235 req-9e3858a7-872f-49b9-ac49-84c1882b1eb0 service nova] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Refreshing instance network info cache due to event network-changed-e98975d1-25ad-4973-9073-0ca95b177a2a. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 18:26:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4754d377-d1c9-410d-8e01-6b6fe09f0235 req-9e3858a7-872f-49b9-ac49-84c1882b1eb0 service nova] Acquiring lock "refresh_cache-719d5fd5-8185-454f-a3a7-dbef383e8953" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:26:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4754d377-d1c9-410d-8e01-6b6fe09f0235 req-9e3858a7-872f-49b9-ac49-84c1882b1eb0 service nova] Acquired lock "refresh_cache-719d5fd5-8185-454f-a3a7-dbef383e8953" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:26:13 user nova-compute[75100]: DEBUG nova.network.neutron [req-4754d377-d1c9-410d-8e01-6b6fe09f0235 req-9e3858a7-872f-49b9-ac49-84c1882b1eb0 service nova] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Refreshing network info cache for port e98975d1-25ad-4973-9073-0ca95b177a2a {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 18:26:14 user nova-compute[75100]: DEBUG nova.network.neutron [req-4754d377-d1c9-410d-8e01-6b6fe09f0235 req-9e3858a7-872f-49b9-ac49-84c1882b1eb0 service nova] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Updated VIF entry in instance network info cache for port e98975d1-25ad-4973-9073-0ca95b177a2a. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 18:26:14 user nova-compute[75100]: DEBUG nova.network.neutron [req-4754d377-d1c9-410d-8e01-6b6fe09f0235 req-9e3858a7-872f-49b9-ac49-84c1882b1eb0 service nova] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Updating instance_info_cache with network_info: [{"id": "e98975d1-25ad-4973-9073-0ca95b177a2a", "address": "fa:16:3e:ce:17:25", "network": {"id": "0c411791-eb03-4e00-9d7f-d032e2c16d46", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1808141765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc6fc8310f44f3788e13aa4f1eb8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape98975d1-25", "ovs_interfaceid": "e98975d1-25ad-4973-9073-0ca95b177a2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:26:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4754d377-d1c9-410d-8e01-6b6fe09f0235 req-9e3858a7-872f-49b9-ac49-84c1882b1eb0 service nova] Releasing lock "refresh_cache-719d5fd5-8185-454f-a3a7-dbef383e8953" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:26:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:26:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:26:17 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:26:17 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Cleaning up deleted instances {{(pid=75100) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 18:26:17 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] There are 0 instances to clean {{(pid=75100) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 18:26:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-23903e16-e1fb-47ab-a708-2b8555408b83 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Acquiring lock "719d5fd5-8185-454f-a3a7-dbef383e8953" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:26:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-23903e16-e1fb-47ab-a708-2b8555408b83 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "719d5fd5-8185-454f-a3a7-dbef383e8953" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:26:19 user nova-compute[75100]: DEBUG nova.objects.instance [None req-23903e16-e1fb-47ab-a708-2b8555408b83 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lazy-loading 'flavor' on Instance uuid 719d5fd5-8185-454f-a3a7-dbef383e8953 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:26:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-23903e16-e1fb-47ab-a708-2b8555408b83 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "719d5fd5-8185-454f-a3a7-dbef383e8953" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:26:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-23903e16-e1fb-47ab-a708-2b8555408b83 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Acquiring lock "719d5fd5-8185-454f-a3a7-dbef383e8953" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:26:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-23903e16-e1fb-47ab-a708-2b8555408b83 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "719d5fd5-8185-454f-a3a7-dbef383e8953" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:26:19 user nova-compute[75100]: INFO nova.compute.manager [None req-23903e16-e1fb-47ab-a708-2b8555408b83 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Attaching volume 86b0a916-38e7-4725-b990-5ab2eeeda339 to /dev/vdb
Nov 10 18:26:19 user nova-compute[75100]: DEBUG os_brick.utils [None req-23903e16-e1fb-47ab-a708-2b8555408b83 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:26:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:26:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:26:20 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[09cf50d6-fc09-4106-9a79-d6e4f53aebf8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90b1a229568f\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:26:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:26:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:26:20 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e707c4-dcd9-4bfb-b0e2-af188b4c06d6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:26:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:26:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:26:20 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e619d0-ff83-4bce-972a-c001662aac0b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:26:20 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f865653f-48c7-451a-85f5-411027aad540]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:26:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-23903e16-e1fb-47ab-a708-2b8555408b83 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:26:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-23903e16-e1fb-47ab-a708-2b8555408b83 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 18:26:20 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-23903e16-e1fb-47ab-a708-2b8555408b83 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 18:26:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:26:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 18:26:20 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 18:26:20 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a38ce0b-27e8-4ef2-a5ac-289ae701e624]: (4, '') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:26:20 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-23903e16-e1fb-47ab-a708-2b8555408b83 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 18:26:20 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-23903e16-e1fb-47ab-a708-2b8555408b83 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 18:26:20 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-23903e16-e1fb-47ab-a708-2b8555408b83 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 18:26:20 user nova-compute[75100]: DEBUG os_brick.utils [None req-23903e16-e1fb-47ab-a708-2b8555408b83 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90b1a229568f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:26:20 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-23903e16-e1fb-47ab-a708-2b8555408b83 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Updating existing volume attachment record: 779a0b4f-4e99-4856-b7ed-8dde05b0cd47 {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 18:26:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:26:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:26:22 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-16de6f61-f944-4151-96a0-c824a92cb540 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d02fea18-bb78-472e-8947-909f4b6b5fde is timed out.
Nov 10 18:26:22 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-16de6f61-f944-4151-96a0-c824a92cb540 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Successfully detached device vdb from instance d02fea18-bb78-472e-8947-909f4b6b5fde from the live domain config.
Nov 10 18:26:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16de6f61-f944-4151-96a0-c824a92cb540 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 18:26:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-16de6f61-f944-4151-96a0-c824a92cb540 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, {'target_iqn': 'iqn.2010-10.org.openstack:9a222f2b-1ead-49a7-9c19-1610e5ba0a4d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nBvghYRb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:26:22 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-16de6f61-f944-4151-96a0-c824a92cb540 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:26:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-16de6f61-f944-4151-96a0-c824a92cb540 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:26:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-16de6f61-f944-4151-96a0-c824a92cb540 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:26:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:26:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:26:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3b52ff-ae21-4dd6-baed-cbf2fe1b3139]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9a222f2b-1ead-49a7-9c19-1610e5ba0a4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:26:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-16de6f61-f944-4151-96a0-c824a92cb540 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 18:26:22 user nova-compute[75100]: No targets found.
Nov 10 18:26:22 user nova-compute[75100]: iSNS:
Nov 10 18:26:22 user nova-compute[75100]: No targets found.
Nov 10 18:26:22 user nova-compute[75100]: STATIC:
Nov 10 18:26:22 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:9a222f2b-1ead-49a7-9c19-1610e5ba0a4d
Nov 10 18:26:22 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:26:22 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:26:22 user nova-compute[75100]: FIRMWARE:
Nov 10 18:26:22 user nova-compute[75100]: No targets found.
Nov 10 18:26:22 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:26:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-16de6f61-f944-4151-96a0-c824a92cb540 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 18:26:22 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 18:26:22 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 18:26:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-16de6f61-f944-4151-96a0-c824a92cb540 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a222f2b-1ead-49a7-9c19-1610e5ba0a4d', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 18:26:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:26:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:26:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[815f7ae9-c89d-4af6-8b62-74079cb10340]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a222f2b-1ead-49a7-9c19-1610e5ba0a4d\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:26:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:26:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:26:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[091818c3-47b9-49c7-b8c4-96484a92149c]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a222f2b-1ead-49a7-9c19-1610e5ba0a4d (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:26:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-16de6f61-f944-4151-96a0-c824a92cb540 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a222f2b-1ead-49a7-9c19-1610e5ba0a4d (non-flash)
Nov 10 18:26:22 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:26:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-16de6f61-f944-4151-96a0-c824a92cb540 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a222f2b-1ead-49a7-9c19-1610e5ba0a4d (non-flash)
Nov 10 18:26:22 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:26:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-16de6f61-f944-4151-96a0-c824a92cb540 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3bc6ce4d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a222f2b-1ead-49a7-9c19-1610e5ba0a4d'): ({'sdb'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 18:26:22 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-16de6f61-f944-4151-96a0-c824a92cb540 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Removing single pathed devices sdb {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 18:26:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:26:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:26:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[507d642f-39e9-461d-9600-5274d1f6faa2]: (4, ('path checker states:\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:26:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:26:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:26:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[77834690-0692-40b4-bd1a-7e4cb4c15c58]: (4, ('ok\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:26:22 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-16de6f61-f944-4151-96a0-c824a92cb540 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Flushing IO for device /dev/sdb {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 18:26:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:26:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:26:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a1aef1-60c3-4723-8944-b8adc88ebe07]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:26:22 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-16de6f61-f944-4151-96a0-c824a92cb540 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 18:26:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:26:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:26:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d632c86d-daea-4e05-a830-5cda1c7a791b]: (4, ('1', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:26:22 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-16de6f61-f944-4151-96a0-c824a92cb540 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 18:26:22 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-16de6f61-f944-4151-96a0-c824a92cb540 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 18:26:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-16de6f61-f944-4151-96a0-c824a92cb540 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a222f2b-1ead-49a7-9c19-1610e5ba0a4d')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 18:26:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a222f2b-1ead-49a7-9c19-1610e5ba0a4d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:26:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a222f2b-1ead-49a7-9c19-1610e5ba0a4d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:26:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[13985267-f53b-4dfe-a2ad-df216507cff7]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:26:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-16de6f61-f944-4151-96a0-c824a92cb540 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:26:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a222f2b-1ead-49a7-9c19-1610e5ba0a4d -p 172.16.0.220:3260 --logout {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:26:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a222f2b-1ead-49a7-9c19-1610e5ba0a4d -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:26:23 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8292776d-0813-4ad3-b614-ea41345adcd3]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:9a222f2b-1ead-49a7-9c19-1610e5ba0a4d, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:9a222f2b-1ead-49a7-9c19-1610e5ba0a4d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:26:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-16de6f61-f944-4151-96a0-c824a92cb540 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:9a222f2b-1ead-49a7-9c19-1610e5ba0a4d, portal: 172.16.0.220,3260]
Nov 10 18:26:23 user nova-compute[75100]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:9a222f2b-1ead-49a7-9c19-1610e5ba0a4d, portal: 172.16.0.220,3260] successful.
Nov 10 18:26:23 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:26:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a222f2b-1ead-49a7-9c19-1610e5ba0a4d -p 172.16.0.220:3260 --op delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:26:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a222f2b-1ead-49a7-9c19-1610e5ba0a4d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:26:23 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[61993ea6-3f18-4476-92ff-4692f6f83094]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:26:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-16de6f61-f944-4151-96a0-c824a92cb540 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:26:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-16de6f61-f944-4151-96a0-c824a92cb540 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.267s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:26:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-16de6f61-f944-4151-96a0-c824a92cb540 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] <== disconnect_volume: return (268ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:26:23 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16de6f61-f944-4151-96a0-c824a92cb540 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 18:26:23 user nova-compute[75100]: DEBUG nova.objects.instance [None req-16de6f61-f944-4151-96a0-c824a92cb540 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lazy-loading 'flavor' on Instance uuid d02fea18-bb78-472e-8947-909f4b6b5fde {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:26:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-16de6f61-f944-4151-96a0-c824a92cb540 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lock "d02fea18-bb78-472e-8947-909f4b6b5fde" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.744s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:26:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:26:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:26:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:26:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:26:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:26:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:26:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:26:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:26:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:26:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:26:39 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:26:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:26:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:26:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:26:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:26:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:26:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:26:42 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23903e16-e1fb-47ab-a708-2b8555408b83 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 18:26:42 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-23903e16-e1fb-47ab-a708-2b8555408b83 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:86b0a916-38e7-4725-b990-5ab2eeeda339', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ITJhfyVA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:26:42 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-23903e16-e1fb-47ab-a708-2b8555408b83 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:26:42 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-23903e16-e1fb-47ab-a708-2b8555408b83 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:26:42 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-23903e16-e1fb-47ab-a708-2b8555408b83 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:26:42 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-23903e16-e1fb-47ab-a708-2b8555408b83 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:26:42 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-23903e16-e1fb-47ab-a708-2b8555408b83 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86b0a916-38e7-4725-b990-5ab2eeeda339" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:26:42 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-23903e16-e1fb-47ab-a708-2b8555408b83 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86b0a916-38e7-4725-b990-5ab2eeeda339" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:26:42 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-23903e16-e1fb-47ab-a708-2b8555408b83 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 18:26:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86b0a916-38e7-4725-b990-5ab2eeeda339 -p 172.16.0.220:3260 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:26:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86b0a916-38e7-4725-b990-5ab2eeeda339 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:26:42 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a6b21c0-35d3-4a4b-9b06-05d9920a95af]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:26:42 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-23903e16-e1fb-47ab-a708-2b8555408b83 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 18:26:42 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:26:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86b0a916-38e7-4725-b990-5ab2eeeda339 -p 172.16.0.220:3260 --interface default --op new {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:26:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86b0a916-38e7-4725-b990-5ab2eeeda339 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:26:42 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4627f9-c7a2-4e42-ac7e-bd487369a507]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:86b0a916-38e7-4725-b990-5ab2eeeda339] added\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:26:42 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-23903e16-e1fb-47ab-a708-2b8555408b83 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:86b0a916-38e7-4725-b990-5ab2eeeda339] added
Nov 10 18:26:42 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:26:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86b0a916-38e7-4725-b990-5ab2eeeda339 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:26:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86b0a916-38e7-4725-b990-5ab2eeeda339 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:26:42 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab33a66-8cca-4f34-93c1-020d9a9de0e7]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:26:42 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-23903e16-e1fb-47ab-a708-2b8555408b83 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:26:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86b0a916-38e7-4725-b990-5ab2eeeda339 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:26:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86b0a916-38e7-4725-b990-5ab2eeeda339 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:26:42 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca3b54bd-1441-44cf-adc8-7d7181ebee91]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:26:42 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-23903e16-e1fb-47ab-a708-2b8555408b83 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:26:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86b0a916-38e7-4725-b990-5ab2eeeda339 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ITJhfyVA {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:26:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86b0a916-38e7-4725-b990-5ab2eeeda339 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ITJhfyVA" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:26:42 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b819bea4-d8f7-4917-966e-aa71711b7132]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:26:42 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-23903e16-e1fb-47ab-a708-2b8555408b83 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ITJhfyVA'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:26:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86b0a916-38e7-4725-b990-5ab2eeeda339 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:26:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86b0a916-38e7-4725-b990-5ab2eeeda339 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:26:42 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d518eead-da28-43f6-86bc-ef3323b82e17]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:26:42 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-23903e16-e1fb-47ab-a708-2b8555408b83 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:26:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:26:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:26:42 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e62418-8d9f-4df2-b163-28531fba8879]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:26:42 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-23903e16-e1fb-47ab-a708-2b8555408b83 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 10 18:26:42 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:26:42 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-23903e16-e1fb-47ab-a708-2b8555408b83 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 10 18:26:42 user nova-compute[75100]:  {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:26:42 user nova-compute[75100]: WARNING os_brick.initiator.connectors.iscsi [None req-23903e16-e1fb-47ab-a708-2b8555408b83 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 10 18:26:42 user nova-compute[75100]: 
Nov 10 18:26:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86b0a916-38e7-4725-b990-5ab2eeeda339 -p 172.16.0.220:3260 --login {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:26:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86b0a916-38e7-4725-b990-5ab2eeeda339 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:26:42 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[929a6c62-9825-451f-8ddb-516f9cb71181]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:86b0a916-38e7-4725-b990-5ab2eeeda339, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:86b0a916-38e7-4725-b990-5ab2eeeda339, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:26:42 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-23903e16-e1fb-47ab-a708-2b8555408b83 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:86b0a916-38e7-4725-b990-5ab2eeeda339, portal: 172.16.0.220,3260]
Nov 10 18:26:42 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:86b0a916-38e7-4725-b990-5ab2eeeda339, portal: 172.16.0.220,3260] successful.
Nov 10 18:26:42 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:26:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86b0a916-38e7-4725-b990-5ab2eeeda339 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:26:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86b0a916-38e7-4725-b990-5ab2eeeda339 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:26:42 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5b82e4-9988-4812-8df4-c1024d1ec7f3]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:26:42 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-23903e16-e1fb-47ab-a708-2b8555408b83 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:26:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:26:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:26:42 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a2ab3bf-c0de-4b14-9c62-8a03ae79bf32]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b0a916-38e7-4725-b990-5ab2eeeda339 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:26:42 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-23903e16-e1fb-47ab-a708-2b8555408b83 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b0a916-38e7-4725-b990-5ab2eeeda339 (non-flash)
Nov 10 18:26:42 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:26:42 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-23903e16-e1fb-47ab-a708-2b8555408b83 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b0a916-38e7-4725-b990-5ab2eeeda339 (non-flash)
Nov 10 18:26:42 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:26:42 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-23903e16-e1fb-47ab-a708-2b8555408b83 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86b0a916-38e7-4725-b990-5ab2eeeda339" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.247s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:26:42 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-23903e16-e1fb-47ab-a708-2b8555408b83 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 18:26:42 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-23903e16-e1fb-47ab-a708-2b8555408b83 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 18:26:42 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-23903e16-e1fb-47ab-a708-2b8555408b83 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 18:26:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:26:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:26:42 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0edfc4f2-7c73-4675-8e36-c602dacca35f]: (4, ('- - 0', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:26:42 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-23903e16-e1fb-47ab-a708-2b8555408b83 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 18:26:42 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-23903e16-e1fb-47ab-a708-2b8555408b83 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:86b0a916-38e7-4725-b990-5ab2eeeda339', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ITJhfyVA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 18:26:43 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-23903e16-e1fb-47ab-a708-2b8555408b83 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.278s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:26:43 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-23903e16-e1fb-47ab-a708-2b8555408b83 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] <== connect_volume: return (1280ms) {'type': 'block', 'scsi_wwn': '23236623435386135', 'path': '/dev/sdb'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:26:43 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23903e16-e1fb-47ab-a708-2b8555408b83 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236623435386135', 'path': '/dev/sdb'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 18:26:43 user nova-compute[75100]: DEBUG nova.objects.instance [None req-23903e16-e1fb-47ab-a708-2b8555408b83 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lazy-loading 'flavor' on Instance uuid 719d5fd5-8185-454f-a3a7-dbef383e8953 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:26:43 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-23903e16-e1fb-47ab-a708-2b8555408b83 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 18:26:43 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:26:43 user nova-compute[75100]:   <source dev="/dev/sdb"/>
Nov 10 18:26:43 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 18:26:43 user nova-compute[75100]:   <serial>86b0a916-38e7-4725-b990-5ab2eeeda339</serial>
Nov 10 18:26:43 user nova-compute[75100]: </disk>
Nov 10 18:26:43 user nova-compute[75100]:  {{(pid=75100) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 18:26:44 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-23903e16-e1fb-47ab-a708-2b8555408b83 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 18:26:44 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-23903e16-e1fb-47ab-a708-2b8555408b83 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 18:26:44 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-23903e16-e1fb-47ab-a708-2b8555408b83 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] No VIF found with MAC fa:16:3e:ce:17:25, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 18:26:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-23903e16-e1fb-47ab-a708-2b8555408b83 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "719d5fd5-8185-454f-a3a7-dbef383e8953" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.601s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:26:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:26:45 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:26:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:26:50 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:26:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:26:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:26:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:26:50 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 18:26:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/719d5fd5-8185-454f-a3a7-dbef383e8953/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:26:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/719d5fd5-8185-454f-a3a7-dbef383e8953/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:26:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/719d5fd5-8185-454f-a3a7-dbef383e8953/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:26:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:26:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/719d5fd5-8185-454f-a3a7-dbef383e8953/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:26:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 18:26:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d02fea18-bb78-472e-8947-909f4b6b5fde/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:26:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d02fea18-bb78-472e-8947-909f4b6b5fde/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:26:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d02fea18-bb78-472e-8947-909f4b6b5fde/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:26:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d02fea18-bb78-472e-8947-909f4b6b5fde/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:26:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e4069e6c-b710-4b13-8794-f11b61fc351d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Acquiring lock "719d5fd5-8185-454f-a3a7-dbef383e8953" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:26:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e4069e6c-b710-4b13-8794-f11b61fc351d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "719d5fd5-8185-454f-a3a7-dbef383e8953" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:26:51 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:26:51 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:26:51 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Hypervisor/Node resource view: name=user free_ram=8837MB free_disk=24.386371612548828GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 18:26:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:26:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:26:51 user nova-compute[75100]: DEBUG nova.objects.instance [None req-e4069e6c-b710-4b13-8794-f11b61fc351d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lazy-loading 'flavor' on Instance uuid 719d5fd5-8185-454f-a3a7-dbef383e8953 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:26:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e4069e6c-b710-4b13-8794-f11b61fc351d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "719d5fd5-8185-454f-a3a7-dbef383e8953" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:26:51 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance d02fea18-bb78-472e-8947-909f4b6b5fde actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:26:51 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 719d5fd5-8185-454f-a3a7-dbef383e8953 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:26:51 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 18:26:51 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 18:26:51 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Refreshing inventories for resource provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 18:26:51 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Updating ProviderTree inventory for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 18:26:51 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Updating inventory in ProviderTree for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 18:26:51 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Refreshing aggregate associations for resource provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64, aggregates: None {{(pid=75100) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 18:26:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e4069e6c-b710-4b13-8794-f11b61fc351d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Acquiring lock "719d5fd5-8185-454f-a3a7-dbef383e8953" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:26:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e4069e6c-b710-4b13-8794-f11b61fc351d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "719d5fd5-8185-454f-a3a7-dbef383e8953" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:26:51 user nova-compute[75100]: INFO nova.compute.manager [None req-e4069e6c-b710-4b13-8794-f11b61fc351d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Attaching volume e5478dcd-7659-47a6-94f9-ec618adec589 to /dev/vdc
Nov 10 18:26:51 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Refreshing trait associations for resource provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2 {{(pid=75100) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 18:26:51 user nova-compute[75100]: DEBUG os_brick.utils [None req-e4069e6c-b710-4b13-8794-f11b61fc351d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:26:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:26:51 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:26:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:26:51 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a402be10-5404-4945-b795-1da53b5739f9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90b1a229568f\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:26:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:26:51 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:26:51 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 18:26:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.317s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:26:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:26:51 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[46eafa8f-19c6-46e9-af1f-a94646fab6f3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:26:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:26:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:26:51 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[45bcdbed-ba5a-40b2-8603-3a19bc5b77a6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:26:51 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[355aa8b6-cf63-4c74-bfb6-32ede7ee009a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:26:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-e4069e6c-b710-4b13-8794-f11b61fc351d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:26:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-e4069e6c-b710-4b13-8794-f11b61fc351d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 18:26:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e4069e6c-b710-4b13-8794-f11b61fc351d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 18:26:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:26:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 18:26:51 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 18:26:51 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62f9c9f-2113-429c-8bab-ec4538737ce4]: (4, '') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:26:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-e4069e6c-b710-4b13-8794-f11b61fc351d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 18:26:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-e4069e6c-b710-4b13-8794-f11b61fc351d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 18:26:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-e4069e6c-b710-4b13-8794-f11b61fc351d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 18:26:51 user nova-compute[75100]: DEBUG os_brick.utils [None req-e4069e6c-b710-4b13-8794-f11b61fc351d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90b1a229568f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:26:51 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-e4069e6c-b710-4b13-8794-f11b61fc351d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Updating existing volume attachment record: 67f73a42-fc2e-44f5-91bf-8dceb4e54dd3 {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 18:26:53 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:26:53 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:26:53 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:26:55 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:26:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:26:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:26:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:26:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:26:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:26:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:26:56 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:26:56 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 18:26:56 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Rebuilding the list of instances to heal {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 18:26:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "refresh_cache-d02fea18-bb78-472e-8947-909f4b6b5fde" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:26:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquired lock "refresh_cache-d02fea18-bb78-472e-8947-909f4b6b5fde" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:26:56 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 18:26:56 user nova-compute[75100]: DEBUG nova.objects.instance [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lazy-loading 'info_cache' on Instance uuid d02fea18-bb78-472e-8947-909f4b6b5fde {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:26:56 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Updating instance_info_cache with network_info: [{"id": "f7d27dda-1b70-4f3f-b866-c2705b01e396", "address": "fa:16:3e:b3:cf:91", "network": {"id": "9b61fda2-5437-4085-889d-35a4edda72bc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1424647024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38869dd0674640b1b72258b53dc8f5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7d27dda-1b", "ovs_interfaceid": "f7d27dda-1b70-4f3f-b866-c2705b01e396", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:26:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Releasing lock "refresh_cache-d02fea18-bb78-472e-8947-909f4b6b5fde" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:26:57 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 18:26:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9d38084e-1b46-4c77-9e52-cc75cd807e61 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Acquiring lock "d02fea18-bb78-472e-8947-909f4b6b5fde" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:26:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9d38084e-1b46-4c77-9e52-cc75cd807e61 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lock "d02fea18-bb78-472e-8947-909f4b6b5fde" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:26:58 user nova-compute[75100]: DEBUG nova.objects.instance [None req-9d38084e-1b46-4c77-9e52-cc75cd807e61 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lazy-loading 'flavor' on Instance uuid d02fea18-bb78-472e-8947-909f4b6b5fde {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:26:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9d38084e-1b46-4c77-9e52-cc75cd807e61 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lock "d02fea18-bb78-472e-8947-909f4b6b5fde" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:26:58 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:26:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9d38084e-1b46-4c77-9e52-cc75cd807e61 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Acquiring lock "d02fea18-bb78-472e-8947-909f4b6b5fde" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:26:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9d38084e-1b46-4c77-9e52-cc75cd807e61 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lock "d02fea18-bb78-472e-8947-909f4b6b5fde" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:26:59 user nova-compute[75100]: INFO nova.compute.manager [None req-9d38084e-1b46-4c77-9e52-cc75cd807e61 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Attaching volume e62edad5-7626-4f87-afd8-9e7682c0a6e4 to /dev/vdb
Nov 10 18:26:59 user nova-compute[75100]: DEBUG os_brick.utils [None req-9d38084e-1b46-4c77-9e52-cc75cd807e61 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:26:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:26:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:26:59 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e671e862-ea0f-40c9-8186-9cdea3fc6b2f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90b1a229568f\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:26:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:26:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:26:59 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ae11c9-d7cc-439e-a26e-e622a68b2137]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:26:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:26:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:26:59 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74f5998-a485-4ea3-9e8d-41396fdee64d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:26:59 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e875b9-5e53-47be-9561-eddec8644471]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:26:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-9d38084e-1b46-4c77-9e52-cc75cd807e61 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:26:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-9d38084e-1b46-4c77-9e52-cc75cd807e61 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 18:26:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9d38084e-1b46-4c77-9e52-cc75cd807e61 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 18:26:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:26:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 18:26:59 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 18:26:59 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5111113d-1e3d-4cd8-bc56-54d08773ae5d]: (4, '') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:26:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-9d38084e-1b46-4c77-9e52-cc75cd807e61 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 18:26:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-9d38084e-1b46-4c77-9e52-cc75cd807e61 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 18:26:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-9d38084e-1b46-4c77-9e52-cc75cd807e61 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 18:26:59 user nova-compute[75100]: DEBUG os_brick.utils [None req-9d38084e-1b46-4c77-9e52-cc75cd807e61 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90b1a229568f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:26:59 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-9d38084e-1b46-4c77-9e52-cc75cd807e61 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Updating existing volume attachment record: d65c7c42-2c45-481b-a363-b51c76a4ce80 {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 18:27:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:27:00 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:27:00 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 18:27:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:27:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:27:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:27:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:27:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4069e6c-b710-4b13-8794-f11b61fc351d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 18:27:15 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4069e6c-b710-4b13-8794-f11b61fc351d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e5478dcd-7659-47a6-94f9-ec618adec589', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zfblLhtq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:27:15 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-e4069e6c-b710-4b13-8794-f11b61fc351d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:27:15 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-e4069e6c-b710-4b13-8794-f11b61fc351d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:27:15 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-e4069e6c-b710-4b13-8794-f11b61fc351d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:27:15 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-e4069e6c-b710-4b13-8794-f11b61fc351d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:27:15 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-e4069e6c-b710-4b13-8794-f11b61fc351d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5478dcd-7659-47a6-94f9-ec618adec589" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:27:15 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-e4069e6c-b710-4b13-8794-f11b61fc351d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5478dcd-7659-47a6-94f9-ec618adec589" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:27:15 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-e4069e6c-b710-4b13-8794-f11b61fc351d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 18:27:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5478dcd-7659-47a6-94f9-ec618adec589 -p 172.16.0.220:3260 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:27:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5478dcd-7659-47a6-94f9-ec618adec589 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:27:15 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbcf5de-ad52-40b6-a300-21c264bc65d1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:27:15 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4069e6c-b710-4b13-8794-f11b61fc351d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 18:27:15 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:27:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5478dcd-7659-47a6-94f9-ec618adec589 -p 172.16.0.220:3260 --interface default --op new {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:27:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5478dcd-7659-47a6-94f9-ec618adec589 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:27:15 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3592efdc-89fe-4cd0-a3f0-81c7e49299ac]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5478dcd-7659-47a6-94f9-ec618adec589] added\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:27:15 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4069e6c-b710-4b13-8794-f11b61fc351d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5478dcd-7659-47a6-94f9-ec618adec589] added
Nov 10 18:27:15 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:27:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5478dcd-7659-47a6-94f9-ec618adec589 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:27:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5478dcd-7659-47a6-94f9-ec618adec589 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:27:15 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5ea7c3-05b5-4853-aabf-f14776ad1d6f]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:27:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4069e6c-b710-4b13-8794-f11b61fc351d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:27:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5478dcd-7659-47a6-94f9-ec618adec589 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:27:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5478dcd-7659-47a6-94f9-ec618adec589 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:27:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee8239d-0ac2-4837-ab59-3e356cff6976]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:27:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4069e6c-b710-4b13-8794-f11b61fc351d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:27:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5478dcd-7659-47a6-94f9-ec618adec589 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zfblLhtq {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:27:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5478dcd-7659-47a6-94f9-ec618adec589 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zfblLhtq" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:27:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[273509d0-2b4f-4115-9894-080e9b3c8007]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:27:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4069e6c-b710-4b13-8794-f11b61fc351d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zfblLhtq'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:27:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5478dcd-7659-47a6-94f9-ec618adec589 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:27:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5478dcd-7659-47a6-94f9-ec618adec589 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:27:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c751ad5c-d995-4e1d-a299-83799f5a6742]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:27:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4069e6c-b710-4b13-8794-f11b61fc351d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:27:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:27:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:27:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f967d28-b89d-47e2-941a-b90d701f9bc6]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b0a916-38e7-4725-b990-5ab2eeeda339 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:27:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4069e6c-b710-4b13-8794-f11b61fc351d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b0a916-38e7-4725-b990-5ab2eeeda339 (non-flash)
Nov 10 18:27:16 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:27:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4069e6c-b710-4b13-8794-f11b61fc351d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b0a916-38e7-4725-b990-5ab2eeeda339 (non-flash)
Nov 10 18:27:16 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:27:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5478dcd-7659-47a6-94f9-ec618adec589 -p 172.16.0.220:3260 --login {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:27:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5478dcd-7659-47a6-94f9-ec618adec589 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:27:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c091b2-c436-4d38-82a0-38d1be1134a0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5478dcd-7659-47a6-94f9-ec618adec589, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e5478dcd-7659-47a6-94f9-ec618adec589, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:27:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4069e6c-b710-4b13-8794-f11b61fc351d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5478dcd-7659-47a6-94f9-ec618adec589, portal: 172.16.0.220,3260]
Nov 10 18:27:16 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:e5478dcd-7659-47a6-94f9-ec618adec589, portal: 172.16.0.220,3260] successful.
Nov 10 18:27:16 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:27:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5478dcd-7659-47a6-94f9-ec618adec589 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:27:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5478dcd-7659-47a6-94f9-ec618adec589 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:27:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3c132f-3850-44a0-90cc-1181f8406fda]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:27:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4069e6c-b710-4b13-8794-f11b61fc351d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:27:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:27:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:27:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf7ba87-0ce6-46e3-9f96-d89ca881f743]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b0a916-38e7-4725-b990-5ab2eeeda339 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5478dcd-7659-47a6-94f9-ec618adec589 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:27:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4069e6c-b710-4b13-8794-f11b61fc351d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b0a916-38e7-4725-b990-5ab2eeeda339 (non-flash)
Nov 10 18:27:16 user nova-compute[75100]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5478dcd-7659-47a6-94f9-ec618adec589 (non-flash)
Nov 10 18:27:16 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:27:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4069e6c-b710-4b13-8794-f11b61fc351d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b0a916-38e7-4725-b990-5ab2eeeda339 (non-flash)
Nov 10 18:27:16 user nova-compute[75100]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5478dcd-7659-47a6-94f9-ec618adec589 (non-flash)
Nov 10 18:27:16 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:27:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-e4069e6c-b710-4b13-8794-f11b61fc351d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5478dcd-7659-47a6-94f9-ec618adec589" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:27:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4069e6c-b710-4b13-8794-f11b61fc351d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 18:27:16 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-e4069e6c-b710-4b13-8794-f11b61fc351d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 18:27:16 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-e4069e6c-b710-4b13-8794-f11b61fc351d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 18:27:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:27:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:27:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3090fe95-b142-4871-966d-e6796567da79]: (4, ('- - 0', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:27:16 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-e4069e6c-b710-4b13-8794-f11b61fc351d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: None {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 18:27:17 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-e4069e6c-b710-4b13-8794-f11b61fc351d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 18:27:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4069e6c-b710-4b13-8794-f11b61fc351d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e5478dcd-7659-47a6-94f9-ec618adec589', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zfblLhtq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 18:27:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-e4069e6c-b710-4b13-8794-f11b61fc351d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:27:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4069e6c-b710-4b13-8794-f11b61fc351d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23566636435643863', 'path': '/dev/sdc'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:27:17 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4069e6c-b710-4b13-8794-f11b61fc351d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23566636435643863', 'path': '/dev/sdc'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 18:27:17 user nova-compute[75100]: DEBUG nova.objects.instance [None req-e4069e6c-b710-4b13-8794-f11b61fc351d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lazy-loading 'flavor' on Instance uuid 719d5fd5-8185-454f-a3a7-dbef383e8953 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:27:17 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-e4069e6c-b710-4b13-8794-f11b61fc351d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 18:27:17 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:27:17 user nova-compute[75100]:   <source dev="/dev/sdc"/>
Nov 10 18:27:17 user nova-compute[75100]:   <target dev="vdc" bus="virtio"/>
Nov 10 18:27:17 user nova-compute[75100]:   <serial>e5478dcd-7659-47a6-94f9-ec618adec589</serial>
Nov 10 18:27:17 user nova-compute[75100]: </disk>
Nov 10 18:27:17 user nova-compute[75100]:  {{(pid=75100) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 18:27:17 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e4069e6c-b710-4b13-8794-f11b61fc351d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 18:27:17 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e4069e6c-b710-4b13-8794-f11b61fc351d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 18:27:17 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e4069e6c-b710-4b13-8794-f11b61fc351d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 18:27:17 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e4069e6c-b710-4b13-8794-f11b61fc351d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] No VIF found with MAC fa:16:3e:ce:17:25, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 18:27:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e4069e6c-b710-4b13-8794-f11b61fc351d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "719d5fd5-8185-454f-a3a7-dbef383e8953" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.065s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:27:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-08a2379a-ec3d-4a96-862b-31bf4c61a074 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Acquiring lock "719d5fd5-8185-454f-a3a7-dbef383e8953" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:27:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-08a2379a-ec3d-4a96-862b-31bf4c61a074 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "719d5fd5-8185-454f-a3a7-dbef383e8953" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:27:18 user nova-compute[75100]: INFO nova.compute.manager [None req-08a2379a-ec3d-4a96-862b-31bf4c61a074 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Detaching volume 86b0a916-38e7-4725-b990-5ab2eeeda339
Nov 10 18:27:18 user nova-compute[75100]: INFO nova.virt.block_device [None req-08a2379a-ec3d-4a96-862b-31bf4c61a074 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Attempting to driver detach volume 86b0a916-38e7-4725-b990-5ab2eeeda339 from mountpoint /dev/vdb
Nov 10 18:27:18 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-08a2379a-ec3d-4a96-862b-31bf4c61a074 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Attempting to detach device vdb from instance 719d5fd5-8185-454f-a3a7-dbef383e8953 from the persistent domain config. {{(pid=75100) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 18:27:18 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-08a2379a-ec3d-4a96-862b-31bf4c61a074 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 18:27:18 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:27:18 user nova-compute[75100]:   <source dev="/dev/sdb"/>
Nov 10 18:27:18 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 18:27:18 user nova-compute[75100]:   <serial>86b0a916-38e7-4725-b990-5ab2eeeda339</serial>
Nov 10 18:27:18 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 18:27:18 user nova-compute[75100]: </disk>
Nov 10 18:27:18 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 18:27:19 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-08a2379a-ec3d-4a96-862b-31bf4c61a074 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Successfully detached device vdb from instance 719d5fd5-8185-454f-a3a7-dbef383e8953 from the persistent domain config.
Nov 10 18:27:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-08a2379a-ec3d-4a96-862b-31bf4c61a074 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 719d5fd5-8185-454f-a3a7-dbef383e8953 from the live domain config. {{(pid=75100) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 18:27:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-08a2379a-ec3d-4a96-862b-31bf4c61a074 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 18:27:19 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:27:19 user nova-compute[75100]:   <source dev="/dev/sdb"/>
Nov 10 18:27:19 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 18:27:19 user nova-compute[75100]:   <serial>86b0a916-38e7-4725-b990-5ab2eeeda339</serial>
Nov 10 18:27:19 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 18:27:19 user nova-compute[75100]: </disk>
Nov 10 18:27:19 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 18:27:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-08a2379a-ec3d-4a96-862b-31bf4c61a074 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 719d5fd5-8185-454f-a3a7-dbef383e8953 {{(pid=75100) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 18:27:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:27:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:27:23 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d38084e-1b46-4c77-9e52-cc75cd807e61 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 18:27:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d38084e-1b46-4c77-9e52-cc75cd807e61 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e62edad5-7626-4f87-afd8-9e7682c0a6e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SqNrInuV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:27:23 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-9d38084e-1b46-4c77-9e52-cc75cd807e61 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:27:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-9d38084e-1b46-4c77-9e52-cc75cd807e61 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:27:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-9d38084e-1b46-4c77-9e52-cc75cd807e61 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:27:23 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-9d38084e-1b46-4c77-9e52-cc75cd807e61 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:27:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-9d38084e-1b46-4c77-9e52-cc75cd807e61 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e62edad5-7626-4f87-afd8-9e7682c0a6e4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:27:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-9d38084e-1b46-4c77-9e52-cc75cd807e61 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e62edad5-7626-4f87-afd8-9e7682c0a6e4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:27:23 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-9d38084e-1b46-4c77-9e52-cc75cd807e61 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 18:27:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e62edad5-7626-4f87-afd8-9e7682c0a6e4 -p 172.16.0.220:3260 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:27:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e62edad5-7626-4f87-afd8-9e7682c0a6e4 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:27:23 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dfdcb7b-e3d1-4e6a-8ab2-0805a951cd58]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:27:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d38084e-1b46-4c77-9e52-cc75cd807e61 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 18:27:23 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:27:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e62edad5-7626-4f87-afd8-9e7682c0a6e4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:27:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e62edad5-7626-4f87-afd8-9e7682c0a6e4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:27:23 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e065925c-3fc7-40be-971d-a612393ea552]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e62edad5-7626-4f87-afd8-9e7682c0a6e4] added\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:27:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d38084e-1b46-4c77-9e52-cc75cd807e61 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e62edad5-7626-4f87-afd8-9e7682c0a6e4] added
Nov 10 18:27:23 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:27:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e62edad5-7626-4f87-afd8-9e7682c0a6e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:27:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e62edad5-7626-4f87-afd8-9e7682c0a6e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:27:23 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af40b59-7e69-4e51-a027-80f0c453e880]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:27:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d38084e-1b46-4c77-9e52-cc75cd807e61 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:27:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e62edad5-7626-4f87-afd8-9e7682c0a6e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:27:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e62edad5-7626-4f87-afd8-9e7682c0a6e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:27:23 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[338cbcec-73f2-47e5-81c6-f148a9f90f04]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:27:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d38084e-1b46-4c77-9e52-cc75cd807e61 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:27:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e62edad5-7626-4f87-afd8-9e7682c0a6e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SqNrInuV {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:27:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e62edad5-7626-4f87-afd8-9e7682c0a6e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SqNrInuV" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:27:23 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13b5c66-52c0-4cf0-8646-246048a8f48a]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:27:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d38084e-1b46-4c77-9e52-cc75cd807e61 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SqNrInuV'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:27:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e62edad5-7626-4f87-afd8-9e7682c0a6e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:27:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e62edad5-7626-4f87-afd8-9e7682c0a6e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:27:24 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a451870-b3f9-4bce-9da4-c738b510c54c]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:27:24 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d38084e-1b46-4c77-9e52-cc75cd807e61 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:27:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:27:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:27:24 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3feea02e-35d5-4d4c-b2e1-4591dd6dfa79]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b0a916-38e7-4725-b990-5ab2eeeda339 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5478dcd-7659-47a6-94f9-ec618adec589 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:27:24 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d38084e-1b46-4c77-9e52-cc75cd807e61 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b0a916-38e7-4725-b990-5ab2eeeda339 (non-flash)
Nov 10 18:27:24 user nova-compute[75100]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5478dcd-7659-47a6-94f9-ec618adec589 (non-flash)
Nov 10 18:27:24 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:27:24 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d38084e-1b46-4c77-9e52-cc75cd807e61 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b0a916-38e7-4725-b990-5ab2eeeda339 (non-flash)
Nov 10 18:27:24 user nova-compute[75100]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5478dcd-7659-47a6-94f9-ec618adec589 (non-flash)
Nov 10 18:27:24 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:27:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e62edad5-7626-4f87-afd8-9e7682c0a6e4 -p 172.16.0.220:3260 --login {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:27:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e62edad5-7626-4f87-afd8-9e7682c0a6e4 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:27:24 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5ec03a-ed4d-42ab-b6bf-e50085f1e4c9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e62edad5-7626-4f87-afd8-9e7682c0a6e4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e62edad5-7626-4f87-afd8-9e7682c0a6e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:27:24 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d38084e-1b46-4c77-9e52-cc75cd807e61 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e62edad5-7626-4f87-afd8-9e7682c0a6e4, portal: 172.16.0.220,3260]
Nov 10 18:27:24 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:e62edad5-7626-4f87-afd8-9e7682c0a6e4, portal: 172.16.0.220,3260] successful.
Nov 10 18:27:24 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:27:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e62edad5-7626-4f87-afd8-9e7682c0a6e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:27:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e62edad5-7626-4f87-afd8-9e7682c0a6e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:27:24 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[79fa4f68-f69f-4565-8270-01d1fa4fb410]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:27:24 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d38084e-1b46-4c77-9e52-cc75cd807e61 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:27:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:27:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:27:24 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4634c1-32d0-442e-8bff-a011304dbda0]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b0a916-38e7-4725-b990-5ab2eeeda339 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5478dcd-7659-47a6-94f9-ec618adec589 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62edad5-7626-4f87-afd8-9e7682c0a6e4 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:27:24 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d38084e-1b46-4c77-9e52-cc75cd807e61 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b0a916-38e7-4725-b990-5ab2eeeda339 (non-flash)
Nov 10 18:27:24 user nova-compute[75100]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5478dcd-7659-47a6-94f9-ec618adec589 (non-flash)
Nov 10 18:27:24 user nova-compute[75100]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62edad5-7626-4f87-afd8-9e7682c0a6e4 (non-flash)
Nov 10 18:27:24 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:27:24 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d38084e-1b46-4c77-9e52-cc75cd807e61 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b0a916-38e7-4725-b990-5ab2eeeda339 (non-flash)
Nov 10 18:27:24 user nova-compute[75100]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5478dcd-7659-47a6-94f9-ec618adec589 (non-flash)
Nov 10 18:27:24 user nova-compute[75100]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62edad5-7626-4f87-afd8-9e7682c0a6e4 (non-flash)
Nov 10 18:27:24 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:27:24 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-9d38084e-1b46-4c77-9e52-cc75cd807e61 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e62edad5-7626-4f87-afd8-9e7682c0a6e4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:27:24 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d38084e-1b46-4c77-9e52-cc75cd807e61 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 18:27:24 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-9d38084e-1b46-4c77-9e52-cc75cd807e61 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] HCTL ('35', '-', '-', 0) found on session 49 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 18:27:24 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-9d38084e-1b46-4c77-9e52-cc75cd807e61 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 18:27:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:27:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:27:24 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5cc35a-1e9b-44c8-a60c-a3418248449b]: (4, ('- - 0', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:27:24 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-9d38084e-1b46-4c77-9e52-cc75cd807e61 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Searching for a device in session 49 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 18:27:24 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d38084e-1b46-4c77-9e52-cc75cd807e61 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e62edad5-7626-4f87-afd8-9e7682c0a6e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SqNrInuV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 18:27:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-9d38084e-1b46-4c77-9e52-cc75cd807e61 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:27:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d38084e-1b46-4c77-9e52-cc75cd807e61 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23066633533626461', 'path': '/dev/sdd'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:27:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d38084e-1b46-4c77-9e52-cc75cd807e61 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23066633533626461', 'path': '/dev/sdd'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 18:27:25 user nova-compute[75100]: DEBUG nova.objects.instance [None req-9d38084e-1b46-4c77-9e52-cc75cd807e61 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lazy-loading 'flavor' on Instance uuid d02fea18-bb78-472e-8947-909f4b6b5fde {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:27:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-9d38084e-1b46-4c77-9e52-cc75cd807e61 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 18:27:25 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:27:25 user nova-compute[75100]:   <source dev="/dev/sdd"/>
Nov 10 18:27:25 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 18:27:25 user nova-compute[75100]:   <serial>e62edad5-7626-4f87-afd8-9e7682c0a6e4</serial>
Nov 10 18:27:25 user nova-compute[75100]: </disk>
Nov 10 18:27:25 user nova-compute[75100]:  {{(pid=75100) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 18:27:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:27:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-9d38084e-1b46-4c77-9e52-cc75cd807e61 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 18:27:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-9d38084e-1b46-4c77-9e52-cc75cd807e61 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 18:27:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-9d38084e-1b46-4c77-9e52-cc75cd807e61 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] No VIF found with MAC fa:16:3e:b3:cf:91, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 18:27:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:27:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9d38084e-1b46-4c77-9e52-cc75cd807e61 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lock "d02fea18-bb78-472e-8947-909f4b6b5fde" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.090s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:27:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-59b375ea-28c8-4b56-9331-4ece53e0d2d8 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Acquiring lock "d02fea18-bb78-472e-8947-909f4b6b5fde" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:27:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-59b375ea-28c8-4b56-9331-4ece53e0d2d8 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lock "d02fea18-bb78-472e-8947-909f4b6b5fde" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:27:27 user nova-compute[75100]: INFO nova.compute.manager [None req-59b375ea-28c8-4b56-9331-4ece53e0d2d8 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Detaching volume e62edad5-7626-4f87-afd8-9e7682c0a6e4
Nov 10 18:27:28 user nova-compute[75100]: INFO nova.virt.block_device [None req-59b375ea-28c8-4b56-9331-4ece53e0d2d8 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Attempting to driver detach volume e62edad5-7626-4f87-afd8-9e7682c0a6e4 from mountpoint /dev/vdb
Nov 10 18:27:28 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-59b375ea-28c8-4b56-9331-4ece53e0d2d8 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Attempting to detach device vdb from instance d02fea18-bb78-472e-8947-909f4b6b5fde from the persistent domain config. {{(pid=75100) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 18:27:28 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-59b375ea-28c8-4b56-9331-4ece53e0d2d8 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 18:27:28 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:27:28 user nova-compute[75100]:   <source dev="/dev/sdd"/>
Nov 10 18:27:28 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 18:27:28 user nova-compute[75100]:   <serial>e62edad5-7626-4f87-afd8-9e7682c0a6e4</serial>
Nov 10 18:27:28 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 18:27:28 user nova-compute[75100]: </disk>
Nov 10 18:27:28 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 18:27:28 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-59b375ea-28c8-4b56-9331-4ece53e0d2d8 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Successfully detached device vdb from instance d02fea18-bb78-472e-8947-909f4b6b5fde from the persistent domain config.
Nov 10 18:27:28 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-59b375ea-28c8-4b56-9331-4ece53e0d2d8 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d02fea18-bb78-472e-8947-909f4b6b5fde from the live domain config. {{(pid=75100) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 18:27:28 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-59b375ea-28c8-4b56-9331-4ece53e0d2d8 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 18:27:28 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:27:28 user nova-compute[75100]:   <source dev="/dev/sdd"/>
Nov 10 18:27:28 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 18:27:28 user nova-compute[75100]:   <serial>e62edad5-7626-4f87-afd8-9e7682c0a6e4</serial>
Nov 10 18:27:28 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 18:27:28 user nova-compute[75100]: </disk>
Nov 10 18:27:28 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 18:27:28 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-59b375ea-28c8-4b56-9331-4ece53e0d2d8 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d02fea18-bb78-472e-8947-909f4b6b5fde {{(pid=75100) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 18:27:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:27:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:27:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:27:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:27:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:27:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:27:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:27:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:27:39 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:27:39 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-08a2379a-ec3d-4a96-862b-31bf4c61a074 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 719d5fd5-8185-454f-a3a7-dbef383e8953 is timed out.
Nov 10 18:27:39 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-08a2379a-ec3d-4a96-862b-31bf4c61a074 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Successfully detached device vdb from instance 719d5fd5-8185-454f-a3a7-dbef383e8953 from the live domain config.
Nov 10 18:27:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08a2379a-ec3d-4a96-862b-31bf4c61a074 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 18:27:39 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-08a2379a-ec3d-4a96-862b-31bf4c61a074 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, {'target_iqn': 'iqn.2010-10.org.openstack:86b0a916-38e7-4725-b990-5ab2eeeda339', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ITJhfyVA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:27:39 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-08a2379a-ec3d-4a96-862b-31bf4c61a074 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:27:39 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-08a2379a-ec3d-4a96-862b-31bf4c61a074 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:27:39 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-08a2379a-ec3d-4a96-862b-31bf4c61a074 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:27:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:27:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:27:39 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b71fe6-1ea1-4ac8-8b05-be5e809596e6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e5478dcd-7659-47a6-94f9-ec618adec589\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:86b0a916-38e7-4725-b990-5ab2eeeda339\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e62edad5-7626-4f87-afd8-9e7682c0a6e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:27:39 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-08a2379a-ec3d-4a96-862b-31bf4c61a074 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 18:27:39 user nova-compute[75100]: No targets found.
Nov 10 18:27:39 user nova-compute[75100]: iSNS:
Nov 10 18:27:39 user nova-compute[75100]: No targets found.
Nov 10 18:27:39 user nova-compute[75100]: STATIC:
Nov 10 18:27:39 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:e5478dcd-7659-47a6-94f9-ec618adec589
Nov 10 18:27:39 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:27:39 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:27:39 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:86b0a916-38e7-4725-b990-5ab2eeeda339
Nov 10 18:27:39 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:27:39 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:27:39 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:e62edad5-7626-4f87-afd8-9e7682c0a6e4
Nov 10 18:27:39 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:27:39 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:27:39 user nova-compute[75100]: FIRMWARE:
Nov 10 18:27:39 user nova-compute[75100]: No targets found.
Nov 10 18:27:39 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:27:39 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-08a2379a-ec3d-4a96-862b-31bf4c61a074 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 18:27:39 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 18:27:39 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 18:27:39 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-08a2379a-ec3d-4a96-862b-31bf4c61a074 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86b0a916-38e7-4725-b990-5ab2eeeda339', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 18:27:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:27:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:27:39 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[026cbc78-1eed-498a-a7b4-2488ae3d46aa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86b0a916-38e7-4725-b990-5ab2eeeda339\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5478dcd-7659-47a6-94f9-ec618adec589\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e62edad5-7626-4f87-afd8-9e7682c0a6e4\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:27:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:27:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:27:39 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[581b3872-e938-4e3c-89da-e3a3f5228e97]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b0a916-38e7-4725-b990-5ab2eeeda339 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5478dcd-7659-47a6-94f9-ec618adec589 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62edad5-7626-4f87-afd8-9e7682c0a6e4 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:27:39 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-08a2379a-ec3d-4a96-862b-31bf4c61a074 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b0a916-38e7-4725-b990-5ab2eeeda339 (non-flash)
Nov 10 18:27:39 user nova-compute[75100]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5478dcd-7659-47a6-94f9-ec618adec589 (non-flash)
Nov 10 18:27:39 user nova-compute[75100]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62edad5-7626-4f87-afd8-9e7682c0a6e4 (non-flash)
Nov 10 18:27:39 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:27:39 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-08a2379a-ec3d-4a96-862b-31bf4c61a074 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b0a916-38e7-4725-b990-5ab2eeeda339 (non-flash)
Nov 10 18:27:39 user nova-compute[75100]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5478dcd-7659-47a6-94f9-ec618adec589 (non-flash)
Nov 10 18:27:39 user nova-compute[75100]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62edad5-7626-4f87-afd8-9e7682c0a6e4 (non-flash)
Nov 10 18:27:39 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:27:39 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-08a2379a-ec3d-4a96-862b-31bf4c61a074 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3d4154820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86b0a916-38e7-4725-b990-5ab2eeeda339'): ({'sdb'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 18:27:39 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-08a2379a-ec3d-4a96-862b-31bf4c61a074 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Removing single pathed devices sdb {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 18:27:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:27:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:27:39 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f5f840-98dd-461b-8e35-d18b4eb81799]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:27:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:27:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:27:39 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf9d7f3-6a99-497b-bb85-5dd85d517b87]: (4, ('ok\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:27:39 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-08a2379a-ec3d-4a96-862b-31bf4c61a074 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Flushing IO for device /dev/sdb {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 18:27:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:27:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:27:39 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[46660e59-9b33-43d7-b67c-f27286f4edd7]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:27:39 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-08a2379a-ec3d-4a96-862b-31bf4c61a074 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 18:27:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:27:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:27:39 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5748d636-69d0-4a8e-bc01-10bd2a04926a]: (4, ('1', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:27:39 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-08a2379a-ec3d-4a96-862b-31bf4c61a074 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 18:27:39 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-08a2379a-ec3d-4a96-862b-31bf4c61a074 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 18:27:39 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-08a2379a-ec3d-4a96-862b-31bf4c61a074 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86b0a916-38e7-4725-b990-5ab2eeeda339')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 18:27:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86b0a916-38e7-4725-b990-5ab2eeeda339 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:27:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86b0a916-38e7-4725-b990-5ab2eeeda339 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:27:39 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed65d3da-fffe-45da-9c3f-24191e5f1392]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:27:39 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-08a2379a-ec3d-4a96-862b-31bf4c61a074 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:27:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86b0a916-38e7-4725-b990-5ab2eeeda339 -p 172.16.0.220:3260 --logout {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:27:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86b0a916-38e7-4725-b990-5ab2eeeda339 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:27:39 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f923894-e232-4464-b343-a72384a5dcf0]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:86b0a916-38e7-4725-b990-5ab2eeeda339, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:86b0a916-38e7-4725-b990-5ab2eeeda339, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:27:39 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-08a2379a-ec3d-4a96-862b-31bf4c61a074 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:86b0a916-38e7-4725-b990-5ab2eeeda339, portal: 172.16.0.220,3260]
Nov 10 18:27:39 user nova-compute[75100]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:86b0a916-38e7-4725-b990-5ab2eeeda339, portal: 172.16.0.220,3260] successful.
Nov 10 18:27:39 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:27:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86b0a916-38e7-4725-b990-5ab2eeeda339 -p 172.16.0.220:3260 --op delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:27:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86b0a916-38e7-4725-b990-5ab2eeeda339 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:27:39 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc0fb8b-b195-48a9-aef3-2ca98aab6356]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:27:39 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-08a2379a-ec3d-4a96-862b-31bf4c61a074 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:27:39 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-08a2379a-ec3d-4a96-862b-31bf4c61a074 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:27:39 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-08a2379a-ec3d-4a96-862b-31bf4c61a074 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] <== disconnect_volume: return (295ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:27:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08a2379a-ec3d-4a96-862b-31bf4c61a074 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 18:27:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:27:40 user nova-compute[75100]: DEBUG nova.objects.instance [None req-08a2379a-ec3d-4a96-862b-31bf4c61a074 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lazy-loading 'flavor' on Instance uuid 719d5fd5-8185-454f-a3a7-dbef383e8953 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:27:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-08a2379a-ec3d-4a96-862b-31bf4c61a074 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "719d5fd5-8185-454f-a3a7-dbef383e8953" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.966s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:27:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d347e650-cb8a-43e4-a1f2-c3b9afc64f78 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Acquiring lock "719d5fd5-8185-454f-a3a7-dbef383e8953" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:27:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d347e650-cb8a-43e4-a1f2-c3b9afc64f78 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "719d5fd5-8185-454f-a3a7-dbef383e8953" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:27:41 user nova-compute[75100]: INFO nova.compute.manager [None req-d347e650-cb8a-43e4-a1f2-c3b9afc64f78 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Detaching volume e5478dcd-7659-47a6-94f9-ec618adec589
Nov 10 18:27:41 user nova-compute[75100]: INFO nova.virt.block_device [None req-d347e650-cb8a-43e4-a1f2-c3b9afc64f78 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Attempting to driver detach volume e5478dcd-7659-47a6-94f9-ec618adec589 from mountpoint /dev/vdc
Nov 10 18:27:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d347e650-cb8a-43e4-a1f2-c3b9afc64f78 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Attempting to detach device vdc from instance 719d5fd5-8185-454f-a3a7-dbef383e8953 from the persistent domain config. {{(pid=75100) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 18:27:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-d347e650-cb8a-43e4-a1f2-c3b9afc64f78 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 18:27:41 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:27:41 user nova-compute[75100]:   <source dev="/dev/sdc"/>
Nov 10 18:27:41 user nova-compute[75100]:   <target dev="vdc" bus="virtio"/>
Nov 10 18:27:41 user nova-compute[75100]:   <serial>e5478dcd-7659-47a6-94f9-ec618adec589</serial>
Nov 10 18:27:41 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 10 18:27:41 user nova-compute[75100]: </disk>
Nov 10 18:27:41 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 18:27:41 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-d347e650-cb8a-43e4-a1f2-c3b9afc64f78 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Successfully detached device vdc from instance 719d5fd5-8185-454f-a3a7-dbef383e8953 from the persistent domain config.
Nov 10 18:27:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d347e650-cb8a-43e4-a1f2-c3b9afc64f78 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 719d5fd5-8185-454f-a3a7-dbef383e8953 from the live domain config. {{(pid=75100) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 18:27:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-d347e650-cb8a-43e4-a1f2-c3b9afc64f78 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 18:27:41 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:27:41 user nova-compute[75100]:   <source dev="/dev/sdc"/>
Nov 10 18:27:41 user nova-compute[75100]:   <target dev="vdc" bus="virtio"/>
Nov 10 18:27:41 user nova-compute[75100]:   <serial>e5478dcd-7659-47a6-94f9-ec618adec589</serial>
Nov 10 18:27:41 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 10 18:27:41 user nova-compute[75100]: </disk>
Nov 10 18:27:41 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 18:27:42 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d347e650-cb8a-43e4-a1f2-c3b9afc64f78 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 719d5fd5-8185-454f-a3a7-dbef383e8953 {{(pid=75100) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 18:27:45 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:27:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:27:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:27:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:27:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:27:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:27:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:27:48 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-59b375ea-28c8-4b56-9331-4ece53e0d2d8 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d02fea18-bb78-472e-8947-909f4b6b5fde is timed out.
Nov 10 18:27:48 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-59b375ea-28c8-4b56-9331-4ece53e0d2d8 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Successfully detached device vdb from instance d02fea18-bb78-472e-8947-909f4b6b5fde from the live domain config.
Nov 10 18:27:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59b375ea-28c8-4b56-9331-4ece53e0d2d8 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 18:27:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-59b375ea-28c8-4b56-9331-4ece53e0d2d8 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, {'target_iqn': 'iqn.2010-10.org.openstack:e62edad5-7626-4f87-afd8-9e7682c0a6e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SqNrInuV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:27:48 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-59b375ea-28c8-4b56-9331-4ece53e0d2d8 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:27:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-59b375ea-28c8-4b56-9331-4ece53e0d2d8 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:27:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-59b375ea-28c8-4b56-9331-4ece53e0d2d8 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:27:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:27:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:27:48 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6acb1fd9-d65c-45b3-82a2-2907fbe06ec7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e5478dcd-7659-47a6-94f9-ec618adec589\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e62edad5-7626-4f87-afd8-9e7682c0a6e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:27:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-59b375ea-28c8-4b56-9331-4ece53e0d2d8 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 18:27:48 user nova-compute[75100]: No targets found.
Nov 10 18:27:48 user nova-compute[75100]: iSNS:
Nov 10 18:27:48 user nova-compute[75100]: No targets found.
Nov 10 18:27:48 user nova-compute[75100]: STATIC:
Nov 10 18:27:48 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:e5478dcd-7659-47a6-94f9-ec618adec589
Nov 10 18:27:48 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:27:48 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:27:48 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:e62edad5-7626-4f87-afd8-9e7682c0a6e4
Nov 10 18:27:48 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:27:48 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:27:48 user nova-compute[75100]: FIRMWARE:
Nov 10 18:27:48 user nova-compute[75100]: No targets found.
Nov 10 18:27:48 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:27:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-59b375ea-28c8-4b56-9331-4ece53e0d2d8 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 18:27:48 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 18:27:48 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 18:27:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-59b375ea-28c8-4b56-9331-4ece53e0d2d8 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e62edad5-7626-4f87-afd8-9e7682c0a6e4', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 18:27:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:27:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:27:48 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[802c907a-7217-4c56-9a80-2d326359fe7d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5478dcd-7659-47a6-94f9-ec618adec589\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e62edad5-7626-4f87-afd8-9e7682c0a6e4\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:27:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:27:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:27:48 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4756dc44-bfc8-4248-9fbb-dfe447c616b4]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5478dcd-7659-47a6-94f9-ec618adec589 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62edad5-7626-4f87-afd8-9e7682c0a6e4 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:27:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-59b375ea-28c8-4b56-9331-4ece53e0d2d8 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5478dcd-7659-47a6-94f9-ec618adec589 (non-flash)
Nov 10 18:27:48 user nova-compute[75100]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62edad5-7626-4f87-afd8-9e7682c0a6e4 (non-flash)
Nov 10 18:27:48 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:27:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-59b375ea-28c8-4b56-9331-4ece53e0d2d8 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5478dcd-7659-47a6-94f9-ec618adec589 (non-flash)
Nov 10 18:27:48 user nova-compute[75100]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62edad5-7626-4f87-afd8-9e7682c0a6e4 (non-flash)
Nov 10 18:27:48 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:27:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-59b375ea-28c8-4b56-9331-4ece53e0d2d8 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3d4156050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e62edad5-7626-4f87-afd8-9e7682c0a6e4'): ({'sdd'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 18:27:48 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-59b375ea-28c8-4b56-9331-4ece53e0d2d8 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Removing single pathed devices sdd {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 18:27:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:27:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:27:48 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b0cbf6-c863-47d9-b398-4fcc67987e0d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:27:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:27:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:27:48 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd10116-1f23-447b-8e24-bfce38be5720]: (4, ('ok\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:27:48 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-59b375ea-28c8-4b56-9331-4ece53e0d2d8 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Flushing IO for device /dev/sdd {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 18:27:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:27:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:27:48 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[129cf962-88cc-4cd3-9780-8a67b5d50818]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:27:48 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-59b375ea-28c8-4b56-9331-4ece53e0d2d8 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 18:27:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:27:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:27:48 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d77fc8b-5482-4d69-990f-16e0f6049225]: (4, ('1', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:27:48 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-59b375ea-28c8-4b56-9331-4ece53e0d2d8 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 18:27:48 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-59b375ea-28c8-4b56-9331-4ece53e0d2d8 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] SCSI volumes sdd have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 18:27:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-59b375ea-28c8-4b56-9331-4ece53e0d2d8 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e62edad5-7626-4f87-afd8-9e7682c0a6e4')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 18:27:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e62edad5-7626-4f87-afd8-9e7682c0a6e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:27:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e62edad5-7626-4f87-afd8-9e7682c0a6e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:27:48 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6bfc186-b99f-411d-b7a2-f75c94724327]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:27:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-59b375ea-28c8-4b56-9331-4ece53e0d2d8 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:27:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e62edad5-7626-4f87-afd8-9e7682c0a6e4 -p 172.16.0.220:3260 --logout {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:27:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e62edad5-7626-4f87-afd8-9e7682c0a6e4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:27:48 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ee7b39-8f90-49d7-b660-96944d33a1b8]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:e62edad5-7626-4f87-afd8-9e7682c0a6e4, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:e62edad5-7626-4f87-afd8-9e7682c0a6e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:27:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-59b375ea-28c8-4b56-9331-4ece53e0d2d8 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:e62edad5-7626-4f87-afd8-9e7682c0a6e4, portal: 172.16.0.220,3260]
Nov 10 18:27:48 user nova-compute[75100]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:e62edad5-7626-4f87-afd8-9e7682c0a6e4, portal: 172.16.0.220,3260] successful.
Nov 10 18:27:48 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:27:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e62edad5-7626-4f87-afd8-9e7682c0a6e4 -p 172.16.0.220:3260 --op delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:27:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e62edad5-7626-4f87-afd8-9e7682c0a6e4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:27:48 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b8272c-8e1e-472d-8878-9b97cf3bcf54]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:27:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-59b375ea-28c8-4b56-9331-4ece53e0d2d8 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:27:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-59b375ea-28c8-4b56-9331-4ece53e0d2d8 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:27:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-59b375ea-28c8-4b56-9331-4ece53e0d2d8 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] <== disconnect_volume: return (307ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:27:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59b375ea-28c8-4b56-9331-4ece53e0d2d8 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 18:27:49 user nova-compute[75100]: DEBUG nova.objects.instance [None req-59b375ea-28c8-4b56-9331-4ece53e0d2d8 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lazy-loading 'flavor' on Instance uuid d02fea18-bb78-472e-8947-909f4b6b5fde {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:27:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-59b375ea-28c8-4b56-9331-4ece53e0d2d8 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lock "d02fea18-bb78-472e-8947-909f4b6b5fde" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.829s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:27:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:27:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:27:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:27:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:27:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:27:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:27:51 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:27:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:27:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:27:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:27:51 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 18:27:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/719d5fd5-8185-454f-a3a7-dbef383e8953/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:27:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/719d5fd5-8185-454f-a3a7-dbef383e8953/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:27:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/719d5fd5-8185-454f-a3a7-dbef383e8953/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:27:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/719d5fd5-8185-454f-a3a7-dbef383e8953/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:27:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d02fea18-bb78-472e-8947-909f4b6b5fde/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:27:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d02fea18-bb78-472e-8947-909f4b6b5fde/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:27:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d02fea18-bb78-472e-8947-909f4b6b5fde/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:27:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d02fea18-bb78-472e-8947-909f4b6b5fde/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:27:52 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:27:52 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:27:52 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Hypervisor/Node resource view: name=user free_ram=8832MB free_disk=24.384639739990234GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 18:27:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:27:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:27:52 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance d02fea18-bb78-472e-8947-909f4b6b5fde actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:27:52 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 719d5fd5-8185-454f-a3a7-dbef383e8953 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:27:52 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 18:27:52 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 18:27:52 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:27:52 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:27:52 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 18:27:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.208s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:27:54 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:27:54 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:27:54 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:27:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:27:56 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:27:58 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:27:58 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 18:27:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "refresh_cache-719d5fd5-8185-454f-a3a7-dbef383e8953" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:27:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquired lock "refresh_cache-719d5fd5-8185-454f-a3a7-dbef383e8953" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:27:58 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 18:27:58 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Updating instance_info_cache with network_info: [{"id": "e98975d1-25ad-4973-9073-0ca95b177a2a", "address": "fa:16:3e:ce:17:25", "network": {"id": "0c411791-eb03-4e00-9d7f-d032e2c16d46", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1808141765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc6fc8310f44f3788e13aa4f1eb8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape98975d1-25", "ovs_interfaceid": "e98975d1-25ad-4973-9073-0ca95b177a2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:27:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Releasing lock "refresh_cache-719d5fd5-8185-454f-a3a7-dbef383e8953" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:27:58 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 18:28:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:28:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:28:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:28:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:28:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:28:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:28:01 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:28:01 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 18:28:02 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-d347e650-cb8a-43e4-a1f2-c3b9afc64f78 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 719d5fd5-8185-454f-a3a7-dbef383e8953 is timed out.
Nov 10 18:28:02 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-d347e650-cb8a-43e4-a1f2-c3b9afc64f78 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Successfully detached device vdc from instance 719d5fd5-8185-454f-a3a7-dbef383e8953 from the live domain config.
Nov 10 18:28:02 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d347e650-cb8a-43e4-a1f2-c3b9afc64f78 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 18:28:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d347e650-cb8a-43e4-a1f2-c3b9afc64f78 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, {'target_iqn': 'iqn.2010-10.org.openstack:e5478dcd-7659-47a6-94f9-ec618adec589', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zfblLhtq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:28:02 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-d347e650-cb8a-43e4-a1f2-c3b9afc64f78 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:28:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-d347e650-cb8a-43e4-a1f2-c3b9afc64f78 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:28:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-d347e650-cb8a-43e4-a1f2-c3b9afc64f78 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:28:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:28:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:28:02 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f23164c-e278-4768-ba48-bc7ee9422bb4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e5478dcd-7659-47a6-94f9-ec618adec589\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:28:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d347e650-cb8a-43e4-a1f2-c3b9afc64f78 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 18:28:02 user nova-compute[75100]: No targets found.
Nov 10 18:28:02 user nova-compute[75100]: iSNS:
Nov 10 18:28:02 user nova-compute[75100]: No targets found.
Nov 10 18:28:02 user nova-compute[75100]: STATIC:
Nov 10 18:28:02 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:e5478dcd-7659-47a6-94f9-ec618adec589
Nov 10 18:28:02 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:28:02 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:28:02 user nova-compute[75100]: FIRMWARE:
Nov 10 18:28:02 user nova-compute[75100]: No targets found.
Nov 10 18:28:02 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:28:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d347e650-cb8a-43e4-a1f2-c3b9afc64f78 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 18:28:02 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 18:28:02 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 18:28:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d347e650-cb8a-43e4-a1f2-c3b9afc64f78 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5478dcd-7659-47a6-94f9-ec618adec589', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 18:28:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:28:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:28:02 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[028cc3df-5da0-426f-84f0-4ba030f9bf2d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5478dcd-7659-47a6-94f9-ec618adec589\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:28:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:28:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:28:02 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e13219-3125-47b6-a6ee-ec00fde46290]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5478dcd-7659-47a6-94f9-ec618adec589 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:28:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d347e650-cb8a-43e4-a1f2-c3b9afc64f78 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5478dcd-7659-47a6-94f9-ec618adec589 (non-flash)
Nov 10 18:28:02 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:28:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d347e650-cb8a-43e4-a1f2-c3b9afc64f78 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5478dcd-7659-47a6-94f9-ec618adec589 (non-flash)
Nov 10 18:28:02 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:28:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d347e650-cb8a-43e4-a1f2-c3b9afc64f78 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3986b2680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5478dcd-7659-47a6-94f9-ec618adec589'): ({'sdc'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 18:28:02 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-d347e650-cb8a-43e4-a1f2-c3b9afc64f78 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Removing single pathed devices sdc {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 18:28:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:28:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:28:02 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7921e0c-f735-4058-8399-33af88acfcf8]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:28:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:28:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:28:02 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f45d945-d87c-413f-b5c5-d7355ffbcea3]: (4, ('ok\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:28:02 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-d347e650-cb8a-43e4-a1f2-c3b9afc64f78 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Flushing IO for device /dev/sdc {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 18:28:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:28:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:28:02 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95c147e-4831-494c-ad2d-a3cad24fa9f9]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:28:02 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-d347e650-cb8a-43e4-a1f2-c3b9afc64f78 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 18:28:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:28:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:28:02 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac20069-ef2d-496d-8043-5c60ef58e4d5]: (4, ('1', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:28:02 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-d347e650-cb8a-43e4-a1f2-c3b9afc64f78 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 18:28:02 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-d347e650-cb8a-43e4-a1f2-c3b9afc64f78 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] SCSI volumes sdc have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 18:28:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d347e650-cb8a-43e4-a1f2-c3b9afc64f78 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5478dcd-7659-47a6-94f9-ec618adec589')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 18:28:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5478dcd-7659-47a6-94f9-ec618adec589 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:28:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5478dcd-7659-47a6-94f9-ec618adec589 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:28:02 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ec8286-994f-44fa-b8e7-97ab63c6d857]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:28:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d347e650-cb8a-43e4-a1f2-c3b9afc64f78 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:28:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5478dcd-7659-47a6-94f9-ec618adec589 -p 172.16.0.220:3260 --logout {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:28:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5478dcd-7659-47a6-94f9-ec618adec589 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:28:02 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed5e4d0-d2f9-4daa-8ebc-62dee7a23e4b]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:e5478dcd-7659-47a6-94f9-ec618adec589, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:e5478dcd-7659-47a6-94f9-ec618adec589, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:28:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d347e650-cb8a-43e4-a1f2-c3b9afc64f78 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:e5478dcd-7659-47a6-94f9-ec618adec589, portal: 172.16.0.220,3260]
Nov 10 18:28:02 user nova-compute[75100]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:e5478dcd-7659-47a6-94f9-ec618adec589, portal: 172.16.0.220,3260] successful.
Nov 10 18:28:02 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:28:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5478dcd-7659-47a6-94f9-ec618adec589 -p 172.16.0.220:3260 --op delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:28:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5478dcd-7659-47a6-94f9-ec618adec589 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:28:02 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb646be-9a84-4f53-9ba2-82ea9a02d7d2]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:28:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d347e650-cb8a-43e4-a1f2-c3b9afc64f78 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:28:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-d347e650-cb8a-43e4-a1f2-c3b9afc64f78 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:28:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d347e650-cb8a-43e4-a1f2-c3b9afc64f78 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] <== disconnect_volume: return (283ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:28:02 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d347e650-cb8a-43e4-a1f2-c3b9afc64f78 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 18:28:03 user nova-compute[75100]: DEBUG nova.objects.instance [None req-d347e650-cb8a-43e4-a1f2-c3b9afc64f78 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lazy-loading 'flavor' on Instance uuid 719d5fd5-8185-454f-a3a7-dbef383e8953 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:28:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d347e650-cb8a-43e4-a1f2-c3b9afc64f78 tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "719d5fd5-8185-454f-a3a7-dbef383e8953" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.925s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:28:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-614fb68b-1bbf-4801-beba-0285ce4b657d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Acquiring lock "719d5fd5-8185-454f-a3a7-dbef383e8953" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:28:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-614fb68b-1bbf-4801-beba-0285ce4b657d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "719d5fd5-8185-454f-a3a7-dbef383e8953" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:28:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-614fb68b-1bbf-4801-beba-0285ce4b657d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Acquiring lock "719d5fd5-8185-454f-a3a7-dbef383e8953-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:28:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-614fb68b-1bbf-4801-beba-0285ce4b657d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "719d5fd5-8185-454f-a3a7-dbef383e8953-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:28:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-614fb68b-1bbf-4801-beba-0285ce4b657d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "719d5fd5-8185-454f-a3a7-dbef383e8953-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:28:04 user nova-compute[75100]: INFO nova.compute.manager [None req-614fb68b-1bbf-4801-beba-0285ce4b657d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Terminating instance
Nov 10 18:28:04 user nova-compute[75100]: DEBUG nova.compute.manager [None req-614fb68b-1bbf-4801-beba-0285ce4b657d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 18:28:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:28:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:28:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:28:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:28:04 user nova-compute[75100]: DEBUG nova.compute.manager [req-568d4535-ca7e-42fe-af7c-4df16dc209bd req-a596c6bf-be0d-4dc6-9f0f-c3dd3cfb1fad service nova] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Received event network-vif-unplugged-e98975d1-25ad-4973-9073-0ca95b177a2a {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:28:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-568d4535-ca7e-42fe-af7c-4df16dc209bd req-a596c6bf-be0d-4dc6-9f0f-c3dd3cfb1fad service nova] Acquiring lock "719d5fd5-8185-454f-a3a7-dbef383e8953-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:28:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-568d4535-ca7e-42fe-af7c-4df16dc209bd req-a596c6bf-be0d-4dc6-9f0f-c3dd3cfb1fad service nova] Lock "719d5fd5-8185-454f-a3a7-dbef383e8953-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:28:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-568d4535-ca7e-42fe-af7c-4df16dc209bd req-a596c6bf-be0d-4dc6-9f0f-c3dd3cfb1fad service nova] Lock "719d5fd5-8185-454f-a3a7-dbef383e8953-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:28:04 user nova-compute[75100]: DEBUG nova.compute.manager [req-568d4535-ca7e-42fe-af7c-4df16dc209bd req-a596c6bf-be0d-4dc6-9f0f-c3dd3cfb1fad service nova] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] No waiting events found dispatching network-vif-unplugged-e98975d1-25ad-4973-9073-0ca95b177a2a {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:28:04 user nova-compute[75100]: DEBUG nova.compute.manager [req-568d4535-ca7e-42fe-af7c-4df16dc209bd req-a596c6bf-be0d-4dc6-9f0f-c3dd3cfb1fad service nova] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Received event network-vif-unplugged-e98975d1-25ad-4973-9073-0ca95b177a2a for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 18:28:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:28:05 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Instance destroyed successfully.
Nov 10 18:28:05 user nova-compute[75100]: DEBUG nova.objects.instance [None req-614fb68b-1bbf-4801-beba-0285ce4b657d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lazy-loading 'resources' on Instance uuid 719d5fd5-8185-454f-a3a7-dbef383e8953 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:28:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-614fb68b-1bbf-4801-beba-0285ce4b657d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:24:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1938732856',display_name='tempest-AttachVolumeTestJSON-server-1938732856',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1938732856',id=50,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB+CbnlQQfwRudtf9FaS37R9aRvSsuwh49ufpL++O9NAWeUpt4WEKhKwXCmWLU7+bmBHU7tcyZzzhzazT8p47QX+A1ppGhF2QLGNJQV5M//yq1ZC8DX2M1UiSU0/CSfNsw==',key_name='tempest-keypair-338677957',keypairs=<?>,launch_index=0,launched_at=2023-11-10T18:24:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8cc6fc8310f44f3788e13aa4f1eb8c96',ramdisk_id='',reservation_id='r-sek93ozd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-375321786',owner_user_name='tempest-AttachVolumeTestJSON-375321786-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T18:24:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='20c5bb15b9174fbc9df8ba12de10cea6',uuid=719d5fd5-8185-454f-a3a7-dbef383e8953,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e98975d1-25ad-4973-9073-0ca95b177a2a", "address": "fa:16:3e:ce:17:25", "network": {"id": "0c411791-eb03-4e00-9d7f-d032e2c16d46", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1808141765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc6fc8310f44f3788e13aa4f1eb8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape98975d1-25", "ovs_interfaceid": "e98975d1-25ad-4973-9073-0ca95b177a2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 18:28:05 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-614fb68b-1bbf-4801-beba-0285ce4b657d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Converting VIF {"id": "e98975d1-25ad-4973-9073-0ca95b177a2a", "address": "fa:16:3e:ce:17:25", "network": {"id": "0c411791-eb03-4e00-9d7f-d032e2c16d46", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1808141765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cc6fc8310f44f3788e13aa4f1eb8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape98975d1-25", "ovs_interfaceid": "e98975d1-25ad-4973-9073-0ca95b177a2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:28:05 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-614fb68b-1bbf-4801-beba-0285ce4b657d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ce:17:25,bridge_name='br-int',has_traffic_filtering=True,id=e98975d1-25ad-4973-9073-0ca95b177a2a,network=Network(0c411791-eb03-4e00-9d7f-d032e2c16d46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape98975d1-25') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:28:05 user nova-compute[75100]: DEBUG os_vif [None req-614fb68b-1bbf-4801-beba-0285ce4b657d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:17:25,bridge_name='br-int',has_traffic_filtering=True,id=e98975d1-25ad-4973-9073-0ca95b177a2a,network=Network(0c411791-eb03-4e00-9d7f-d032e2c16d46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape98975d1-25') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 18:28:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:28:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape98975d1-25, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:28:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:28:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:28:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=60161d7e-7002-4b1e-81e2-5404652d6601) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:28:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:28:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:28:05 user nova-compute[75100]: INFO os_vif [None req-614fb68b-1bbf-4801-beba-0285ce4b657d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:17:25,bridge_name='br-int',has_traffic_filtering=True,id=e98975d1-25ad-4973-9073-0ca95b177a2a,network=Network(0c411791-eb03-4e00-9d7f-d032e2c16d46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape98975d1-25')
Nov 10 18:28:05 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-614fb68b-1bbf-4801-beba-0285ce4b657d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Deleting instance files /opt/stack/data/nova/instances/719d5fd5-8185-454f-a3a7-dbef383e8953_del
Nov 10 18:28:05 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-614fb68b-1bbf-4801-beba-0285ce4b657d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Deletion of /opt/stack/data/nova/instances/719d5fd5-8185-454f-a3a7-dbef383e8953_del complete
Nov 10 18:28:05 user nova-compute[75100]: INFO nova.compute.manager [None req-614fb68b-1bbf-4801-beba-0285ce4b657d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Took 0.77 seconds to destroy the instance on the hypervisor.
Nov 10 18:28:05 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-614fb68b-1bbf-4801-beba-0285ce4b657d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 18:28:05 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 18:28:05 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 18:28:06 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:28:06 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Took 1.01 seconds to deallocate network for instance.
Nov 10 18:28:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-614fb68b-1bbf-4801-beba-0285ce4b657d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:28:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-614fb68b-1bbf-4801-beba-0285ce4b657d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:28:06 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-614fb68b-1bbf-4801-beba-0285ce4b657d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:28:06 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-614fb68b-1bbf-4801-beba-0285ce4b657d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:28:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-614fb68b-1bbf-4801-beba-0285ce4b657d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.147s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:28:06 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-614fb68b-1bbf-4801-beba-0285ce4b657d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Deleted allocations for instance 719d5fd5-8185-454f-a3a7-dbef383e8953
Nov 10 18:28:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-614fb68b-1bbf-4801-beba-0285ce4b657d tempest-AttachVolumeTestJSON-375321786 tempest-AttachVolumeTestJSON-375321786-project-member] Lock "719d5fd5-8185-454f-a3a7-dbef383e8953" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.122s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:28:07 user nova-compute[75100]: DEBUG nova.compute.manager [req-5128b07b-cb51-4bd4-8c80-7443cb4097a3 req-e2e26abe-1e71-4a25-b258-2f54ffff968c service nova] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Received event network-vif-plugged-e98975d1-25ad-4973-9073-0ca95b177a2a {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:28:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5128b07b-cb51-4bd4-8c80-7443cb4097a3 req-e2e26abe-1e71-4a25-b258-2f54ffff968c service nova] Acquiring lock "719d5fd5-8185-454f-a3a7-dbef383e8953-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:28:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5128b07b-cb51-4bd4-8c80-7443cb4097a3 req-e2e26abe-1e71-4a25-b258-2f54ffff968c service nova] Lock "719d5fd5-8185-454f-a3a7-dbef383e8953-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:28:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5128b07b-cb51-4bd4-8c80-7443cb4097a3 req-e2e26abe-1e71-4a25-b258-2f54ffff968c service nova] Lock "719d5fd5-8185-454f-a3a7-dbef383e8953-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:28:07 user nova-compute[75100]: DEBUG nova.compute.manager [req-5128b07b-cb51-4bd4-8c80-7443cb4097a3 req-e2e26abe-1e71-4a25-b258-2f54ffff968c service nova] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] No waiting events found dispatching network-vif-plugged-e98975d1-25ad-4973-9073-0ca95b177a2a {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:28:07 user nova-compute[75100]: WARNING nova.compute.manager [req-5128b07b-cb51-4bd4-8c80-7443cb4097a3 req-e2e26abe-1e71-4a25-b258-2f54ffff968c service nova] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Received unexpected event network-vif-plugged-e98975d1-25ad-4973-9073-0ca95b177a2a for instance with vm_state deleted and task_state None.
Nov 10 18:28:07 user nova-compute[75100]: DEBUG nova.compute.manager [req-5128b07b-cb51-4bd4-8c80-7443cb4097a3 req-e2e26abe-1e71-4a25-b258-2f54ffff968c service nova] [instance: 719d5fd5-8185-454f-a3a7-dbef383e8953] Received event network-vif-deleted-e98975d1-25ad-4973-9073-0ca95b177a2a {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:28:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:28:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:28:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:28:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:28:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:28:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:28:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:28:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:28:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d57ef334-8d65-4ef6-8f82-8637161e8474 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Acquiring lock "d02fea18-bb78-472e-8947-909f4b6b5fde" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:28:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d57ef334-8d65-4ef6-8f82-8637161e8474 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lock "d02fea18-bb78-472e-8947-909f4b6b5fde" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:28:24 user nova-compute[75100]: DEBUG nova.objects.instance [None req-d57ef334-8d65-4ef6-8f82-8637161e8474 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lazy-loading 'flavor' on Instance uuid d02fea18-bb78-472e-8947-909f4b6b5fde {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:28:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d57ef334-8d65-4ef6-8f82-8637161e8474 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lock "d02fea18-bb78-472e-8947-909f4b6b5fde" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:28:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d57ef334-8d65-4ef6-8f82-8637161e8474 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Acquiring lock "d02fea18-bb78-472e-8947-909f4b6b5fde" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:28:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d57ef334-8d65-4ef6-8f82-8637161e8474 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lock "d02fea18-bb78-472e-8947-909f4b6b5fde" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:28:24 user nova-compute[75100]: INFO nova.compute.manager [None req-d57ef334-8d65-4ef6-8f82-8637161e8474 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Attaching volume 247b4f58-9ab7-494e-a271-af9fe8832fc5 to /dev/vdb
Nov 10 18:28:24 user nova-compute[75100]: DEBUG os_brick.utils [None req-d57ef334-8d65-4ef6-8f82-8637161e8474 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:28:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:28:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:28:24 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce14c493-6617-4ab1-afdc-0a6cc0781262]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90b1a229568f\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:28:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:28:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:28:24 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30dd7a6-21e8-44e9-9b45-469a99d9aa62]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:28:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:28:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:28:24 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef094675-68e6-4544-b41b-ee003af44e4b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:28:24 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9134dd58-f40f-4a83-944d-21f871e8f2e7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:28:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-d57ef334-8d65-4ef6-8f82-8637161e8474 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:28:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-d57ef334-8d65-4ef6-8f82-8637161e8474 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 18:28:24 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d57ef334-8d65-4ef6-8f82-8637161e8474 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 18:28:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:28:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 18:28:24 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 18:28:24 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3174aa-3817-4ae8-8f5d-8bb3ff79c1b6]: (4, '') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:28:24 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-d57ef334-8d65-4ef6-8f82-8637161e8474 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 18:28:24 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-d57ef334-8d65-4ef6-8f82-8637161e8474 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 18:28:24 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-d57ef334-8d65-4ef6-8f82-8637161e8474 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 18:28:24 user nova-compute[75100]: DEBUG os_brick.utils [None req-d57ef334-8d65-4ef6-8f82-8637161e8474 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90b1a229568f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:28:24 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-d57ef334-8d65-4ef6-8f82-8637161e8474 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Updating existing volume attachment record: f2e2bc32-21ef-4737-8594-cfa5e66b102c {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 18:28:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:28:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:28:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:28:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:28:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:28:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:28:41 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:28:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:28:46 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:28:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d57ef334-8d65-4ef6-8f82-8637161e8474 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 18:28:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d57ef334-8d65-4ef6-8f82-8637161e8474 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:247b4f58-9ab7-494e-a271-af9fe8832fc5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UqzXFwMO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:28:46 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-d57ef334-8d65-4ef6-8f82-8637161e8474 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:28:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-d57ef334-8d65-4ef6-8f82-8637161e8474 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:28:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-d57ef334-8d65-4ef6-8f82-8637161e8474 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:28:46 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-d57ef334-8d65-4ef6-8f82-8637161e8474 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:28:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-d57ef334-8d65-4ef6-8f82-8637161e8474 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:247b4f58-9ab7-494e-a271-af9fe8832fc5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:28:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-d57ef334-8d65-4ef6-8f82-8637161e8474 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:247b4f58-9ab7-494e-a271-af9fe8832fc5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:28:46 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-d57ef334-8d65-4ef6-8f82-8637161e8474 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 18:28:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:247b4f58-9ab7-494e-a271-af9fe8832fc5 -p 172.16.0.220:3260 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:28:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:247b4f58-9ab7-494e-a271-af9fe8832fc5 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:28:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb04498-c603-43f7-ab1c-f5116693cce2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:28:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d57ef334-8d65-4ef6-8f82-8637161e8474 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 18:28:46 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:28:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:247b4f58-9ab7-494e-a271-af9fe8832fc5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:28:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:247b4f58-9ab7-494e-a271-af9fe8832fc5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:28:47 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3338dc48-e4ae-451d-a8ed-cbf23c9025d3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:247b4f58-9ab7-494e-a271-af9fe8832fc5] added\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:28:47 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d57ef334-8d65-4ef6-8f82-8637161e8474 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:247b4f58-9ab7-494e-a271-af9fe8832fc5] added
Nov 10 18:28:47 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:28:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:247b4f58-9ab7-494e-a271-af9fe8832fc5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:28:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:247b4f58-9ab7-494e-a271-af9fe8832fc5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:28:47 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa96c2d-bc4a-495d-9e79-9e9170a3a676]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:28:47 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d57ef334-8d65-4ef6-8f82-8637161e8474 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:28:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:247b4f58-9ab7-494e-a271-af9fe8832fc5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:28:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:247b4f58-9ab7-494e-a271-af9fe8832fc5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:28:47 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8c6228-577a-4ed5-8dd6-08d2802c284e]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:28:47 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d57ef334-8d65-4ef6-8f82-8637161e8474 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:28:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:247b4f58-9ab7-494e-a271-af9fe8832fc5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UqzXFwMO {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:28:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:247b4f58-9ab7-494e-a271-af9fe8832fc5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UqzXFwMO" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:28:47 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf1587c-50a1-42d6-a8b2-b11d29e827a7]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:28:47 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d57ef334-8d65-4ef6-8f82-8637161e8474 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UqzXFwMO'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:28:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:247b4f58-9ab7-494e-a271-af9fe8832fc5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:28:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:247b4f58-9ab7-494e-a271-af9fe8832fc5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:28:47 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ccd3c75-21ec-4779-8665-7f8b08ce4b31]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:28:47 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d57ef334-8d65-4ef6-8f82-8637161e8474 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:28:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:28:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:28:47 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[76217ece-65d8-4116-b772-349370edca5c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:28:47 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d57ef334-8d65-4ef6-8f82-8637161e8474 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 10 18:28:47 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:28:47 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d57ef334-8d65-4ef6-8f82-8637161e8474 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 10 18:28:47 user nova-compute[75100]:  {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:28:47 user nova-compute[75100]: WARNING os_brick.initiator.connectors.iscsi [None req-d57ef334-8d65-4ef6-8f82-8637161e8474 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 10 18:28:47 user nova-compute[75100]: 
Nov 10 18:28:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:247b4f58-9ab7-494e-a271-af9fe8832fc5 -p 172.16.0.220:3260 --login {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:28:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:247b4f58-9ab7-494e-a271-af9fe8832fc5 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:28:47 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[666dde81-37a5-4e20-80f5-5b0292564d32]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:247b4f58-9ab7-494e-a271-af9fe8832fc5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:247b4f58-9ab7-494e-a271-af9fe8832fc5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:28:47 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d57ef334-8d65-4ef6-8f82-8637161e8474 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:247b4f58-9ab7-494e-a271-af9fe8832fc5, portal: 172.16.0.220,3260]
Nov 10 18:28:47 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:247b4f58-9ab7-494e-a271-af9fe8832fc5, portal: 172.16.0.220,3260] successful.
Nov 10 18:28:47 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:28:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:247b4f58-9ab7-494e-a271-af9fe8832fc5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:28:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:247b4f58-9ab7-494e-a271-af9fe8832fc5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:28:47 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2c2bba-68f0-41f2-b6e0-85ffff961e91]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:28:47 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d57ef334-8d65-4ef6-8f82-8637161e8474 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:28:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:28:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:28:47 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0185af2a-7b04-4ce9-b524-ac8b89c1d61b]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:247b4f58-9ab7-494e-a271-af9fe8832fc5 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:28:47 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d57ef334-8d65-4ef6-8f82-8637161e8474 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:247b4f58-9ab7-494e-a271-af9fe8832fc5 (non-flash)
Nov 10 18:28:47 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:28:47 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d57ef334-8d65-4ef6-8f82-8637161e8474 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:247b4f58-9ab7-494e-a271-af9fe8832fc5 (non-flash)
Nov 10 18:28:47 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:28:47 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-d57ef334-8d65-4ef6-8f82-8637161e8474 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:247b4f58-9ab7-494e-a271-af9fe8832fc5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:28:47 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d57ef334-8d65-4ef6-8f82-8637161e8474 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 18:28:47 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-d57ef334-8d65-4ef6-8f82-8637161e8474 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 18:28:47 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-d57ef334-8d65-4ef6-8f82-8637161e8474 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 18:28:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:28:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:28:47 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33ef4e1-9fef-4e25-aa87-cf2bf6529c3c]: (4, ('- - 0', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:28:47 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-d57ef334-8d65-4ef6-8f82-8637161e8474 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 18:28:47 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d57ef334-8d65-4ef6-8f82-8637161e8474 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:247b4f58-9ab7-494e-a271-af9fe8832fc5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UqzXFwMO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 18:28:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-d57ef334-8d65-4ef6-8f82-8637161e8474 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:28:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d57ef334-8d65-4ef6-8f82-8637161e8474 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '26234613231383532', 'path': '/dev/sdb'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:28:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d57ef334-8d65-4ef6-8f82-8637161e8474 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234613231383532', 'path': '/dev/sdb'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 18:28:48 user nova-compute[75100]: DEBUG nova.objects.instance [None req-d57ef334-8d65-4ef6-8f82-8637161e8474 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lazy-loading 'flavor' on Instance uuid d02fea18-bb78-472e-8947-909f4b6b5fde {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:28:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-d57ef334-8d65-4ef6-8f82-8637161e8474 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 18:28:48 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:28:48 user nova-compute[75100]:   <source dev="/dev/sdb"/>
Nov 10 18:28:48 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 18:28:48 user nova-compute[75100]:   <serial>247b4f58-9ab7-494e-a271-af9fe8832fc5</serial>
Nov 10 18:28:48 user nova-compute[75100]: </disk>
Nov 10 18:28:48 user nova-compute[75100]:  {{(pid=75100) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 18:28:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d57ef334-8d65-4ef6-8f82-8637161e8474 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 18:28:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d57ef334-8d65-4ef6-8f82-8637161e8474 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 18:28:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d57ef334-8d65-4ef6-8f82-8637161e8474 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] No VIF found with MAC fa:16:3e:b3:cf:91, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 18:28:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d57ef334-8d65-4ef6-8f82-8637161e8474 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lock "d02fea18-bb78-472e-8947-909f4b6b5fde" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.464s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:28:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:28:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:28:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b3369aa5-5810-424c-8d58-e636c712e83a tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Acquiring lock "d02fea18-bb78-472e-8947-909f4b6b5fde" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:28:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b3369aa5-5810-424c-8d58-e636c712e83a tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lock "d02fea18-bb78-472e-8947-909f4b6b5fde" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:28:51 user nova-compute[75100]: INFO nova.compute.manager [None req-b3369aa5-5810-424c-8d58-e636c712e83a tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Detaching volume 247b4f58-9ab7-494e-a271-af9fe8832fc5
Nov 10 18:28:51 user nova-compute[75100]: INFO nova.virt.block_device [None req-b3369aa5-5810-424c-8d58-e636c712e83a tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Attempting to driver detach volume 247b4f58-9ab7-494e-a271-af9fe8832fc5 from mountpoint /dev/vdb
Nov 10 18:28:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-b3369aa5-5810-424c-8d58-e636c712e83a tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Attempting to detach device vdb from instance d02fea18-bb78-472e-8947-909f4b6b5fde from the persistent domain config. {{(pid=75100) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 18:28:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-b3369aa5-5810-424c-8d58-e636c712e83a tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 18:28:51 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:28:51 user nova-compute[75100]:   <source dev="/dev/sdb"/>
Nov 10 18:28:51 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 18:28:51 user nova-compute[75100]:   <serial>247b4f58-9ab7-494e-a271-af9fe8832fc5</serial>
Nov 10 18:28:51 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 18:28:51 user nova-compute[75100]: </disk>
Nov 10 18:28:51 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 18:28:51 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-b3369aa5-5810-424c-8d58-e636c712e83a tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Successfully detached device vdb from instance d02fea18-bb78-472e-8947-909f4b6b5fde from the persistent domain config.
Nov 10 18:28:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-b3369aa5-5810-424c-8d58-e636c712e83a tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d02fea18-bb78-472e-8947-909f4b6b5fde from the live domain config. {{(pid=75100) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 18:28:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-b3369aa5-5810-424c-8d58-e636c712e83a tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 18:28:51 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:28:51 user nova-compute[75100]:   <source dev="/dev/sdb"/>
Nov 10 18:28:51 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 18:28:51 user nova-compute[75100]:   <serial>247b4f58-9ab7-494e-a271-af9fe8832fc5</serial>
Nov 10 18:28:51 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 18:28:51 user nova-compute[75100]: </disk>
Nov 10 18:28:51 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 18:28:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-b3369aa5-5810-424c-8d58-e636c712e83a tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d02fea18-bb78-472e-8947-909f4b6b5fde {{(pid=75100) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 18:28:52 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:28:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:28:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:28:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:28:52 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 18:28:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d02fea18-bb78-472e-8947-909f4b6b5fde/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:28:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d02fea18-bb78-472e-8947-909f4b6b5fde/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:28:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d02fea18-bb78-472e-8947-909f4b6b5fde/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:28:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d02fea18-bb78-472e-8947-909f4b6b5fde/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:28:53 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:28:53 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:28:53 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Hypervisor/Node resource view: name=user free_ram=8928MB free_disk=24.40347671508789GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 18:28:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:28:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:28:53 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance d02fea18-bb78-472e-8947-909f4b6b5fde actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:28:53 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 18:28:53 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 18:28:53 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:28:53 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:28:53 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 18:28:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.200s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:28:54 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:28:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:28:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:28:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:28:55 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:28:56 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:28:58 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:28:58 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 18:28:58 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Rebuilding the list of instances to heal {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 18:28:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "refresh_cache-d02fea18-bb78-472e-8947-909f4b6b5fde" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:28:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquired lock "refresh_cache-d02fea18-bb78-472e-8947-909f4b6b5fde" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:28:58 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 18:28:58 user nova-compute[75100]: DEBUG nova.objects.instance [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lazy-loading 'info_cache' on Instance uuid d02fea18-bb78-472e-8947-909f4b6b5fde {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:28:58 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Updating instance_info_cache with network_info: [{"id": "f7d27dda-1b70-4f3f-b866-c2705b01e396", "address": "fa:16:3e:b3:cf:91", "network": {"id": "9b61fda2-5437-4085-889d-35a4edda72bc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1424647024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38869dd0674640b1b72258b53dc8f5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7d27dda-1b", "ovs_interfaceid": "f7d27dda-1b70-4f3f-b866-c2705b01e396", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:28:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Releasing lock "refresh_cache-d02fea18-bb78-472e-8947-909f4b6b5fde" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:28:58 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 18:28:58 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:29:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:29:01 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:29:02 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:29:02 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 18:29:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:29:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:29:11 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-b3369aa5-5810-424c-8d58-e636c712e83a tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d02fea18-bb78-472e-8947-909f4b6b5fde is timed out.
Nov 10 18:29:11 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-b3369aa5-5810-424c-8d58-e636c712e83a tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Successfully detached device vdb from instance d02fea18-bb78-472e-8947-909f4b6b5fde from the live domain config.
Nov 10 18:29:11 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3369aa5-5810-424c-8d58-e636c712e83a tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 18:29:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3369aa5-5810-424c-8d58-e636c712e83a tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, {'target_iqn': 'iqn.2010-10.org.openstack:247b4f58-9ab7-494e-a271-af9fe8832fc5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UqzXFwMO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:29:11 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-b3369aa5-5810-424c-8d58-e636c712e83a tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:29:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-b3369aa5-5810-424c-8d58-e636c712e83a tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:29:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-b3369aa5-5810-424c-8d58-e636c712e83a tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:29:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:29:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:29:11 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[917df6da-3b95-401e-bea9-c000409256ec]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:247b4f58-9ab7-494e-a271-af9fe8832fc5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:29:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3369aa5-5810-424c-8d58-e636c712e83a tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 18:29:11 user nova-compute[75100]: No targets found.
Nov 10 18:29:11 user nova-compute[75100]: iSNS:
Nov 10 18:29:11 user nova-compute[75100]: No targets found.
Nov 10 18:29:11 user nova-compute[75100]: STATIC:
Nov 10 18:29:11 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:247b4f58-9ab7-494e-a271-af9fe8832fc5
Nov 10 18:29:11 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:29:11 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:29:11 user nova-compute[75100]: FIRMWARE:
Nov 10 18:29:11 user nova-compute[75100]: No targets found.
Nov 10 18:29:11 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:29:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3369aa5-5810-424c-8d58-e636c712e83a tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 18:29:11 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 18:29:11 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 18:29:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3369aa5-5810-424c-8d58-e636c712e83a tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:247b4f58-9ab7-494e-a271-af9fe8832fc5', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 18:29:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:29:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:29:12 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5498e0-c515-4d57-9965-154eb83858a0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:247b4f58-9ab7-494e-a271-af9fe8832fc5\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:29:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:29:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:29:12 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9433d38d-933d-498d-a7d0-19f7ddf2636d]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:247b4f58-9ab7-494e-a271-af9fe8832fc5 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:29:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3369aa5-5810-424c-8d58-e636c712e83a tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:247b4f58-9ab7-494e-a271-af9fe8832fc5 (non-flash)
Nov 10 18:29:12 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:29:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3369aa5-5810-424c-8d58-e636c712e83a tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:247b4f58-9ab7-494e-a271-af9fe8832fc5 (non-flash)
Nov 10 18:29:12 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:29:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3369aa5-5810-424c-8d58-e636c712e83a tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3986d0af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:247b4f58-9ab7-494e-a271-af9fe8832fc5'): ({'sdb'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 18:29:12 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-b3369aa5-5810-424c-8d58-e636c712e83a tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Removing single pathed devices sdb {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 18:29:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:29:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:29:12 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[40826c4e-3dbb-4023-87a2-f1037149375d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:29:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:29:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:29:12 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e14e44-0d53-4101-8202-683502709b30]: (4, ('ok\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:29:12 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-b3369aa5-5810-424c-8d58-e636c712e83a tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Flushing IO for device /dev/sdb {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 18:29:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:29:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:29:12 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5cdd3b8-de9a-4305-b478-4e9d5e9a0b0f]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:29:12 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-b3369aa5-5810-424c-8d58-e636c712e83a tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 18:29:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:29:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:29:12 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d571ec9-94bc-4a45-98b2-6e08f45fa10b]: (4, ('1', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:29:12 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-b3369aa5-5810-424c-8d58-e636c712e83a tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 18:29:12 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-b3369aa5-5810-424c-8d58-e636c712e83a tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 18:29:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3369aa5-5810-424c-8d58-e636c712e83a tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:247b4f58-9ab7-494e-a271-af9fe8832fc5')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 18:29:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:247b4f58-9ab7-494e-a271-af9fe8832fc5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:29:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:247b4f58-9ab7-494e-a271-af9fe8832fc5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:29:12 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac78a285-b78a-4de6-8afe-6931e2db8135]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:29:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3369aa5-5810-424c-8d58-e636c712e83a tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:29:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:247b4f58-9ab7-494e-a271-af9fe8832fc5 -p 172.16.0.220:3260 --logout {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:29:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:247b4f58-9ab7-494e-a271-af9fe8832fc5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:29:12 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf875f2-a3c5-439e-806b-104d4300d0a1]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:247b4f58-9ab7-494e-a271-af9fe8832fc5, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:247b4f58-9ab7-494e-a271-af9fe8832fc5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:29:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3369aa5-5810-424c-8d58-e636c712e83a tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:247b4f58-9ab7-494e-a271-af9fe8832fc5, portal: 172.16.0.220,3260]
Nov 10 18:29:12 user nova-compute[75100]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:247b4f58-9ab7-494e-a271-af9fe8832fc5, portal: 172.16.0.220,3260] successful.
Nov 10 18:29:12 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:29:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:247b4f58-9ab7-494e-a271-af9fe8832fc5 -p 172.16.0.220:3260 --op delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:29:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:247b4f58-9ab7-494e-a271-af9fe8832fc5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:29:12 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cfd3511-cd90-47f9-b248-59c26f187d5a]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:29:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3369aa5-5810-424c-8d58-e636c712e83a tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:29:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-b3369aa5-5810-424c-8d58-e636c712e83a tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:29:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3369aa5-5810-424c-8d58-e636c712e83a tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] <== disconnect_volume: return (315ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:29:12 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3369aa5-5810-424c-8d58-e636c712e83a tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 18:29:13 user nova-compute[75100]: DEBUG nova.objects.instance [None req-b3369aa5-5810-424c-8d58-e636c712e83a tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lazy-loading 'flavor' on Instance uuid d02fea18-bb78-472e-8947-909f4b6b5fde {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:29:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b3369aa5-5810-424c-8d58-e636c712e83a tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lock "d02fea18-bb78-472e-8947-909f4b6b5fde" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.952s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:29:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:29:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:29:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:29:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:29:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:29:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:29:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:29:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:29:42 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:29:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:29:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:29:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:29:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:29:48 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:29:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:29:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:29:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:29:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:29:52 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:29:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:29:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:29:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:29:52 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 18:29:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d02fea18-bb78-472e-8947-909f4b6b5fde/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:29:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d02fea18-bb78-472e-8947-909f4b6b5fde/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:29:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d02fea18-bb78-472e-8947-909f4b6b5fde/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:29:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d02fea18-bb78-472e-8947-909f4b6b5fde/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:29:53 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:29:53 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:29:53 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Hypervisor/Node resource view: name=user free_ram=8940MB free_disk=24.400737762451172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 18:29:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:29:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:29:53 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance d02fea18-bb78-472e-8947-909f4b6b5fde actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:29:53 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 18:29:53 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 18:29:53 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:29:53 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:29:53 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 18:29:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.196s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:29:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Acquiring lock "228d6943-f74a-40ed-b272-aa31c50ee879" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:29:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Lock "228d6943-f74a-40ed-b272-aa31c50ee879" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:29:54 user nova-compute[75100]: DEBUG nova.compute.manager [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 18:29:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:29:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:29:54 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 18:29:54 user nova-compute[75100]: INFO nova.compute.claims [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Claim successful on node user
Nov 10 18:29:55 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:29:55 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:29:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.236s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:29:55 user nova-compute[75100]: DEBUG nova.compute.manager [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 18:29:55 user nova-compute[75100]: DEBUG nova.compute.manager [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 18:29:55 user nova-compute[75100]: DEBUG nova.network.neutron [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 18:29:55 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 18:29:55 user nova-compute[75100]: DEBUG nova.compute.manager [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 18:29:55 user nova-compute[75100]: DEBUG nova.policy [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5c872b1827cd452aa3b47a80f448d317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab3787fb375442288ea080aa156a326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 18:29:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:29:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:29:55 user nova-compute[75100]: DEBUG nova.compute.manager [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 18:29:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 18:29:55 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Creating image(s)
Nov 10 18:29:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Acquiring lock "/opt/stack/data/nova/instances/228d6943-f74a-40ed-b272-aa31c50ee879/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:29:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Lock "/opt/stack/data/nova/instances/228d6943-f74a-40ed-b272-aa31c50ee879/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:29:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Lock "/opt/stack/data/nova/instances/228d6943-f74a-40ed-b272-aa31c50ee879/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:29:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:29:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.194s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:29:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Acquiring lock "818b9e28e061d41a38d903968b229be2ed9ba520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:29:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:29:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:29:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.183s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:29:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/228d6943-f74a-40ed-b272-aa31c50ee879/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:29:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/228d6943-f74a-40ed-b272-aa31c50ee879/disk 1073741824" returned: 0 in 0.048s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:29:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Lock "818b9e28e061d41a38d903968b229be2ed9ba520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:29:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:29:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.178s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:29:55 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Checking if we can resize image /opt/stack/data/nova/instances/228d6943-f74a-40ed-b272-aa31c50ee879/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 18:29:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228d6943-f74a-40ed-b272-aa31c50ee879/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:29:56 user nova-compute[75100]: DEBUG nova.network.neutron [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Successfully created port: 963a800b-186d-457e-b83e-410214f7f92d {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 18:29:56 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228d6943-f74a-40ed-b272-aa31c50ee879/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:29:56 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Cannot resize image /opt/stack/data/nova/instances/228d6943-f74a-40ed-b272-aa31c50ee879/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 18:29:56 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 18:29:56 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Ensure instance console log exists: /opt/stack/data/nova/instances/228d6943-f74a-40ed-b272-aa31c50ee879/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 18:29:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:29:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:29:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:29:56 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:29:56 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:29:56 user nova-compute[75100]: DEBUG nova.network.neutron [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Successfully updated port: 963a800b-186d-457e-b83e-410214f7f92d {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 18:29:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Acquiring lock "refresh_cache-228d6943-f74a-40ed-b272-aa31c50ee879" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:29:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Acquired lock "refresh_cache-228d6943-f74a-40ed-b272-aa31c50ee879" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:29:56 user nova-compute[75100]: DEBUG nova.network.neutron [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 18:29:56 user nova-compute[75100]: DEBUG nova.compute.manager [req-fb97c7a3-de20-4f74-9028-efdb4b037134 req-662cc410-4539-484e-9da3-46e5765762ba service nova] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Received event network-changed-963a800b-186d-457e-b83e-410214f7f92d {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:29:56 user nova-compute[75100]: DEBUG nova.compute.manager [req-fb97c7a3-de20-4f74-9028-efdb4b037134 req-662cc410-4539-484e-9da3-46e5765762ba service nova] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Refreshing instance network info cache due to event network-changed-963a800b-186d-457e-b83e-410214f7f92d. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 18:29:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-fb97c7a3-de20-4f74-9028-efdb4b037134 req-662cc410-4539-484e-9da3-46e5765762ba service nova] Acquiring lock "refresh_cache-228d6943-f74a-40ed-b272-aa31c50ee879" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:29:56 user nova-compute[75100]: DEBUG nova.network.neutron [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 18:29:57 user nova-compute[75100]: DEBUG nova.network.neutron [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Updating instance_info_cache with network_info: [{"id": "963a800b-186d-457e-b83e-410214f7f92d", "address": "fa:16:3e:80:31:f9", "network": {"id": "5cc7dc03-a2c6-488f-aefd-2160f3a9f300", "bridge": "br-int", "label": "tempest-TestStampPattern-1448697637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aab3787fb375442288ea080aa156a326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap963a800b-18", "ovs_interfaceid": "963a800b-186d-457e-b83e-410214f7f92d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:29:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Releasing lock "refresh_cache-228d6943-f74a-40ed-b272-aa31c50ee879" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:29:57 user nova-compute[75100]: DEBUG nova.compute.manager [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Instance network_info: |[{"id": "963a800b-186d-457e-b83e-410214f7f92d", "address": "fa:16:3e:80:31:f9", "network": {"id": "5cc7dc03-a2c6-488f-aefd-2160f3a9f300", "bridge": "br-int", "label": "tempest-TestStampPattern-1448697637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aab3787fb375442288ea080aa156a326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap963a800b-18", "ovs_interfaceid": "963a800b-186d-457e-b83e-410214f7f92d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 18:29:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-fb97c7a3-de20-4f74-9028-efdb4b037134 req-662cc410-4539-484e-9da3-46e5765762ba service nova] Acquired lock "refresh_cache-228d6943-f74a-40ed-b272-aa31c50ee879" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:29:57 user nova-compute[75100]: DEBUG nova.network.neutron [req-fb97c7a3-de20-4f74-9028-efdb4b037134 req-662cc410-4539-484e-9da3-46e5765762ba service nova] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Refreshing network info cache for port 963a800b-186d-457e-b83e-410214f7f92d {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 18:29:57 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Start _get_guest_xml network_info=[{"id": "963a800b-186d-457e-b83e-410214f7f92d", "address": "fa:16:3e:80:31:f9", "network": {"id": "5cc7dc03-a2c6-488f-aefd-2160f3a9f300", "bridge": "br-int", "label": "tempest-TestStampPattern-1448697637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aab3787fb375442288ea080aa156a326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap963a800b-18", "ovs_interfaceid": "963a800b-186d-457e-b83e-410214f7f92d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'e3cc5321-4d40-49ee-885c-700e14741732'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 18:29:57 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:29:57 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:29:57 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 18:29:57 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 18:29:57 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 18:29:57 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 18:29:57 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 18:29:57 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T17:40:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T17:40:36Z,direct_url=<?>,disk_format='qcow2',id=e3cc5321-4d40-49ee-885c-700e14741732,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cabf2ee94c5f40fa840ed5664129268a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T17:40:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 18:29:57 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 18:29:57 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 18:29:57 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 18:29:57 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 18:29:57 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 18:29:57 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 18:29:57 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 18:29:57 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 18:29:57 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 18:29:57 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 18:29:57 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:29:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-79239815',display_name='tempest-TestStampPattern-server-79239815',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-79239815',id=51,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLg1o8VEM12ucIF0jbu9iRsAi+yimtLWbBqy1yWv1lvMVGrEdaR9OpNE3a9kQ5XxDFdFpuI1a1qU/MhZ+OEp8MDnm6aGBwbckIWyJWH9mMzvKTXeZHDzkokpLOBFuU09oA==',key_name='tempest-TestStampPattern-794323654',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aab3787fb375442288ea080aa156a326',ramdisk_id='',reservation_id='r-eeuroz7r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1090834960',owner_user_name='tempest-TestStampPattern-1090834960-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T18:29:55Z,user_data=None,user_id='5c872b1827cd452aa3b47a80f448d317',uuid=228d6943-f74a-40ed-b272-aa31c50ee879,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "963a800b-186d-457e-b83e-410214f7f92d", "address": "fa:16:3e:80:31:f9", "network": {"id": "5cc7dc03-a2c6-488f-aefd-2160f3a9f300", "bridge": "br-int", "label": "tempest-TestStampPattern-1448697637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aab3787fb375442288ea080aa156a326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap963a800b-18", "ovs_interfaceid": "963a800b-186d-457e-b83e-410214f7f92d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 18:29:57 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Converting VIF {"id": "963a800b-186d-457e-b83e-410214f7f92d", "address": "fa:16:3e:80:31:f9", "network": {"id": "5cc7dc03-a2c6-488f-aefd-2160f3a9f300", "bridge": "br-int", "label": "tempest-TestStampPattern-1448697637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aab3787fb375442288ea080aa156a326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap963a800b-18", "ovs_interfaceid": "963a800b-186d-457e-b83e-410214f7f92d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:29:57 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:31:f9,bridge_name='br-int',has_traffic_filtering=True,id=963a800b-186d-457e-b83e-410214f7f92d,network=Network(5cc7dc03-a2c6-488f-aefd-2160f3a9f300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap963a800b-18') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:29:57 user nova-compute[75100]: DEBUG nova.objects.instance [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Lazy-loading 'pci_devices' on Instance uuid 228d6943-f74a-40ed-b272-aa31c50ee879 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:29:57 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] End _get_guest_xml xml=<domain type="kvm">
Nov 10 18:29:57 user nova-compute[75100]:   <uuid>228d6943-f74a-40ed-b272-aa31c50ee879</uuid>
Nov 10 18:29:57 user nova-compute[75100]:   <name>instance-00000033</name>
Nov 10 18:29:57 user nova-compute[75100]:   <memory>524288</memory>
Nov 10 18:29:57 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 10 18:29:57 user nova-compute[75100]:   <metadata>
Nov 10 18:29:57 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 18:29:57 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 10 18:29:57 user nova-compute[75100]:       <nova:name>tempest-TestStampPattern-server-79239815</nova:name>
Nov 10 18:29:57 user nova-compute[75100]:       <nova:creationTime>2023-11-10 18:29:57</nova:creationTime>
Nov 10 18:29:57 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 10 18:29:57 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 10 18:29:57 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 10 18:29:57 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 10 18:29:57 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 18:29:57 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 10 18:29:57 user nova-compute[75100]:       </nova:flavor>
Nov 10 18:29:57 user nova-compute[75100]:       <nova:owner>
Nov 10 18:29:57 user nova-compute[75100]:         <nova:user uuid="5c872b1827cd452aa3b47a80f448d317">tempest-TestStampPattern-1090834960-project-member</nova:user>
Nov 10 18:29:57 user nova-compute[75100]:         <nova:project uuid="aab3787fb375442288ea080aa156a326">tempest-TestStampPattern-1090834960</nova:project>
Nov 10 18:29:57 user nova-compute[75100]:       </nova:owner>
Nov 10 18:29:57 user nova-compute[75100]:       <nova:root type="image" uuid="e3cc5321-4d40-49ee-885c-700e14741732"/>
Nov 10 18:29:57 user nova-compute[75100]:       <nova:ports>
Nov 10 18:29:57 user nova-compute[75100]:         <nova:port uuid="963a800b-186d-457e-b83e-410214f7f92d">
Nov 10 18:29:57 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 10 18:29:57 user nova-compute[75100]:         </nova:port>
Nov 10 18:29:57 user nova-compute[75100]:       </nova:ports>
Nov 10 18:29:57 user nova-compute[75100]:     </nova:instance>
Nov 10 18:29:57 user nova-compute[75100]:   </metadata>
Nov 10 18:29:57 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 10 18:29:57 user nova-compute[75100]:     <system>
Nov 10 18:29:57 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 18:29:57 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 10 18:29:57 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 10 18:29:57 user nova-compute[75100]:       <entry name="serial">228d6943-f74a-40ed-b272-aa31c50ee879</entry>
Nov 10 18:29:57 user nova-compute[75100]:       <entry name="uuid">228d6943-f74a-40ed-b272-aa31c50ee879</entry>
Nov 10 18:29:57 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 10 18:29:57 user nova-compute[75100]:     </system>
Nov 10 18:29:57 user nova-compute[75100]:   </sysinfo>
Nov 10 18:29:57 user nova-compute[75100]:   <os>
Nov 10 18:29:57 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 18:29:57 user nova-compute[75100]:     <boot dev="hd"/>
Nov 10 18:29:57 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 10 18:29:57 user nova-compute[75100]:   </os>
Nov 10 18:29:57 user nova-compute[75100]:   <features>
Nov 10 18:29:57 user nova-compute[75100]:     <acpi/>
Nov 10 18:29:57 user nova-compute[75100]:     <apic/>
Nov 10 18:29:57 user nova-compute[75100]:     <vmcoreinfo/>
Nov 10 18:29:57 user nova-compute[75100]:   </features>
Nov 10 18:29:57 user nova-compute[75100]:   <clock offset="utc">
Nov 10 18:29:57 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 18:29:57 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 18:29:57 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 10 18:29:57 user nova-compute[75100]:   </clock>
Nov 10 18:29:57 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 10 18:29:57 user nova-compute[75100]:     <model>Nehalem</model>
Nov 10 18:29:57 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 18:29:57 user nova-compute[75100]:   </cpu>
Nov 10 18:29:57 user nova-compute[75100]:   <devices>
Nov 10 18:29:57 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 10 18:29:57 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 18:29:57 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/228d6943-f74a-40ed-b272-aa31c50ee879/disk"/>
Nov 10 18:29:57 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 10 18:29:57 user nova-compute[75100]:     </disk>
Nov 10 18:29:57 user nova-compute[75100]:     <interface type="ethernet">
Nov 10 18:29:57 user nova-compute[75100]:       <mac address="fa:16:3e:80:31:f9"/>
Nov 10 18:29:57 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 18:29:57 user nova-compute[75100]:       <mtu size="1442"/>
Nov 10 18:29:57 user nova-compute[75100]:       <target dev="tap963a800b-18"/>
Nov 10 18:29:57 user nova-compute[75100]:     </interface>
Nov 10 18:29:57 user nova-compute[75100]:     <serial type="pty">
Nov 10 18:29:57 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/228d6943-f74a-40ed-b272-aa31c50ee879/console.log" append="off"/>
Nov 10 18:29:57 user nova-compute[75100]:     </serial>
Nov 10 18:29:57 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 18:29:57 user nova-compute[75100]:     <video>
Nov 10 18:29:57 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 18:29:57 user nova-compute[75100]:     </video>
Nov 10 18:29:57 user nova-compute[75100]:     <rng model="virtio">
Nov 10 18:29:57 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 10 18:29:57 user nova-compute[75100]:     </rng>
Nov 10 18:29:57 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 10 18:29:57 user nova-compute[75100]:     <memballoon model="virtio">
Nov 10 18:29:57 user nova-compute[75100]:       <stats period="10"/>
Nov 10 18:29:57 user nova-compute[75100]:     </memballoon>
Nov 10 18:29:57 user nova-compute[75100]:   </devices>
Nov 10 18:29:57 user nova-compute[75100]: </domain>
Nov 10 18:29:57 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 18:29:57 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:29:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-79239815',display_name='tempest-TestStampPattern-server-79239815',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-79239815',id=51,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLg1o8VEM12ucIF0jbu9iRsAi+yimtLWbBqy1yWv1lvMVGrEdaR9OpNE3a9kQ5XxDFdFpuI1a1qU/MhZ+OEp8MDnm6aGBwbckIWyJWH9mMzvKTXeZHDzkokpLOBFuU09oA==',key_name='tempest-TestStampPattern-794323654',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aab3787fb375442288ea080aa156a326',ramdisk_id='',reservation_id='r-eeuroz7r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1090834960',owner_user_name='tempest-TestStampPattern-1090834960-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T18:29:55Z,user_data=None,user_id='5c872b1827cd452aa3b47a80f448d317',uuid=228d6943-f74a-40ed-b272-aa31c50ee879,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "963a800b-186d-457e-b83e-410214f7f92d", "address": "fa:16:3e:80:31:f9", "network": {"id": "5cc7dc03-a2c6-488f-aefd-2160f3a9f300", "bridge": "br-int", "label": "tempest-TestStampPattern-1448697637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aab3787fb375442288ea080aa156a326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap963a800b-18", "ovs_interfaceid": "963a800b-186d-457e-b83e-410214f7f92d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 18:29:57 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Converting VIF {"id": "963a800b-186d-457e-b83e-410214f7f92d", "address": "fa:16:3e:80:31:f9", "network": {"id": "5cc7dc03-a2c6-488f-aefd-2160f3a9f300", "bridge": "br-int", "label": "tempest-TestStampPattern-1448697637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aab3787fb375442288ea080aa156a326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap963a800b-18", "ovs_interfaceid": "963a800b-186d-457e-b83e-410214f7f92d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:29:57 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:31:f9,bridge_name='br-int',has_traffic_filtering=True,id=963a800b-186d-457e-b83e-410214f7f92d,network=Network(5cc7dc03-a2c6-488f-aefd-2160f3a9f300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap963a800b-18') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:29:57 user nova-compute[75100]: DEBUG os_vif [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:31:f9,bridge_name='br-int',has_traffic_filtering=True,id=963a800b-186d-457e-b83e-410214f7f92d,network=Network(5cc7dc03-a2c6-488f-aefd-2160f3a9f300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap963a800b-18') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 18:29:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:29:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:29:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 18:29:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:29:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3931319b-1fc5-5173-9c48-7b63893a6ea8', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:29:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:29:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:29:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:29:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap963a800b-18, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:29:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap963a800b-18, col_values=(('qos', UUID('b9a296e6-a55c-4853-ac84-18b04688110e')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:29:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap963a800b-18, col_values=(('external_ids', {'iface-id': '963a800b-186d-457e-b83e-410214f7f92d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:31:f9', 'vm-uuid': '228d6943-f74a-40ed-b272-aa31c50ee879'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:29:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:29:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:29:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:29:57 user nova-compute[75100]: INFO os_vif [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:31:f9,bridge_name='br-int',has_traffic_filtering=True,id=963a800b-186d-457e-b83e-410214f7f92d,network=Network(5cc7dc03-a2c6-488f-aefd-2160f3a9f300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap963a800b-18')
Nov 10 18:29:57 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 18:29:57 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] No VIF found with MAC fa:16:3e:80:31:f9, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 18:29:57 user nova-compute[75100]: DEBUG nova.network.neutron [req-fb97c7a3-de20-4f74-9028-efdb4b037134 req-662cc410-4539-484e-9da3-46e5765762ba service nova] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Updated VIF entry in instance network info cache for port 963a800b-186d-457e-b83e-410214f7f92d. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 18:29:57 user nova-compute[75100]: DEBUG nova.network.neutron [req-fb97c7a3-de20-4f74-9028-efdb4b037134 req-662cc410-4539-484e-9da3-46e5765762ba service nova] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Updating instance_info_cache with network_info: [{"id": "963a800b-186d-457e-b83e-410214f7f92d", "address": "fa:16:3e:80:31:f9", "network": {"id": "5cc7dc03-a2c6-488f-aefd-2160f3a9f300", "bridge": "br-int", "label": "tempest-TestStampPattern-1448697637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aab3787fb375442288ea080aa156a326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap963a800b-18", "ovs_interfaceid": "963a800b-186d-457e-b83e-410214f7f92d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:29:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-fb97c7a3-de20-4f74-9028-efdb4b037134 req-662cc410-4539-484e-9da3-46e5765762ba service nova] Releasing lock "refresh_cache-228d6943-f74a-40ed-b272-aa31c50ee879" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:29:58 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:29:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:29:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:29:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:29:58 user nova-compute[75100]: DEBUG nova.compute.manager [req-b69cd016-819c-4ce1-83de-fb8f472fbc22 req-ba1132bf-b072-4300-8872-86f5797ef227 service nova] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Received event network-vif-plugged-963a800b-186d-457e-b83e-410214f7f92d {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:29:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b69cd016-819c-4ce1-83de-fb8f472fbc22 req-ba1132bf-b072-4300-8872-86f5797ef227 service nova] Acquiring lock "228d6943-f74a-40ed-b272-aa31c50ee879-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:29:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b69cd016-819c-4ce1-83de-fb8f472fbc22 req-ba1132bf-b072-4300-8872-86f5797ef227 service nova] Lock "228d6943-f74a-40ed-b272-aa31c50ee879-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:29:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b69cd016-819c-4ce1-83de-fb8f472fbc22 req-ba1132bf-b072-4300-8872-86f5797ef227 service nova] Lock "228d6943-f74a-40ed-b272-aa31c50ee879-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:29:58 user nova-compute[75100]: DEBUG nova.compute.manager [req-b69cd016-819c-4ce1-83de-fb8f472fbc22 req-ba1132bf-b072-4300-8872-86f5797ef227 service nova] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] No waiting events found dispatching network-vif-plugged-963a800b-186d-457e-b83e-410214f7f92d {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:29:58 user nova-compute[75100]: WARNING nova.compute.manager [req-b69cd016-819c-4ce1-83de-fb8f472fbc22 req-ba1132bf-b072-4300-8872-86f5797ef227 service nova] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Received unexpected event network-vif-plugged-963a800b-186d-457e-b83e-410214f7f92d for instance with vm_state building and task_state spawning.
Nov 10 18:29:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:29:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:29:59 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:29:59 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 18:29:59 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Rebuilding the list of instances to heal {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 18:29:59 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Skipping network cache update for instance because it is Building. {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 10 18:29:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "refresh_cache-d02fea18-bb78-472e-8947-909f4b6b5fde" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:29:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquired lock "refresh_cache-d02fea18-bb78-472e-8947-909f4b6b5fde" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:29:59 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 18:29:59 user nova-compute[75100]: DEBUG nova.objects.instance [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lazy-loading 'info_cache' on Instance uuid d02fea18-bb78-472e-8947-909f4b6b5fde {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:29:59 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Updating instance_info_cache with network_info: [{"id": "f7d27dda-1b70-4f3f-b866-c2705b01e396", "address": "fa:16:3e:b3:cf:91", "network": {"id": "9b61fda2-5437-4085-889d-35a4edda72bc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1424647024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38869dd0674640b1b72258b53dc8f5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7d27dda-1b", "ovs_interfaceid": "f7d27dda-1b70-4f3f-b866-c2705b01e396", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:29:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Releasing lock "refresh_cache-d02fea18-bb78-472e-8947-909f4b6b5fde" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:29:59 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 18:29:59 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:30:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:30:00 user nova-compute[75100]: DEBUG nova.compute.manager [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 18:30:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 18:30:00 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Instance spawned successfully.
Nov 10 18:30:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 18:30:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:30:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:30:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:30:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:30:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:30:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:30:00 user nova-compute[75100]: INFO nova.compute.manager [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Took 5.55 seconds to spawn the instance on the hypervisor.
Nov 10 18:30:00 user nova-compute[75100]: DEBUG nova.compute.manager [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 18:30:00 user nova-compute[75100]: DEBUG nova.compute.manager [req-21ebfbfc-6c26-4f8a-a8be-f62aaaa49f24 req-617d6612-eb45-49fa-b466-2986edb7d37b service nova] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Received event network-vif-plugged-963a800b-186d-457e-b83e-410214f7f92d {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:30:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-21ebfbfc-6c26-4f8a-a8be-f62aaaa49f24 req-617d6612-eb45-49fa-b466-2986edb7d37b service nova] Acquiring lock "228d6943-f74a-40ed-b272-aa31c50ee879-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:30:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-21ebfbfc-6c26-4f8a-a8be-f62aaaa49f24 req-617d6612-eb45-49fa-b466-2986edb7d37b service nova] Lock "228d6943-f74a-40ed-b272-aa31c50ee879-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:30:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-21ebfbfc-6c26-4f8a-a8be-f62aaaa49f24 req-617d6612-eb45-49fa-b466-2986edb7d37b service nova] Lock "228d6943-f74a-40ed-b272-aa31c50ee879-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:30:00 user nova-compute[75100]: DEBUG nova.compute.manager [req-21ebfbfc-6c26-4f8a-a8be-f62aaaa49f24 req-617d6612-eb45-49fa-b466-2986edb7d37b service nova] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] No waiting events found dispatching network-vif-plugged-963a800b-186d-457e-b83e-410214f7f92d {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:30:00 user nova-compute[75100]: WARNING nova.compute.manager [req-21ebfbfc-6c26-4f8a-a8be-f62aaaa49f24 req-617d6612-eb45-49fa-b466-2986edb7d37b service nova] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Received unexpected event network-vif-plugged-963a800b-186d-457e-b83e-410214f7f92d for instance with vm_state building and task_state spawning.
Nov 10 18:30:01 user nova-compute[75100]: INFO nova.compute.manager [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Took 6.22 seconds to build instance.
Nov 10 18:30:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-46ec3f19-7cce-4079-b831-51f8271f2c8f tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Lock "228d6943-f74a-40ed-b272-aa31c50ee879" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.327s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:30:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:30:03 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:30:03 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 18:30:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:30:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:30:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:30:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:30:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:30:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:30:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:30:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:30:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:30:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:30:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:30:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:30:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:30:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:30:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:30:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:30:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:30:42 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:30:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:30:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:30:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:30:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:30:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:30:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:30:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:30:48 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:30:48 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75100) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 18:30:49 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:30:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:30:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:30:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:30:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:30:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:30:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:30:53 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:30:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:30:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:30:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:30:53 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 18:30:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d02fea18-bb78-472e-8947-909f4b6b5fde/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:30:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d02fea18-bb78-472e-8947-909f4b6b5fde/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:30:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d02fea18-bb78-472e-8947-909f4b6b5fde/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:30:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d02fea18-bb78-472e-8947-909f4b6b5fde/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:30:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228d6943-f74a-40ed-b272-aa31c50ee879/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:30:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228d6943-f74a-40ed-b272-aa31c50ee879/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:30:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228d6943-f74a-40ed-b272-aa31c50ee879/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:30:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228d6943-f74a-40ed-b272-aa31c50ee879/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:30:54 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:30:54 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:30:54 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Hypervisor/Node resource view: name=user free_ram=8838MB free_disk=24.370750427246094GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 18:30:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:30:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:30:54 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance d02fea18-bb78-472e-8947-909f4b6b5fde actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:30:54 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 228d6943-f74a-40ed-b272-aa31c50ee879 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:30:54 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 18:30:54 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 18:30:54 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:30:54 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:30:54 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 18:30:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.343s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:30:56 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:30:57 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:30:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:30:58 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:30:59 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:30:59 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 18:30:59 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Rebuilding the list of instances to heal {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 18:30:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "refresh_cache-d02fea18-bb78-472e-8947-909f4b6b5fde" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:30:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquired lock "refresh_cache-d02fea18-bb78-472e-8947-909f4b6b5fde" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:30:59 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 18:30:59 user nova-compute[75100]: DEBUG nova.objects.instance [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lazy-loading 'info_cache' on Instance uuid d02fea18-bb78-472e-8947-909f4b6b5fde {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:30:59 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Updating instance_info_cache with network_info: [{"id": "f7d27dda-1b70-4f3f-b866-c2705b01e396", "address": "fa:16:3e:b3:cf:91", "network": {"id": "9b61fda2-5437-4085-889d-35a4edda72bc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1424647024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38869dd0674640b1b72258b53dc8f5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7d27dda-1b", "ovs_interfaceid": "f7d27dda-1b70-4f3f-b866-c2705b01e396", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:30:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Releasing lock "refresh_cache-d02fea18-bb78-472e-8947-909f4b6b5fde" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:30:59 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 18:31:01 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:31:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:31:03 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:31:03 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 18:31:04 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:31:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5fb8ff93-4229-4471-8fa4-7fc3a3fc2970 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Acquiring lock "d02fea18-bb78-472e-8947-909f4b6b5fde" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:31:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5fb8ff93-4229-4471-8fa4-7fc3a3fc2970 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lock "d02fea18-bb78-472e-8947-909f4b6b5fde" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:31:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5fb8ff93-4229-4471-8fa4-7fc3a3fc2970 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Acquiring lock "d02fea18-bb78-472e-8947-909f4b6b5fde-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:31:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5fb8ff93-4229-4471-8fa4-7fc3a3fc2970 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lock "d02fea18-bb78-472e-8947-909f4b6b5fde-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:31:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5fb8ff93-4229-4471-8fa4-7fc3a3fc2970 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lock "d02fea18-bb78-472e-8947-909f4b6b5fde-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:31:06 user nova-compute[75100]: INFO nova.compute.manager [None req-5fb8ff93-4229-4471-8fa4-7fc3a3fc2970 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Terminating instance
Nov 10 18:31:06 user nova-compute[75100]: DEBUG nova.compute.manager [None req-5fb8ff93-4229-4471-8fa4-7fc3a3fc2970 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 18:31:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:31:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:31:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:31:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:31:06 user nova-compute[75100]: DEBUG nova.compute.manager [req-49ffd7ca-230e-4b62-837d-9527bb8c9341 req-81b32ddc-c38b-4b49-9cd5-e9414a3f7c81 service nova] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Received event network-vif-unplugged-f7d27dda-1b70-4f3f-b866-c2705b01e396 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:31:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-49ffd7ca-230e-4b62-837d-9527bb8c9341 req-81b32ddc-c38b-4b49-9cd5-e9414a3f7c81 service nova] Acquiring lock "d02fea18-bb78-472e-8947-909f4b6b5fde-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:31:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-49ffd7ca-230e-4b62-837d-9527bb8c9341 req-81b32ddc-c38b-4b49-9cd5-e9414a3f7c81 service nova] Lock "d02fea18-bb78-472e-8947-909f4b6b5fde-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:31:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-49ffd7ca-230e-4b62-837d-9527bb8c9341 req-81b32ddc-c38b-4b49-9cd5-e9414a3f7c81 service nova] Lock "d02fea18-bb78-472e-8947-909f4b6b5fde-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:31:06 user nova-compute[75100]: DEBUG nova.compute.manager [req-49ffd7ca-230e-4b62-837d-9527bb8c9341 req-81b32ddc-c38b-4b49-9cd5-e9414a3f7c81 service nova] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] No waiting events found dispatching network-vif-unplugged-f7d27dda-1b70-4f3f-b866-c2705b01e396 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:31:06 user nova-compute[75100]: DEBUG nova.compute.manager [req-49ffd7ca-230e-4b62-837d-9527bb8c9341 req-81b32ddc-c38b-4b49-9cd5-e9414a3f7c81 service nova] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Received event network-vif-unplugged-f7d27dda-1b70-4f3f-b866-c2705b01e396 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 18:31:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:31:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:31:06 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Instance destroyed successfully.
Nov 10 18:31:06 user nova-compute[75100]: DEBUG nova.objects.instance [None req-5fb8ff93-4229-4471-8fa4-7fc3a3fc2970 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lazy-loading 'resources' on Instance uuid d02fea18-bb78-472e-8947-909f4b6b5fde {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:31:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-5fb8ff93-4229-4471-8fa4-7fc3a3fc2970 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:21:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1947290224',display_name='tempest-SnapshotDataIntegrityTests-server-1947290224',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1947290224',id=49,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6pvXTJ7G6EdpLcOaGzqjuyc4qsZcZrBUiIRaIFkewlXSrOSxvECdwUY2WJBA92SsMT8ZcO/35Txv8sPEdEtD6xmUkGaTq7ko2Bjq8fgfGK9/IMaZAaGNJGWHpcds5lgw==',key_name='tempest-keypair-1240068900',keypairs=<?>,launch_index=0,launched_at=2023-11-10T18:21:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='38869dd0674640b1b72258b53dc8f5db',ramdisk_id='',reservation_id='r-04atrpd3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1069078983',owner_user_name='tempest-SnapshotDataIntegrityTests-1069078983-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T18:21:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6c06f310b524587ac7344729aa3a0bb',uuid=d02fea18-bb78-472e-8947-909f4b6b5fde,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f7d27dda-1b70-4f3f-b866-c2705b01e396", "address": "fa:16:3e:b3:cf:91", "network": {"id": "9b61fda2-5437-4085-889d-35a4edda72bc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1424647024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38869dd0674640b1b72258b53dc8f5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7d27dda-1b", "ovs_interfaceid": "f7d27dda-1b70-4f3f-b866-c2705b01e396", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 18:31:07 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-5fb8ff93-4229-4471-8fa4-7fc3a3fc2970 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Converting VIF {"id": "f7d27dda-1b70-4f3f-b866-c2705b01e396", "address": "fa:16:3e:b3:cf:91", "network": {"id": "9b61fda2-5437-4085-889d-35a4edda72bc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1424647024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38869dd0674640b1b72258b53dc8f5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7d27dda-1b", "ovs_interfaceid": "f7d27dda-1b70-4f3f-b866-c2705b01e396", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:31:07 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-5fb8ff93-4229-4471-8fa4-7fc3a3fc2970 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:cf:91,bridge_name='br-int',has_traffic_filtering=True,id=f7d27dda-1b70-4f3f-b866-c2705b01e396,network=Network(9b61fda2-5437-4085-889d-35a4edda72bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7d27dda-1b') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:31:07 user nova-compute[75100]: DEBUG os_vif [None req-5fb8ff93-4229-4471-8fa4-7fc3a3fc2970 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:cf:91,bridge_name='br-int',has_traffic_filtering=True,id=f7d27dda-1b70-4f3f-b866-c2705b01e396,network=Network(9b61fda2-5437-4085-889d-35a4edda72bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7d27dda-1b') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 18:31:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:31:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf7d27dda-1b, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:31:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:31:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:31:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:31:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d74172ea-a3ce-4809-b77b-b84f174c8233) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:31:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:31:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:31:07 user nova-compute[75100]: INFO os_vif [None req-5fb8ff93-4229-4471-8fa4-7fc3a3fc2970 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:cf:91,bridge_name='br-int',has_traffic_filtering=True,id=f7d27dda-1b70-4f3f-b866-c2705b01e396,network=Network(9b61fda2-5437-4085-889d-35a4edda72bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7d27dda-1b')
Nov 10 18:31:07 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-5fb8ff93-4229-4471-8fa4-7fc3a3fc2970 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Deleting instance files /opt/stack/data/nova/instances/d02fea18-bb78-472e-8947-909f4b6b5fde_del
Nov 10 18:31:07 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-5fb8ff93-4229-4471-8fa4-7fc3a3fc2970 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Deletion of /opt/stack/data/nova/instances/d02fea18-bb78-472e-8947-909f4b6b5fde_del complete
Nov 10 18:31:07 user nova-compute[75100]: INFO nova.compute.manager [None req-5fb8ff93-4229-4471-8fa4-7fc3a3fc2970 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 10 18:31:07 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-5fb8ff93-4229-4471-8fa4-7fc3a3fc2970 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 18:31:07 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 18:31:07 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 18:31:08 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:31:08 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Took 1.03 seconds to deallocate network for instance.
Nov 10 18:31:08 user nova-compute[75100]: DEBUG nova.compute.manager [req-0fd6e07a-2995-4c86-ad06-54391c6457ec req-10ce6e4a-dbcc-44fa-9a3d-7fc86d6132bf service nova] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Received event network-vif-deleted-f7d27dda-1b70-4f3f-b866-c2705b01e396 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:31:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5fb8ff93-4229-4471-8fa4-7fc3a3fc2970 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:31:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5fb8ff93-4229-4471-8fa4-7fc3a3fc2970 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:31:08 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:31:08 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-5fb8ff93-4229-4471-8fa4-7fc3a3fc2970 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:31:08 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-5fb8ff93-4229-4471-8fa4-7fc3a3fc2970 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:31:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5fb8ff93-4229-4471-8fa4-7fc3a3fc2970 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.147s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:31:08 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-5fb8ff93-4229-4471-8fa4-7fc3a3fc2970 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Deleted allocations for instance d02fea18-bb78-472e-8947-909f4b6b5fde
Nov 10 18:31:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5fb8ff93-4229-4471-8fa4-7fc3a3fc2970 tempest-SnapshotDataIntegrityTests-1069078983 tempest-SnapshotDataIntegrityTests-1069078983-project-member] Lock "d02fea18-bb78-472e-8947-909f4b6b5fde" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.273s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:31:08 user nova-compute[75100]: DEBUG nova.compute.manager [req-af3cd081-075d-45ad-b102-f85d18a53a31 req-c7812e4c-868c-488c-a810-e5c99c02b07b service nova] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Received event network-vif-plugged-f7d27dda-1b70-4f3f-b866-c2705b01e396 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:31:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-af3cd081-075d-45ad-b102-f85d18a53a31 req-c7812e4c-868c-488c-a810-e5c99c02b07b service nova] Acquiring lock "d02fea18-bb78-472e-8947-909f4b6b5fde-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:31:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-af3cd081-075d-45ad-b102-f85d18a53a31 req-c7812e4c-868c-488c-a810-e5c99c02b07b service nova] Lock "d02fea18-bb78-472e-8947-909f4b6b5fde-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:31:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-af3cd081-075d-45ad-b102-f85d18a53a31 req-c7812e4c-868c-488c-a810-e5c99c02b07b service nova] Lock "d02fea18-bb78-472e-8947-909f4b6b5fde-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:31:08 user nova-compute[75100]: DEBUG nova.compute.manager [req-af3cd081-075d-45ad-b102-f85d18a53a31 req-c7812e4c-868c-488c-a810-e5c99c02b07b service nova] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] No waiting events found dispatching network-vif-plugged-f7d27dda-1b70-4f3f-b866-c2705b01e396 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:31:08 user nova-compute[75100]: WARNING nova.compute.manager [req-af3cd081-075d-45ad-b102-f85d18a53a31 req-c7812e4c-868c-488c-a810-e5c99c02b07b service nova] [instance: d02fea18-bb78-472e-8947-909f4b6b5fde] Received unexpected event network-vif-plugged-f7d27dda-1b70-4f3f-b866-c2705b01e396 for instance with vm_state deleted and task_state None.
Nov 10 18:31:09 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:31:09 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Triggering sync for uuid 228d6943-f74a-40ed-b272-aa31c50ee879 {{(pid=75100) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 18:31:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "228d6943-f74a-40ed-b272-aa31c50ee879" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:31:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "228d6943-f74a-40ed-b272-aa31c50ee879" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:31:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "228d6943-f74a-40ed-b272-aa31c50ee879" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:31:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:31:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:31:18 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:31:18 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Cleaning up deleted instances {{(pid=75100) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 18:31:18 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] There are 0 instances to clean {{(pid=75100) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 18:31:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:31:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:31:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:31:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:31:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:31:42 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:31:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:31:46 user nova-compute[75100]: DEBUG nova.compute.manager [req-df2588fb-5cea-4a3d-a822-02c68c829d60 req-17c247fa-78af-4001-bc11-48e3882d94e9 service nova] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Received event network-changed-963a800b-186d-457e-b83e-410214f7f92d {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:31:46 user nova-compute[75100]: DEBUG nova.compute.manager [req-df2588fb-5cea-4a3d-a822-02c68c829d60 req-17c247fa-78af-4001-bc11-48e3882d94e9 service nova] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Refreshing instance network info cache due to event network-changed-963a800b-186d-457e-b83e-410214f7f92d. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 18:31:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-df2588fb-5cea-4a3d-a822-02c68c829d60 req-17c247fa-78af-4001-bc11-48e3882d94e9 service nova] Acquiring lock "refresh_cache-228d6943-f74a-40ed-b272-aa31c50ee879" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:31:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-df2588fb-5cea-4a3d-a822-02c68c829d60 req-17c247fa-78af-4001-bc11-48e3882d94e9 service nova] Acquired lock "refresh_cache-228d6943-f74a-40ed-b272-aa31c50ee879" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:31:46 user nova-compute[75100]: DEBUG nova.network.neutron [req-df2588fb-5cea-4a3d-a822-02c68c829d60 req-17c247fa-78af-4001-bc11-48e3882d94e9 service nova] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Refreshing network info cache for port 963a800b-186d-457e-b83e-410214f7f92d {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 18:31:46 user nova-compute[75100]: DEBUG nova.network.neutron [req-df2588fb-5cea-4a3d-a822-02c68c829d60 req-17c247fa-78af-4001-bc11-48e3882d94e9 service nova] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Updated VIF entry in instance network info cache for port 963a800b-186d-457e-b83e-410214f7f92d. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 18:31:46 user nova-compute[75100]: DEBUG nova.network.neutron [req-df2588fb-5cea-4a3d-a822-02c68c829d60 req-17c247fa-78af-4001-bc11-48e3882d94e9 service nova] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Updating instance_info_cache with network_info: [{"id": "963a800b-186d-457e-b83e-410214f7f92d", "address": "fa:16:3e:80:31:f9", "network": {"id": "5cc7dc03-a2c6-488f-aefd-2160f3a9f300", "bridge": "br-int", "label": "tempest-TestStampPattern-1448697637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aab3787fb375442288ea080aa156a326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap963a800b-18", "ovs_interfaceid": "963a800b-186d-457e-b83e-410214f7f92d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:31:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-df2588fb-5cea-4a3d-a822-02c68c829d60 req-17c247fa-78af-4001-bc11-48e3882d94e9 service nova] Releasing lock "refresh_cache-228d6943-f74a-40ed-b272-aa31c50ee879" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:31:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7ecb9255-83fa-4758-aa89-30b097d4200c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Acquiring lock "228d6943-f74a-40ed-b272-aa31c50ee879" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:31:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7ecb9255-83fa-4758-aa89-30b097d4200c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Lock "228d6943-f74a-40ed-b272-aa31c50ee879" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:31:46 user nova-compute[75100]: DEBUG nova.objects.instance [None req-7ecb9255-83fa-4758-aa89-30b097d4200c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Lazy-loading 'flavor' on Instance uuid 228d6943-f74a-40ed-b272-aa31c50ee879 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:31:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7ecb9255-83fa-4758-aa89-30b097d4200c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Lock "228d6943-f74a-40ed-b272-aa31c50ee879" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:31:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7ecb9255-83fa-4758-aa89-30b097d4200c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Acquiring lock "228d6943-f74a-40ed-b272-aa31c50ee879" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:31:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7ecb9255-83fa-4758-aa89-30b097d4200c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Lock "228d6943-f74a-40ed-b272-aa31c50ee879" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:31:46 user nova-compute[75100]: INFO nova.compute.manager [None req-7ecb9255-83fa-4758-aa89-30b097d4200c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Attaching volume 466cbff1-3abc-41a1-a0d9-567d1b10d613 to /dev/vdb
Nov 10 18:31:46 user nova-compute[75100]: DEBUG os_brick.utils [None req-7ecb9255-83fa-4758-aa89-30b097d4200c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:31:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:31:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:31:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e560211e-768b-4f51-80c6-b29ec33b20fb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90b1a229568f\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:31:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:31:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:31:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6cf41d-8906-413b-9b78-f4ed3388a81a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:31:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:31:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:31:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec7bb58-39b6-4f9e-bf42-061814d9e663]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:31:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[12057f7e-fdc6-4ba2-bda1-b5c887f81519]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:31:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-7ecb9255-83fa-4758-aa89-30b097d4200c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:31:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-7ecb9255-83fa-4758-aa89-30b097d4200c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 18:31:47 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7ecb9255-83fa-4758-aa89-30b097d4200c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 18:31:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:31:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 18:31:47 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 18:31:47 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe38515-686a-4999-99bd-4f1d7976d8e8]: (4, '') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:31:47 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-7ecb9255-83fa-4758-aa89-30b097d4200c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 18:31:47 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-7ecb9255-83fa-4758-aa89-30b097d4200c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 18:31:47 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-7ecb9255-83fa-4758-aa89-30b097d4200c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 18:31:47 user nova-compute[75100]: DEBUG os_brick.utils [None req-7ecb9255-83fa-4758-aa89-30b097d4200c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90b1a229568f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:31:47 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-7ecb9255-83fa-4758-aa89-30b097d4200c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Updating existing volume attachment record: 4f9b256b-ad32-42ae-b679-99312fd4bd81 {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 18:31:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:31:50 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:31:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:31:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:31:54 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:31:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:31:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:31:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:31:54 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 18:31:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228d6943-f74a-40ed-b272-aa31c50ee879/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:31:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228d6943-f74a-40ed-b272-aa31c50ee879/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:31:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228d6943-f74a-40ed-b272-aa31c50ee879/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:31:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228d6943-f74a-40ed-b272-aa31c50ee879/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:31:55 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:31:55 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:31:55 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Hypervisor/Node resource view: name=user free_ram=8936MB free_disk=24.397869110107422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 18:31:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:31:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:31:55 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 228d6943-f74a-40ed-b272-aa31c50ee879 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:31:55 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 18:31:55 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 18:31:55 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Refreshing inventories for resource provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 18:31:55 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Updating ProviderTree inventory for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 18:31:55 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Updating inventory in ProviderTree for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 18:31:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:31:55 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Refreshing aggregate associations for resource provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64, aggregates: None {{(pid=75100) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 18:31:55 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Refreshing trait associations for resource provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2 {{(pid=75100) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 18:31:55 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:31:55 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:31:55 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 18:31:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.333s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:31:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:31:58 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:31:58 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:31:58 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:31:59 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:31:59 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 18:31:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "refresh_cache-228d6943-f74a-40ed-b272-aa31c50ee879" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:31:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquired lock "refresh_cache-228d6943-f74a-40ed-b272-aa31c50ee879" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:31:59 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 18:31:59 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Updating instance_info_cache with network_info: [{"id": "963a800b-186d-457e-b83e-410214f7f92d", "address": "fa:16:3e:80:31:f9", "network": {"id": "5cc7dc03-a2c6-488f-aefd-2160f3a9f300", "bridge": "br-int", "label": "tempest-TestStampPattern-1448697637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aab3787fb375442288ea080aa156a326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap963a800b-18", "ovs_interfaceid": "963a800b-186d-457e-b83e-410214f7f92d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:31:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Releasing lock "refresh_cache-228d6943-f74a-40ed-b272-aa31c50ee879" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:31:59 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 18:32:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:32:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:32:02 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:32:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:32:05 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:32:05 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 18:32:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:32:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:32:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:32:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:32:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:32:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ecb9255-83fa-4758-aa89-30b097d4200c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 18:32:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ecb9255-83fa-4758-aa89-30b097d4200c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:466cbff1-3abc-41a1-a0d9-567d1b10d613', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AZGfQRpr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:32:21 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-7ecb9255-83fa-4758-aa89-30b097d4200c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:32:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-7ecb9255-83fa-4758-aa89-30b097d4200c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:32:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-7ecb9255-83fa-4758-aa89-30b097d4200c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:32:21 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-7ecb9255-83fa-4758-aa89-30b097d4200c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:32:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-7ecb9255-83fa-4758-aa89-30b097d4200c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:466cbff1-3abc-41a1-a0d9-567d1b10d613" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:32:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-7ecb9255-83fa-4758-aa89-30b097d4200c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:466cbff1-3abc-41a1-a0d9-567d1b10d613" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:32:21 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-7ecb9255-83fa-4758-aa89-30b097d4200c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 18:32:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:466cbff1-3abc-41a1-a0d9-567d1b10d613 -p 172.16.0.220:3260 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:32:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:466cbff1-3abc-41a1-a0d9-567d1b10d613 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:32:21 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b658077-e51f-47ef-9a42-db01ed3faa70]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:32:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ecb9255-83fa-4758-aa89-30b097d4200c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 18:32:21 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:32:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:466cbff1-3abc-41a1-a0d9-567d1b10d613 -p 172.16.0.220:3260 --interface default --op new {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:32:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:466cbff1-3abc-41a1-a0d9-567d1b10d613 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:32:21 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01ff3e7-9822-46cb-86ca-c42b950aff0b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:466cbff1-3abc-41a1-a0d9-567d1b10d613] added\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:32:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ecb9255-83fa-4758-aa89-30b097d4200c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:466cbff1-3abc-41a1-a0d9-567d1b10d613] added
Nov 10 18:32:21 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:32:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:466cbff1-3abc-41a1-a0d9-567d1b10d613 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:32:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:466cbff1-3abc-41a1-a0d9-567d1b10d613 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:32:21 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c6f437-415d-438c-9564-04208bb4943a]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:32:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ecb9255-83fa-4758-aa89-30b097d4200c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:32:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:466cbff1-3abc-41a1-a0d9-567d1b10d613 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:32:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:466cbff1-3abc-41a1-a0d9-567d1b10d613 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:32:21 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75f60d1-b804-4eb4-b7e1-ac7a131f4853]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:32:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ecb9255-83fa-4758-aa89-30b097d4200c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:32:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:466cbff1-3abc-41a1-a0d9-567d1b10d613 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AZGfQRpr {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:32:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:466cbff1-3abc-41a1-a0d9-567d1b10d613 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AZGfQRpr" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:32:21 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[00243d55-feca-494c-8510-d3b45dffbb93]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:32:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ecb9255-83fa-4758-aa89-30b097d4200c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AZGfQRpr'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:32:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:466cbff1-3abc-41a1-a0d9-567d1b10d613 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:32:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:466cbff1-3abc-41a1-a0d9-567d1b10d613 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:32:21 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[05cc98c3-72aa-4f2d-9bb4-59a16fdfc9b6]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:32:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ecb9255-83fa-4758-aa89-30b097d4200c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:32:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:32:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:32:21 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c6636d-cd3d-44c0-affb-041ea28aba6d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:32:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ecb9255-83fa-4758-aa89-30b097d4200c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 10 18:32:21 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:32:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ecb9255-83fa-4758-aa89-30b097d4200c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 10 18:32:21 user nova-compute[75100]:  {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:32:21 user nova-compute[75100]: WARNING os_brick.initiator.connectors.iscsi [None req-7ecb9255-83fa-4758-aa89-30b097d4200c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 10 18:32:21 user nova-compute[75100]: 
Nov 10 18:32:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:466cbff1-3abc-41a1-a0d9-567d1b10d613 -p 172.16.0.220:3260 --login {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:32:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:466cbff1-3abc-41a1-a0d9-567d1b10d613 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:32:21 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b74a93-ae39-43b9-9622-3e5bb1b19565]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:466cbff1-3abc-41a1-a0d9-567d1b10d613, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:466cbff1-3abc-41a1-a0d9-567d1b10d613, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:32:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ecb9255-83fa-4758-aa89-30b097d4200c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:466cbff1-3abc-41a1-a0d9-567d1b10d613, portal: 172.16.0.220,3260]
Nov 10 18:32:21 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:466cbff1-3abc-41a1-a0d9-567d1b10d613, portal: 172.16.0.220,3260] successful.
Nov 10 18:32:21 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:32:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:466cbff1-3abc-41a1-a0d9-567d1b10d613 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:32:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:466cbff1-3abc-41a1-a0d9-567d1b10d613 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:32:21 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5ebb55-0eed-4c5f-84dc-2f293f76fffc]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:32:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ecb9255-83fa-4758-aa89-30b097d4200c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:32:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:32:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:32:21 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb92a66-ebee-457d-8688-d20cf52826af]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466cbff1-3abc-41a1-a0d9-567d1b10d613 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:32:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ecb9255-83fa-4758-aa89-30b097d4200c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466cbff1-3abc-41a1-a0d9-567d1b10d613 (non-flash)
Nov 10 18:32:21 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:32:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ecb9255-83fa-4758-aa89-30b097d4200c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466cbff1-3abc-41a1-a0d9-567d1b10d613 (non-flash)
Nov 10 18:32:21 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:32:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-7ecb9255-83fa-4758-aa89-30b097d4200c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:466cbff1-3abc-41a1-a0d9-567d1b10d613" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.242s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:32:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ecb9255-83fa-4758-aa89-30b097d4200c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 18:32:21 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-7ecb9255-83fa-4758-aa89-30b097d4200c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 18:32:21 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-7ecb9255-83fa-4758-aa89-30b097d4200c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 18:32:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:32:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:32:21 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a9c444-2eb3-4cf0-8fa4-cb0a70ca9db1]: (4, ('- - 0', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:32:21 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-7ecb9255-83fa-4758-aa89-30b097d4200c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 18:32:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ecb9255-83fa-4758-aa89-30b097d4200c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:466cbff1-3abc-41a1-a0d9-567d1b10d613', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AZGfQRpr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 18:32:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:32:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-7ecb9255-83fa-4758-aa89-30b097d4200c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.279s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:32:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ecb9255-83fa-4758-aa89-30b097d4200c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] <== connect_volume: return (1281ms) {'type': 'block', 'scsi_wwn': '23831653662356365', 'path': '/dev/sdb'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:32:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ecb9255-83fa-4758-aa89-30b097d4200c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831653662356365', 'path': '/dev/sdb'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 18:32:22 user nova-compute[75100]: DEBUG nova.objects.instance [None req-7ecb9255-83fa-4758-aa89-30b097d4200c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Lazy-loading 'flavor' on Instance uuid 228d6943-f74a-40ed-b272-aa31c50ee879 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:32:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-7ecb9255-83fa-4758-aa89-30b097d4200c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 18:32:22 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:32:22 user nova-compute[75100]:   <source dev="/dev/sdb"/>
Nov 10 18:32:22 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 18:32:22 user nova-compute[75100]:   <serial>466cbff1-3abc-41a1-a0d9-567d1b10d613</serial>
Nov 10 18:32:22 user nova-compute[75100]: </disk>
Nov 10 18:32:22 user nova-compute[75100]:  {{(pid=75100) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 18:32:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7ecb9255-83fa-4758-aa89-30b097d4200c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 18:32:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7ecb9255-83fa-4758-aa89-30b097d4200c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 18:32:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7ecb9255-83fa-4758-aa89-30b097d4200c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] No VIF found with MAC fa:16:3e:80:31:f9, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 18:32:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7ecb9255-83fa-4758-aa89-30b097d4200c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Lock "228d6943-f74a-40ed-b272-aa31c50ee879" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 36.195s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:32:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:32:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-182f9458-6b9b-4872-801f-9ea236ca63c0 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Acquiring lock "228d6943-f74a-40ed-b272-aa31c50ee879" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:32:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-182f9458-6b9b-4872-801f-9ea236ca63c0 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Lock "228d6943-f74a-40ed-b272-aa31c50ee879" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:32:26 user nova-compute[75100]: INFO nova.compute.manager [None req-182f9458-6b9b-4872-801f-9ea236ca63c0 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Detaching volume 466cbff1-3abc-41a1-a0d9-567d1b10d613
Nov 10 18:32:26 user nova-compute[75100]: INFO nova.virt.block_device [None req-182f9458-6b9b-4872-801f-9ea236ca63c0 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Attempting to driver detach volume 466cbff1-3abc-41a1-a0d9-567d1b10d613 from mountpoint /dev/vdb
Nov 10 18:32:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-182f9458-6b9b-4872-801f-9ea236ca63c0 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Attempting to detach device vdb from instance 228d6943-f74a-40ed-b272-aa31c50ee879 from the persistent domain config. {{(pid=75100) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 18:32:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-182f9458-6b9b-4872-801f-9ea236ca63c0 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 18:32:26 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:32:26 user nova-compute[75100]:   <source dev="/dev/sdb"/>
Nov 10 18:32:26 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 18:32:26 user nova-compute[75100]:   <serial>466cbff1-3abc-41a1-a0d9-567d1b10d613</serial>
Nov 10 18:32:26 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 18:32:26 user nova-compute[75100]: </disk>
Nov 10 18:32:26 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 18:32:26 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-182f9458-6b9b-4872-801f-9ea236ca63c0 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Successfully detached device vdb from instance 228d6943-f74a-40ed-b272-aa31c50ee879 from the persistent domain config.
Nov 10 18:32:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-182f9458-6b9b-4872-801f-9ea236ca63c0 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 228d6943-f74a-40ed-b272-aa31c50ee879 from the live domain config. {{(pid=75100) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 18:32:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-182f9458-6b9b-4872-801f-9ea236ca63c0 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 18:32:26 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:32:26 user nova-compute[75100]:   <source dev="/dev/sdb"/>
Nov 10 18:32:26 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 18:32:26 user nova-compute[75100]:   <serial>466cbff1-3abc-41a1-a0d9-567d1b10d613</serial>
Nov 10 18:32:26 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 18:32:26 user nova-compute[75100]: </disk>
Nov 10 18:32:26 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 18:32:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-182f9458-6b9b-4872-801f-9ea236ca63c0 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 228d6943-f74a-40ed-b272-aa31c50ee879 {{(pid=75100) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 18:32:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:32:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:32:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:32:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:32:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:32:44 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:32:46 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-182f9458-6b9b-4872-801f-9ea236ca63c0 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 228d6943-f74a-40ed-b272-aa31c50ee879 is timed out.
Nov 10 18:32:46 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-182f9458-6b9b-4872-801f-9ea236ca63c0 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Successfully detached device vdb from instance 228d6943-f74a-40ed-b272-aa31c50ee879 from the live domain config.
Nov 10 18:32:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-182f9458-6b9b-4872-801f-9ea236ca63c0 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 18:32:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-182f9458-6b9b-4872-801f-9ea236ca63c0 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, {'target_iqn': 'iqn.2010-10.org.openstack:466cbff1-3abc-41a1-a0d9-567d1b10d613', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AZGfQRpr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:32:46 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-182f9458-6b9b-4872-801f-9ea236ca63c0 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:32:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-182f9458-6b9b-4872-801f-9ea236ca63c0 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:32:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-182f9458-6b9b-4872-801f-9ea236ca63c0 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:32:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:32:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:32:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1572b163-27e7-43f4-b1b1-2b7e05a92264]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:466cbff1-3abc-41a1-a0d9-567d1b10d613\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:32:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-182f9458-6b9b-4872-801f-9ea236ca63c0 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 18:32:46 user nova-compute[75100]: No targets found.
Nov 10 18:32:46 user nova-compute[75100]: iSNS:
Nov 10 18:32:46 user nova-compute[75100]: No targets found.
Nov 10 18:32:46 user nova-compute[75100]: STATIC:
Nov 10 18:32:46 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:466cbff1-3abc-41a1-a0d9-567d1b10d613
Nov 10 18:32:46 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:32:46 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:32:46 user nova-compute[75100]: FIRMWARE:
Nov 10 18:32:46 user nova-compute[75100]: No targets found.
Nov 10 18:32:46 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:32:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-182f9458-6b9b-4872-801f-9ea236ca63c0 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 18:32:46 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 18:32:46 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 18:32:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-182f9458-6b9b-4872-801f-9ea236ca63c0 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:466cbff1-3abc-41a1-a0d9-567d1b10d613', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 18:32:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:32:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:32:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbdd1bfb-395e-43fa-b5c5-e3acb415457e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:466cbff1-3abc-41a1-a0d9-567d1b10d613\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:32:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:32:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:32:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea7c2d8-7220-4156-9a14-f68d0312f116]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466cbff1-3abc-41a1-a0d9-567d1b10d613 (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:32:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-182f9458-6b9b-4872-801f-9ea236ca63c0 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466cbff1-3abc-41a1-a0d9-567d1b10d613 (non-flash)
Nov 10 18:32:46 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:32:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-182f9458-6b9b-4872-801f-9ea236ca63c0 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466cbff1-3abc-41a1-a0d9-567d1b10d613 (non-flash)
Nov 10 18:32:46 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:32:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-182f9458-6b9b-4872-801f-9ea236ca63c0 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3986a9e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:466cbff1-3abc-41a1-a0d9-567d1b10d613'): ({'sdb'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 18:32:46 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-182f9458-6b9b-4872-801f-9ea236ca63c0 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Removing single pathed devices sdb {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 18:32:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:32:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:32:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1d8008-42a8-46ca-8e1f-cf96abd92f47]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:32:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:32:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:32:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4827cfa1-a16a-41f9-8280-26c12738a956]: (4, ('ok\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:32:46 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-182f9458-6b9b-4872-801f-9ea236ca63c0 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Flushing IO for device /dev/sdb {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 18:32:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:32:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:32:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[44772f9c-18c6-4b96-907e-c8f3d26dc0b8]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:32:46 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-182f9458-6b9b-4872-801f-9ea236ca63c0 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 18:32:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:32:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:32:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0e2757-b495-4641-85a4-74c648dfac37]: (4, ('1', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:32:46 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-182f9458-6b9b-4872-801f-9ea236ca63c0 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 18:32:46 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-182f9458-6b9b-4872-801f-9ea236ca63c0 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 18:32:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-182f9458-6b9b-4872-801f-9ea236ca63c0 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:466cbff1-3abc-41a1-a0d9-567d1b10d613')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 18:32:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:466cbff1-3abc-41a1-a0d9-567d1b10d613 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:32:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:466cbff1-3abc-41a1-a0d9-567d1b10d613 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:32:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b90b2a-2276-4e60-b096-89582581406f]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:32:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-182f9458-6b9b-4872-801f-9ea236ca63c0 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:32:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:466cbff1-3abc-41a1-a0d9-567d1b10d613 -p 172.16.0.220:3260 --logout {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:32:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:466cbff1-3abc-41a1-a0d9-567d1b10d613 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:32:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8620d8c7-6d1c-4407-a094-9a7915a5573a]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:466cbff1-3abc-41a1-a0d9-567d1b10d613, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:466cbff1-3abc-41a1-a0d9-567d1b10d613, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:32:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-182f9458-6b9b-4872-801f-9ea236ca63c0 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:466cbff1-3abc-41a1-a0d9-567d1b10d613, portal: 172.16.0.220,3260]
Nov 10 18:32:46 user nova-compute[75100]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:466cbff1-3abc-41a1-a0d9-567d1b10d613, portal: 172.16.0.220,3260] successful.
Nov 10 18:32:46 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:32:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:466cbff1-3abc-41a1-a0d9-567d1b10d613 -p 172.16.0.220:3260 --op delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:32:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:466cbff1-3abc-41a1-a0d9-567d1b10d613 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:32:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdbcc9e3-02e6-4b4e-b0cc-2d4c50a1a3ae]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:32:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-182f9458-6b9b-4872-801f-9ea236ca63c0 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:32:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-182f9458-6b9b-4872-801f-9ea236ca63c0 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.270s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:32:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-182f9458-6b9b-4872-801f-9ea236ca63c0 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] <== disconnect_volume: return (271ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:32:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-182f9458-6b9b-4872-801f-9ea236ca63c0 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 18:32:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:32:47 user nova-compute[75100]: DEBUG nova.objects.instance [None req-182f9458-6b9b-4872-801f-9ea236ca63c0 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Lazy-loading 'flavor' on Instance uuid 228d6943-f74a-40ed-b272-aa31c50ee879 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:32:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-182f9458-6b9b-4872-801f-9ea236ca63c0 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Lock "228d6943-f74a-40ed-b272-aa31c50ee879" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.768s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:32:51 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:32:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:32:54 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:32:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:32:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:32:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:32:54 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 18:32:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228d6943-f74a-40ed-b272-aa31c50ee879/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:32:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228d6943-f74a-40ed-b272-aa31c50ee879/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:32:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228d6943-f74a-40ed-b272-aa31c50ee879/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:32:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228d6943-f74a-40ed-b272-aa31c50ee879/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:32:55 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:32:55 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:32:55 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Hypervisor/Node resource view: name=user free_ram=8993MB free_disk=24.395923614501953GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 18:32:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:32:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:32:55 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 228d6943-f74a-40ed-b272-aa31c50ee879 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:32:55 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 18:32:55 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 18:32:55 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:32:55 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:32:55 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 18:32:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.186s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:32:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:32:59 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:32:59 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:32:59 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:32:59 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 18:32:59 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Rebuilding the list of instances to heal {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 18:32:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "refresh_cache-228d6943-f74a-40ed-b272-aa31c50ee879" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:32:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquired lock "refresh_cache-228d6943-f74a-40ed-b272-aa31c50ee879" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:32:59 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 18:32:59 user nova-compute[75100]: DEBUG nova.objects.instance [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lazy-loading 'info_cache' on Instance uuid 228d6943-f74a-40ed-b272-aa31c50ee879 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:32:59 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Updating instance_info_cache with network_info: [{"id": "963a800b-186d-457e-b83e-410214f7f92d", "address": "fa:16:3e:80:31:f9", "network": {"id": "5cc7dc03-a2c6-488f-aefd-2160f3a9f300", "bridge": "br-int", "label": "tempest-TestStampPattern-1448697637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aab3787fb375442288ea080aa156a326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap963a800b-18", "ovs_interfaceid": "963a800b-186d-457e-b83e-410214f7f92d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:32:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Releasing lock "refresh_cache-228d6943-f74a-40ed-b272-aa31c50ee879" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:32:59 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 18:33:00 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:33:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:33:02 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:33:05 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:33:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:33:07 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:33:07 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 18:33:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:33:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:33:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:33:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:33:28 user nova-compute[75100]: DEBUG nova.compute.manager [None req-5275d62e-3a3a-45f4-b0c2-94b5dd33e396 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 18:33:29 user nova-compute[75100]: INFO nova.compute.manager [None req-5275d62e-3a3a-45f4-b0c2-94b5dd33e396 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] instance snapshotting
Nov 10 18:33:29 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-5275d62e-3a3a-45f4-b0c2-94b5dd33e396 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Beginning live snapshot process
Nov 10 18:33:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5275d62e-3a3a-45f4-b0c2-94b5dd33e396 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228d6943-f74a-40ed-b272-aa31c50ee879/disk --force-share --output=json -f qcow2 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:33:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5275d62e-3a3a-45f4-b0c2-94b5dd33e396 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228d6943-f74a-40ed-b272-aa31c50ee879/disk --force-share --output=json -f qcow2" returned: 0 in 0.180s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:33:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5275d62e-3a3a-45f4-b0c2-94b5dd33e396 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228d6943-f74a-40ed-b272-aa31c50ee879/disk --force-share --output=json -f qcow2 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:33:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5275d62e-3a3a-45f4-b0c2-94b5dd33e396 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228d6943-f74a-40ed-b272-aa31c50ee879/disk --force-share --output=json -f qcow2" returned: 0 in 0.176s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:33:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5275d62e-3a3a-45f4-b0c2-94b5dd33e396 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:33:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5275d62e-3a3a-45f4-b0c2-94b5dd33e396 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520 --force-share --output=json" returned: 0 in 0.177s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:33:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5275d62e-3a3a-45f4-b0c2-94b5dd33e396 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpnbab_0e3/97d1283fcd7d42a2afcc9d498f7656d1.delta 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:33:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5275d62e-3a3a-45f4-b0c2-94b5dd33e396 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/818b9e28e061d41a38d903968b229be2ed9ba520,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpnbab_0e3/97d1283fcd7d42a2afcc9d498f7656d1.delta 1073741824" returned: 0 in 0.049s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:33:29 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-5275d62e-3a3a-45f4-b0c2-94b5dd33e396 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 10 18:33:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-5275d62e-3a3a-45f4-b0c2-94b5dd33e396 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75100) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 18:33:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-5275d62e-3a3a-45f4-b0c2-94b5dd33e396 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75100) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 18:33:31 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-5275d62e-3a3a-45f4-b0c2-94b5dd33e396 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 10 18:33:31 user nova-compute[75100]: DEBUG nova.privsep.utils [None req-5275d62e-3a3a-45f4-b0c2-94b5dd33e396 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75100) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 18:33:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5275d62e-3a3a-45f4-b0c2-94b5dd33e396 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpnbab_0e3/97d1283fcd7d42a2afcc9d498f7656d1.delta /opt/stack/data/nova/instances/snapshots/tmpnbab_0e3/97d1283fcd7d42a2afcc9d498f7656d1 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:33:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5275d62e-3a3a-45f4-b0c2-94b5dd33e396 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpnbab_0e3/97d1283fcd7d42a2afcc9d498f7656d1.delta /opt/stack/data/nova/instances/snapshots/tmpnbab_0e3/97d1283fcd7d42a2afcc9d498f7656d1" returned: 0 in 0.773s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:33:31 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-5275d62e-3a3a-45f4-b0c2-94b5dd33e396 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Snapshot extracted, beginning image upload
Nov 10 18:33:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:33:34 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-5275d62e-3a3a-45f4-b0c2-94b5dd33e396 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Snapshot image upload complete
Nov 10 18:33:34 user nova-compute[75100]: INFO nova.compute.manager [None req-5275d62e-3a3a-45f4-b0c2-94b5dd33e396 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Took 5.23 seconds to snapshot the instance on the hypervisor.
Nov 10 18:33:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Acquiring lock "65cf69e9-ec9a-43a1-933b-ee89cfb42d22" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:33:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Lock "65cf69e9-ec9a-43a1-933b-ee89cfb42d22" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:33:36 user nova-compute[75100]: DEBUG nova.compute.manager [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 18:33:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:33:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:33:36 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 18:33:36 user nova-compute[75100]: INFO nova.compute.claims [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Claim successful on node user
Nov 10 18:33:37 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:33:37 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:33:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.249s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:33:37 user nova-compute[75100]: DEBUG nova.compute.manager [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 18:33:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:33:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:33:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:33:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:33:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:33:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:33:37 user nova-compute[75100]: DEBUG nova.compute.manager [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 18:33:37 user nova-compute[75100]: DEBUG nova.network.neutron [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 18:33:37 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 18:33:37 user nova-compute[75100]: DEBUG nova.compute.manager [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 18:33:37 user nova-compute[75100]: DEBUG nova.policy [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5c872b1827cd452aa3b47a80f448d317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab3787fb375442288ea080aa156a326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 18:33:37 user nova-compute[75100]: DEBUG nova.compute.manager [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 18:33:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 18:33:37 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Creating image(s)
Nov 10 18:33:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Acquiring lock "/opt/stack/data/nova/instances/65cf69e9-ec9a-43a1-933b-ee89cfb42d22/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:33:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Lock "/opt/stack/data/nova/instances/65cf69e9-ec9a-43a1-933b-ee89cfb42d22/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:33:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Lock "/opt/stack/data/nova/instances/65cf69e9-ec9a-43a1-933b-ee89cfb42d22/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:33:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Acquiring lock "8dc883773704c915983896b0a9699e9ee2d81fbb" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:33:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Lock "8dc883773704c915983896b0a9699e9ee2d81fbb" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:33:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8dc883773704c915983896b0a9699e9ee2d81fbb.part --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:33:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:33:38 user nova-compute[75100]: DEBUG nova.network.neutron [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Successfully created port: ddd53b42-4ddb-40d0-bfda-3ebe8125b1ae {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 18:33:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8dc883773704c915983896b0a9699e9ee2d81fbb.part --force-share --output=json" returned: 0 in 0.181s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:33:38 user nova-compute[75100]: DEBUG nova.virt.images [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] a8ce0be9-64c0-4a57-8308-21c46198bdce was qcow2, converting to raw {{(pid=75100) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 10 18:33:38 user nova-compute[75100]: DEBUG nova.privsep.utils [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75100) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 18:33:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8dc883773704c915983896b0a9699e9ee2d81fbb.part /opt/stack/data/nova/instances/_base/8dc883773704c915983896b0a9699e9ee2d81fbb.converted {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:33:39 user nova-compute[75100]: DEBUG nova.network.neutron [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Successfully updated port: ddd53b42-4ddb-40d0-bfda-3ebe8125b1ae {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 18:33:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Acquiring lock "refresh_cache-65cf69e9-ec9a-43a1-933b-ee89cfb42d22" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:33:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Acquired lock "refresh_cache-65cf69e9-ec9a-43a1-933b-ee89cfb42d22" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:33:39 user nova-compute[75100]: DEBUG nova.network.neutron [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 18:33:39 user nova-compute[75100]: DEBUG nova.network.neutron [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 18:33:39 user nova-compute[75100]: DEBUG nova.compute.manager [req-6fe03dc4-172d-4974-b40f-ba0c624304c7 req-f238af6b-16a8-4ecd-b045-878d6cbb6f34 service nova] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Received event network-changed-ddd53b42-4ddb-40d0-bfda-3ebe8125b1ae {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:33:39 user nova-compute[75100]: DEBUG nova.compute.manager [req-6fe03dc4-172d-4974-b40f-ba0c624304c7 req-f238af6b-16a8-4ecd-b045-878d6cbb6f34 service nova] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Refreshing instance network info cache due to event network-changed-ddd53b42-4ddb-40d0-bfda-3ebe8125b1ae. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 18:33:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6fe03dc4-172d-4974-b40f-ba0c624304c7 req-f238af6b-16a8-4ecd-b045-878d6cbb6f34 service nova] Acquiring lock "refresh_cache-65cf69e9-ec9a-43a1-933b-ee89cfb42d22" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:33:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8dc883773704c915983896b0a9699e9ee2d81fbb.part /opt/stack/data/nova/instances/_base/8dc883773704c915983896b0a9699e9ee2d81fbb.converted" returned: 0 in 1.056s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:33:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8dc883773704c915983896b0a9699e9ee2d81fbb.converted --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:33:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8dc883773704c915983896b0a9699e9ee2d81fbb.converted --force-share --output=json" returned: 0 in 0.191s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:33:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Lock "8dc883773704c915983896b0a9699e9ee2d81fbb" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.514s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:33:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8dc883773704c915983896b0a9699e9ee2d81fbb --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:33:39 user nova-compute[75100]: DEBUG nova.network.neutron [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Updating instance_info_cache with network_info: [{"id": "ddd53b42-4ddb-40d0-bfda-3ebe8125b1ae", "address": "fa:16:3e:05:c7:40", "network": {"id": "5cc7dc03-a2c6-488f-aefd-2160f3a9f300", "bridge": "br-int", "label": "tempest-TestStampPattern-1448697637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aab3787fb375442288ea080aa156a326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddd53b42-4d", "ovs_interfaceid": "ddd53b42-4ddb-40d0-bfda-3ebe8125b1ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:33:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Releasing lock "refresh_cache-65cf69e9-ec9a-43a1-933b-ee89cfb42d22" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:33:39 user nova-compute[75100]: DEBUG nova.compute.manager [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Instance network_info: |[{"id": "ddd53b42-4ddb-40d0-bfda-3ebe8125b1ae", "address": "fa:16:3e:05:c7:40", "network": {"id": "5cc7dc03-a2c6-488f-aefd-2160f3a9f300", "bridge": "br-int", "label": "tempest-TestStampPattern-1448697637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aab3787fb375442288ea080aa156a326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddd53b42-4d", "ovs_interfaceid": "ddd53b42-4ddb-40d0-bfda-3ebe8125b1ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 18:33:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6fe03dc4-172d-4974-b40f-ba0c624304c7 req-f238af6b-16a8-4ecd-b045-878d6cbb6f34 service nova] Acquired lock "refresh_cache-65cf69e9-ec9a-43a1-933b-ee89cfb42d22" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:33:39 user nova-compute[75100]: DEBUG nova.network.neutron [req-6fe03dc4-172d-4974-b40f-ba0c624304c7 req-f238af6b-16a8-4ecd-b045-878d6cbb6f34 service nova] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Refreshing network info cache for port ddd53b42-4ddb-40d0-bfda-3ebe8125b1ae {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 18:33:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8dc883773704c915983896b0a9699e9ee2d81fbb --force-share --output=json" returned: 0 in 0.180s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:33:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Acquiring lock "8dc883773704c915983896b0a9699e9ee2d81fbb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:33:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Lock "8dc883773704c915983896b0a9699e9ee2d81fbb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:33:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8dc883773704c915983896b0a9699e9ee2d81fbb --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:33:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8dc883773704c915983896b0a9699e9ee2d81fbb --force-share --output=json" returned: 0 in 0.169s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:33:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8dc883773704c915983896b0a9699e9ee2d81fbb,backing_fmt=raw /opt/stack/data/nova/instances/65cf69e9-ec9a-43a1-933b-ee89cfb42d22/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:33:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8dc883773704c915983896b0a9699e9ee2d81fbb,backing_fmt=raw /opt/stack/data/nova/instances/65cf69e9-ec9a-43a1-933b-ee89cfb42d22/disk 1073741824" returned: 0 in 0.052s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:33:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Lock "8dc883773704c915983896b0a9699e9ee2d81fbb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:33:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8dc883773704c915983896b0a9699e9ee2d81fbb --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:33:40 user nova-compute[75100]: DEBUG nova.network.neutron [req-6fe03dc4-172d-4974-b40f-ba0c624304c7 req-f238af6b-16a8-4ecd-b045-878d6cbb6f34 service nova] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Updated VIF entry in instance network info cache for port ddd53b42-4ddb-40d0-bfda-3ebe8125b1ae. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 18:33:40 user nova-compute[75100]: DEBUG nova.network.neutron [req-6fe03dc4-172d-4974-b40f-ba0c624304c7 req-f238af6b-16a8-4ecd-b045-878d6cbb6f34 service nova] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Updating instance_info_cache with network_info: [{"id": "ddd53b42-4ddb-40d0-bfda-3ebe8125b1ae", "address": "fa:16:3e:05:c7:40", "network": {"id": "5cc7dc03-a2c6-488f-aefd-2160f3a9f300", "bridge": "br-int", "label": "tempest-TestStampPattern-1448697637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aab3787fb375442288ea080aa156a326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddd53b42-4d", "ovs_interfaceid": "ddd53b42-4ddb-40d0-bfda-3ebe8125b1ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:33:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6fe03dc4-172d-4974-b40f-ba0c624304c7 req-f238af6b-16a8-4ecd-b045-878d6cbb6f34 service nova] Releasing lock "refresh_cache-65cf69e9-ec9a-43a1-933b-ee89cfb42d22" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:33:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8dc883773704c915983896b0a9699e9ee2d81fbb --force-share --output=json" returned: 0 in 0.176s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:33:40 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 18:33:40 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Ensure instance console log exists: /opt/stack/data/nova/instances/65cf69e9-ec9a-43a1-933b-ee89cfb42d22/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 18:33:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:33:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:33:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:33:40 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Start _get_guest_xml network_info=[{"id": "ddd53b42-4ddb-40d0-bfda-3ebe8125b1ae", "address": "fa:16:3e:05:c7:40", "network": {"id": "5cc7dc03-a2c6-488f-aefd-2160f3a9f300", "bridge": "br-int", "label": "tempest-TestStampPattern-1448697637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aab3787fb375442288ea080aa156a326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddd53b42-4d", "ovs_interfaceid": "ddd53b42-4ddb-40d0-bfda-3ebe8125b1ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='0ec393875723dbb0019e7f255b064a0d',container_format='bare',created_at=2023-11-10T18:33:29Z,direct_url=<?>,disk_format='qcow2',id=a8ce0be9-64c0-4a57-8308-21c46198bdce,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-815606516',owner='aab3787fb375442288ea080aa156a326',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-10T18:33:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'a8ce0be9-64c0-4a57-8308-21c46198bdce'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 18:33:40 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:33:40 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:33:40 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 18:33:40 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 18:33:40 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 18:33:40 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 18:33:40 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 18:33:40 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T17:40:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0ec393875723dbb0019e7f255b064a0d',container_format='bare',created_at=2023-11-10T18:33:29Z,direct_url=<?>,disk_format='qcow2',id=a8ce0be9-64c0-4a57-8308-21c46198bdce,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-815606516',owner='aab3787fb375442288ea080aa156a326',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-10T18:33:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 18:33:40 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 18:33:40 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 18:33:40 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 18:33:40 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 18:33:40 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 18:33:40 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 18:33:40 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 18:33:40 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 18:33:40 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 18:33:40 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 18:33:40 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:33:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1650641924',display_name='tempest-TestStampPattern-server-1650641924',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1650641924',id=52,image_ref='a8ce0be9-64c0-4a57-8308-21c46198bdce',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLg1o8VEM12ucIF0jbu9iRsAi+yimtLWbBqy1yWv1lvMVGrEdaR9OpNE3a9kQ5XxDFdFpuI1a1qU/MhZ+OEp8MDnm6aGBwbckIWyJWH9mMzvKTXeZHDzkokpLOBFuU09oA==',key_name='tempest-TestStampPattern-794323654',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aab3787fb375442288ea080aa156a326',ramdisk_id='',reservation_id='r-xzcmz80x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='228d6943-f74a-40ed-b272-aa31c50ee879',image_min_disk='1',image_min_ram='0',image_owner_id='aab3787fb375442288ea080aa156a326',image_owner_project_name='tempest-TestStampPattern-1090834960',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1090834960-project-member',image_user_id='5c872b1827cd452aa3b47a80f448d317',network_allocated='True',owner_project_name='tempest-TestStampPattern-1090834960',owner_user_name='tempest-TestStampPattern-1090834960-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T18:33:37Z,user_data=None,user_id='5c872b1827cd452aa3b47a80f448d317',uuid=65cf69e9-ec9a-43a1-933b-ee89cfb42d22,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ddd53b42-4ddb-40d0-bfda-3ebe8125b1ae", "address": "fa:16:3e:05:c7:40", "network": {"id": "5cc7dc03-a2c6-488f-aefd-2160f3a9f300", "bridge": "br-int", "label": "tempest-TestStampPattern-1448697637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aab3787fb375442288ea080aa156a326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddd53b42-4d", "ovs_interfaceid": "ddd53b42-4ddb-40d0-bfda-3ebe8125b1ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 18:33:40 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Converting VIF {"id": "ddd53b42-4ddb-40d0-bfda-3ebe8125b1ae", "address": "fa:16:3e:05:c7:40", "network": {"id": "5cc7dc03-a2c6-488f-aefd-2160f3a9f300", "bridge": "br-int", "label": "tempest-TestStampPattern-1448697637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aab3787fb375442288ea080aa156a326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddd53b42-4d", "ovs_interfaceid": "ddd53b42-4ddb-40d0-bfda-3ebe8125b1ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:33:40 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:c7:40,bridge_name='br-int',has_traffic_filtering=True,id=ddd53b42-4ddb-40d0-bfda-3ebe8125b1ae,network=Network(5cc7dc03-a2c6-488f-aefd-2160f3a9f300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddd53b42-4d') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:33:40 user nova-compute[75100]: DEBUG nova.objects.instance [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Lazy-loading 'pci_devices' on Instance uuid 65cf69e9-ec9a-43a1-933b-ee89cfb42d22 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:33:40 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] End _get_guest_xml xml=<domain type="kvm">
Nov 10 18:33:40 user nova-compute[75100]:   <uuid>65cf69e9-ec9a-43a1-933b-ee89cfb42d22</uuid>
Nov 10 18:33:40 user nova-compute[75100]:   <name>instance-00000034</name>
Nov 10 18:33:40 user nova-compute[75100]:   <memory>524288</memory>
Nov 10 18:33:40 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 10 18:33:40 user nova-compute[75100]:   <metadata>
Nov 10 18:33:40 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 18:33:40 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 10 18:33:40 user nova-compute[75100]:       <nova:name>tempest-TestStampPattern-server-1650641924</nova:name>
Nov 10 18:33:40 user nova-compute[75100]:       <nova:creationTime>2023-11-10 18:33:40</nova:creationTime>
Nov 10 18:33:40 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 10 18:33:40 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 10 18:33:40 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 10 18:33:40 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 10 18:33:40 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 18:33:40 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 10 18:33:40 user nova-compute[75100]:       </nova:flavor>
Nov 10 18:33:40 user nova-compute[75100]:       <nova:owner>
Nov 10 18:33:40 user nova-compute[75100]:         <nova:user uuid="5c872b1827cd452aa3b47a80f448d317">tempest-TestStampPattern-1090834960-project-member</nova:user>
Nov 10 18:33:40 user nova-compute[75100]:         <nova:project uuid="aab3787fb375442288ea080aa156a326">tempest-TestStampPattern-1090834960</nova:project>
Nov 10 18:33:40 user nova-compute[75100]:       </nova:owner>
Nov 10 18:33:40 user nova-compute[75100]:       <nova:root type="image" uuid="a8ce0be9-64c0-4a57-8308-21c46198bdce"/>
Nov 10 18:33:40 user nova-compute[75100]:       <nova:ports>
Nov 10 18:33:40 user nova-compute[75100]:         <nova:port uuid="ddd53b42-4ddb-40d0-bfda-3ebe8125b1ae">
Nov 10 18:33:40 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 10 18:33:40 user nova-compute[75100]:         </nova:port>
Nov 10 18:33:40 user nova-compute[75100]:       </nova:ports>
Nov 10 18:33:40 user nova-compute[75100]:     </nova:instance>
Nov 10 18:33:40 user nova-compute[75100]:   </metadata>
Nov 10 18:33:40 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 10 18:33:40 user nova-compute[75100]:     <system>
Nov 10 18:33:40 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 18:33:40 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 10 18:33:40 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 10 18:33:40 user nova-compute[75100]:       <entry name="serial">65cf69e9-ec9a-43a1-933b-ee89cfb42d22</entry>
Nov 10 18:33:40 user nova-compute[75100]:       <entry name="uuid">65cf69e9-ec9a-43a1-933b-ee89cfb42d22</entry>
Nov 10 18:33:40 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 10 18:33:40 user nova-compute[75100]:     </system>
Nov 10 18:33:40 user nova-compute[75100]:   </sysinfo>
Nov 10 18:33:40 user nova-compute[75100]:   <os>
Nov 10 18:33:40 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 18:33:40 user nova-compute[75100]:     <boot dev="hd"/>
Nov 10 18:33:40 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 10 18:33:40 user nova-compute[75100]:   </os>
Nov 10 18:33:40 user nova-compute[75100]:   <features>
Nov 10 18:33:40 user nova-compute[75100]:     <acpi/>
Nov 10 18:33:40 user nova-compute[75100]:     <apic/>
Nov 10 18:33:40 user nova-compute[75100]:     <vmcoreinfo/>
Nov 10 18:33:40 user nova-compute[75100]:   </features>
Nov 10 18:33:40 user nova-compute[75100]:   <clock offset="utc">
Nov 10 18:33:40 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 18:33:40 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 18:33:40 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 10 18:33:40 user nova-compute[75100]:   </clock>
Nov 10 18:33:40 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 10 18:33:40 user nova-compute[75100]:     <model>Nehalem</model>
Nov 10 18:33:40 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 18:33:40 user nova-compute[75100]:   </cpu>
Nov 10 18:33:40 user nova-compute[75100]:   <devices>
Nov 10 18:33:40 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 10 18:33:40 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 18:33:40 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/65cf69e9-ec9a-43a1-933b-ee89cfb42d22/disk"/>
Nov 10 18:33:40 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 10 18:33:40 user nova-compute[75100]:     </disk>
Nov 10 18:33:40 user nova-compute[75100]:     <interface type="ethernet">
Nov 10 18:33:40 user nova-compute[75100]:       <mac address="fa:16:3e:05:c7:40"/>
Nov 10 18:33:40 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 18:33:40 user nova-compute[75100]:       <mtu size="1442"/>
Nov 10 18:33:40 user nova-compute[75100]:       <target dev="tapddd53b42-4d"/>
Nov 10 18:33:40 user nova-compute[75100]:     </interface>
Nov 10 18:33:40 user nova-compute[75100]:     <serial type="pty">
Nov 10 18:33:40 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/65cf69e9-ec9a-43a1-933b-ee89cfb42d22/console.log" append="off"/>
Nov 10 18:33:40 user nova-compute[75100]:     </serial>
Nov 10 18:33:40 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 18:33:40 user nova-compute[75100]:     <video>
Nov 10 18:33:40 user nova-compute[75100]:       <model type="virtio"/>
Nov 10 18:33:40 user nova-compute[75100]:     </video>
Nov 10 18:33:40 user nova-compute[75100]:     <rng model="virtio">
Nov 10 18:33:40 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 10 18:33:40 user nova-compute[75100]:     </rng>
Nov 10 18:33:40 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 10 18:33:40 user nova-compute[75100]:     <memballoon model="virtio">
Nov 10 18:33:40 user nova-compute[75100]:       <stats period="10"/>
Nov 10 18:33:40 user nova-compute[75100]:     </memballoon>
Nov 10 18:33:40 user nova-compute[75100]:   </devices>
Nov 10 18:33:40 user nova-compute[75100]: </domain>
Nov 10 18:33:40 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 18:33:40 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:33:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1650641924',display_name='tempest-TestStampPattern-server-1650641924',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1650641924',id=52,image_ref='a8ce0be9-64c0-4a57-8308-21c46198bdce',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLg1o8VEM12ucIF0jbu9iRsAi+yimtLWbBqy1yWv1lvMVGrEdaR9OpNE3a9kQ5XxDFdFpuI1a1qU/MhZ+OEp8MDnm6aGBwbckIWyJWH9mMzvKTXeZHDzkokpLOBFuU09oA==',key_name='tempest-TestStampPattern-794323654',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aab3787fb375442288ea080aa156a326',ramdisk_id='',reservation_id='r-xzcmz80x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='228d6943-f74a-40ed-b272-aa31c50ee879',image_min_disk='1',image_min_ram='0',image_owner_id='aab3787fb375442288ea080aa156a326',image_owner_project_name='tempest-TestStampPattern-1090834960',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1090834960-project-member',image_user_id='5c872b1827cd452aa3b47a80f448d317',network_allocated='True',owner_project_name='tempest-TestStampPattern-1090834960',owner_user_name='tempest-TestStampPattern-1090834960-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T18:33:37Z,user_data=None,user_id='5c872b1827cd452aa3b47a80f448d317',uuid=65cf69e9-ec9a-43a1-933b-ee89cfb42d22,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ddd53b42-4ddb-40d0-bfda-3ebe8125b1ae", "address": "fa:16:3e:05:c7:40", "network": {"id": "5cc7dc03-a2c6-488f-aefd-2160f3a9f300", "bridge": "br-int", "label": "tempest-TestStampPattern-1448697637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aab3787fb375442288ea080aa156a326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddd53b42-4d", "ovs_interfaceid": "ddd53b42-4ddb-40d0-bfda-3ebe8125b1ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 18:33:40 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Converting VIF {"id": "ddd53b42-4ddb-40d0-bfda-3ebe8125b1ae", "address": "fa:16:3e:05:c7:40", "network": {"id": "5cc7dc03-a2c6-488f-aefd-2160f3a9f300", "bridge": "br-int", "label": "tempest-TestStampPattern-1448697637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aab3787fb375442288ea080aa156a326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddd53b42-4d", "ovs_interfaceid": "ddd53b42-4ddb-40d0-bfda-3ebe8125b1ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:33:40 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:c7:40,bridge_name='br-int',has_traffic_filtering=True,id=ddd53b42-4ddb-40d0-bfda-3ebe8125b1ae,network=Network(5cc7dc03-a2c6-488f-aefd-2160f3a9f300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddd53b42-4d') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:33:40 user nova-compute[75100]: DEBUG os_vif [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:c7:40,bridge_name='br-int',has_traffic_filtering=True,id=ddd53b42-4ddb-40d0-bfda-3ebe8125b1ae,network=Network(5cc7dc03-a2c6-488f-aefd-2160f3a9f300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddd53b42-4d') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 18:33:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:33:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:33:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 18:33:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:33:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '53db0409-1851-5f92-8084-8cf1de547420', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:33:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:33:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:33:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:33:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapddd53b42-4d, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:33:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapddd53b42-4d, col_values=(('qos', UUID('d65976ed-4dfa-47e0-8d56-083be07aab33')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:33:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapddd53b42-4d, col_values=(('external_ids', {'iface-id': 'ddd53b42-4ddb-40d0-bfda-3ebe8125b1ae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:c7:40', 'vm-uuid': '65cf69e9-ec9a-43a1-933b-ee89cfb42d22'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:33:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:33:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:33:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:33:40 user nova-compute[75100]: INFO os_vif [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:c7:40,bridge_name='br-int',has_traffic_filtering=True,id=ddd53b42-4ddb-40d0-bfda-3ebe8125b1ae,network=Network(5cc7dc03-a2c6-488f-aefd-2160f3a9f300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddd53b42-4d')
Nov 10 18:33:40 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 18:33:40 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] No VIF found with MAC fa:16:3e:05:c7:40, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 18:33:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:33:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:33:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:33:42 user nova-compute[75100]: DEBUG nova.compute.manager [req-2a41a2db-482c-4eb2-9278-0a548e17040f req-c58070af-d20b-4adf-970b-c78ee15d356e service nova] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Received event network-vif-plugged-ddd53b42-4ddb-40d0-bfda-3ebe8125b1ae {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:33:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2a41a2db-482c-4eb2-9278-0a548e17040f req-c58070af-d20b-4adf-970b-c78ee15d356e service nova] Acquiring lock "65cf69e9-ec9a-43a1-933b-ee89cfb42d22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:33:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2a41a2db-482c-4eb2-9278-0a548e17040f req-c58070af-d20b-4adf-970b-c78ee15d356e service nova] Lock "65cf69e9-ec9a-43a1-933b-ee89cfb42d22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:33:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2a41a2db-482c-4eb2-9278-0a548e17040f req-c58070af-d20b-4adf-970b-c78ee15d356e service nova] Lock "65cf69e9-ec9a-43a1-933b-ee89cfb42d22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:33:42 user nova-compute[75100]: DEBUG nova.compute.manager [req-2a41a2db-482c-4eb2-9278-0a548e17040f req-c58070af-d20b-4adf-970b-c78ee15d356e service nova] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] No waiting events found dispatching network-vif-plugged-ddd53b42-4ddb-40d0-bfda-3ebe8125b1ae {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:33:42 user nova-compute[75100]: WARNING nova.compute.manager [req-2a41a2db-482c-4eb2-9278-0a548e17040f req-c58070af-d20b-4adf-970b-c78ee15d356e service nova] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Received unexpected event network-vif-plugged-ddd53b42-4ddb-40d0-bfda-3ebe8125b1ae for instance with vm_state building and task_state spawning.
Nov 10 18:33:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:33:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:33:44 user nova-compute[75100]: DEBUG nova.compute.manager [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 18:33:44 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 18:33:44 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Instance spawned successfully.
Nov 10 18:33:44 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 18:33:44 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:33:44 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 18:33:44 user nova-compute[75100]: DEBUG nova.compute.manager [req-fa231736-100c-420c-b661-65b45b4d4a0a req-547b6e16-4f1e-4fc5-a185-91a9c90861ec service nova] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Received event network-vif-plugged-ddd53b42-4ddb-40d0-bfda-3ebe8125b1ae {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:33:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-fa231736-100c-420c-b661-65b45b4d4a0a req-547b6e16-4f1e-4fc5-a185-91a9c90861ec service nova] Acquiring lock "65cf69e9-ec9a-43a1-933b-ee89cfb42d22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:33:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-fa231736-100c-420c-b661-65b45b4d4a0a req-547b6e16-4f1e-4fc5-a185-91a9c90861ec service nova] Lock "65cf69e9-ec9a-43a1-933b-ee89cfb42d22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:33:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-fa231736-100c-420c-b661-65b45b4d4a0a req-547b6e16-4f1e-4fc5-a185-91a9c90861ec service nova] Lock "65cf69e9-ec9a-43a1-933b-ee89cfb42d22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:33:44 user nova-compute[75100]: DEBUG nova.compute.manager [req-fa231736-100c-420c-b661-65b45b4d4a0a req-547b6e16-4f1e-4fc5-a185-91a9c90861ec service nova] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] No waiting events found dispatching network-vif-plugged-ddd53b42-4ddb-40d0-bfda-3ebe8125b1ae {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:33:44 user nova-compute[75100]: WARNING nova.compute.manager [req-fa231736-100c-420c-b661-65b45b4d4a0a req-547b6e16-4f1e-4fc5-a185-91a9c90861ec service nova] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Received unexpected event network-vif-plugged-ddd53b42-4ddb-40d0-bfda-3ebe8125b1ae for instance with vm_state building and task_state spawning.
Nov 10 18:33:44 user nova-compute[75100]: INFO nova.compute.manager [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Took 6.87 seconds to spawn the instance on the hypervisor.
Nov 10 18:33:44 user nova-compute[75100]: DEBUG nova.compute.manager [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 18:33:44 user nova-compute[75100]: INFO nova.compute.manager [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Took 7.48 seconds to build instance.
Nov 10 18:33:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a78c6cf1-1029-4281-aaf2-4a659b758c54 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Lock "65cf69e9-ec9a-43a1-933b-ee89cfb42d22" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.584s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:33:44 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:33:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:33:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:33:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:33:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:33:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:33:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:33:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:33:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:33:51 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:33:54 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:33:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:33:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:33:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:33:54 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 18:33:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228d6943-f74a-40ed-b272-aa31c50ee879/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:33:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228d6943-f74a-40ed-b272-aa31c50ee879/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:33:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228d6943-f74a-40ed-b272-aa31c50ee879/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:33:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228d6943-f74a-40ed-b272-aa31c50ee879/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:33:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65cf69e9-ec9a-43a1-933b-ee89cfb42d22/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:33:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65cf69e9-ec9a-43a1-933b-ee89cfb42d22/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:33:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65cf69e9-ec9a-43a1-933b-ee89cfb42d22/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:33:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65cf69e9-ec9a-43a1-933b-ee89cfb42d22/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:33:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:33:55 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:33:55 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:33:55 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Hypervisor/Node resource view: name=user free_ram=8837MB free_disk=24.250125885009766GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 18:33:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:33:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:33:55 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 228d6943-f74a-40ed-b272-aa31c50ee879 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:33:55 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 65cf69e9-ec9a-43a1-933b-ee89cfb42d22 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:33:55 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 18:33:55 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 18:33:55 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:33:55 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:33:55 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 18:33:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.214s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:34:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:34:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:34:00 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:34:00 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:34:00 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 18:34:00 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Rebuilding the list of instances to heal {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 18:34:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "refresh_cache-228d6943-f74a-40ed-b272-aa31c50ee879" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:34:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquired lock "refresh_cache-228d6943-f74a-40ed-b272-aa31c50ee879" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:34:00 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 18:34:00 user nova-compute[75100]: DEBUG nova.objects.instance [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lazy-loading 'info_cache' on Instance uuid 228d6943-f74a-40ed-b272-aa31c50ee879 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:34:01 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Updating instance_info_cache with network_info: [{"id": "963a800b-186d-457e-b83e-410214f7f92d", "address": "fa:16:3e:80:31:f9", "network": {"id": "5cc7dc03-a2c6-488f-aefd-2160f3a9f300", "bridge": "br-int", "label": "tempest-TestStampPattern-1448697637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aab3787fb375442288ea080aa156a326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap963a800b-18", "ovs_interfaceid": "963a800b-186d-457e-b83e-410214f7f92d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:34:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Releasing lock "refresh_cache-228d6943-f74a-40ed-b272-aa31c50ee879" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:34:01 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 18:34:01 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:34:01 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:34:04 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:34:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:34:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:34:08 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:34:08 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 18:34:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:34:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:34:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:34:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:34:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:34:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:34:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:34:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:34:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:34:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:34:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:34:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:34:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:34:45 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:34:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:34:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:34:52 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:34:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:34:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:34:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:34:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:34:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:34:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:34:56 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:34:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:34:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:34:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:34:56 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 18:34:56 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228d6943-f74a-40ed-b272-aa31c50ee879/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:34:56 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228d6943-f74a-40ed-b272-aa31c50ee879/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:34:56 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228d6943-f74a-40ed-b272-aa31c50ee879/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:34:56 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228d6943-f74a-40ed-b272-aa31c50ee879/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:34:56 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65cf69e9-ec9a-43a1-933b-ee89cfb42d22/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:34:56 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65cf69e9-ec9a-43a1-933b-ee89cfb42d22/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:34:56 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65cf69e9-ec9a-43a1-933b-ee89cfb42d22/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:34:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65cf69e9-ec9a-43a1-933b-ee89cfb42d22/disk --force-share --output=json" returned: 0 in 0.357s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:34:57 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:34:57 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:34:57 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Hypervisor/Node resource view: name=user free_ram=8923MB free_disk=24.249061584472656GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 18:34:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:34:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:34:57 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 228d6943-f74a-40ed-b272-aa31c50ee879 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:34:57 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 65cf69e9-ec9a-43a1-933b-ee89cfb42d22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:34:57 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 18:34:57 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 18:34:57 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:34:57 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:34:57 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 18:34:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.190s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:35:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:35:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:35:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:35:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:35:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:35:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:35:00 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:35:00 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:35:00 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 18:35:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "refresh_cache-65cf69e9-ec9a-43a1-933b-ee89cfb42d22" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:35:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquired lock "refresh_cache-65cf69e9-ec9a-43a1-933b-ee89cfb42d22" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:35:01 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 18:35:01 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Updating instance_info_cache with network_info: [{"id": "ddd53b42-4ddb-40d0-bfda-3ebe8125b1ae", "address": "fa:16:3e:05:c7:40", "network": {"id": "5cc7dc03-a2c6-488f-aefd-2160f3a9f300", "bridge": "br-int", "label": "tempest-TestStampPattern-1448697637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aab3787fb375442288ea080aa156a326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddd53b42-4d", "ovs_interfaceid": "ddd53b42-4ddb-40d0-bfda-3ebe8125b1ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:35:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Releasing lock "refresh_cache-65cf69e9-ec9a-43a1-933b-ee89cfb42d22" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:35:01 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 18:35:01 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:35:03 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:35:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:35:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:35:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:35:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:35:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:35:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:35:06 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:35:07 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:35:10 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:35:10 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 18:35:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:35:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:35:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:35:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:35:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:35:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:35:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:35:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:35:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:35:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:35:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:35:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:35:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:35:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:35:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:35:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:35:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:35:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:35:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:35:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:35:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:35:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:35:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:35:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:35:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:35:28 user nova-compute[75100]: DEBUG nova.compute.manager [req-196d00e4-7145-480c-995f-ea6b120526b8 req-c7c4f03f-2df3-4fdf-950f-2b5dbd5f1b11 service nova] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Received event network-changed-ddd53b42-4ddb-40d0-bfda-3ebe8125b1ae {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:35:28 user nova-compute[75100]: DEBUG nova.compute.manager [req-196d00e4-7145-480c-995f-ea6b120526b8 req-c7c4f03f-2df3-4fdf-950f-2b5dbd5f1b11 service nova] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Refreshing instance network info cache due to event network-changed-ddd53b42-4ddb-40d0-bfda-3ebe8125b1ae. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 18:35:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-196d00e4-7145-480c-995f-ea6b120526b8 req-c7c4f03f-2df3-4fdf-950f-2b5dbd5f1b11 service nova] Acquiring lock "refresh_cache-65cf69e9-ec9a-43a1-933b-ee89cfb42d22" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:35:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-196d00e4-7145-480c-995f-ea6b120526b8 req-c7c4f03f-2df3-4fdf-950f-2b5dbd5f1b11 service nova] Acquired lock "refresh_cache-65cf69e9-ec9a-43a1-933b-ee89cfb42d22" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:35:28 user nova-compute[75100]: DEBUG nova.network.neutron [req-196d00e4-7145-480c-995f-ea6b120526b8 req-c7c4f03f-2df3-4fdf-950f-2b5dbd5f1b11 service nova] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Refreshing network info cache for port ddd53b42-4ddb-40d0-bfda-3ebe8125b1ae {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 18:35:29 user nova-compute[75100]: DEBUG nova.network.neutron [req-196d00e4-7145-480c-995f-ea6b120526b8 req-c7c4f03f-2df3-4fdf-950f-2b5dbd5f1b11 service nova] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Updated VIF entry in instance network info cache for port ddd53b42-4ddb-40d0-bfda-3ebe8125b1ae. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 18:35:29 user nova-compute[75100]: DEBUG nova.network.neutron [req-196d00e4-7145-480c-995f-ea6b120526b8 req-c7c4f03f-2df3-4fdf-950f-2b5dbd5f1b11 service nova] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Updating instance_info_cache with network_info: [{"id": "ddd53b42-4ddb-40d0-bfda-3ebe8125b1ae", "address": "fa:16:3e:05:c7:40", "network": {"id": "5cc7dc03-a2c6-488f-aefd-2160f3a9f300", "bridge": "br-int", "label": "tempest-TestStampPattern-1448697637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aab3787fb375442288ea080aa156a326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddd53b42-4d", "ovs_interfaceid": "ddd53b42-4ddb-40d0-bfda-3ebe8125b1ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:35:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-196d00e4-7145-480c-995f-ea6b120526b8 req-c7c4f03f-2df3-4fdf-950f-2b5dbd5f1b11 service nova] Releasing lock "refresh_cache-65cf69e9-ec9a-43a1-933b-ee89cfb42d22" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:35:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8c075193-cd51-4215-8e31-f1b546804bf4 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Acquiring lock "65cf69e9-ec9a-43a1-933b-ee89cfb42d22" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:35:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8c075193-cd51-4215-8e31-f1b546804bf4 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Lock "65cf69e9-ec9a-43a1-933b-ee89cfb42d22" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:35:30 user nova-compute[75100]: DEBUG nova.objects.instance [None req-8c075193-cd51-4215-8e31-f1b546804bf4 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Lazy-loading 'flavor' on Instance uuid 65cf69e9-ec9a-43a1-933b-ee89cfb42d22 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:35:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8c075193-cd51-4215-8e31-f1b546804bf4 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Lock "65cf69e9-ec9a-43a1-933b-ee89cfb42d22" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:35:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8c075193-cd51-4215-8e31-f1b546804bf4 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Acquiring lock "65cf69e9-ec9a-43a1-933b-ee89cfb42d22" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:35:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8c075193-cd51-4215-8e31-f1b546804bf4 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Lock "65cf69e9-ec9a-43a1-933b-ee89cfb42d22" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:35:30 user nova-compute[75100]: INFO nova.compute.manager [None req-8c075193-cd51-4215-8e31-f1b546804bf4 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Attaching volume bb5326ea-790a-40ab-858c-65de8e9f5ead to /dev/vdb
Nov 10 18:35:30 user nova-compute[75100]: DEBUG os_brick.utils [None req-8c075193-cd51-4215-8e31-f1b546804bf4 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:35:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:35:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:35:30 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3dba0a-009c-48e6-9265-4d011b6b81b0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:90b1a229568f\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:35:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:35:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:35:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:35:30 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[deec1b43-bed8-41d6-9f7f-46a86392bb30]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:35:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:35:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:35:30 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf75a55e-e2b0-4bb6-9176-6ad724ed7525]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:35:30 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a5a966-205c-4b70-98fe-6450b7306f34]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:35:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-8c075193-cd51-4215-8e31-f1b546804bf4 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:35:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-8c075193-cd51-4215-8e31-f1b546804bf4 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 18:35:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8c075193-cd51-4215-8e31-f1b546804bf4 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 18:35:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:35:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 18:35:30 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 18:35:30 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba67323-9483-43d1-8f11-b714c49346fa]: (4, '') {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:35:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-8c075193-cd51-4215-8e31-f1b546804bf4 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 18:35:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-8c075193-cd51-4215-8e31-f1b546804bf4 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 18:35:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-8c075193-cd51-4215-8e31-f1b546804bf4 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 18:35:30 user nova-compute[75100]: DEBUG os_brick.utils [None req-8c075193-cd51-4215-8e31-f1b546804bf4 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:90b1a229568f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:35:30 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-8c075193-cd51-4215-8e31-f1b546804bf4 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Updating existing volume attachment record: 9aa24412-5d07-4c07-a5c4-91f1ed301e9c {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 18:35:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:35:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:35:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:35:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:35:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:35:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:35:46 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:35:49 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:35:49 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75100) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 18:35:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:35:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:35:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:35:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:35:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:35:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:35:53 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c075193-cd51-4215-8e31-f1b546804bf4 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 18:35:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c075193-cd51-4215-8e31-f1b546804bf4 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bb5326ea-790a-40ab-858c-65de8e9f5ead', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TMqlXegA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:35:53 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-8c075193-cd51-4215-8e31-f1b546804bf4 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:35:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-8c075193-cd51-4215-8e31-f1b546804bf4 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:35:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-8c075193-cd51-4215-8e31-f1b546804bf4 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:35:53 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-8c075193-cd51-4215-8e31-f1b546804bf4 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:35:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-8c075193-cd51-4215-8e31-f1b546804bf4 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb5326ea-790a-40ab-858c-65de8e9f5ead" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:35:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-8c075193-cd51-4215-8e31-f1b546804bf4 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb5326ea-790a-40ab-858c-65de8e9f5ead" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:35:53 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-8c075193-cd51-4215-8e31-f1b546804bf4 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 18:35:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb5326ea-790a-40ab-858c-65de8e9f5ead -p 172.16.0.220:3260 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:35:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb5326ea-790a-40ab-858c-65de8e9f5ead -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:35:53 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a3074d4-ca1b-4fd2-af91-e23f36eab4ae]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:35:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c075193-cd51-4215-8e31-f1b546804bf4 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 18:35:53 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:35:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb5326ea-790a-40ab-858c-65de8e9f5ead -p 172.16.0.220:3260 --interface default --op new {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:35:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb5326ea-790a-40ab-858c-65de8e9f5ead -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:35:53 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc71f8c5-3325-41f5-b6dd-a39226b68328]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb5326ea-790a-40ab-858c-65de8e9f5ead] added\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:35:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c075193-cd51-4215-8e31-f1b546804bf4 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb5326ea-790a-40ab-858c-65de8e9f5ead] added
Nov 10 18:35:53 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:35:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb5326ea-790a-40ab-858c-65de8e9f5ead -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:35:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb5326ea-790a-40ab-858c-65de8e9f5ead -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:35:53 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5722e32-2a75-4dfe-8c6d-65ee4cf9b406]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:35:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c075193-cd51-4215-8e31-f1b546804bf4 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:35:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb5326ea-790a-40ab-858c-65de8e9f5ead -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:35:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb5326ea-790a-40ab-858c-65de8e9f5ead -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:35:53 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f589a901-ed87-4e43-8b70-a2d5eaea2f0f]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:35:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c075193-cd51-4215-8e31-f1b546804bf4 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:35:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb5326ea-790a-40ab-858c-65de8e9f5ead -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TMqlXegA {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:35:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb5326ea-790a-40ab-858c-65de8e9f5ead -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TMqlXegA" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:35:53 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[83cbecda-8f41-4c81-8612-6edd6117f7ef]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:35:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c075193-cd51-4215-8e31-f1b546804bf4 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TMqlXegA'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:35:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb5326ea-790a-40ab-858c-65de8e9f5ead -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:35:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb5326ea-790a-40ab-858c-65de8e9f5ead -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:35:53 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cef8995-cf8a-4cc3-a5c6-c29087eab20a]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:35:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c075193-cd51-4215-8e31-f1b546804bf4 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:35:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:35:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:35:53 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0128ec5-add9-4998-97dc-0722072afa3b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:35:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c075193-cd51-4215-8e31-f1b546804bf4 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 10 18:35:53 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:35:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c075193-cd51-4215-8e31-f1b546804bf4 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 10 18:35:53 user nova-compute[75100]:  {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:35:53 user nova-compute[75100]: WARNING os_brick.initiator.connectors.iscsi [None req-8c075193-cd51-4215-8e31-f1b546804bf4 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 10 18:35:53 user nova-compute[75100]: 
Nov 10 18:35:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb5326ea-790a-40ab-858c-65de8e9f5ead -p 172.16.0.220:3260 --login {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:35:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb5326ea-790a-40ab-858c-65de8e9f5ead -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:35:53 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b224d287-a32c-4eac-bd0f-0adc2d30de98]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb5326ea-790a-40ab-858c-65de8e9f5ead, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bb5326ea-790a-40ab-858c-65de8e9f5ead, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:35:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c075193-cd51-4215-8e31-f1b546804bf4 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb5326ea-790a-40ab-858c-65de8e9f5ead, portal: 172.16.0.220,3260]
Nov 10 18:35:53 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:bb5326ea-790a-40ab-858c-65de8e9f5ead, portal: 172.16.0.220,3260] successful.
Nov 10 18:35:53 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:35:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb5326ea-790a-40ab-858c-65de8e9f5ead -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:35:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb5326ea-790a-40ab-858c-65de8e9f5ead -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:35:53 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[103d8fa3-8042-485f-8d4d-7ed79c191a60]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:35:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c075193-cd51-4215-8e31-f1b546804bf4 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:35:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:35:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:35:53 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbaf7d64-059b-4178-944e-1033c33c0f86]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5326ea-790a-40ab-858c-65de8e9f5ead (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:35:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c075193-cd51-4215-8e31-f1b546804bf4 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5326ea-790a-40ab-858c-65de8e9f5ead (non-flash)
Nov 10 18:35:53 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:35:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c075193-cd51-4215-8e31-f1b546804bf4 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5326ea-790a-40ab-858c-65de8e9f5ead (non-flash)
Nov 10 18:35:53 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:35:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-8c075193-cd51-4215-8e31-f1b546804bf4 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb5326ea-790a-40ab-858c-65de8e9f5ead" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:35:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c075193-cd51-4215-8e31-f1b546804bf4 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 18:35:53 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-8c075193-cd51-4215-8e31-f1b546804bf4 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 18:35:53 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-8c075193-cd51-4215-8e31-f1b546804bf4 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 18:35:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:35:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:35:53 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2dc174d-ee42-41d5-ac99-654f7040a81a]: (4, ('- - 0', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:35:53 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-8c075193-cd51-4215-8e31-f1b546804bf4 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: None {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 18:35:54 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:35:54 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-8c075193-cd51-4215-8e31-f1b546804bf4 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 18:35:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c075193-cd51-4215-8e31-f1b546804bf4 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:bb5326ea-790a-40ab-858c-65de8e9f5ead', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TMqlXegA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 18:35:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-8c075193-cd51-4215-8e31-f1b546804bf4 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:35:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c075193-cd51-4215-8e31-f1b546804bf4 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '26164353738346538', 'path': '/dev/sdb'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:35:54 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c075193-cd51-4215-8e31-f1b546804bf4 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26164353738346538', 'path': '/dev/sdb'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 18:35:54 user nova-compute[75100]: DEBUG nova.objects.instance [None req-8c075193-cd51-4215-8e31-f1b546804bf4 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Lazy-loading 'flavor' on Instance uuid 65cf69e9-ec9a-43a1-933b-ee89cfb42d22 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:35:54 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-8c075193-cd51-4215-8e31-f1b546804bf4 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 18:35:54 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:35:54 user nova-compute[75100]:   <source dev="/dev/sdb"/>
Nov 10 18:35:54 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 18:35:54 user nova-compute[75100]:   <serial>bb5326ea-790a-40ab-858c-65de8e9f5ead</serial>
Nov 10 18:35:54 user nova-compute[75100]: </disk>
Nov 10 18:35:54 user nova-compute[75100]:  {{(pid=75100) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 18:35:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8c075193-cd51-4215-8e31-f1b546804bf4 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 18:35:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8c075193-cd51-4215-8e31-f1b546804bf4 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 18:35:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8c075193-cd51-4215-8e31-f1b546804bf4 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] No VIF found with MAC fa:16:3e:05:c7:40, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 18:35:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8c075193-cd51-4215-8e31-f1b546804bf4 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Lock "65cf69e9-ec9a-43a1-933b-ee89cfb42d22" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.073s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:35:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:35:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:35:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:35:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:35:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:35:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:35:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7656139d-cff5-46c1-836b-29c67aa24e3c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Acquiring lock "65cf69e9-ec9a-43a1-933b-ee89cfb42d22" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:35:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7656139d-cff5-46c1-836b-29c67aa24e3c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Lock "65cf69e9-ec9a-43a1-933b-ee89cfb42d22" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:35:57 user nova-compute[75100]: INFO nova.compute.manager [None req-7656139d-cff5-46c1-836b-29c67aa24e3c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Detaching volume bb5326ea-790a-40ab-858c-65de8e9f5ead
Nov 10 18:35:57 user nova-compute[75100]: INFO nova.virt.block_device [None req-7656139d-cff5-46c1-836b-29c67aa24e3c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Attempting to driver detach volume bb5326ea-790a-40ab-858c-65de8e9f5ead from mountpoint /dev/vdb
Nov 10 18:35:57 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7656139d-cff5-46c1-836b-29c67aa24e3c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Attempting to detach device vdb from instance 65cf69e9-ec9a-43a1-933b-ee89cfb42d22 from the persistent domain config. {{(pid=75100) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 18:35:57 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-7656139d-cff5-46c1-836b-29c67aa24e3c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 18:35:57 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:35:57 user nova-compute[75100]:   <source dev="/dev/sdb"/>
Nov 10 18:35:57 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 18:35:57 user nova-compute[75100]:   <serial>bb5326ea-790a-40ab-858c-65de8e9f5ead</serial>
Nov 10 18:35:57 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 18:35:57 user nova-compute[75100]: </disk>
Nov 10 18:35:57 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 18:35:57 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-7656139d-cff5-46c1-836b-29c67aa24e3c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Successfully detached device vdb from instance 65cf69e9-ec9a-43a1-933b-ee89cfb42d22 from the persistent domain config.
Nov 10 18:35:57 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7656139d-cff5-46c1-836b-29c67aa24e3c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 65cf69e9-ec9a-43a1-933b-ee89cfb42d22 from the live domain config. {{(pid=75100) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 18:35:57 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-7656139d-cff5-46c1-836b-29c67aa24e3c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 18:35:57 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 18:35:57 user nova-compute[75100]:   <source dev="/dev/sdb"/>
Nov 10 18:35:57 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 10 18:35:57 user nova-compute[75100]:   <serial>bb5326ea-790a-40ab-858c-65de8e9f5ead</serial>
Nov 10 18:35:57 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 18:35:57 user nova-compute[75100]: </disk>
Nov 10 18:35:57 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 18:35:57 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:35:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:35:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:35:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:35:57 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 18:35:57 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7656139d-cff5-46c1-836b-29c67aa24e3c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 65cf69e9-ec9a-43a1-933b-ee89cfb42d22 {{(pid=75100) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 18:35:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228d6943-f74a-40ed-b272-aa31c50ee879/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:35:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228d6943-f74a-40ed-b272-aa31c50ee879/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:35:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228d6943-f74a-40ed-b272-aa31c50ee879/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:35:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228d6943-f74a-40ed-b272-aa31c50ee879/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:35:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65cf69e9-ec9a-43a1-933b-ee89cfb42d22/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:35:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65cf69e9-ec9a-43a1-933b-ee89cfb42d22/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:35:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65cf69e9-ec9a-43a1-933b-ee89cfb42d22/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:35:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65cf69e9-ec9a-43a1-933b-ee89cfb42d22/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:35:58 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:35:58 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:35:58 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Hypervisor/Node resource view: name=user free_ram=8908MB free_disk=24.240215301513672GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 18:35:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:35:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:35:58 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 228d6943-f74a-40ed-b272-aa31c50ee879 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:35:58 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 65cf69e9-ec9a-43a1-933b-ee89cfb42d22 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:35:58 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 18:35:58 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 18:35:59 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:35:59 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:35:59 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 18:35:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.307s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:36:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:36:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:36:03 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:36:03 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:36:03 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 18:36:03 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Rebuilding the list of instances to heal {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 18:36:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "refresh_cache-228d6943-f74a-40ed-b272-aa31c50ee879" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:36:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquired lock "refresh_cache-228d6943-f74a-40ed-b272-aa31c50ee879" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:36:03 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 18:36:03 user nova-compute[75100]: DEBUG nova.objects.instance [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lazy-loading 'info_cache' on Instance uuid 228d6943-f74a-40ed-b272-aa31c50ee879 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:36:03 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Updating instance_info_cache with network_info: [{"id": "963a800b-186d-457e-b83e-410214f7f92d", "address": "fa:16:3e:80:31:f9", "network": {"id": "5cc7dc03-a2c6-488f-aefd-2160f3a9f300", "bridge": "br-int", "label": "tempest-TestStampPattern-1448697637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aab3787fb375442288ea080aa156a326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap963a800b-18", "ovs_interfaceid": "963a800b-186d-457e-b83e-410214f7f92d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:36:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Releasing lock "refresh_cache-228d6943-f74a-40ed-b272-aa31c50ee879" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:36:03 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 18:36:03 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:36:04 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:36:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:36:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:36:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:36:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:36:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:36:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:36:08 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:36:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:36:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:36:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:36:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:36:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:36:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:36:11 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:36:11 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 18:36:12 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:36:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:36:17 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-7656139d-cff5-46c1-836b-29c67aa24e3c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 65cf69e9-ec9a-43a1-933b-ee89cfb42d22 is timed out.
Nov 10 18:36:17 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-7656139d-cff5-46c1-836b-29c67aa24e3c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Successfully detached device vdb from instance 65cf69e9-ec9a-43a1-933b-ee89cfb42d22 from the live domain config.
Nov 10 18:36:17 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7656139d-cff5-46c1-836b-29c67aa24e3c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 18:36:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7656139d-cff5-46c1-836b-29c67aa24e3c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3bc7a2ce0>, {'target_iqn': 'iqn.2010-10.org.openstack:bb5326ea-790a-40ab-858c-65de8e9f5ead', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TMqlXegA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 18:36:17 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-7656139d-cff5-46c1-836b-29c67aa24e3c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 18:36:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-7656139d-cff5-46c1-836b-29c67aa24e3c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 18:36:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-7656139d-cff5-46c1-836b-29c67aa24e3c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 18:36:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:36:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:36:17 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2368ac94-b005-43fb-9e34-b9a3f1726d4f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bb5326ea-790a-40ab-858c-65de8e9f5ead\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:36:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7656139d-cff5-46c1-836b-29c67aa24e3c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 18:36:17 user nova-compute[75100]: No targets found.
Nov 10 18:36:17 user nova-compute[75100]: iSNS:
Nov 10 18:36:17 user nova-compute[75100]: No targets found.
Nov 10 18:36:17 user nova-compute[75100]: STATIC:
Nov 10 18:36:17 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:bb5326ea-790a-40ab-858c-65de8e9f5ead
Nov 10 18:36:17 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 10 18:36:17 user nova-compute[75100]:                 Iface Name: default
Nov 10 18:36:17 user nova-compute[75100]: FIRMWARE:
Nov 10 18:36:17 user nova-compute[75100]: No targets found.
Nov 10 18:36:17 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:36:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7656139d-cff5-46c1-836b-29c67aa24e3c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 18:36:17 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 18:36:17 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 18:36:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7656139d-cff5-46c1-836b-29c67aa24e3c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb5326ea-790a-40ab-858c-65de8e9f5ead', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 18:36:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:36:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:36:17 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[817d0c3a-b626-42e4-acf5-a1569121ac42]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb5326ea-790a-40ab-858c-65de8e9f5ead\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:36:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:36:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:36:17 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fcddb97-6915-453d-a4ca-90511165bcf7]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5326ea-790a-40ab-858c-65de8e9f5ead (non-flash)\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:36:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7656139d-cff5-46c1-836b-29c67aa24e3c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5326ea-790a-40ab-858c-65de8e9f5ead (non-flash)
Nov 10 18:36:17 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 18:36:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7656139d-cff5-46c1-836b-29c67aa24e3c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5326ea-790a-40ab-858c-65de8e9f5ead (non-flash)
Nov 10 18:36:17 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 18:36:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7656139d-cff5-46c1-836b-29c67aa24e3c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3d41b9bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb5326ea-790a-40ab-858c-65de8e9f5ead'): ({'sdb'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 18:36:17 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-7656139d-cff5-46c1-836b-29c67aa24e3c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Removing single pathed devices sdb {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 18:36:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:36:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:36:17 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[322a67d5-96fe-44fa-ab1e-f46547a4e6c2]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:36:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:36:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:36:17 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2fa97b9-81ce-4ee4-9ef2-30a1e7419cc4]: (4, ('ok\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:36:17 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-7656139d-cff5-46c1-836b-29c67aa24e3c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Flushing IO for device /dev/sdb {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 18:36:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:36:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:36:17 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f8f5c8-c895-4f3e-aecc-70b2af0cb1da]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:36:17 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-7656139d-cff5-46c1-836b-29c67aa24e3c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 18:36:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:36:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:36:17 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e5e879-b9d1-43b6-9262-3987e30efbdb]: (4, ('1', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:36:17 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-7656139d-cff5-46c1-836b-29c67aa24e3c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 18:36:17 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-7656139d-cff5-46c1-836b-29c67aa24e3c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 18:36:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7656139d-cff5-46c1-836b-29c67aa24e3c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb5326ea-790a-40ab-858c-65de8e9f5ead')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 18:36:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb5326ea-790a-40ab-858c-65de8e9f5ead -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:36:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb5326ea-790a-40ab-858c-65de8e9f5ead -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:36:17 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0356ed80-c347-41d9-956e-63fdffd64712]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:36:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7656139d-cff5-46c1-836b-29c67aa24e3c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:36:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb5326ea-790a-40ab-858c-65de8e9f5ead -p 172.16.0.220:3260 --logout {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:36:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb5326ea-790a-40ab-858c-65de8e9f5ead -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:36:17 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f1e497-070e-47b8-8c67-24eddbe7d996]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:bb5326ea-790a-40ab-858c-65de8e9f5ead, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:bb5326ea-790a-40ab-858c-65de8e9f5ead, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:36:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7656139d-cff5-46c1-836b-29c67aa24e3c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:bb5326ea-790a-40ab-858c-65de8e9f5ead, portal: 172.16.0.220,3260]
Nov 10 18:36:17 user nova-compute[75100]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:bb5326ea-790a-40ab-858c-65de8e9f5ead, portal: 172.16.0.220,3260] successful.
Nov 10 18:36:17 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:36:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb5326ea-790a-40ab-858c-65de8e9f5ead -p 172.16.0.220:3260 --op delete {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:36:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb5326ea-790a-40ab-858c-65de8e9f5ead -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:36:17 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a344b7-4721-4e40-a483-8c489b7a89da]: (4, ('', '')) {{(pid=86608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 18:36:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7656139d-cff5-46c1-836b-29c67aa24e3c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 18:36:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-7656139d-cff5-46c1-836b-29c67aa24e3c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.273s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 18:36:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7656139d-cff5-46c1-836b-29c67aa24e3c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] <== disconnect_volume: return (274ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 18:36:17 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7656139d-cff5-46c1-836b-29c67aa24e3c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 18:36:18 user nova-compute[75100]: DEBUG nova.objects.instance [None req-7656139d-cff5-46c1-836b-29c67aa24e3c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Lazy-loading 'flavor' on Instance uuid 65cf69e9-ec9a-43a1-933b-ee89cfb42d22 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:36:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7656139d-cff5-46c1-836b-29c67aa24e3c tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Lock "65cf69e9-ec9a-43a1-933b-ee89cfb42d22" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.817s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:36:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:36:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:36:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:36:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:36:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:36:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:36:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:36:29 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:36:29 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Cleaning up deleted instances {{(pid=75100) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 18:36:29 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] There are 0 instances to clean {{(pid=75100) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 18:36:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:36:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:36:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:36:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:36:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:36:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:36:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:36:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:36:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:36:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:36:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:36:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:36:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:36:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:36:47 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:36:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:36:47 user nova-compute[75100]: DEBUG nova.compute.manager [req-dece87ca-e61c-4877-ada6-26a49732d1dc req-a5df6723-0d8a-426a-8273-6856d7af2a3a service nova] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Received event network-changed-ddd53b42-4ddb-40d0-bfda-3ebe8125b1ae {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:36:47 user nova-compute[75100]: DEBUG nova.compute.manager [req-dece87ca-e61c-4877-ada6-26a49732d1dc req-a5df6723-0d8a-426a-8273-6856d7af2a3a service nova] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Refreshing instance network info cache due to event network-changed-ddd53b42-4ddb-40d0-bfda-3ebe8125b1ae. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 18:36:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-dece87ca-e61c-4877-ada6-26a49732d1dc req-a5df6723-0d8a-426a-8273-6856d7af2a3a service nova] Acquiring lock "refresh_cache-65cf69e9-ec9a-43a1-933b-ee89cfb42d22" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:36:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-dece87ca-e61c-4877-ada6-26a49732d1dc req-a5df6723-0d8a-426a-8273-6856d7af2a3a service nova] Acquired lock "refresh_cache-65cf69e9-ec9a-43a1-933b-ee89cfb42d22" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:36:47 user nova-compute[75100]: DEBUG nova.network.neutron [req-dece87ca-e61c-4877-ada6-26a49732d1dc req-a5df6723-0d8a-426a-8273-6856d7af2a3a service nova] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Refreshing network info cache for port ddd53b42-4ddb-40d0-bfda-3ebe8125b1ae {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 18:36:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e9ef8fb0-66d7-41de-b016-0e8448e9c5e0 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Acquiring lock "65cf69e9-ec9a-43a1-933b-ee89cfb42d22" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:36:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e9ef8fb0-66d7-41de-b016-0e8448e9c5e0 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Lock "65cf69e9-ec9a-43a1-933b-ee89cfb42d22" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:36:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e9ef8fb0-66d7-41de-b016-0e8448e9c5e0 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Acquiring lock "65cf69e9-ec9a-43a1-933b-ee89cfb42d22-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:36:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e9ef8fb0-66d7-41de-b016-0e8448e9c5e0 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Lock "65cf69e9-ec9a-43a1-933b-ee89cfb42d22-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:36:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e9ef8fb0-66d7-41de-b016-0e8448e9c5e0 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Lock "65cf69e9-ec9a-43a1-933b-ee89cfb42d22-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:36:47 user nova-compute[75100]: INFO nova.compute.manager [None req-e9ef8fb0-66d7-41de-b016-0e8448e9c5e0 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Terminating instance
Nov 10 18:36:47 user nova-compute[75100]: DEBUG nova.compute.manager [None req-e9ef8fb0-66d7-41de-b016-0e8448e9c5e0 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 18:36:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:36:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:36:48 user nova-compute[75100]: DEBUG nova.network.neutron [req-dece87ca-e61c-4877-ada6-26a49732d1dc req-a5df6723-0d8a-426a-8273-6856d7af2a3a service nova] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Updated VIF entry in instance network info cache for port ddd53b42-4ddb-40d0-bfda-3ebe8125b1ae. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 18:36:48 user nova-compute[75100]: DEBUG nova.network.neutron [req-dece87ca-e61c-4877-ada6-26a49732d1dc req-a5df6723-0d8a-426a-8273-6856d7af2a3a service nova] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Updating instance_info_cache with network_info: [{"id": "ddd53b42-4ddb-40d0-bfda-3ebe8125b1ae", "address": "fa:16:3e:05:c7:40", "network": {"id": "5cc7dc03-a2c6-488f-aefd-2160f3a9f300", "bridge": "br-int", "label": "tempest-TestStampPattern-1448697637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aab3787fb375442288ea080aa156a326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddd53b42-4d", "ovs_interfaceid": "ddd53b42-4ddb-40d0-bfda-3ebe8125b1ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:36:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:36:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-dece87ca-e61c-4877-ada6-26a49732d1dc req-a5df6723-0d8a-426a-8273-6856d7af2a3a service nova] Releasing lock "refresh_cache-65cf69e9-ec9a-43a1-933b-ee89cfb42d22" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:36:48 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Instance destroyed successfully.
Nov 10 18:36:48 user nova-compute[75100]: DEBUG nova.objects.instance [None req-e9ef8fb0-66d7-41de-b016-0e8448e9c5e0 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Lazy-loading 'resources' on Instance uuid 65cf69e9-ec9a-43a1-933b-ee89cfb42d22 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:36:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-e9ef8fb0-66d7-41de-b016-0e8448e9c5e0 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:33:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1650641924',display_name='tempest-TestStampPattern-server-1650641924',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1650641924',id=52,image_ref='a8ce0be9-64c0-4a57-8308-21c46198bdce',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLg1o8VEM12ucIF0jbu9iRsAi+yimtLWbBqy1yWv1lvMVGrEdaR9OpNE3a9kQ5XxDFdFpuI1a1qU/MhZ+OEp8MDnm6aGBwbckIWyJWH9mMzvKTXeZHDzkokpLOBFuU09oA==',key_name='tempest-TestStampPattern-794323654',keypairs=<?>,launch_index=0,launched_at=2023-11-10T18:33:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aab3787fb375442288ea080aa156a326',ramdisk_id='',reservation_id='r-xzcmz80x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='228d6943-f74a-40ed-b272-aa31c50ee879',image_min_disk='1',image_min_ram='0',image_owner_id='aab3787fb375442288ea080aa156a326',image_owner_project_name='tempest-TestStampPattern-1090834960',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1090834960-project-member',image_user_id='5c872b1827cd452aa3b47a80f448d317',owner_project_name='tempest-TestStampPattern-1090834960',owner_user_name='tempest-TestStampPattern-1090834960-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T18:33:44Z,user_data=None,user_id='5c872b1827cd452aa3b47a80f448d317',uuid=65cf69e9-ec9a-43a1-933b-ee89cfb42d22,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ddd53b42-4ddb-40d0-bfda-3ebe8125b1ae", "address": "fa:16:3e:05:c7:40", "network": {"id": "5cc7dc03-a2c6-488f-aefd-2160f3a9f300", "bridge": "br-int", "label": "tempest-TestStampPattern-1448697637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aab3787fb375442288ea080aa156a326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddd53b42-4d", "ovs_interfaceid": "ddd53b42-4ddb-40d0-bfda-3ebe8125b1ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 18:36:48 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-e9ef8fb0-66d7-41de-b016-0e8448e9c5e0 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Converting VIF {"id": "ddd53b42-4ddb-40d0-bfda-3ebe8125b1ae", "address": "fa:16:3e:05:c7:40", "network": {"id": "5cc7dc03-a2c6-488f-aefd-2160f3a9f300", "bridge": "br-int", "label": "tempest-TestStampPattern-1448697637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aab3787fb375442288ea080aa156a326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddd53b42-4d", "ovs_interfaceid": "ddd53b42-4ddb-40d0-bfda-3ebe8125b1ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:36:48 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-e9ef8fb0-66d7-41de-b016-0e8448e9c5e0 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:05:c7:40,bridge_name='br-int',has_traffic_filtering=True,id=ddd53b42-4ddb-40d0-bfda-3ebe8125b1ae,network=Network(5cc7dc03-a2c6-488f-aefd-2160f3a9f300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddd53b42-4d') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:36:48 user nova-compute[75100]: DEBUG os_vif [None req-e9ef8fb0-66d7-41de-b016-0e8448e9c5e0 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:c7:40,bridge_name='br-int',has_traffic_filtering=True,id=ddd53b42-4ddb-40d0-bfda-3ebe8125b1ae,network=Network(5cc7dc03-a2c6-488f-aefd-2160f3a9f300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddd53b42-4d') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 18:36:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:36:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapddd53b42-4d, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:36:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:36:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:36:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:36:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d65976ed-4dfa-47e0-8d56-083be07aab33) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:36:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:36:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:36:48 user nova-compute[75100]: INFO os_vif [None req-e9ef8fb0-66d7-41de-b016-0e8448e9c5e0 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:c7:40,bridge_name='br-int',has_traffic_filtering=True,id=ddd53b42-4ddb-40d0-bfda-3ebe8125b1ae,network=Network(5cc7dc03-a2c6-488f-aefd-2160f3a9f300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddd53b42-4d')
Nov 10 18:36:48 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-e9ef8fb0-66d7-41de-b016-0e8448e9c5e0 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Deleting instance files /opt/stack/data/nova/instances/65cf69e9-ec9a-43a1-933b-ee89cfb42d22_del
Nov 10 18:36:48 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-e9ef8fb0-66d7-41de-b016-0e8448e9c5e0 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Deletion of /opt/stack/data/nova/instances/65cf69e9-ec9a-43a1-933b-ee89cfb42d22_del complete
Nov 10 18:36:48 user nova-compute[75100]: INFO nova.compute.manager [None req-e9ef8fb0-66d7-41de-b016-0e8448e9c5e0 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Took 0.65 seconds to destroy the instance on the hypervisor.
Nov 10 18:36:48 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-e9ef8fb0-66d7-41de-b016-0e8448e9c5e0 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 18:36:48 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 18:36:48 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 18:36:49 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:36:49 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Took 0.96 seconds to deallocate network for instance.
Nov 10 18:36:49 user nova-compute[75100]: DEBUG nova.compute.manager [req-fa1dc0ac-99ed-455b-8d47-5dcfb43971c2 req-46063a2f-fa62-495c-80ed-24605c95c583 service nova] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Received event network-vif-deleted-ddd53b42-4ddb-40d0-bfda-3ebe8125b1ae {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:36:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e9ef8fb0-66d7-41de-b016-0e8448e9c5e0 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:36:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e9ef8fb0-66d7-41de-b016-0e8448e9c5e0 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:36:49 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-e9ef8fb0-66d7-41de-b016-0e8448e9c5e0 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:36:49 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-e9ef8fb0-66d7-41de-b016-0e8448e9c5e0 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:36:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e9ef8fb0-66d7-41de-b016-0e8448e9c5e0 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.142s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:36:49 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-e9ef8fb0-66d7-41de-b016-0e8448e9c5e0 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Deleted allocations for instance 65cf69e9-ec9a-43a1-933b-ee89cfb42d22
Nov 10 18:36:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e9ef8fb0-66d7-41de-b016-0e8448e9c5e0 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Lock "65cf69e9-ec9a-43a1-933b-ee89cfb42d22" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.945s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:36:49 user nova-compute[75100]: DEBUG nova.compute.manager [req-35181640-33fb-4d12-b934-e8ac52e73a7a req-9c3235e0-eba6-4fbf-8a00-61f2a5b3b3e2 service nova] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Received event network-vif-unplugged-ddd53b42-4ddb-40d0-bfda-3ebe8125b1ae {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:36:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-35181640-33fb-4d12-b934-e8ac52e73a7a req-9c3235e0-eba6-4fbf-8a00-61f2a5b3b3e2 service nova] Acquiring lock "65cf69e9-ec9a-43a1-933b-ee89cfb42d22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:36:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-35181640-33fb-4d12-b934-e8ac52e73a7a req-9c3235e0-eba6-4fbf-8a00-61f2a5b3b3e2 service nova] Lock "65cf69e9-ec9a-43a1-933b-ee89cfb42d22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:36:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-35181640-33fb-4d12-b934-e8ac52e73a7a req-9c3235e0-eba6-4fbf-8a00-61f2a5b3b3e2 service nova] Lock "65cf69e9-ec9a-43a1-933b-ee89cfb42d22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:36:49 user nova-compute[75100]: DEBUG nova.compute.manager [req-35181640-33fb-4d12-b934-e8ac52e73a7a req-9c3235e0-eba6-4fbf-8a00-61f2a5b3b3e2 service nova] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] No waiting events found dispatching network-vif-unplugged-ddd53b42-4ddb-40d0-bfda-3ebe8125b1ae {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:36:49 user nova-compute[75100]: WARNING nova.compute.manager [req-35181640-33fb-4d12-b934-e8ac52e73a7a req-9c3235e0-eba6-4fbf-8a00-61f2a5b3b3e2 service nova] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Received unexpected event network-vif-unplugged-ddd53b42-4ddb-40d0-bfda-3ebe8125b1ae for instance with vm_state deleted and task_state None.
Nov 10 18:36:49 user nova-compute[75100]: DEBUG nova.compute.manager [req-35181640-33fb-4d12-b934-e8ac52e73a7a req-9c3235e0-eba6-4fbf-8a00-61f2a5b3b3e2 service nova] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Received event network-vif-plugged-ddd53b42-4ddb-40d0-bfda-3ebe8125b1ae {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:36:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-35181640-33fb-4d12-b934-e8ac52e73a7a req-9c3235e0-eba6-4fbf-8a00-61f2a5b3b3e2 service nova] Acquiring lock "65cf69e9-ec9a-43a1-933b-ee89cfb42d22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:36:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-35181640-33fb-4d12-b934-e8ac52e73a7a req-9c3235e0-eba6-4fbf-8a00-61f2a5b3b3e2 service nova] Lock "65cf69e9-ec9a-43a1-933b-ee89cfb42d22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:36:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-35181640-33fb-4d12-b934-e8ac52e73a7a req-9c3235e0-eba6-4fbf-8a00-61f2a5b3b3e2 service nova] Lock "65cf69e9-ec9a-43a1-933b-ee89cfb42d22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:36:49 user nova-compute[75100]: DEBUG nova.compute.manager [req-35181640-33fb-4d12-b934-e8ac52e73a7a req-9c3235e0-eba6-4fbf-8a00-61f2a5b3b3e2 service nova] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] No waiting events found dispatching network-vif-plugged-ddd53b42-4ddb-40d0-bfda-3ebe8125b1ae {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:36:49 user nova-compute[75100]: WARNING nova.compute.manager [req-35181640-33fb-4d12-b934-e8ac52e73a7a req-9c3235e0-eba6-4fbf-8a00-61f2a5b3b3e2 service nova] [instance: 65cf69e9-ec9a-43a1-933b-ee89cfb42d22] Received unexpected event network-vif-plugged-ddd53b42-4ddb-40d0-bfda-3ebe8125b1ae for instance with vm_state deleted and task_state None.
Nov 10 18:36:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:36:56 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:36:58 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:36:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:36:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:36:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:36:58 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 18:36:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228d6943-f74a-40ed-b272-aa31c50ee879/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:36:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:36:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228d6943-f74a-40ed-b272-aa31c50ee879/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:36:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228d6943-f74a-40ed-b272-aa31c50ee879/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:36:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228d6943-f74a-40ed-b272-aa31c50ee879/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:36:59 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:36:59 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:36:59 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Hypervisor/Node resource view: name=user free_ram=8995MB free_disk=24.240726470947266GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 18:36:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:36:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:36:59 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 228d6943-f74a-40ed-b272-aa31c50ee879 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:36:59 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 18:36:59 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 18:36:59 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Refreshing inventories for resource provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 18:36:59 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Updating ProviderTree inventory for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 18:36:59 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Updating inventory in ProviderTree for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 18:36:59 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Refreshing aggregate associations for resource provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64, aggregates: None {{(pid=75100) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 18:36:59 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Refreshing trait associations for resource provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2 {{(pid=75100) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 18:36:59 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:36:59 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:36:59 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 18:36:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.322s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:37:03 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:37:03 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:37:03 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 18:37:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:37:03 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Didn't find any instances for network info cache update. {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 18:37:04 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:37:05 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:37:08 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:37:08 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:37:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:37:12 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:37:12 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 18:37:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:37:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:37:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:37:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:37:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:37:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:37:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:37:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:37:49 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:37:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:37:58 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:37:58 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:37:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:37:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:37:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:37:58 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 18:37:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228d6943-f74a-40ed-b272-aa31c50ee879/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:37:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:37:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228d6943-f74a-40ed-b272-aa31c50ee879/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:37:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228d6943-f74a-40ed-b272-aa31c50ee879/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 18:37:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/228d6943-f74a-40ed-b272-aa31c50ee879/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 18:37:59 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:37:59 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:37:59 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Hypervisor/Node resource view: name=user free_ram=9002MB free_disk=24.33757781982422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 18:37:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:37:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:37:59 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Instance 228d6943-f74a-40ed-b272-aa31c50ee879 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 18:37:59 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 18:37:59 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 18:37:59 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:37:59 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:37:59 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 18:37:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.164s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:38:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:38:01 user nova-compute[75100]: DEBUG nova.compute.manager [req-056ea614-9745-4c28-ad4d-e734bfa8b80b req-9df1d420-56e4-4ad6-a908-a0b7a10b5233 service nova] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Received event network-changed-963a800b-186d-457e-b83e-410214f7f92d {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:38:01 user nova-compute[75100]: DEBUG nova.compute.manager [req-056ea614-9745-4c28-ad4d-e734bfa8b80b req-9df1d420-56e4-4ad6-a908-a0b7a10b5233 service nova] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Refreshing instance network info cache due to event network-changed-963a800b-186d-457e-b83e-410214f7f92d. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 18:38:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-056ea614-9745-4c28-ad4d-e734bfa8b80b req-9df1d420-56e4-4ad6-a908-a0b7a10b5233 service nova] Acquiring lock "refresh_cache-228d6943-f74a-40ed-b272-aa31c50ee879" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 18:38:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-056ea614-9745-4c28-ad4d-e734bfa8b80b req-9df1d420-56e4-4ad6-a908-a0b7a10b5233 service nova] Acquired lock "refresh_cache-228d6943-f74a-40ed-b272-aa31c50ee879" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 18:38:01 user nova-compute[75100]: DEBUG nova.network.neutron [req-056ea614-9745-4c28-ad4d-e734bfa8b80b req-9df1d420-56e4-4ad6-a908-a0b7a10b5233 service nova] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Refreshing network info cache for port 963a800b-186d-457e-b83e-410214f7f92d {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 18:38:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-baaae90a-1983-42a7-8e6d-4f4057ace258 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Acquiring lock "228d6943-f74a-40ed-b272-aa31c50ee879" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:38:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-baaae90a-1983-42a7-8e6d-4f4057ace258 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Lock "228d6943-f74a-40ed-b272-aa31c50ee879" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:38:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-baaae90a-1983-42a7-8e6d-4f4057ace258 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Acquiring lock "228d6943-f74a-40ed-b272-aa31c50ee879-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:38:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-baaae90a-1983-42a7-8e6d-4f4057ace258 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Lock "228d6943-f74a-40ed-b272-aa31c50ee879-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:38:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-baaae90a-1983-42a7-8e6d-4f4057ace258 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Lock "228d6943-f74a-40ed-b272-aa31c50ee879-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:38:01 user nova-compute[75100]: INFO nova.compute.manager [None req-baaae90a-1983-42a7-8e6d-4f4057ace258 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Terminating instance
Nov 10 18:38:01 user nova-compute[75100]: DEBUG nova.compute.manager [None req-baaae90a-1983-42a7-8e6d-4f4057ace258 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 18:38:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:38:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:38:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:38:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:38:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:38:02 user nova-compute[75100]: DEBUG nova.network.neutron [req-056ea614-9745-4c28-ad4d-e734bfa8b80b req-9df1d420-56e4-4ad6-a908-a0b7a10b5233 service nova] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Updated VIF entry in instance network info cache for port 963a800b-186d-457e-b83e-410214f7f92d. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 18:38:02 user nova-compute[75100]: DEBUG nova.network.neutron [req-056ea614-9745-4c28-ad4d-e734bfa8b80b req-9df1d420-56e4-4ad6-a908-a0b7a10b5233 service nova] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Updating instance_info_cache with network_info: [{"id": "963a800b-186d-457e-b83e-410214f7f92d", "address": "fa:16:3e:80:31:f9", "network": {"id": "5cc7dc03-a2c6-488f-aefd-2160f3a9f300", "bridge": "br-int", "label": "tempest-TestStampPattern-1448697637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aab3787fb375442288ea080aa156a326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap963a800b-18", "ovs_interfaceid": "963a800b-186d-457e-b83e-410214f7f92d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:38:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-056ea614-9745-4c28-ad4d-e734bfa8b80b req-9df1d420-56e4-4ad6-a908-a0b7a10b5233 service nova] Releasing lock "refresh_cache-228d6943-f74a-40ed-b272-aa31c50ee879" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 18:38:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:38:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:38:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:38:02 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Instance destroyed successfully.
Nov 10 18:38:02 user nova-compute[75100]: DEBUG nova.objects.instance [None req-baaae90a-1983-42a7-8e6d-4f4057ace258 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Lazy-loading 'resources' on Instance uuid 228d6943-f74a-40ed-b272-aa31c50ee879 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 18:38:02 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-baaae90a-1983-42a7-8e6d-4f4057ace258 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T18:29:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-79239815',display_name='tempest-TestStampPattern-server-79239815',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-79239815',id=51,image_ref='e3cc5321-4d40-49ee-885c-700e14741732',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLg1o8VEM12ucIF0jbu9iRsAi+yimtLWbBqy1yWv1lvMVGrEdaR9OpNE3a9kQ5XxDFdFpuI1a1qU/MhZ+OEp8MDnm6aGBwbckIWyJWH9mMzvKTXeZHDzkokpLOBFuU09oA==',key_name='tempest-TestStampPattern-794323654',keypairs=<?>,launch_index=0,launched_at=2023-11-10T18:30:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aab3787fb375442288ea080aa156a326',ramdisk_id='',reservation_id='r-eeuroz7r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3cc5321-4d40-49ee-885c-700e14741732',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1090834960',owner_user_name='tempest-TestStampPattern-1090834960-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T18:33:34Z,user_data=None,user_id='5c872b1827cd452aa3b47a80f448d317',uuid=228d6943-f74a-40ed-b272-aa31c50ee879,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "963a800b-186d-457e-b83e-410214f7f92d", "address": "fa:16:3e:80:31:f9", "network": {"id": "5cc7dc03-a2c6-488f-aefd-2160f3a9f300", "bridge": "br-int", "label": "tempest-TestStampPattern-1448697637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aab3787fb375442288ea080aa156a326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap963a800b-18", "ovs_interfaceid": "963a800b-186d-457e-b83e-410214f7f92d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 18:38:02 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-baaae90a-1983-42a7-8e6d-4f4057ace258 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Converting VIF {"id": "963a800b-186d-457e-b83e-410214f7f92d", "address": "fa:16:3e:80:31:f9", "network": {"id": "5cc7dc03-a2c6-488f-aefd-2160f3a9f300", "bridge": "br-int", "label": "tempest-TestStampPattern-1448697637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aab3787fb375442288ea080aa156a326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap963a800b-18", "ovs_interfaceid": "963a800b-186d-457e-b83e-410214f7f92d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 18:38:02 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-baaae90a-1983-42a7-8e6d-4f4057ace258 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:80:31:f9,bridge_name='br-int',has_traffic_filtering=True,id=963a800b-186d-457e-b83e-410214f7f92d,network=Network(5cc7dc03-a2c6-488f-aefd-2160f3a9f300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap963a800b-18') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 18:38:02 user nova-compute[75100]: DEBUG os_vif [None req-baaae90a-1983-42a7-8e6d-4f4057ace258 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:31:f9,bridge_name='br-int',has_traffic_filtering=True,id=963a800b-186d-457e-b83e-410214f7f92d,network=Network(5cc7dc03-a2c6-488f-aefd-2160f3a9f300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap963a800b-18') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 18:38:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:38:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap963a800b-18, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:38:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:38:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:38:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:38:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b9a296e6-a55c-4853-ac84-18b04688110e) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 18:38:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:38:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:38:02 user nova-compute[75100]: INFO os_vif [None req-baaae90a-1983-42a7-8e6d-4f4057ace258 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:31:f9,bridge_name='br-int',has_traffic_filtering=True,id=963a800b-186d-457e-b83e-410214f7f92d,network=Network(5cc7dc03-a2c6-488f-aefd-2160f3a9f300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap963a800b-18')
Nov 10 18:38:02 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-baaae90a-1983-42a7-8e6d-4f4057ace258 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Deleting instance files /opt/stack/data/nova/instances/228d6943-f74a-40ed-b272-aa31c50ee879_del
Nov 10 18:38:02 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-baaae90a-1983-42a7-8e6d-4f4057ace258 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Deletion of /opt/stack/data/nova/instances/228d6943-f74a-40ed-b272-aa31c50ee879_del complete
Nov 10 18:38:02 user nova-compute[75100]: INFO nova.compute.manager [None req-baaae90a-1983-42a7-8e6d-4f4057ace258 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 10 18:38:02 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-baaae90a-1983-42a7-8e6d-4f4057ace258 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 18:38:02 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 18:38:02 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 18:38:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:38:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:38:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:38:03 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:38:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:38:03 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Took 0.52 seconds to deallocate network for instance.
Nov 10 18:38:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-79312fcc-ee9a-4983-b9fb-a8cafe260eb8 req-4a172287-0abd-4e6d-a677-b314baf42f7b service nova] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Received event network-vif-deleted-963a800b-186d-457e-b83e-410214f7f92d {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:38:03 user nova-compute[75100]: INFO nova.compute.manager [req-79312fcc-ee9a-4983-b9fb-a8cafe260eb8 req-4a172287-0abd-4e6d-a677-b314baf42f7b service nova] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Neutron deleted interface 963a800b-186d-457e-b83e-410214f7f92d; detaching it from the instance and deleting it from the info cache
Nov 10 18:38:03 user nova-compute[75100]: DEBUG nova.network.neutron [req-79312fcc-ee9a-4983-b9fb-a8cafe260eb8 req-4a172287-0abd-4e6d-a677-b314baf42f7b service nova] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 18:38:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:38:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-79312fcc-ee9a-4983-b9fb-a8cafe260eb8 req-4a172287-0abd-4e6d-a677-b314baf42f7b service nova] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Detach interface failed, port_id=963a800b-186d-457e-b83e-410214f7f92d, reason: Instance 228d6943-f74a-40ed-b272-aa31c50ee879 could not be found. {{(pid=75100) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 18:38:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-baaae90a-1983-42a7-8e6d-4f4057ace258 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:38:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-baaae90a-1983-42a7-8e6d-4f4057ace258 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:38:03 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-baaae90a-1983-42a7-8e6d-4f4057ace258 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:38:03 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-baaae90a-1983-42a7-8e6d-4f4057ace258 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:38:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-baaae90a-1983-42a7-8e6d-4f4057ace258 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.116s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:38:03 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-baaae90a-1983-42a7-8e6d-4f4057ace258 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Deleted allocations for instance 228d6943-f74a-40ed-b272-aa31c50ee879
Nov 10 18:38:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-baaae90a-1983-42a7-8e6d-4f4057ace258 tempest-TestStampPattern-1090834960 tempest-TestStampPattern-1090834960-project-member] Lock "228d6943-f74a-40ed-b272-aa31c50ee879" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.797s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:38:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-8c12b571-f60f-49d6-b6bc-b072c382fcad req-76970c4e-c15c-449a-bcb7-88a05936505d service nova] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Received event network-vif-unplugged-963a800b-186d-457e-b83e-410214f7f92d {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:38:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8c12b571-f60f-49d6-b6bc-b072c382fcad req-76970c4e-c15c-449a-bcb7-88a05936505d service nova] Acquiring lock "228d6943-f74a-40ed-b272-aa31c50ee879-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:38:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8c12b571-f60f-49d6-b6bc-b072c382fcad req-76970c4e-c15c-449a-bcb7-88a05936505d service nova] Lock "228d6943-f74a-40ed-b272-aa31c50ee879-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:38:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8c12b571-f60f-49d6-b6bc-b072c382fcad req-76970c4e-c15c-449a-bcb7-88a05936505d service nova] Lock "228d6943-f74a-40ed-b272-aa31c50ee879-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:38:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-8c12b571-f60f-49d6-b6bc-b072c382fcad req-76970c4e-c15c-449a-bcb7-88a05936505d service nova] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] No waiting events found dispatching network-vif-unplugged-963a800b-186d-457e-b83e-410214f7f92d {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:38:03 user nova-compute[75100]: WARNING nova.compute.manager [req-8c12b571-f60f-49d6-b6bc-b072c382fcad req-76970c4e-c15c-449a-bcb7-88a05936505d service nova] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Received unexpected event network-vif-unplugged-963a800b-186d-457e-b83e-410214f7f92d for instance with vm_state deleted and task_state None.
Nov 10 18:38:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-8c12b571-f60f-49d6-b6bc-b072c382fcad req-76970c4e-c15c-449a-bcb7-88a05936505d service nova] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Received event network-vif-plugged-963a800b-186d-457e-b83e-410214f7f92d {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:38:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8c12b571-f60f-49d6-b6bc-b072c382fcad req-76970c4e-c15c-449a-bcb7-88a05936505d service nova] Acquiring lock "228d6943-f74a-40ed-b272-aa31c50ee879-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:38:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8c12b571-f60f-49d6-b6bc-b072c382fcad req-76970c4e-c15c-449a-bcb7-88a05936505d service nova] Lock "228d6943-f74a-40ed-b272-aa31c50ee879-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:38:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8c12b571-f60f-49d6-b6bc-b072c382fcad req-76970c4e-c15c-449a-bcb7-88a05936505d service nova] Lock "228d6943-f74a-40ed-b272-aa31c50ee879-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:38:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-8c12b571-f60f-49d6-b6bc-b072c382fcad req-76970c4e-c15c-449a-bcb7-88a05936505d service nova] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] No waiting events found dispatching network-vif-plugged-963a800b-186d-457e-b83e-410214f7f92d {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:38:03 user nova-compute[75100]: WARNING nova.compute.manager [req-8c12b571-f60f-49d6-b6bc-b072c382fcad req-76970c4e-c15c-449a-bcb7-88a05936505d service nova] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Received unexpected event network-vif-plugged-963a800b-186d-457e-b83e-410214f7f92d for instance with vm_state deleted and task_state None.
Nov 10 18:38:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-8c12b571-f60f-49d6-b6bc-b072c382fcad req-76970c4e-c15c-449a-bcb7-88a05936505d service nova] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Received event network-vif-plugged-963a800b-186d-457e-b83e-410214f7f92d {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:38:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8c12b571-f60f-49d6-b6bc-b072c382fcad req-76970c4e-c15c-449a-bcb7-88a05936505d service nova] Acquiring lock "228d6943-f74a-40ed-b272-aa31c50ee879-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:38:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8c12b571-f60f-49d6-b6bc-b072c382fcad req-76970c4e-c15c-449a-bcb7-88a05936505d service nova] Lock "228d6943-f74a-40ed-b272-aa31c50ee879-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:38:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8c12b571-f60f-49d6-b6bc-b072c382fcad req-76970c4e-c15c-449a-bcb7-88a05936505d service nova] Lock "228d6943-f74a-40ed-b272-aa31c50ee879-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:38:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-8c12b571-f60f-49d6-b6bc-b072c382fcad req-76970c4e-c15c-449a-bcb7-88a05936505d service nova] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] No waiting events found dispatching network-vif-plugged-963a800b-186d-457e-b83e-410214f7f92d {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:38:03 user nova-compute[75100]: WARNING nova.compute.manager [req-8c12b571-f60f-49d6-b6bc-b072c382fcad req-76970c4e-c15c-449a-bcb7-88a05936505d service nova] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Received unexpected event network-vif-plugged-963a800b-186d-457e-b83e-410214f7f92d for instance with vm_state deleted and task_state None.
Nov 10 18:38:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-8c12b571-f60f-49d6-b6bc-b072c382fcad req-76970c4e-c15c-449a-bcb7-88a05936505d service nova] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Received event network-vif-plugged-963a800b-186d-457e-b83e-410214f7f92d {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:38:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8c12b571-f60f-49d6-b6bc-b072c382fcad req-76970c4e-c15c-449a-bcb7-88a05936505d service nova] Acquiring lock "228d6943-f74a-40ed-b272-aa31c50ee879-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:38:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8c12b571-f60f-49d6-b6bc-b072c382fcad req-76970c4e-c15c-449a-bcb7-88a05936505d service nova] Lock "228d6943-f74a-40ed-b272-aa31c50ee879-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:38:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8c12b571-f60f-49d6-b6bc-b072c382fcad req-76970c4e-c15c-449a-bcb7-88a05936505d service nova] Lock "228d6943-f74a-40ed-b272-aa31c50ee879-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:38:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-8c12b571-f60f-49d6-b6bc-b072c382fcad req-76970c4e-c15c-449a-bcb7-88a05936505d service nova] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] No waiting events found dispatching network-vif-plugged-963a800b-186d-457e-b83e-410214f7f92d {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:38:03 user nova-compute[75100]: WARNING nova.compute.manager [req-8c12b571-f60f-49d6-b6bc-b072c382fcad req-76970c4e-c15c-449a-bcb7-88a05936505d service nova] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Received unexpected event network-vif-plugged-963a800b-186d-457e-b83e-410214f7f92d for instance with vm_state deleted and task_state None.
Nov 10 18:38:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-8c12b571-f60f-49d6-b6bc-b072c382fcad req-76970c4e-c15c-449a-bcb7-88a05936505d service nova] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Received event network-vif-plugged-963a800b-186d-457e-b83e-410214f7f92d {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 18:38:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8c12b571-f60f-49d6-b6bc-b072c382fcad req-76970c4e-c15c-449a-bcb7-88a05936505d service nova] Acquiring lock "228d6943-f74a-40ed-b272-aa31c50ee879-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:38:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8c12b571-f60f-49d6-b6bc-b072c382fcad req-76970c4e-c15c-449a-bcb7-88a05936505d service nova] Lock "228d6943-f74a-40ed-b272-aa31c50ee879-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:38:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8c12b571-f60f-49d6-b6bc-b072c382fcad req-76970c4e-c15c-449a-bcb7-88a05936505d service nova] Lock "228d6943-f74a-40ed-b272-aa31c50ee879-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:38:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-8c12b571-f60f-49d6-b6bc-b072c382fcad req-76970c4e-c15c-449a-bcb7-88a05936505d service nova] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] No waiting events found dispatching network-vif-plugged-963a800b-186d-457e-b83e-410214f7f92d {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 18:38:03 user nova-compute[75100]: WARNING nova.compute.manager [req-8c12b571-f60f-49d6-b6bc-b072c382fcad req-76970c4e-c15c-449a-bcb7-88a05936505d service nova] [instance: 228d6943-f74a-40ed-b272-aa31c50ee879] Received unexpected event network-vif-plugged-963a800b-186d-457e-b83e-410214f7f92d for instance with vm_state deleted and task_state None.
Nov 10 18:38:05 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:38:05 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:38:05 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 18:38:05 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Rebuilding the list of instances to heal {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 18:38:05 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Didn't find any instances for network info cache update. {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 18:38:05 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:38:06 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:38:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:38:09 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:38:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:38:13 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:38:13 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 18:38:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:38:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:38:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:38:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:38:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:38:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:38:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:38:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:38:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:38:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:38:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:38:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:38:51 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:38:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:38:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:38:58 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:38:58 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:38:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:38:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:38:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:38:58 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 18:38:58 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:38:58 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:38:58 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Hypervisor/Node resource view: name=user free_ram=9145MB free_disk=24.364665985107422GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 18:38:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:38:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:38:58 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 18:38:58 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 18:38:58 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:38:58 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:38:59 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 18:38:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.324s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:39:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:39:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:39:05 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:39:05 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 18:39:05 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Rebuilding the list of instances to heal {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 18:39:05 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Didn't find any instances for network info cache update. {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 18:39:05 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:39:06 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:39:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:39:07 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:39:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:39:09 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:39:10 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:39:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:39:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:39:13 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:39:13 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 18:39:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:39:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:39:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:39:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:39:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:39:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:39:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:39:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:39:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:39:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:39:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:39:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:39:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:39:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:39:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:39:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:39:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:39:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:39:53 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:39:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:39:58 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:40:00 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:40:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:40:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:40:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:40:00 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 18:40:00 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:40:00 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:40:00 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Hypervisor/Node resource view: name=user free_ram=9122MB free_disk=24.362651824951172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 18:40:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:40:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:40:00 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 18:40:00 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 18:40:00 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:40:00 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:40:00 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 18:40:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.117s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:40:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:40:04 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:40:04 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 18:40:04 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Rebuilding the list of instances to heal {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 18:40:04 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Didn't find any instances for network info cache update. {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 18:40:07 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:40:07 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:40:07 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:40:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:40:08 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:40:09 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:40:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:40:13 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:40:13 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 18:40:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:40:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:40:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:40:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:40:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:40:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:40:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:40:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:40:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:40:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:40:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:40:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:40:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:40:53 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:40:53 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:40:53 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75100) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 18:40:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:40:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:40:59 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:41:01 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:41:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:41:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:41:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:41:01 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 18:41:01 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:41:01 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 18:41:01 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Hypervisor/Node resource view: name=user free_ram=9286MB free_disk=24.3582763671875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 18:41:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 18:41:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 18:41:01 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 18:41:01 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 18:41:01 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed in ProviderTree for provider: 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 18:41:01 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Inventory has not changed for provider 54b9bcbe-8fbf-45ee-a64e-50f2d7bbba64 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 18:41:01 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 18:41:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.116s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 18:41:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:41:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:41:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:41:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:41:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:41:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:41:05 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:41:05 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 18:41:05 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Rebuilding the list of instances to heal {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 18:41:05 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Didn't find any instances for network info cache update. {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 18:41:07 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:41:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:41:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:41:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:41:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:41:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:41:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:41:08 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:41:10 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:41:11 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:41:11 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:41:12 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:41:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 18:41:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:41:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 18:41:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:41:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 18:41:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 18:41:15 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 18:41:15 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ce5a027f-5001-435e-b728-73eaf1a8da12 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 18:41:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}